Note: This is test shard 1 of 3.
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/0
2026-08-10T19:47:41Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-10T19:47:41Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260810 19:47:41.931216 9135 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu
/tmp/dist-test-taskcRGNMp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.235.254:33891
--webserver_interface=127.8.235.254
--webserver_port=0
--builtin_ntp_servers=127.8.235.212:46393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.235.254:33891,127.8.235.253:37397,127.8.235.252:43301
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260810 19:47:42.357662 9145 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 19:47:42.358120 9145 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 19:47:42.358249 9145 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 19:47:42.367869 9145 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 19:47:42.367981 9145 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 19:47:42.368052 9145 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 19:47:42.368124 9145 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260810 19:47:42.380797 9145 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.235.212:46393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.235.254:33891,127.8.235.253:37397,127.8.235.252:43301
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.235.254:33891
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.235.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 19:43:23 UTC on bdcb31816ec0
build id 13278
ASAN enabled
I20260810 19:47:42.383296 9145 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 19:47:42.386178 9145 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 19:47:42.407868 9151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 19:47:42.408047 9155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 19:47:42.408016 9153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 19:47:42.409348 9145 server_base.cc:1061] running on GCE node
I20260810 19:47:42.410885 9145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 19:47:42.413540 9145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 19:47:42.414996 9145 hybrid_clock.cc:648] HybridClock initialized: now 1786391262414911 us; error 106 us; skew 500 ppm
I20260810 19:47:42.415594 9145 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 19:47:42.419343 9145 webserver.cc:533] Webserver started at http://127.8.235.254:33371/ using document root <none> and password file <none>
I20260810 19:47:42.420728 9145 fs_manager.cc:362] Metadata directory not provided
I20260810 19:47:42.420914 9145 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 19:47:42.421542 9145 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 19:47:42.425981 9145 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/data/instance:
uuid: "5268e710af3c43ddab70eb7dd1aaa575"
format_stamp: "Formatted at 2026-08-10 19:47:42 on dist-test-slave-fgb3"
I20260810 19:47:42.427381 9145 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/wal/instance:
uuid: "5268e710af3c43ddab70eb7dd1aaa575"
format_stamp: "Formatted at 2026-08-10 19:47:42 on dist-test-slave-fgb3"
I20260810 19:47:42.437009 9145 fs_manager.cc:696] Time spent creating directory manager: real 0.009s user 0.008s sys 0.000s
I20260810 19:47:42.443928 9164 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 19:47:42.446440 9145 fs_manager.cc:730] Time spent opening block manager: real 0.006s user 0.006s sys 0.000s
I20260810 19:47:42.446705 9145 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/data,/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/wal
uuid: "5268e710af3c43ddab70eb7dd1aaa575"
format_stamp: "Formatted at 2026-08-10 19:47:42 on dist-test-slave-fgb3"
I20260810 19:47:42.447009 9145 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 19:47:42.463172 9145 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 19:47:42.464586 9145 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 19:47:42.464951 9145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 19:47:42.501689 9145 rpc_server.cc:307] RPC server started. Bound to: 127.8.235.254:33891
I20260810 19:47:42.501683 9243 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.235.254:33891 every 8 connection(s)
I20260810 19:47:42.504400 9145 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/data/info.pb
I20260810 19:47:42.507309 9135 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu as pid 9145
I20260810 19:47:42.507706 9135 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/wal/instance
I20260810 19:47:42.511833 9135 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu
/tmp/dist-test-taskcRGNMp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.235.253:37397
--webserver_interface=127.8.235.253
--webserver_port=0
--builtin_ntp_servers=127.8.235.212:46393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.235.254:33891,127.8.235.253:37397,127.8.235.252:43301
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260810 19:47:42.516238 9244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:42.527493 9244 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } has no permanent_uuid. Determining permanent_uuid...
I20260810 19:47:42.566125 9244 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } has no permanent_uuid. Determining permanent_uuid...
W20260810 19:47:42.567888 9171 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.235.253:37397: connect: Connection refused (error 111)
W20260810 19:47:42.570235 9244 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.235.253:37397: Network error: Client connection negotiation failed: client connection to 127.8.235.253:37397: connect: Connection refused (error 111)
I20260810 19:47:42.619647 9244 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } attempt: 1
W20260810 19:47:42.621825 9244 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.235.253:37397: Network error: Client connection negotiation failed: client connection to 127.8.235.253:37397: connect: Connection refused (error 111)
I20260810 19:47:42.690076 9244 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } attempt: 2
W20260810 19:47:42.692409 9244 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.235.253:37397: Network error: Client connection negotiation failed: client connection to 127.8.235.253:37397: connect: Connection refused (error 111)
I20260810 19:47:42.783679 9244 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } attempt: 3
W20260810 19:47:42.785969 9244 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.235.253:37397: Network error: Client connection negotiation failed: client connection to 127.8.235.253:37397: connect: Connection refused (error 111)
W20260810 19:47:42.897529 9247 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 19:47:42.897928 9247 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 19:47:42.898070 9247 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 19:47:42.907192 9247 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 19:47:42.907317 9247 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 19:47:42.907392 9247 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 19:47:42.907465 9247 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260810 19:47:42.918757 9247 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.235.212:46393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.235.254:33891,127.8.235.253:37397,127.8.235.252:43301
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.235.253:37397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.235.253
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 19:43:23 UTC on bdcb31816ec0
build id 13278
ASAN enabled
I20260810 19:47:42.920621 9247 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 19:47:42.922705 9247 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260810 19:47:42.929234 9244 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } attempt: 4
W20260810 19:47:42.931871 9244 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.235.253:37397: Network error: Client connection negotiation failed: client connection to 127.8.235.253:37397: connect: Connection refused (error 111)
W20260810 19:47:42.931885 9261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 19:47:42.931905 9260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 19:47:42.933032 9264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 19:47:42.933990 9247 server_base.cc:1061] running on GCE node
I20260810 19:47:42.934904 9247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 19:47:42.936482 9247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 19:47:42.937718 9247 hybrid_clock.cc:648] HybridClock initialized: now 1786391262937650 us; error 56 us; skew 500 ppm
I20260810 19:47:42.938120 9247 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 19:47:42.940510 9247 webserver.cc:533] Webserver started at http://127.8.235.253:37717/ using document root <none> and password file <none>
I20260810 19:47:42.941339 9247 fs_manager.cc:362] Metadata directory not provided
I20260810 19:47:42.941457 9247 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 19:47:42.941937 9247 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 19:47:42.944835 9247 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/data/instance:
uuid: "f52c40e347e24ab4b3129e7064f4a43e"
format_stamp: "Formatted at 2026-08-10 19:47:42 on dist-test-slave-fgb3"
I20260810 19:47:42.945756 9247 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/wal/instance:
uuid: "f52c40e347e24ab4b3129e7064f4a43e"
format_stamp: "Formatted at 2026-08-10 19:47:42 on dist-test-slave-fgb3"
I20260810 19:47:42.952174 9247 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.002s sys 0.006s
I20260810 19:47:42.956377 9278 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 19:47:42.958163 9247 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260810 19:47:42.958424 9247 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/data,/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/wal
uuid: "f52c40e347e24ab4b3129e7064f4a43e"
format_stamp: "Formatted at 2026-08-10 19:47:42 on dist-test-slave-fgb3"
I20260810 19:47:42.958673 9247 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 19:47:42.975149 9247 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 19:47:42.976171 9247 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 19:47:42.976512 9247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 19:47:43.000334 9247 rpc_server.cc:307] RPC server started. Bound to: 127.8.235.253:37397
I20260810 19:47:43.000310 9361 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.235.253:37397 every 8 connection(s)
I20260810 19:47:43.002122 9247 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/data/info.pb
I20260810 19:47:43.003108 9135 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu as pid 9247
I20260810 19:47:43.003326 9135 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/wal/instance
I20260810 19:47:43.004511 9135 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu
/tmp/dist-test-taskcRGNMp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.235.252:43301
--webserver_interface=127.8.235.252
--webserver_port=0
--builtin_ntp_servers=127.8.235.212:46393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.235.254:33891,127.8.235.253:37397,127.8.235.252:43301
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260810 19:47:43.007346 9362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:43.013707 9362 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } has no permanent_uuid. Determining permanent_uuid...
I20260810 19:47:43.028204 9362 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } has no permanent_uuid. Determining permanent_uuid...
I20260810 19:47:43.038020 9362 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } has no permanent_uuid. Determining permanent_uuid...
W20260810 19:47:43.039469 9280 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.235.252:43301: connect: Connection refused (error 111)
W20260810 19:47:43.041251 9362 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.235.252:43301: Network error: Client connection negotiation failed: client connection to 127.8.235.252:43301: connect: Connection refused (error 111)
I20260810 19:47:43.090543 9362 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } attempt: 1
W20260810 19:47:43.092711 9362 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.235.252:43301: Network error: Client connection negotiation failed: client connection to 127.8.235.252:43301: connect: Connection refused (error 111)
I20260810 19:47:43.161036 9362 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } attempt: 2
W20260810 19:47:43.163187 9362 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.235.252:43301: Network error: Client connection negotiation failed: client connection to 127.8.235.252:43301: connect: Connection refused (error 111)
I20260810 19:47:43.231235 9244 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } attempt: 5
I20260810 19:47:43.238215 9244 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } has no permanent_uuid. Determining permanent_uuid...
W20260810 19:47:43.240171 9244 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.235.252:43301: Network error: Client connection negotiation failed: client connection to 127.8.235.252:43301: connect: Connection refused (error 111)
I20260810 19:47:43.254426 9362 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } attempt: 3
W20260810 19:47:43.256688 9362 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.235.252:43301: Network error: Client connection negotiation failed: client connection to 127.8.235.252:43301: connect: Connection refused (error 111)
I20260810 19:47:43.291407 9244 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } attempt: 1
W20260810 19:47:43.293809 9244 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.235.252:43301: Network error: Client connection negotiation failed: client connection to 127.8.235.252:43301: connect: Connection refused (error 111)
I20260810 19:47:43.362085 9244 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } attempt: 2
W20260810 19:47:43.364383 9244 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.235.252:43301: Network error: Client connection negotiation failed: client connection to 127.8.235.252:43301: connect: Connection refused (error 111)
W20260810 19:47:43.392398 9366 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 19:47:43.392760 9366 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 19:47:43.392869 9366 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260810 19:47:43.399912 9362 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } attempt: 4
W20260810 19:47:43.401892 9362 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.235.252:43301: Network error: Client connection negotiation failed: client connection to 127.8.235.252:43301: connect: Connection refused (error 111)
W20260810 19:47:43.402050 9366 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 19:47:43.402135 9366 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 19:47:43.402222 9366 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 19:47:43.402351 9366 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260810 19:47:43.413064 9366 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.235.212:46393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.235.254:33891,127.8.235.253:37397,127.8.235.252:43301
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.235.252:43301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.235.252
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 19:43:23 UTC on bdcb31816ec0
build id 13278
ASAN enabled
I20260810 19:47:43.414921 9366 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 19:47:43.416982 9366 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 19:47:43.426294 9384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 19:47:43.426719 9382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 19:47:43.427723 9386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 19:47:43.428092 9366 server_base.cc:1061] running on GCE node
I20260810 19:47:43.428987 9366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 19:47:43.430706 9366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 19:47:43.431921 9366 hybrid_clock.cc:648] HybridClock initialized: now 1786391263431867 us; error 44 us; skew 500 ppm
I20260810 19:47:43.432300 9366 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 19:47:43.434893 9366 webserver.cc:533] Webserver started at http://127.8.235.252:38549/ using document root <none> and password file <none>
I20260810 19:47:43.435796 9366 fs_manager.cc:362] Metadata directory not provided
I20260810 19:47:43.435956 9366 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 19:47:43.436357 9366 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 19:47:43.439127 9366 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-2/data/instance:
uuid: "0c56283079e74549afd0096f7e72046a"
format_stamp: "Formatted at 2026-08-10 19:47:43 on dist-test-slave-fgb3"
I20260810 19:47:43.440151 9366 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-2/wal/instance:
uuid: "0c56283079e74549afd0096f7e72046a"
format_stamp: "Formatted at 2026-08-10 19:47:43 on dist-test-slave-fgb3"
I20260810 19:47:43.446368 9366 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260810 19:47:43.450299 9394 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 19:47:43.451853 9366 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 19:47:43.452034 9366 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-2/data,/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-2/wal
uuid: "0c56283079e74549afd0096f7e72046a"
format_stamp: "Formatted at 2026-08-10 19:47:43 on dist-test-slave-fgb3"
I20260810 19:47:43.452275 9366 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 19:47:43.465087 9366 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 19:47:43.466039 9366 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 19:47:43.466349 9366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 19:47:43.470600 9244 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } attempt: 3
W20260810 19:47:43.472609 9244 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.235.252:43301: Network error: Client connection negotiation failed: client connection to 127.8.235.252:43301: connect: Connection refused (error 111)
I20260810 19:47:43.490250 9366 rpc_server.cc:307] RPC server started. Bound to: 127.8.235.252:43301
I20260810 19:47:43.490365 9468 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.235.252:43301 every 8 connection(s)
I20260810 19:47:43.491943 9366 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-2/data/info.pb
I20260810 19:47:43.496609 9470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:43.497761 9135 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu as pid 9366
I20260810 19:47:43.497992 9135 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-2/wal/instance
I20260810 19:47:43.505682 9470 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } has no permanent_uuid. Determining permanent_uuid...
I20260810 19:47:43.525739 9470 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } has no permanent_uuid. Determining permanent_uuid...
I20260810 19:47:43.537638 9470 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } has no permanent_uuid. Determining permanent_uuid...
I20260810 19:47:43.551473 9470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Bootstrap starting.
I20260810 19:47:43.558106 9470 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:43.560458 9470 log.cc:826] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Log is configured to *not* fsync() on all Append() calls
I20260810 19:47:43.565299 9470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: No bootstrap required, opened a new log
I20260810 19:47:43.573199 9470 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } }
I20260810 19:47:43.573726 9470 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:43.573945 9470 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c56283079e74549afd0096f7e72046a, State: Initialized, Role: FOLLOWER
I20260810 19:47:43.575290 9470 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } }
I20260810 19:47:43.576632 9485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } } }
I20260810 19:47:43.576918 9485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 19:47:43.578907 9470 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 19:47:43.587698 9366 master_runner.cc:187] Error getting master registration for 127.8.235.254:33891: OK, instance_id { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" instance_seqno: 1786391262493172 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 19:47:43.593186 9366 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260810 19:47:43.594010 9505 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 19:47:43.594206 9505 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 19:47:43.649853 9244 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } attempt: 4
I20260810 19:47:43.661104 9244 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575: Bootstrap starting.
I20260810 19:47:43.664608 9244 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:43.665902 9244 log.cc:826] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575: Log is configured to *not* fsync() on all Append() calls
I20260810 19:47:43.668676 9244 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575: No bootstrap required, opened a new log
I20260810 19:47:43.674811 9244 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } }
I20260810 19:47:43.675313 9244 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:43.675529 9244 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5268e710af3c43ddab70eb7dd1aaa575, State: Initialized, Role: FOLLOWER
I20260810 19:47:43.676225 9244 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } }
I20260810 19:47:43.677425 9509 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } } }
I20260810 19:47:43.677802 9509 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 19:47:43.678755 9244 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [sys.catalog]: configured and running, proceeding with master startup.
W20260810 19:47:43.690342 9528 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 19:47:43.690568 9528 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 19:47:43.690196 9145 master_runner.cc:187] Error getting master registration for 127.8.235.253:37397: OK, instance_id { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" instance_seqno: 1786391262994146 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 19:47:43.696328 9145 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260810 19:47:43.701140 9362 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } attempt: 5
I20260810 19:47:43.716099 9362 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e: Bootstrap starting.
W20260810 19:47:43.718791 9402 tablet.cc:2406] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 19:47:43.720793 9173 tablet.cc:2406] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 19:47:43.720927 9362 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:43.722508 9362 log.cc:826] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e: Log is configured to *not* fsync() on all Append() calls
I20260810 19:47:43.726167 9362 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e: No bootstrap required, opened a new log
I20260810 19:47:43.734660 9362 raft_consensus.cc:359] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } }
I20260810 19:47:43.735113 9362 raft_consensus.cc:385] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:43.735313 9362 raft_consensus.cc:740] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f52c40e347e24ab4b3129e7064f4a43e, State: Initialized, Role: FOLLOWER
I20260810 19:47:43.736133 9362 consensus_queue.cc:260] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } }
I20260810 19:47:43.737332 9532 sys_catalog.cc:455] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } } }
I20260810 19:47:43.737733 9532 sys_catalog.cc:458] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [sys.catalog]: This master's current role is: FOLLOWER
I20260810 19:47:43.739001 9362 sys_catalog.cc:565] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 19:47:43.744304 9485 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:43.744758 9485 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } }
I20260810 19:47:43.749905 9210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c56283079e74549afd0096f7e72046a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5268e710af3c43ddab70eb7dd1aaa575" is_pre_election: true
I20260810 19:47:43.750917 9210 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c56283079e74549afd0096f7e72046a in term 0.
I20260810 19:47:43.751852 9330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c56283079e74549afd0096f7e72046a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f52c40e347e24ab4b3129e7064f4a43e" is_pre_election: true
I20260810 19:47:43.752087 9397 leader_election.cc:304] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c56283079e74549afd0096f7e72046a, 5268e710af3c43ddab70eb7dd1aaa575; no voters:
I20260810 19:47:43.752470 9330 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c56283079e74549afd0096f7e72046a in term 0.
I20260810 19:47:43.755493 9485 leader_election.cc:290] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5268e710af3c43ddab70eb7dd1aaa575 (127.8.235.254:33891), f52c40e347e24ab4b3129e7064f4a43e (127.8.235.253:37397)
I20260810 19:47:43.755908 9485 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:43.756145 9485 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:43.756350 9485 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:43.760950 9485 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } }
I20260810 19:47:43.762624 9330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c56283079e74549afd0096f7e72046a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f52c40e347e24ab4b3129e7064f4a43e"
I20260810 19:47:43.762881 9330 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:43.764408 9210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c56283079e74549afd0096f7e72046a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5268e710af3c43ddab70eb7dd1aaa575"
I20260810 19:47:43.764650 9210 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:43.766665 9330 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c56283079e74549afd0096f7e72046a in term 1.
I20260810 19:47:43.767359 9400 leader_election.cc:304] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c56283079e74549afd0096f7e72046a, f52c40e347e24ab4b3129e7064f4a43e; no voters:
I20260810 19:47:43.767855 9485 leader_election.cc:290] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [CANDIDATE]: Term 1 election: Requested vote from peers 5268e710af3c43ddab70eb7dd1aaa575 (127.8.235.254:33891), f52c40e347e24ab4b3129e7064f4a43e (127.8.235.253:37397)
I20260810 19:47:43.768263 9485 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:43.768373 9210 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c56283079e74549afd0096f7e72046a in term 1.
I20260810 19:47:43.768544 9485 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [term 1 LEADER]: Becoming Leader. State: Replica: 0c56283079e74549afd0096f7e72046a, State: Running, Role: LEADER
I20260810 19:47:43.769273 9485 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } }
I20260810 19:47:43.786284 9552 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c56283079e74549afd0096f7e72046a. Latest consensus state: current_term: 1 leader_uuid: "0c56283079e74549afd0096f7e72046a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } } }
I20260810 19:47:43.786736 9552 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [sys.catalog]: This master's current role is: LEADER
I20260810 19:47:43.796950 9560 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260810 19:47:43.800082 9560 catalog_manager.cc:1520] Initializing Kudu cluster ID...
W20260810 19:47:43.814347 9555 catalog_manager.cc:1594] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 19:47:43.814536 9555 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 19:47:43.840323 9330 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [term 1 FOLLOWER]: Refusing update from remote peer 0c56283079e74549afd0096f7e72046a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 19:47:43.842157 9552 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:43.851199 9210 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [term 1 FOLLOWER]: Refusing update from remote peer 0c56283079e74549afd0096f7e72046a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 19:47:43.852456 9552 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:43.890285 9509 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c56283079e74549afd0096f7e72046a. Latest consensus state: current_term: 1 leader_uuid: "0c56283079e74549afd0096f7e72046a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } } }
I20260810 19:47:43.890626 9509 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 19:47:43.895514 9532 sys_catalog.cc:455] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c56283079e74549afd0096f7e72046a. Latest consensus state: current_term: 1 leader_uuid: "0c56283079e74549afd0096f7e72046a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } } }
I20260810 19:47:43.895824 9532 sys_catalog.cc:458] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [sys.catalog]: This master's current role is: FOLLOWER
I20260810 19:47:43.901175 9564 mvcc.cc:204] Tried to move back new op lower bound from 7317058616648384512 to 7317058616407236608. Current Snapshot: MvccSnapshot[applied={T|T < 7317058616648384512}]
I20260810 19:47:43.904876 9567 mvcc.cc:204] Tried to move back new op lower bound from 7317058616648384512 to 7317058616407236608. Current Snapshot: MvccSnapshot[applied={T|T < 7317058616648384512}]
I20260810 19:47:43.909301 9566 mvcc.cc:204] Tried to move back new op lower bound from 7317058616648384512 to 7317058616407236608. Current Snapshot: MvccSnapshot[applied={T|T < 7317058616648384512}]
I20260810 19:47:43.916461 9485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0c56283079e74549afd0096f7e72046a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } } }
I20260810 19:47:43.916785 9485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [sys.catalog]: This master's current role is: LEADER
I20260810 19:47:43.917199 9485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0c56283079e74549afd0096f7e72046a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } } }
I20260810 19:47:43.917424 9485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [sys.catalog]: This master's current role is: LEADER
I20260810 19:47:43.919270 9560 catalog_manager.cc:1383] Generated new cluster ID: 8abb52f4596a48b3a090b657ee482300
I20260810 19:47:43.919431 9560 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260810 19:47:43.926088 9509 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0c56283079e74549afd0096f7e72046a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } } }
I20260810 19:47:43.926383 9509 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 19:47:43.935634 9532 sys_catalog.cc:455] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0c56283079e74549afd0096f7e72046a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } } }
I20260810 19:47:43.935906 9532 sys_catalog.cc:458] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [sys.catalog]: This master's current role is: FOLLOWER
I20260810 19:47:43.942184 9560 catalog_manager.cc:1406] Generated new certificate authority record
I20260810 19:47:43.944382 9560 catalog_manager.cc:1540] Loading token signing keys...
I20260810 19:47:43.980572 9560 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Generated new TSK 0
I20260810 19:47:43.982595 9560 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260810 19:47:43.999785 9135 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu
/tmp/dist-test-taskcRGNMp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.235.193:0
--local_ip_for_outbound_sockets=127.8.235.193
--webserver_interface=127.8.235.193
--webserver_port=0
--tserver_master_addrs=127.8.235.254:33891,127.8.235.253:37397,127.8.235.252:43301
--builtin_ntp_servers=127.8.235.212:46393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260810 19:47:44.500339 9588 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c56283079e74549afd0096f7e72046a)
I20260810 19:47:44.500592 9588 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } }
I20260810 19:47:44.502640 9588 leader_election.cc:290] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f52c40e347e24ab4b3129e7064f4a43e (127.8.235.253:37397), 0c56283079e74549afd0096f7e72046a (127.8.235.252:43301)
I20260810 19:47:44.503000 9326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5268e710af3c43ddab70eb7dd1aaa575" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f52c40e347e24ab4b3129e7064f4a43e" is_pre_election: true
I20260810 19:47:44.503432 9435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5268e710af3c43ddab70eb7dd1aaa575" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c56283079e74549afd0096f7e72046a" is_pre_election: true
I20260810 19:47:44.507215 9171 leader_election.cc:304] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5268e710af3c43ddab70eb7dd1aaa575; no voters: 0c56283079e74549afd0096f7e72046a, f52c40e347e24ab4b3129e7064f4a43e
I20260810 19:47:44.508203 9588 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 19:47:44.527679 9584 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 19:47:44.528048 9584 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 19:47:44.528177 9584 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 19:47:44.537529 9584 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 19:47:44.537768 9584 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.235.193
I20260810 19:47:44.548535 9584 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.235.212:46393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.235.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.235.193
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.8.235.254:33891,127.8.235.253:37397,127.8.235.252:43301
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.235.193
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 19:43:23 UTC on bdcb31816ec0
build id 13278
ASAN enabled
I20260810 19:47:44.550395 9584 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 19:47:44.552307 9584 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 19:47:44.563777 9598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 19:47:44.563809 9601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 19:47:44.563973 9599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 19:47:44.564692 9584 server_base.cc:1061] running on GCE node
I20260810 19:47:44.565330 9584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 19:47:44.566296 9584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 19:47:44.567535 9584 hybrid_clock.cc:648] HybridClock initialized: now 1786391264567484 us; error 56 us; skew 500 ppm
I20260810 19:47:44.567853 9584 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 19:47:44.570133 9584 webserver.cc:533] Webserver started at http://127.8.235.193:36155/ using document root <none> and password file <none>
I20260810 19:47:44.570958 9584 fs_manager.cc:362] Metadata directory not provided
I20260810 19:47:44.571056 9584 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 19:47:44.571424 9584 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 19:47:44.573926 9584 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/data/instance:
uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
format_stamp: "Formatted at 2026-08-10 19:47:44 on dist-test-slave-fgb3"
I20260810 19:47:44.574734 9584 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/instance:
uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
format_stamp: "Formatted at 2026-08-10 19:47:44 on dist-test-slave-fgb3"
I20260810 19:47:44.580739 9584 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260810 19:47:44.584612 9610 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 19:47:44.586120 9584 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 19:47:44.586295 9584 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/data,/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal
uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
format_stamp: "Formatted at 2026-08-10 19:47:44 on dist-test-slave-fgb3"
I20260810 19:47:44.586544 9584 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 19:47:44.604264 9584 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 19:47:44.605259 9584 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 19:47:44.605607 9584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 19:47:44.606915 9584 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 19:47:44.609269 9584 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 19:47:44.609411 9584 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 19:47:44.609562 9584 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 19:47:44.609692 9584 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 19:47:44.649070 9584 rpc_server.cc:307] RPC server started. Bound to: 127.8.235.193:41413
I20260810 19:47:44.649129 9785 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.235.193:41413 every 8 connection(s)
I20260810 19:47:44.650765 9584 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/data/info.pb
I20260810 19:47:44.657922 9135 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu as pid 9584
I20260810 19:47:44.658205 9135 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/instance
I20260810 19:47:44.667616 9135 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu
/tmp/dist-test-taskcRGNMp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.235.194:0
--local_ip_for_outbound_sockets=127.8.235.194
--webserver_interface=127.8.235.194
--webserver_port=0
--tserver_master_addrs=127.8.235.254:33891,127.8.235.253:37397,127.8.235.252:43301
--builtin_ntp_servers=127.8.235.212:46393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260810 19:47:44.689457 9786 heartbeater.cc:344] Connected to a master server at 127.8.235.252:43301
I20260810 19:47:44.689586 9789 heartbeater.cc:344] Connected to a master server at 127.8.235.254:33891
I20260810 19:47:44.691859 9789 heartbeater.cc:461] Registering TS with master...
I20260810 19:47:44.691869 9786 heartbeater.cc:461] Registering TS with master...
I20260810 19:47:44.691886 9791 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:47:44.692188 9791 heartbeater.cc:461] Registering TS with master...
I20260810 19:47:44.694522 9528 catalog_manager.cc:1295] Loaded cluster ID: 8abb52f4596a48b3a090b657ee482300
I20260810 19:47:44.694622 9528 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575: loading cluster ID for follower catalog manager: success
I20260810 19:47:44.695604 9786 heartbeater.cc:507] Master 127.8.235.252:43301 requested a full tablet report, sending...
I20260810 19:47:44.698057 9789 heartbeater.cc:507] Master 127.8.235.254:33891 requested a full tablet report, sending...
I20260810 19:47:44.698678 9791 heartbeater.cc:507] Master 127.8.235.253:37397 requested a full tablet report, sending...
I20260810 19:47:44.699079 9528 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575: acquiring CA information for follower catalog manager: success
I20260810 19:47:44.701121 9421 ts_manager.cc:194] Registered new tserver with Master: fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:44.702759 9195 ts_manager.cc:194] Registered new tserver with Master: fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:44.703763 9528 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 19:47:44.704075 9421 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.235.193:43705
I20260810 19:47:44.707515 9312 ts_manager.cc:194] Registered new tserver with Master: fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:44.817281 9555 catalog_manager.cc:1295] Loaded cluster ID: 8abb52f4596a48b3a090b657ee482300
I20260810 19:47:44.817452 9555 catalog_manager.cc:1588] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e: loading cluster ID for follower catalog manager: success
I20260810 19:47:44.821558 9555 catalog_manager.cc:1610] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e: acquiring CA information for follower catalog manager: success
I20260810 19:47:44.824306 9555 catalog_manager.cc:1638] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 19:47:44.949245 9805 raft_consensus.cc:493] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c56283079e74549afd0096f7e72046a)
I20260810 19:47:44.949482 9805 raft_consensus.cc:515] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } }
I20260810 19:47:44.950985 9805 leader_election.cc:290] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5268e710af3c43ddab70eb7dd1aaa575 (127.8.235.254:33891), 0c56283079e74549afd0096f7e72046a (127.8.235.252:43301)
I20260810 19:47:44.951702 9435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f52c40e347e24ab4b3129e7064f4a43e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c56283079e74549afd0096f7e72046a" is_pre_election: true
I20260810 19:47:44.951678 9210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f52c40e347e24ab4b3129e7064f4a43e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5268e710af3c43ddab70eb7dd1aaa575" is_pre_election: true
I20260810 19:47:44.952526 9282 leader_election.cc:304] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f52c40e347e24ab4b3129e7064f4a43e; no voters: 0c56283079e74549afd0096f7e72046a, 5268e710af3c43ddab70eb7dd1aaa575
I20260810 19:47:44.952980 9805 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 19:47:45.073262 9804 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 19:47:45.073683 9804 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 19:47:45.073830 9804 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 19:47:45.083950 9804 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 19:47:45.084219 9804 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.235.194
I20260810 19:47:45.095619 9804 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.235.212:46393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.235.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.235.194
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.8.235.254:33891,127.8.235.253:37397,127.8.235.252:43301
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.235.194
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 19:43:23 UTC on bdcb31816ec0
build id 13278
ASAN enabled
I20260810 19:47:45.097544 9804 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 19:47:45.099723 9804 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 19:47:45.110213 9818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 19:47:45.110183 9815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 19:47:45.110654 9814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 19:47:45.111227 9804 server_base.cc:1061] running on GCE node
I20260810 19:47:45.111977 9804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 19:47:45.113086 9804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 19:47:45.114305 9804 hybrid_clock.cc:648] HybridClock initialized: now 1786391265114240 us; error 58 us; skew 500 ppm
I20260810 19:47:45.114676 9804 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 19:47:45.117163 9804 webserver.cc:533] Webserver started at http://127.8.235.194:46091/ using document root <none> and password file <none>
I20260810 19:47:45.117998 9804 fs_manager.cc:362] Metadata directory not provided
I20260810 19:47:45.118115 9804 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 19:47:45.118557 9804 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 19:47:45.121197 9804 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/data/instance:
uuid: "6986ed920dcb4af29a5eeeda6f671691"
format_stamp: "Formatted at 2026-08-10 19:47:45 on dist-test-slave-fgb3"
I20260810 19:47:45.122052 9804 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/instance:
uuid: "6986ed920dcb4af29a5eeeda6f671691"
format_stamp: "Formatted at 2026-08-10 19:47:45 on dist-test-slave-fgb3"
I20260810 19:47:45.128010 9804 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260810 19:47:45.132005 9829 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 19:47:45.133513 9804 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 19:47:45.133692 9804 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/data,/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal
uuid: "6986ed920dcb4af29a5eeeda6f671691"
format_stamp: "Formatted at 2026-08-10 19:47:45 on dist-test-slave-fgb3"
I20260810 19:47:45.133914 9804 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 19:47:45.161322 9804 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 19:47:45.162533 9804 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 19:47:45.162875 9804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 19:47:45.164011 9804 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 19:47:45.166030 9804 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 19:47:45.166139 9804 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 19:47:45.166251 9804 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 19:47:45.166352 9804 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 19:47:45.207697 9786 heartbeater.cc:499] Master 127.8.235.252:43301 was elected leader, sending a full tablet report...
I20260810 19:47:45.215236 9804 rpc_server.cc:307] RPC server started. Bound to: 127.8.235.194:35105
I20260810 19:47:45.215287 10024 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.235.194:35105 every 8 connection(s)
I20260810 19:47:45.216951 9804 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/data/info.pb
I20260810 19:47:45.224365 9135 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu as pid 9804
I20260810 19:47:45.224584 9135 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/instance
I20260810 19:47:45.229810 9135 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu
/tmp/dist-test-taskcRGNMp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.235.195:0
--local_ip_for_outbound_sockets=127.8.235.195
--webserver_interface=127.8.235.195
--webserver_port=0
--tserver_master_addrs=127.8.235.254:33891,127.8.235.253:37397,127.8.235.252:43301
--builtin_ntp_servers=127.8.235.212:46393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260810 19:47:45.238762 10026 heartbeater.cc:344] Connected to a master server at 127.8.235.254:33891
I20260810 19:47:45.238802 10029 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:47:45.238871 10025 heartbeater.cc:344] Connected to a master server at 127.8.235.252:43301
I20260810 19:47:45.239281 10026 heartbeater.cc:461] Registering TS with master...
I20260810 19:47:45.239279 10025 heartbeater.cc:461] Registering TS with master...
I20260810 19:47:45.239284 10029 heartbeater.cc:461] Registering TS with master...
I20260810 19:47:45.240609 10029 heartbeater.cc:507] Master 127.8.235.253:37397 requested a full tablet report, sending...
I20260810 19:47:45.240653 10025 heartbeater.cc:507] Master 127.8.235.252:43301 requested a full tablet report, sending...
I20260810 19:47:45.240696 10026 heartbeater.cc:507] Master 127.8.235.254:33891 requested a full tablet report, sending...
I20260810 19:47:45.242638 9421 ts_manager.cc:194] Registered new tserver with Master: 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:45.242724 9312 ts_manager.cc:194] Registered new tserver with Master: 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:45.242897 9195 ts_manager.cc:194] Registered new tserver with Master: 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:45.243830 9421 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.235.194:59637
W20260810 19:47:45.637367 10040 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 19:47:45.637732 10040 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 19:47:45.637902 10040 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 19:47:45.647248 10040 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 19:47:45.647472 10040 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.235.195
I20260810 19:47:45.658638 10040 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.235.212:46393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.235.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.235.195
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.8.235.254:33891,127.8.235.253:37397,127.8.235.252:43301
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.235.195
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 19:43:23 UTC on bdcb31816ec0
build id 13278
ASAN enabled
I20260810 19:47:45.660332 10040 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 19:47:45.662428 10040 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 19:47:45.673213 10048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 19:47:45.673238 10049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 19:47:45.674343 10052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 19:47:45.674661 10040 server_base.cc:1061] running on GCE node
I20260810 19:47:45.675330 10040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 19:47:45.677012 10040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 19:47:45.678211 10040 hybrid_clock.cc:648] HybridClock initialized: now 1786391265678150 us; error 61 us; skew 500 ppm
I20260810 19:47:45.678565 10040 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 19:47:45.680941 10040 webserver.cc:533] Webserver started at http://127.8.235.195:40685/ using document root <none> and password file <none>
I20260810 19:47:45.681736 10040 fs_manager.cc:362] Metadata directory not provided
I20260810 19:47:45.681838 10040 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 19:47:45.682168 10040 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 19:47:45.685057 10040 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/data/instance:
uuid: "eadde59fd6504d679e47f03a60c64bb0"
format_stamp: "Formatted at 2026-08-10 19:47:45 on dist-test-slave-fgb3"
I20260810 19:47:45.685892 10040 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/instance:
uuid: "eadde59fd6504d679e47f03a60c64bb0"
format_stamp: "Formatted at 2026-08-10 19:47:45 on dist-test-slave-fgb3"
I20260810 19:47:45.692277 10040 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.009s sys 0.000s
I20260810 19:47:45.696456 10065 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 19:47:45.698132 10040 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 19:47:45.698343 10040 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/data,/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal
uuid: "eadde59fd6504d679e47f03a60c64bb0"
format_stamp: "Formatted at 2026-08-10 19:47:45 on dist-test-slave-fgb3"
I20260810 19:47:45.698596 10040 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 19:47:45.718962 10040 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 19:47:45.719931 10040 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 19:47:45.720201 10040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 19:47:45.721261 10040 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 19:47:45.723168 10040 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 19:47:45.723271 10040 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 19:47:45.723397 10040 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 19:47:45.723474 10040 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 19:47:45.746204 10025 heartbeater.cc:499] Master 127.8.235.252:43301 was elected leader, sending a full tablet report...
I20260810 19:47:45.759410 10040 rpc_server.cc:307] RPC server started. Bound to: 127.8.235.195:43797
I20260810 19:47:45.759495 10244 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.235.195:43797 every 8 connection(s)
I20260810 19:47:45.761086 10040 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/data/info.pb
I20260810 19:47:45.768885 9135 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu as pid 10040
I20260810 19:47:45.769129 9135 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/instance
I20260810 19:47:45.811021 10247 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:47:45.811239 10246 heartbeater.cc:344] Connected to a master server at 127.8.235.254:33891
I20260810 19:47:45.811317 10245 heartbeater.cc:344] Connected to a master server at 127.8.235.252:43301
I20260810 19:47:45.811566 10245 heartbeater.cc:461] Registering TS with master...
I20260810 19:47:45.811570 10246 heartbeater.cc:461] Registering TS with master...
I20260810 19:47:45.811569 10247 heartbeater.cc:461] Registering TS with master...
I20260810 19:47:45.812706 10246 heartbeater.cc:507] Master 127.8.235.254:33891 requested a full tablet report, sending...
I20260810 19:47:45.812742 10247 heartbeater.cc:507] Master 127.8.235.253:37397 requested a full tablet report, sending...
I20260810 19:47:45.812767 10245 heartbeater.cc:507] Master 127.8.235.252:43301 requested a full tablet report, sending...
I20260810 19:47:45.814675 9421 ts_manager.cc:194] Registered new tserver with Master: eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:45.814733 9195 ts_manager.cc:194] Registered new tserver with Master: eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:45.815474 9312 ts_manager.cc:194] Registered new tserver with Master: eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:45.815717 9421 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.235.195:32931
I20260810 19:47:45.819918 9135 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260810 19:47:45.877599 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2d1cf1aaf0f34e92a831cf3f07f4c63c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:45.878142 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_5a878853aea546eaa3d67f3fe16fd6a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:45.883188 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d1cf1aaf0f34e92a831cf3f07f4c63c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:45.883865 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c0b0a57e41c548209056316a524f4baf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:45.884629 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0b0a57e41c548209056316a524f4baf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:45.885546 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_4d877a8e04454ebba390bf4a154ebebb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:45.886111 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_9323129d801c4f3ca77cbcaad34448df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:45.886448 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d877a8e04454ebba390bf4a154ebebb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:45.886884 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c20b319fb4f746588c08244614f4d848"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:45.887261 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3d858b3e9ad1479bb70c6978a34ec7e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:45.887588 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c20b319fb4f746588c08244614f4d848 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:45.887948 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d858b3e9ad1479bb70c6978a34ec7e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:45.890844 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a4a70636564542e9a531543884e80437"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:45.891068 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0228abc6973841f6af303c8a836cc2eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:45.891665 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4a70636564542e9a531543884e80437 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:45.886907 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9323129d801c4f3ca77cbcaad34448df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:45.893293 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0228abc6973841f6af303c8a836cc2eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:45.895812 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a878853aea546eaa3d67f3fe16fd6a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:45.895306 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3432f5ec7a7f4b948a397a4c118a8f1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:45.898998 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3432f5ec7a7f4b948a397a4c118a8f1c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:45.954342 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3d858b3e9ad1479bb70c6978a34ec7e5" } new_table_name: "default.Table_6d0fe01100c94447a026749e395525d4" modify_external_catalogs: true
I20260810 19:47:45.971769 9135 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu pid 9145
I20260810 19:47:45.973887 9239 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 19:47:45.975816 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a4a70636564542e9a531543884e80437" } new_table_name: "default.Table_bdbce93f86aa466bae793ccc1ac54a6b" modify_external_catalogs: true
I20260810 19:47:45.976487 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4d877a8e04454ebba390bf4a154ebebb" } new_table_name: "default.Table_d91fb3bbd3c74e48a77dee972fd26bce" modify_external_catalogs: true
I20260810 19:47:45.978873 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c20b319fb4f746588c08244614f4d848" } modify_external_catalogs: true
I20260810 19:47:45.979115 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c20b319fb4f746588c08244614f4d848" } modify_external_catalogs: true
I20260810 19:47:45.981654 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c0b0a57e41c548209056316a524f4baf" } new_table_name: "default.Table_9b5b4cea035c42949c4ec302d4b82b21" modify_external_catalogs: true
I20260810 19:47:45.983083 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2d1cf1aaf0f34e92a831cf3f07f4c63c" } new_table_name: "default.Table_1a54e5f7520f4f2a9b675e28944d9f6d" modify_external_catalogs: true
I20260810 19:47:46.003640 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5a878853aea546eaa3d67f3fe16fd6a8" } modify_external_catalogs: true
I20260810 19:47:46.003904 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5a878853aea546eaa3d67f3fe16fd6a8" } modify_external_catalogs: true
W20260810 19:47:46.006702 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ed5cea610aed4e0aae56cc4888ca6c4d has no consensus state
W20260810 19:47:46.007638 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 99265c93337b49c1ba4d9ae59c05318b has no consensus state
W20260810 19:47:46.009343 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6a51f407c3c6466e83f491b98f44ff84 consensus state has no leader
W20260810 19:47:46.011308 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 39b27416e1a94ab98e66ad175f9bbbeb has no consensus state
I20260810 19:47:46.011866 9415 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 64fd7f075d564691a49ae793f05ba58e
I20260810 19:47:46.020283 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9323129d801c4f3ca77cbcaad34448df" } modify_external_catalogs: true
I20260810 19:47:46.020396 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0228abc6973841f6af303c8a836cc2eb" } modify_external_catalogs: true
I20260810 19:47:46.020612 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9323129d801c4f3ca77cbcaad34448df" } modify_external_catalogs: true
I20260810 19:47:46.020637 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0228abc6973841f6af303c8a836cc2eb" } modify_external_catalogs: true
I20260810 19:47:46.021334 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3432f5ec7a7f4b948a397a4c118a8f1c" } modify_external_catalogs: true
I20260810 19:47:46.021533 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3432f5ec7a7f4b948a397a4c118a8f1c" } modify_external_catalogs: true
W20260810 19:47:46.047554 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7481a7e759454f7e989caf7bc4d0788e has no consensus state
W20260810 19:47:46.049953 9398 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 39b27416e1a94ab98e66ad175f9bbbeb (table default.Table_9b5b4cea035c42949c4ec302d4b82b21 [id=9d3ea0ed528846718fdac913e46fc276], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 39b27416e1a94ab98e66ad175f9bbbeb consensus state has no leader
I20260810 19:47:46.052001 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 6a51f407c3c6466e83f491b98f44ff84 (DEFAULT_TABLE table=default.Table_3d858b3e9ad1479bb70c6978a34ec7e5 [id=374315d136c94e148f590805b89200a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.054174 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a51f407c3c6466e83f491b98f44ff84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.054755 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 6a51f407c3c6466e83f491b98f44ff84 (DEFAULT_TABLE table=default.Table_3d858b3e9ad1479bb70c6978a34ec7e5 [id=374315d136c94e148f590805b89200a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.055123 9685 tablet_service.cc:1511] Processing CreateTablet for tablet f871e89a900b4e79a2b4ebb31ff80003 (DEFAULT_TABLE table=default.Table_9323129d801c4f3ca77cbcaad34448df [id=5bdb225dea3c4737945f5f249b74dfd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.055104 9687 tablet_service.cc:1511] Processing CreateTablet for tablet b3f52e1f94054c48859b0fe46d0908d2 (DEFAULT_TABLE table=default.Table_3432f5ec7a7f4b948a397a4c118a8f1c [id=654afc1abde94b2b8e2a3c816c8200d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.055938 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 88e511f69694484686f453530d0b7f30 (DEFAULT_TABLE table=default.Table_0228abc6973841f6af303c8a836cc2eb [id=e9aacfa2250843498ca298deebc22a0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.056851 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a51f407c3c6466e83f491b98f44ff84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.057099 9685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f871e89a900b4e79a2b4ebb31ff80003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.057762 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88e511f69694484686f453530d0b7f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.058593 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 99265c93337b49c1ba4d9ae59c05318b (DEFAULT_TABLE table=default.Table_d91fb3bbd3c74e48a77dee972fd26bce [id=590c71a2efbd4ae3b579dc1d180e8761]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.058987 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f52e1f94054c48859b0fe46d0908d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.059243 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99265c93337b49c1ba4d9ae59c05318b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.059170 9911 tablet_service.cc:1511] Processing CreateTablet for tablet b3f52e1f94054c48859b0fe46d0908d2 (DEFAULT_TABLE table=default.Table_3432f5ec7a7f4b948a397a4c118a8f1c [id=654afc1abde94b2b8e2a3c816c8200d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.059645 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f52e1f94054c48859b0fe46d0908d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.076668 9677 tablet_service.cc:1511] Processing CreateTablet for tablet 39b27416e1a94ab98e66ad175f9bbbeb (DEFAULT_TABLE table=default.Table_9b5b4cea035c42949c4ec302d4b82b21 [id=9d3ea0ed528846718fdac913e46fc276]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.076742 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 7481a7e759454f7e989caf7bc4d0788e (DEFAULT_TABLE table=default.Table_1a54e5f7520f4f2a9b675e28944d9f6d [id=fd19aa6322f041f38dd88e11224afdbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.077450 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39b27416e1a94ab98e66ad175f9bbbeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.079108 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 6a51f407c3c6466e83f491b98f44ff84 (DEFAULT_TABLE table=default.Table_3d858b3e9ad1479bb70c6978a34ec7e5 [id=374315d136c94e148f590805b89200a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.080749 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7481a7e759454f7e989caf7bc4d0788e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.081015 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a51f407c3c6466e83f491b98f44ff84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.090929 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet f871e89a900b4e79a2b4ebb31ff80003
I20260810 19:47:46.091730 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 88e511f69694484686f453530d0b7f30
I20260810 19:47:46.093489 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet b3f52e1f94054c48859b0fe46d0908d2
I20260810 19:47:46.093807 10144 tablet_service.cc:1511] Processing CreateTablet for tablet b3f52e1f94054c48859b0fe46d0908d2 (DEFAULT_TABLE table=default.Table_3432f5ec7a7f4b948a397a4c118a8f1c [id=654afc1abde94b2b8e2a3c816c8200d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.094559 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f52e1f94054c48859b0fe46d0908d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.095050 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 1f5eb1b5853046c2a28c46ed19312df7
I20260810 19:47:46.105821 9908 tablet_service.cc:1511] Processing CreateTablet for tablet f871e89a900b4e79a2b4ebb31ff80003 (DEFAULT_TABLE table=default.Table_9323129d801c4f3ca77cbcaad34448df [id=5bdb225dea3c4737945f5f249b74dfd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.106631 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f871e89a900b4e79a2b4ebb31ff80003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.106675 9416 master_service.cc:960] ReplaceTablet: received request to replace tablet b3f52e1f94054c48859b0fe46d0908d2 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:46.107944 9408 master_service.cc:960] ReplaceTablet: received request to replace tablet b3f52e1f94054c48859b0fe46d0908d2 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:46.109328 9408 master_service.cc:960] ReplaceTablet: received request to replace tablet b3f52e1f94054c48859b0fe46d0908d2 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:46.110342 9416 master_service.cc:960] ReplaceTablet: received request to replace tablet b3f52e1f94054c48859b0fe46d0908d2 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:46.111119 9416 master_service.cc:960] ReplaceTablet: received request to replace tablet b3f52e1f94054c48859b0fe46d0908d2 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:46.115511 10142 tablet_service.cc:1511] Processing CreateTablet for tablet f871e89a900b4e79a2b4ebb31ff80003 (DEFAULT_TABLE table=default.Table_9323129d801c4f3ca77cbcaad34448df [id=5bdb225dea3c4737945f5f249b74dfd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.115845 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 88e511f69694484686f453530d0b7f30 (DEFAULT_TABLE table=default.Table_0228abc6973841f6af303c8a836cc2eb [id=e9aacfa2250843498ca298deebc22a0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.116209 10142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f871e89a900b4e79a2b4ebb31ff80003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.116377 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88e511f69694484686f453530d0b7f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.123306 10140 tablet_service.cc:1511] Processing CreateTablet for tablet 88e511f69694484686f453530d0b7f30 (DEFAULT_TABLE table=default.Table_0228abc6973841f6af303c8a836cc2eb [id=e9aacfa2250843498ca298deebc22a0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.123903 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88e511f69694484686f453530d0b7f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.130474 9673 tablet_service.cc:1558] Processing DeleteTablet for tablet b3f52e1f94054c48859b0fe46d0908d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:46.131731 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5eb1b5853046c2a28c46ed19312df7 (DEFAULT_TABLE table=default.Table_5a878853aea546eaa3d67f3fe16fd6a8 [id=8a7d81bb5a844974b4947535d6a3f577]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.132404 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5eb1b5853046c2a28c46ed19312df7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.134665 9685 tablet_service.cc:1511] Processing CreateTablet for tablet ed5cea610aed4e0aae56cc4888ca6c4d (DEFAULT_TABLE table=default.Table_bdbce93f86aa466bae793ccc1ac54a6b [id=d537831ed0b04450bad2bed57f1d3b23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.135329 9685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed5cea610aed4e0aae56cc4888ca6c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.139007 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f5eb1b5853046c2a28c46ed19312df7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:45 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:46.147302 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 88e511f69694484686f453530d0b7f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:46.148999 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5eb1b5853046c2a28c46ed19312df7 (DEFAULT_TABLE table=default.Table_5a878853aea546eaa3d67f3fe16fd6a8 [id=8a7d81bb5a844974b4947535d6a3f577]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.149740 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5eb1b5853046c2a28c46ed19312df7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.150789 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_5418a55907644546b1e77ca3b34cfb5d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.151469 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5418a55907644546b1e77ca3b34cfb5d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:46.155627 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet b3f52e1f94054c48859b0fe46d0908d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3f52e1f94054c48859b0fe46d0908d2 already in progress: creating tablet
W20260810 19:47:46.156071 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 1f5eb1b5853046c2a28c46ed19312df7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f5eb1b5853046c2a28c46ed19312df7 already in progress: creating tablet
W20260810 19:47:46.156307 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 88e511f69694484686f453530d0b7f30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88e511f69694484686f453530d0b7f30 already in progress: creating tablet
I20260810 19:47:46.160120 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 99265c93337b49c1ba4d9ae59c05318b (DEFAULT_TABLE table=default.Table_d91fb3bbd3c74e48a77dee972fd26bce [id=590c71a2efbd4ae3b579dc1d180e8761]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.160586 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99265c93337b49c1ba4d9ae59c05318b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.162453 10367 tablet_bootstrap.cc:492] T b3f52e1f94054c48859b0fe46d0908d2 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:46.162976 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3f316e1395dd450bbeb0ffd71efd83fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.163650 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f316e1395dd450bbeb0ffd71efd83fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.167850 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_cf2961e9b7d34b04bb822a30b8f5a62c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.168530 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf2961e9b7d34b04bb822a30b8f5a62c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.171304 9685 tablet_service.cc:1511] Processing CreateTablet for tablet 46d7f9bcff4140c7bad02526befc1a56 (DEFAULT_TABLE table=default.Table_5418a55907644546b1e77ca3b34cfb5d [id=fb5ae6ab2d20481992a9d0d99186a1cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.171898 9685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d7f9bcff4140c7bad02526befc1a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.177044 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_8efdcde7394a4cbcb0a7efc039be2794"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.177754 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8efdcde7394a4cbcb0a7efc039be2794 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.181056 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_369bd7e9555d45dd84c434fb07f7d103"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.181725 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_369bd7e9555d45dd84c434fb07f7d103 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.182853 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_faa748cf759946fc9aedfa23fa15680c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.183430 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_faa748cf759946fc9aedfa23fa15680c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.191917 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 07a7203a875c40e394a00c1ac44874d8 (DEFAULT_TABLE table=default.Table_3f316e1395dd450bbeb0ffd71efd83fe [id=d9f804aed5ee40fa90152b6475aea1af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.192482 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a7203a875c40e394a00c1ac44874d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.194831 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_d3a9560cb9364ab6beb532186e4dc76d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.195427 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3a9560cb9364ab6beb532186e4dc76d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.195649 10367 tablet_bootstrap.cc:654] T b3f52e1f94054c48859b0fe46d0908d2 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.196641 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_43a8dfd72855490a9430e0783eb17f20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.197178 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43a8dfd72855490a9430e0783eb17f20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.197352 10367 log.cc:826] T b3f52e1f94054c48859b0fe46d0908d2 P fcd31b1bbb0340cbacfce652b4ad8da4: Log is configured to *not* fsync() on all Append() calls
I20260810 19:47:46.198094 9677 tablet_service.cc:1558] Processing DeleteTablet for tablet f871e89a900b4e79a2b4ebb31ff80003 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:46.198884 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 99265c93337b49c1ba4d9ae59c05318b (DEFAULT_TABLE table=default.Table_d91fb3bbd3c74e48a77dee972fd26bce [id=590c71a2efbd4ae3b579dc1d180e8761]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.199352 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99265c93337b49c1ba4d9ae59c05318b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.199924 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a76a0ccd7c9c473781c4ce3cabb2112d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.200465 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a76a0ccd7c9c473781c4ce3cabb2112d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.202020 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_72ff6ea7e8804869845ad4866d103346"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.202580 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72ff6ea7e8804869845ad4866d103346 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.204188 10142 tablet_service.cc:1511] Processing CreateTablet for tablet ed5cea610aed4e0aae56cc4888ca6c4d (DEFAULT_TABLE table=default.Table_bdbce93f86aa466bae793ccc1ac54a6b [id=d537831ed0b04450bad2bed57f1d3b23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.204676 10142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed5cea610aed4e0aae56cc4888ca6c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.213915 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_cf2961e9b7d34b04bb822a30b8f5a62c" } new_table_name: "default.Table_6f68ade8691340aa901cd94c21b98ef3" modify_external_catalogs: true
I20260810 19:47:46.215595 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5418a55907644546b1e77ca3b34cfb5d" } new_table_name: "default.Table_52b776d314ed4833b63f0dca563647c7" modify_external_catalogs: true
I20260810 19:47:46.217226 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3f316e1395dd450bbeb0ffd71efd83fe" } new_table_name: "default.Table_5422399034c2420ca3bf7a39a090f84a" modify_external_catalogs: true
I20260810 19:47:46.219219 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9b5b4cea035c42949c4ec302d4b82b21" } new_table_name: "default.Table_1b95ebac5ef2432ea62092ff83c4451d" modify_external_catalogs: true
I20260810 19:47:46.222266 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8efdcde7394a4cbcb0a7efc039be2794" } modify_external_catalogs: true
I20260810 19:47:46.222534 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8efdcde7394a4cbcb0a7efc039be2794" } modify_external_catalogs: true
I20260810 19:47:46.223325 9681 tablet_service.cc:1511] Processing CreateTablet for tablet ba8c4420f5e345eeac30c805d673b5e9 (DEFAULT_TABLE table=default.Table_cf2961e9b7d34b04bb822a30b8f5a62c [id=c421996810c34ce69ca7c00ed984dc54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.223955 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba8c4420f5e345eeac30c805d673b5e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.228259 10140 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5eb1b5853046c2a28c46ed19312df7 (DEFAULT_TABLE table=default.Table_5a878853aea546eaa3d67f3fe16fd6a8 [id=8a7d81bb5a844974b4947535d6a3f577]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.228729 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5eb1b5853046c2a28c46ed19312df7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.230799 9908 tablet_service.cc:1511] Processing CreateTablet for tablet ed5cea610aed4e0aae56cc4888ca6c4d (DEFAULT_TABLE table=default.Table_bdbce93f86aa466bae793ccc1ac54a6b [id=d537831ed0b04450bad2bed57f1d3b23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.231290 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed5cea610aed4e0aae56cc4888ca6c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.236310 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 7481a7e759454f7e989caf7bc4d0788e (DEFAULT_TABLE table=default.Table_1a54e5f7520f4f2a9b675e28944d9f6d [id=fd19aa6322f041f38dd88e11224afdbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.237025 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7481a7e759454f7e989caf7bc4d0788e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:46.237557 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 07a7203a875c40e394a00c1ac44874d8 consensus state has no leader
W20260810 19:47:46.238041 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 46d7f9bcff4140c7bad02526befc1a56 consensus state has no leader
W20260810 19:47:46.238464 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ba8c4420f5e345eeac30c805d673b5e9 consensus state has no leader
I20260810 19:47:46.250020 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 39b27416e1a94ab98e66ad175f9bbbeb (DEFAULT_TABLE table=default.Table_9b5b4cea035c42949c4ec302d4b82b21 [id=9d3ea0ed528846718fdac913e46fc276]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:46.250856 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 39b27416e1a94ab98e66ad175f9bbbeb consensus state has no leader
I20260810 19:47:46.251937 9420 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 1bd4230625dd45c8ad8f85cfbc3c2b63
W20260810 19:47:46.254873 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet f871e89a900b4e79a2b4ebb31ff80003 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f871e89a900b4e79a2b4ebb31ff80003 already in progress: creating tablet
I20260810 19:47:46.255986 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_faa748cf759946fc9aedfa23fa15680c" } new_table_name: "default.Table_eacf01da875f41b2a5fa11e073c1877b" modify_external_catalogs: true
I20260810 19:47:46.257865 10142 tablet_service.cc:1511] Processing CreateTablet for tablet 39b27416e1a94ab98e66ad175f9bbbeb (DEFAULT_TABLE table=default.Table_9b5b4cea035c42949c4ec302d4b82b21 [id=9d3ea0ed528846718fdac913e46fc276]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.258500 10142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39b27416e1a94ab98e66ad175f9bbbeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.264441 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39b27416e1a94ab98e66ad175f9bbbeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.271342 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 7481a7e759454f7e989caf7bc4d0788e (DEFAULT_TABLE table=default.Table_1a54e5f7520f4f2a9b675e28944d9f6d [id=fd19aa6322f041f38dd88e11224afdbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.271986 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7481a7e759454f7e989caf7bc4d0788e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.272152 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet f871e89a900b4e79a2b4ebb31ff80003 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:47:46.277683 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7f5f05a042c4670a929d9a826c52667 consensus state has no leader
I20260810 19:47:46.277776 9681 tablet_service.cc:1511] Processing CreateTablet for tablet d7f5f05a042c4670a929d9a826c52667 (DEFAULT_TABLE table=default.Table_faa748cf759946fc9aedfa23fa15680c [id=683dbf29590844c692a645a7a60715e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.278342 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f5f05a042c4670a929d9a826c52667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.280815 9677 tablet_service.cc:1511] Processing CreateTablet for tablet 0d16b53753324290b10e4bdebcd8e243 (DEFAULT_TABLE table=default.Table_369bd7e9555d45dd84c434fb07f7d103 [id=0294677b9ff14aaa9d9ad515d1b77f8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.285817 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet f871e89a900b4e79a2b4ebb31ff80003 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:46.286592 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d16b53753324290b10e4bdebcd8e243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.291646 10367 tablet_bootstrap.cc:492] T b3f52e1f94054c48859b0fe46d0908d2 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:46.292054 10367 ts_tablet_manager.cc:1403] T b3f52e1f94054c48859b0fe46d0908d2 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.145s user 0.007s sys 0.003s
I20260810 19:47:46.294509 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 043f418de5ee493eb2bc43f3bc61e7fa (DEFAULT_TABLE table=default.Table_72ff6ea7e8804869845ad4866d103346 [id=d0343c1dbf284737b5183387c8ef1483]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.295047 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 043f418de5ee493eb2bc43f3bc61e7fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.295794 9685 tablet_service.cc:1511] Processing CreateTablet for tablet e70d3c77a75d4aacb85bfaec774147e2 (DEFAULT_TABLE table=default.Table_d3a9560cb9364ab6beb532186e4dc76d [id=87adb026d28943cb9a16184b8112db22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.296212 9685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70d3c77a75d4aacb85bfaec774147e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.297200 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 4c9c99ced15c4d3bac2330b8bcf36a26 (DEFAULT_TABLE table=default.Table_43a8dfd72855490a9430e0783eb17f20 [id=7f76320f426748e79b1e7f0446d7cb51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.297701 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c9c99ced15c4d3bac2330b8bcf36a26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.298537 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_52b776d314ed4833b63f0dca563647c7" } modify_external_catalogs: true
I20260810 19:47:46.298749 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_52b776d314ed4833b63f0dca563647c7" } modify_external_catalogs: true
I20260810 19:47:46.299347 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1a54e5f7520f4f2a9b675e28944d9f6d" } modify_external_catalogs: true
I20260810 19:47:46.299582 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1a54e5f7520f4f2a9b675e28944d9f6d" } modify_external_catalogs: true
I20260810 19:47:46.302708 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 65d2f6fcf0bd4f0e9650e880d305442b (DEFAULT_TABLE table=default.Table_a76a0ccd7c9c473781c4ce3cabb2112d [id=4fda913821434991b62c8de128735a25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.302732 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_43a8dfd72855490a9430e0783eb17f20" } modify_external_catalogs: true
I20260810 19:47:46.302949 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_43a8dfd72855490a9430e0783eb17f20" } modify_external_catalogs: true
I20260810 19:47:46.303349 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65d2f6fcf0bd4f0e9650e880d305442b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.306249 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet 88e511f69694484686f453530d0b7f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:46.306820 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d91fb3bbd3c74e48a77dee972fd26bce" } modify_external_catalogs: true
I20260810 19:47:46.306991 10139 tablet_service.cc:1558] Processing DeleteTablet for tablet 88e511f69694484686f453530d0b7f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:46.306984 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d91fb3bbd3c74e48a77dee972fd26bce" } modify_external_catalogs: true
I20260810 19:47:46.308277 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet b3f52e1f94054c48859b0fe46d0908d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:46.310011 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 46d7f9bcff4140c7bad02526befc1a56
I20260810 19:47:46.311990 9685 tablet_service.cc:1558] Processing DeleteTablet for tablet 46d7f9bcff4140c7bad02526befc1a56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:46.312654 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet b3f52e1f94054c48859b0fe46d0908d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:47:46.312822 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 46d7f9bcff4140c7bad02526befc1a56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46d7f9bcff4140c7bad02526befc1a56 already in progress: creating tablet
I20260810 19:47:46.313776 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f5eb1b5853046c2a28c46ed19312df7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:45 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:46.314980 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 46d7f9bcff4140c7bad02526befc1a56 (DEFAULT_TABLE table=default.Table_5418a55907644546b1e77ca3b34cfb5d [id=fb5ae6ab2d20481992a9d0d99186a1cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.315490 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d7f9bcff4140c7bad02526befc1a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.316956 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 46d7f9bcff4140c7bad02526befc1a56 (DEFAULT_TABLE table=default.Table_5418a55907644546b1e77ca3b34cfb5d [id=fb5ae6ab2d20481992a9d0d99186a1cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.317528 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d7f9bcff4140c7bad02526befc1a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.319311 10245 heartbeater.cc:499] Master 127.8.235.252:43301 was elected leader, sending a full tablet report...
I20260810 19:47:46.322136 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 7481a7e759454f7e989caf7bc4d0788e
I20260810 19:47:46.323594 9685 tablet_service.cc:1558] Processing DeleteTablet for tablet 7481a7e759454f7e989caf7bc4d0788e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:46.324542 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 7481a7e759454f7e989caf7bc4d0788e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7481a7e759454f7e989caf7bc4d0788e already in progress: creating tablet
I20260810 19:47:46.324836 9415 master_service.cc:960] ReplaceTablet: received request to replace tablet 88e511f69694484686f453530d0b7f30 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:46.325096 9412 master_service.cc:960] ReplaceTablet: received request to replace tablet 7481a7e759454f7e989caf7bc4d0788e from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:46.325146 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet 7481a7e759454f7e989caf7bc4d0788e from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:46.325311 9421 master_service.cc:960] ReplaceTablet: received request to replace tablet 1f5eb1b5853046c2a28c46ed19312df7 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:46.325356 9420 master_service.cc:960] ReplaceTablet: received request to replace tablet 88e511f69694484686f453530d0b7f30 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:46.326524 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f5eb1b5853046c2a28c46ed19312df7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:45 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:46.328368 9418 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 6a51f407c3c6466e83f491b98f44ff84 (table default.Table_6d0fe01100c94447a026749e395525d4 [id=374315d136c94e148f590805b89200a6]). Expected version 1 got 0
I20260810 19:47:46.328745 9418 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet ed5cea610aed4e0aae56cc4888ca6c4d (table default.Table_bdbce93f86aa466bae793ccc1ac54a6b [id=d537831ed0b04450bad2bed57f1d3b23]). Expected version 1 got 0
I20260810 19:47:46.333540 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 4c9c99ced15c4d3bac2330b8bcf36a26
I20260810 19:47:46.335112 9685 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c9c99ced15c4d3bac2330b8bcf36a26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:46.336164 9397 catalog_manager.cc:5017] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 4c9c99ced15c4d3bac2330b8bcf36a26 because the tablet was not found. No further retry: Not found: Tablet not found: 4c9c99ced15c4d3bac2330b8bcf36a26
I20260810 19:47:46.337495 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 07a7203a875c40e394a00c1ac44874d8 (DEFAULT_TABLE table=default.Table_3f316e1395dd450bbeb0ffd71efd83fe [id=d9f804aed5ee40fa90152b6475aea1af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.338073 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a7203a875c40e394a00c1ac44874d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.344085 9135 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu with pid 9145
I20260810 19:47:46.346834 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 99265c93337b49c1ba4d9ae59c05318b
W20260810 19:47:46.347851 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet f871e89a900b4e79a2b4ebb31ff80003 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f871e89a900b4e79a2b4ebb31ff80003 already in progress: creating tablet
I20260810 19:47:46.347849 10136 tablet_service.cc:1511] Processing CreateTablet for tablet ba8c4420f5e345eeac30c805d673b5e9 (DEFAULT_TABLE table=default.Table_cf2961e9b7d34b04bb822a30b8f5a62c [id=c421996810c34ce69ca7c00ed984dc54]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:46.348098 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 88e511f69694484686f453530d0b7f30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88e511f69694484686f453530d0b7f30 already in progress: creating tablet
I20260810 19:47:46.348361 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba8c4420f5e345eeac30c805d673b5e9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:46.348668 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet f871e89a900b4e79a2b4ebb31ff80003 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f871e89a900b4e79a2b4ebb31ff80003 already in progress: creating tablet
W20260810 19:47:46.348896 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 88e511f69694484686f453530d0b7f30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88e511f69694484686f453530d0b7f30 already in progress: creating tablet
I20260810 19:47:46.348955 9673 tablet_service.cc:1558] Processing DeleteTablet for tablet 99265c93337b49c1ba4d9ae59c05318b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:46.349133 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet b3f52e1f94054c48859b0fe46d0908d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3f52e1f94054c48859b0fe46d0908d2 already in progress: creating tablet
W20260810 19:47:46.349836 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 99265c93337b49c1ba4d9ae59c05318b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99265c93337b49c1ba4d9ae59c05318b already in progress: creating tablet
I20260810 19:47:46.356459 10367 raft_consensus.cc:359] T b3f52e1f94054c48859b0fe46d0908d2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.356841 10135 tablet_service.cc:1511] Processing CreateTablet for tablet d7f5f05a042c4670a929d9a826c52667 (DEFAULT_TABLE table=default.Table_faa748cf759946fc9aedfa23fa15680c [id=683dbf29590844c692a645a7a60715e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.356918 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 65d2f6fcf0bd4f0e9650e880d305442b (DEFAULT_TABLE table=default.Table_a76a0ccd7c9c473781c4ce3cabb2112d [id=4fda913821434991b62c8de128735a25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.357496 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65d2f6fcf0bd4f0e9650e880d305442b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.357566 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 0d16b53753324290b10e4bdebcd8e243 (DEFAULT_TABLE table=default.Table_369bd7e9555d45dd84c434fb07f7d103 [id=0294677b9ff14aaa9d9ad515d1b77f8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.358352 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d16b53753324290b10e4bdebcd8e243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.360071 10367 raft_consensus.cc:385] T b3f52e1f94054c48859b0fe46d0908d2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:46.360514 10367 raft_consensus.cc:740] T b3f52e1f94054c48859b0fe46d0908d2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:46.362020 10367 consensus_queue.cc:260] T b3f52e1f94054c48859b0fe46d0908d2 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.362490 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 4c9c99ced15c4d3bac2330b8bcf36a26 (DEFAULT_TABLE table=default.Table_43a8dfd72855490a9430e0783eb17f20 [id=7f76320f426748e79b1e7f0446d7cb51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.362736 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 043f418de5ee493eb2bc43f3bc61e7fa (DEFAULT_TABLE table=default.Table_72ff6ea7e8804869845ad4866d103346 [id=d0343c1dbf284737b5183387c8ef1483]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.363250 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c9c99ced15c4d3bac2330b8bcf36a26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.363464 10366 tablet_bootstrap.cc:492] T b3f52e1f94054c48859b0fe46d0908d2 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:46.363734 10128 tablet_service.cc:1511] Processing CreateTablet for tablet e70d3c77a75d4aacb85bfaec774147e2 (DEFAULT_TABLE table=default.Table_d3a9560cb9364ab6beb532186e4dc76d [id=87adb026d28943cb9a16184b8112db22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.364298 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70d3c77a75d4aacb85bfaec774147e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.366608 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet 46d7f9bcff4140c7bad02526befc1a56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:46.367038 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet 7481a7e759454f7e989caf7bc4d0788e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:46.367367 10120 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c9c99ced15c4d3bac2330b8bcf36a26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:46.367725 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet 99265c93337b49c1ba4d9ae59c05318b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:46.367692 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_fe486cd2688f4cff81fa2103990736dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:46.367945 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 043f418de5ee493eb2bc43f3bc61e7fa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:46.368364 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe486cd2688f4cff81fa2103990736dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.370112 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f5f05a042c4670a929d9a826c52667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.377731 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 07a7203a875c40e394a00c1ac44874d8 (DEFAULT_TABLE table=default.Table_3f316e1395dd450bbeb0ffd71efd83fe [id=d9f804aed5ee40fa90152b6475aea1af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.378417 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a7203a875c40e394a00c1ac44874d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.381505 10370 tablet_bootstrap.cc:492] T 6a51f407c3c6466e83f491b98f44ff84 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:46.382026 9904 tablet_service.cc:1511] Processing CreateTablet for tablet ba8c4420f5e345eeac30c805d673b5e9 (DEFAULT_TABLE table=default.Table_cf2961e9b7d34b04bb822a30b8f5a62c [id=c421996810c34ce69ca7c00ed984dc54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.382550 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba8c4420f5e345eeac30c805d673b5e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.384564 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c9c99ced15c4d3bac2330b8bcf36a26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:46.385044 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_dc05f630b188441b9a67477cdce6b939"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.385759 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc05f630b188441b9a67477cdce6b939 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.386770 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 65d2f6fcf0bd4f0e9650e880d305442b (DEFAULT_TABLE table=default.Table_a76a0ccd7c9c473781c4ce3cabb2112d [id=4fda913821434991b62c8de128735a25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.387352 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65d2f6fcf0bd4f0e9650e880d305442b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.387720 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0ba2d519828e48e29bb7af21dcac296e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.388278 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ba2d519828e48e29bb7af21dcac296e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.386246 9911 tablet_service.cc:1511] Processing CreateTablet for tablet d7f5f05a042c4670a929d9a826c52667 (DEFAULT_TABLE table=default.Table_faa748cf759946fc9aedfa23fa15680c [id=683dbf29590844c692a645a7a60715e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.390619 10370 tablet_bootstrap.cc:654] T 6a51f407c3c6466e83f491b98f44ff84 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.390564 9899 tablet_service.cc:1511] Processing CreateTablet for tablet 4c9c99ced15c4d3bac2330b8bcf36a26 (DEFAULT_TABLE table=default.Table_43a8dfd72855490a9430e0783eb17f20 [id=7f76320f426748e79b1e7f0446d7cb51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.391786 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 99265c93337b49c1ba4d9ae59c05318b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:46.392308 10370 log.cc:826] T 6a51f407c3c6466e83f491b98f44ff84 P eadde59fd6504d679e47f03a60c64bb0: Log is configured to *not* fsync() on all Append() calls
I20260810 19:47:46.396555 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f5f05a042c4670a929d9a826c52667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.397544 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 7481a7e759454f7e989caf7bc4d0788e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:46.397573 9901 tablet_service.cc:1511] Processing CreateTablet for tablet e70d3c77a75d4aacb85bfaec774147e2 (DEFAULT_TABLE table=default.Table_d3a9560cb9364ab6beb532186e4dc76d [id=87adb026d28943cb9a16184b8112db22]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:46.402921 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 1f5eb1b5853046c2a28c46ed19312df7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f5eb1b5853046c2a28c46ed19312df7 already in progress: creating tablet
W20260810 19:47:46.403457 9395 catalog_manager.cc:5017] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 4c9c99ced15c4d3bac2330b8bcf36a26 because the tablet was not found. No further retry: Not found: Tablet not found: 4c9c99ced15c4d3bac2330b8bcf36a26
W20260810 19:47:46.403700 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 99265c93337b49c1ba4d9ae59c05318b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99265c93337b49c1ba4d9ae59c05318b already in progress: creating tablet
W20260810 19:47:46.403970 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 7481a7e759454f7e989caf7bc4d0788e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7481a7e759454f7e989caf7bc4d0788e already in progress: creating tablet
W20260810 19:47:46.404189 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet b3f52e1f94054c48859b0fe46d0908d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3f52e1f94054c48859b0fe46d0908d2 already in progress: creating tablet
I20260810 19:47:46.404052 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_73b47bf58bf5407c89c12ca820fd650a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.405305 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73b47bf58bf5407c89c12ca820fd650a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.405659 9897 tablet_service.cc:1558] Processing DeleteTablet for tablet 46d7f9bcff4140c7bad02526befc1a56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:46.406548 9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c9c99ced15c4d3bac2330b8bcf36a26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.411240 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70d3c77a75d4aacb85bfaec774147e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.411422 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 043f418de5ee493eb2bc43f3bc61e7fa (DEFAULT_TABLE table=default.Table_72ff6ea7e8804869845ad4866d103346 [id=d0343c1dbf284737b5183387c8ef1483]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:46.404424 9395 catalog_manager.cc:5017] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 1f5eb1b5853046c2a28c46ed19312df7 because the tablet was not found. No further retry: Not found: Tablet not found: 1f5eb1b5853046c2a28c46ed19312df7
W20260810 19:47:46.418203 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 46d7f9bcff4140c7bad02526befc1a56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46d7f9bcff4140c7bad02526befc1a56 already in progress: creating tablet
W20260810 19:47:46.418726 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 7481a7e759454f7e989caf7bc4d0788e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7481a7e759454f7e989caf7bc4d0788e already in progress: creating tablet
W20260810 19:47:46.418979 9395 catalog_manager.cc:5017] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 4c9c99ced15c4d3bac2330b8bcf36a26 because the tablet was not found. No further retry: Not found: Tablet not found: 4c9c99ced15c4d3bac2330b8bcf36a26
W20260810 19:47:46.419265 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 99265c93337b49c1ba4d9ae59c05318b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99265c93337b49c1ba4d9ae59c05318b already in progress: creating tablet
W20260810 19:47:46.419622 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 46d7f9bcff4140c7bad02526befc1a56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46d7f9bcff4140c7bad02526befc1a56 already in progress: creating tablet
I20260810 19:47:46.423748 10370 tablet_bootstrap.cc:492] T 6a51f407c3c6466e83f491b98f44ff84 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:46.424127 10370 ts_tablet_manager.cc:1403] T 6a51f407c3c6466e83f491b98f44ff84 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.043s user 0.014s sys 0.012s
I20260810 19:47:46.425086 9677 tablet_service.cc:1511] Processing CreateTablet for tablet 537bcbf01b1d42768996cf5b80c2ae5d (DEFAULT_TABLE table=default.Table_dc05f630b188441b9a67477cdce6b939 [id=f4297c4f80854d1a88438b2591a6d5b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.425632 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 537bcbf01b1d42768996cf5b80c2ae5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.426081 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet b3f52e1f94054c48859b0fe46d0908d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:46.427014 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet b3f52e1f94054c48859b0fe46d0908d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3f52e1f94054c48859b0fe46d0908d2 already in progress: creating tablet
I20260810 19:47:46.427973 10367 ts_tablet_manager.cc:1434] T b3f52e1f94054c48859b0fe46d0908d2 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.136s user 0.015s sys 0.028s
I20260810 19:47:46.428514 10367 tablet_bootstrap.cc:492] T f871e89a900b4e79a2b4ebb31ff80003 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:46.430660 10367 tablet_bootstrap.cc:654] T f871e89a900b4e79a2b4ebb31ff80003 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.432104 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet b3f52e1f94054c48859b0fe46d0908d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:46.432425 10371 tablet_replica.cc:333] T b3f52e1f94054c48859b0fe46d0908d2 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:46.433178 10371 raft_consensus.cc:2243] T b3f52e1f94054c48859b0fe46d0908d2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:46.433745 10371 raft_consensus.cc:2272] T b3f52e1f94054c48859b0fe46d0908d2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:46.435139 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_02491570846c46cf8b1b01467711a2f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.435809 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02491570846c46cf8b1b01467711a2f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.437304 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_6084dcfa994e4313896e6f7b5e09953c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:46.437438 10370 raft_consensus.cc:359] T 6a51f407c3c6466e83f491b98f44ff84 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:46.437883 10370 raft_consensus.cc:385] T 6a51f407c3c6466e83f491b98f44ff84 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 19:47:46.437901 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6084dcfa994e4313896e6f7b5e09953c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.438027 10370 raft_consensus.cc:740] T 6a51f407c3c6466e83f491b98f44ff84 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:46.438876 10370 consensus_queue.cc:260] T 6a51f407c3c6466e83f491b98f44ff84 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:46.439078 9897 tablet_service.cc:1511] Processing CreateTablet for tablet 537bcbf01b1d42768996cf5b80c2ae5d (DEFAULT_TABLE table=default.Table_dc05f630b188441b9a67477cdce6b939 [id=f4297c4f80854d1a88438b2591a6d5b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.442464 10371 ts_tablet_manager.cc:1916] T b3f52e1f94054c48859b0fe46d0908d2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:46.450212 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_4b9c0a9770784e0d850b9fd5481270e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.450927 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b9c0a9770784e0d850b9fd5481270e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.452281 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_d3d4ff6a369249fea07d925aa5bfcd23"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.452862 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3d4ff6a369249fea07d925aa5bfcd23 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.453702 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 043f418de5ee493eb2bc43f3bc61e7fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.454372 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_73b47bf58bf5407c89c12ca820fd650a" } new_table_name: "default.Table_257ddf6dffe443b7bb3a6d5e7f1e93a2" modify_external_catalogs: true
I20260810 19:47:46.454587 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_99ca3af32eef44d3a5f5c1923c288fcd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.455103 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99ca3af32eef44d3a5f5c1923c288fcd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.456282 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_dc05f630b188441b9a67477cdce6b939" } new_table_name: "default.Table_abe7676ae72548798853314dc36977ad" modify_external_catalogs: true
I20260810 19:47:46.457540 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f1f332ce5d104c2b889c1faf78a0510f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.458038 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1f332ce5d104c2b889c1faf78a0510f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.459282 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 537bcbf01b1d42768996cf5b80c2ae5d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:46.469385 10246 heartbeater.cc:646] Failed to heartbeat to 127.8.235.254:33891 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.8.235.254:33891 (error 108)
W20260810 19:47:46.470330 10026 heartbeater.cc:646] Failed to heartbeat to 127.8.235.254:33891 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.8.235.254:33891 (error 108)
W20260810 19:47:46.471648 9789 heartbeater.cc:646] Failed to heartbeat to 127.8.235.254:33891 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.8.235.254:33891 (error 108)
I20260810 19:47:46.473065 10366 tablet_bootstrap.cc:654] T b3f52e1f94054c48859b0fe46d0908d2 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.474843 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 537bcbf01b1d42768996cf5b80c2ae5d (DEFAULT_TABLE table=default.Table_dc05f630b188441b9a67477cdce6b939 [id=f4297c4f80854d1a88438b2591a6d5b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.475364 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 537bcbf01b1d42768996cf5b80c2ae5d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:46.478061 9397 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.235.254:33891 (error 108)
I20260810 19:47:46.480129 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 0d16b53753324290b10e4bdebcd8e243 (DEFAULT_TABLE table=default.Table_369bd7e9555d45dd84c434fb07f7d103 [id=0294677b9ff14aaa9d9ad515d1b77f8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.480574 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d16b53753324290b10e4bdebcd8e243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.482705 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5422399034c2420ca3bf7a39a090f84a" } new_table_name: "default.Table_bf651ef28af14d53b75748d0719a987d" modify_external_catalogs: true
I20260810 19:47:46.484344 10366 log.cc:826] T b3f52e1f94054c48859b0fe46d0908d2 P 6986ed920dcb4af29a5eeeda6f671691: Log is configured to *not* fsync() on all Append() calls
I20260810 19:47:46.493466 10367 tablet_bootstrap.cc:492] T f871e89a900b4e79a2b4ebb31ff80003 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:46.493673 10367 ts_tablet_manager.cc:1403] T f871e89a900b4e79a2b4ebb31ff80003 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.065s user 0.009s sys 0.021s
I20260810 19:47:46.494046 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6f68ade8691340aa901cd94c21b98ef3" } new_table_name: "default.Table_2080a27caba94bd8a8ab66b012cb20e4" modify_external_catalogs: true
I20260810 19:47:46.494880 10367 raft_consensus.cc:359] T f871e89a900b4e79a2b4ebb31ff80003 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.495098 10367 raft_consensus.cc:385] T f871e89a900b4e79a2b4ebb31ff80003 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:46.495204 10367 raft_consensus.cc:740] T f871e89a900b4e79a2b4ebb31ff80003 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
W20260810 19:47:46.495568 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 537bcbf01b1d42768996cf5b80c2ae5d consensus state has no leader
I20260810 19:47:46.495591 10367 consensus_queue.cc:260] T f871e89a900b4e79a2b4ebb31ff80003 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.497195 10367 ts_tablet_manager.cc:1434] T f871e89a900b4e79a2b4ebb31ff80003 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260810 19:47:46.497205 9397 consensus_peers.cc:597] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a -> Peer 5268e710af3c43ddab70eb7dd1aaa575 (127.8.235.254:33891): Couldn't send request to peer 5268e710af3c43ddab70eb7dd1aaa575. Status: Network error: Client connection negotiation failed: client connection to 127.8.235.254:33891: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:46.497506 10367 tablet_bootstrap.cc:492] T 99265c93337b49c1ba4d9ae59c05318b P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:46.499387 10367 tablet_bootstrap.cc:654] T 99265c93337b49c1ba4d9ae59c05318b P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.500109 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 4df9d4be6ca042d3957e540d7ef44d8a (DEFAULT_TABLE table=default.Table_0ba2d519828e48e29bb7af21dcac296e [id=f641e04b9f7c4052b81c7364bc2d1cde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.500582 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df9d4be6ca042d3957e540d7ef44d8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.500651 9902 tablet_service.cc:1511] Processing CreateTablet for tablet f9e1f8b7b2d04c56bc89a6b42e60da50 (DEFAULT_TABLE table=default.Table_fe486cd2688f4cff81fa2103990736dc [id=098d4c95bab142c2b56fecac4113a429]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.500725 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_369bd7e9555d45dd84c434fb07f7d103" } modify_external_catalogs: true
I20260810 19:47:46.500916 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_369bd7e9555d45dd84c434fb07f7d103" } modify_external_catalogs: true
I20260810 19:47:46.501154 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9e1f8b7b2d04c56bc89a6b42e60da50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.501865 10370 ts_tablet_manager.cc:1434] T 6a51f407c3c6466e83f491b98f44ff84 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.078s user 0.024s sys 0.011s
I20260810 19:47:46.502243 9673 tablet_service.cc:1511] Processing CreateTablet for tablet f9e1f8b7b2d04c56bc89a6b42e60da50 (DEFAULT_TABLE table=default.Table_fe486cd2688f4cff81fa2103990736dc [id=098d4c95bab142c2b56fecac4113a429]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.502645 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9e1f8b7b2d04c56bc89a6b42e60da50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.502668 10127 tablet_service.cc:1511] Processing CreateTablet for tablet f9e1f8b7b2d04c56bc89a6b42e60da50 (DEFAULT_TABLE table=default.Table_fe486cd2688f4cff81fa2103990736dc [id=098d4c95bab142c2b56fecac4113a429]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.503052 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9e1f8b7b2d04c56bc89a6b42e60da50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.504067 9899 tablet_service.cc:1511] Processing CreateTablet for tablet 4df9d4be6ca042d3957e540d7ef44d8a (DEFAULT_TABLE table=default.Table_0ba2d519828e48e29bb7af21dcac296e [id=f641e04b9f7c4052b81c7364bc2d1cde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.504429 9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df9d4be6ca042d3957e540d7ef44d8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.506675 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 4df9d4be6ca042d3957e540d7ef44d8a (DEFAULT_TABLE table=default.Table_0ba2d519828e48e29bb7af21dcac296e [id=f641e04b9f7c4052b81c7364bc2d1cde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.507128 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df9d4be6ca042d3957e540d7ef44d8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.507071 9677 tablet_service.cc:1511] Processing CreateTablet for tablet 00dabf43505f4fc89be39ee8fb41c7ee (DEFAULT_TABLE table=default.Table_73b47bf58bf5407c89c12ca820fd650a [id=6b30bf93c566421593a182e1768c0482]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.507447 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00dabf43505f4fc89be39ee8fb41c7ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.509418 9583 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0c56283079e74549afd0096f7e72046a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } } }
I20260810 19:47:46.509642 9583 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [sys.catalog]: This master's current role is: LEADER
I20260810 19:47:46.510187 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 00dabf43505f4fc89be39ee8fb41c7ee (DEFAULT_TABLE table=default.Table_73b47bf58bf5407c89c12ca820fd650a [id=6b30bf93c566421593a182e1768c0482]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.510609 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00dabf43505f4fc89be39ee8fb41c7ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.511128 10370 tablet_bootstrap.cc:492] T f871e89a900b4e79a2b4ebb31ff80003 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:47:46.511911 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 00dabf43505f4fc89be39ee8fb41c7ee consensus state has no leader
I20260810 19:47:46.513242 10370 tablet_bootstrap.cc:654] T f871e89a900b4e79a2b4ebb31ff80003 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.518124 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_99ca3af32eef44d3a5f5c1923c288fcd" } modify_external_catalogs: true
I20260810 19:47:46.518400 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_99ca3af32eef44d3a5f5c1923c288fcd" } modify_external_catalogs: true
I20260810 19:47:46.520944 10366 tablet_bootstrap.cc:492] T b3f52e1f94054c48859b0fe46d0908d2 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:46.521402 10366 ts_tablet_manager.cc:1403] T b3f52e1f94054c48859b0fe46d0908d2 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.158s user 0.007s sys 0.005s
I20260810 19:47:46.525380 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6d0fe01100c94447a026749e395525d4" } modify_external_catalogs: true
W20260810 19:47:46.525575 10249 tablet.cc:2406] T 6a51f407c3c6466e83f491b98f44ff84 P eadde59fd6504d679e47f03a60c64bb0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 19:47:46.525594 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6d0fe01100c94447a026749e395525d4" } modify_external_catalogs: true
I20260810 19:47:46.526582 10367 tablet_bootstrap.cc:492] T 99265c93337b49c1ba4d9ae59c05318b P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:46.526786 10367 ts_tablet_manager.cc:1403] T 99265c93337b49c1ba4d9ae59c05318b P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.002s
I20260810 19:47:46.527686 10367 raft_consensus.cc:359] T 99265c93337b49c1ba4d9ae59c05318b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.527922 10367 raft_consensus.cc:385] T 99265c93337b49c1ba4d9ae59c05318b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:46.528024 10367 raft_consensus.cc:740] T 99265c93337b49c1ba4d9ae59c05318b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:46.528323 10367 consensus_queue.cc:260] T 99265c93337b49c1ba4d9ae59c05318b P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.531607 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_eacf01da875f41b2a5fa11e073c1877b" } new_table_name: "default.Table_b74fb4e112f74b04ad782941c5f66ba2" modify_external_catalogs: true
I20260810 19:47:46.534695 10367 ts_tablet_manager.cc:1434] T 99265c93337b49c1ba4d9ae59c05318b P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260810 19:47:46.548329 9415 master_service.cc:960] ReplaceTablet: received request to replace tablet 0d16b53753324290b10e4bdebcd8e243 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:46.548636 9413 master_service.cc:960] ReplaceTablet: received request to replace tablet 88e511f69694484686f453530d0b7f30 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:46.550642 9677 tablet_service.cc:1558] Processing DeleteTablet for tablet f871e89a900b4e79a2b4ebb31ff80003 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:46.551097 10367 tablet_bootstrap.cc:492] T 6a51f407c3c6466e83f491b98f44ff84 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:46.553030 10367 tablet_bootstrap.cc:654] T 6a51f407c3c6466e83f491b98f44ff84 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.554590 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 99265c93337b49c1ba4d9ae59c05318b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:46.555001 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 00dabf43505f4fc89be39ee8fb41c7ee (DEFAULT_TABLE table=default.Table_73b47bf58bf5407c89c12ca820fd650a [id=6b30bf93c566421593a182e1768c0482]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.555598 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00dabf43505f4fc89be39ee8fb41c7ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.556277 9413 master_service.cc:960] ReplaceTablet: received request to replace tablet 1f5eb1b5853046c2a28c46ed19312df7 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:46.556766 9413 master_service.cc:960] ReplaceTablet: received request to replace tablet 4c9c99ced15c4d3bac2330b8bcf36a26 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:46.557188 9413 master_service.cc:960] ReplaceTablet: received request to replace tablet f871e89a900b4e79a2b4ebb31ff80003 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:46.557706 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_abe7676ae72548798853314dc36977ad" } modify_external_catalogs: true
I20260810 19:47:46.557933 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_abe7676ae72548798853314dc36977ad" } modify_external_catalogs: true
W20260810 19:47:46.559396 10384 negotiation.cc:336] Failed RPC negotiation. Trace:
0810 19:47:46.472281 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.8.235.254:33891 (local address 127.8.235.193:39459)
0810 19:47:46.556927 (+ 84646us) negotiation.cc:107] Waiting for socket to connect
0810 19:47:46.557179 (+ 252us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.235.254:33891: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":84433,"threads_started":1}
I20260810 19:47:46.559736 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d3a9560cb9364ab6beb532186e4dc76d" } modify_external_catalogs: true
I20260810 19:47:46.559918 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d3a9560cb9364ab6beb532186e4dc76d" } modify_external_catalogs: true
W20260810 19:47:46.561522 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 07a7203a875c40e394a00c1ac44874d8 consensus state has no leader
I20260810 19:47:46.563002 10370 tablet_bootstrap.cc:492] T f871e89a900b4e79a2b4ebb31ff80003 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:46.563181 10370 ts_tablet_manager.cc:1403] T f871e89a900b4e79a2b4ebb31ff80003 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.052s user 0.003s sys 0.012s
I20260810 19:47:46.555387 10366 raft_consensus.cc:359] T b3f52e1f94054c48859b0fe46d0908d2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.565578 9420 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 6a51f407c3c6466e83f491b98f44ff84 (table default.Table_6d0fe01100c94447a026749e395525d4 [id=374315d136c94e148f590805b89200a6]). Expected version 1 got 0
I20260810 19:47:46.565670 10366 raft_consensus.cc:385] T b3f52e1f94054c48859b0fe46d0908d2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:46.565795 10366 raft_consensus.cc:740] T b3f52e1f94054c48859b0fe46d0908d2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:46.567548 10366 consensus_queue.cc:260] T b3f52e1f94054c48859b0fe46d0908d2 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.568411 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 1b0d0eeff07f410eacd8a2d006241cfb (DEFAULT_TABLE table=default.Table_02491570846c46cf8b1b01467711a2f9 [id=b40853681dfa4d5381e47c894f8f6b9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.569056 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b0d0eeff07f410eacd8a2d006241cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.571674 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 1b0d0eeff07f410eacd8a2d006241cfb (DEFAULT_TABLE table=default.Table_02491570846c46cf8b1b01467711a2f9 [id=b40853681dfa4d5381e47c894f8f6b9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.572305 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b0d0eeff07f410eacd8a2d006241cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.559443 10371 ts_tablet_manager.cc:1929] T b3f52e1f94054c48859b0fe46d0908d2 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:46.578543 10371 log.cc:1199] T b3f52e1f94054c48859b0fe46d0908d2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/b3f52e1f94054c48859b0fe46d0908d2
I20260810 19:47:46.565358 10370 raft_consensus.cc:359] T f871e89a900b4e79a2b4ebb31ff80003 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.579087 10370 raft_consensus.cc:385] T f871e89a900b4e79a2b4ebb31ff80003 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:46.579234 10370 raft_consensus.cc:740] T f871e89a900b4e79a2b4ebb31ff80003 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:46.579314 10371 ts_tablet_manager.cc:1950] T b3f52e1f94054c48859b0fe46d0908d2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:46.579573 10370 consensus_queue.cc:260] T f871e89a900b4e79a2b4ebb31ff80003 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.579638 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 1b0d0eeff07f410eacd8a2d006241cfb (DEFAULT_TABLE table=default.Table_02491570846c46cf8b1b01467711a2f9 [id=b40853681dfa4d5381e47c894f8f6b9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.580259 10370 ts_tablet_manager.cc:1434] T f871e89a900b4e79a2b4ebb31ff80003 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.017s user 0.000s sys 0.003s
I20260810 19:47:46.580614 10370 tablet_bootstrap.cc:492] T 88e511f69694484686f453530d0b7f30 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:47:46.585489 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ba8c4420f5e345eeac30c805d673b5e9 consensus state has no leader
I20260810 19:47:46.580231 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b0d0eeff07f410eacd8a2d006241cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.588948 10378 raft_consensus.cc:493] T f871e89a900b4e79a2b4ebb31ff80003 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:46.589223 10378 raft_consensus.cc:515] T f871e89a900b4e79a2b4ebb31ff80003 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.591426 10378 leader_election.cc:290] T f871e89a900b4e79a2b4ebb31ff80003 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:46.593727 10370 tablet_bootstrap.cc:654] T 88e511f69694484686f453530d0b7f30 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.601300 10371 tablet_replica.cc:333] T f871e89a900b4e79a2b4ebb31ff80003 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:46.601604 9410 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 85e9a890e8db4bfbafb72e652800c2a5
I20260810 19:47:46.601581 10371 raft_consensus.cc:2243] T f871e89a900b4e79a2b4ebb31ff80003 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:46.601786 10371 raft_consensus.cc:2272] T f871e89a900b4e79a2b4ebb31ff80003 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:47:46.604437 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7f5f05a042c4670a929d9a826c52667 consensus state has no leader
I20260810 19:47:46.608136 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet b3f52e1f94054c48859b0fe46d0908d2 (table default.Table_3432f5ec7a7f4b948a397a4c118a8f1c [id=654afc1abde94b2b8e2a3c816c8200d8]) successfully deleted
I20260810 19:47:46.612229 10367 tablet_bootstrap.cc:492] T 6a51f407c3c6466e83f491b98f44ff84 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:46.614352 10367 ts_tablet_manager.cc:1403] T 6a51f407c3c6466e83f491b98f44ff84 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.063s user 0.011s sys 0.010s
I20260810 19:47:46.615916 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b9b9f2dbf2db4c97b9316a35caf74ca9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.616570 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9b9f2dbf2db4c97b9316a35caf74ca9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.616663 10367 raft_consensus.cc:359] T 6a51f407c3c6466e83f491b98f44ff84 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:46.616951 10367 raft_consensus.cc:385] T 6a51f407c3c6466e83f491b98f44ff84 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:46.617012 10366 ts_tablet_manager.cc:1434] T b3f52e1f94054c48859b0fe46d0908d2 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.095s user 0.020s sys 0.027s
I20260810 19:47:46.617049 10367 raft_consensus.cc:740] T 6a51f407c3c6466e83f491b98f44ff84 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:46.618242 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_027211c3405146eebb29d662f9be9f77"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.618932 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_027211c3405146eebb29d662f9be9f77 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.619236 10367 consensus_queue.cc:260] T 6a51f407c3c6466e83f491b98f44ff84 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:46.621057 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_730d817e803a49e180281cc558c18e52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.621673 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_730d817e803a49e180281cc558c18e52 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.622848 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 6a51f407c3c6466e83f491b98f44ff84
I20260810 19:47:46.623893 9673 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a51f407c3c6466e83f491b98f44ff84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:46.624591 10367 ts_tablet_manager.cc:1434] T 6a51f407c3c6466e83f491b98f44ff84 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260810 19:47:46.624625 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 0d16b53753324290b10e4bdebcd8e243
I20260810 19:47:46.624994 10367 tablet_bootstrap.cc:492] T 88e511f69694484686f453530d0b7f30 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:46.625546 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet b3f52e1f94054c48859b0fe46d0908d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:46.625914 10377 tablet_replica.cc:333] T b3f52e1f94054c48859b0fe46d0908d2 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:46.626469 10377 raft_consensus.cc:2243] T b3f52e1f94054c48859b0fe46d0908d2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:46.626933 10377 raft_consensus.cc:2272] T b3f52e1f94054c48859b0fe46d0908d2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:46.627172 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3b8308e996664215914e49d2819c2309"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.627805 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b8308e996664215914e49d2819c2309 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.629406 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d16b53753324290b10e4bdebcd8e243 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:46.629686 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d16b53753324290b10e4bdebcd8e243 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:47:46.630538 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 0d16b53753324290b10e4bdebcd8e243 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d16b53753324290b10e4bdebcd8e243 already in progress: creating tablet
I20260810 19:47:46.632483 10377 ts_tablet_manager.cc:1916] T b3f52e1f94054c48859b0fe46d0908d2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:46.635025 10370 tablet_bootstrap.cc:492] T 88e511f69694484686f453530d0b7f30 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:46.635290 10370 ts_tablet_manager.cc:1403] T 88e511f69694484686f453530d0b7f30 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.055s user 0.004s sys 0.024s
I20260810 19:47:46.636802 10370 raft_consensus.cc:359] T 88e511f69694484686f453530d0b7f30 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.637074 10370 raft_consensus.cc:385] T 88e511f69694484686f453530d0b7f30 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:46.637179 10370 raft_consensus.cc:740] T 88e511f69694484686f453530d0b7f30 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:46.637553 10370 consensus_queue.cc:260] T 88e511f69694484686f453530d0b7f30 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.638530 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d16b53753324290b10e4bdebcd8e243 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:46.638968 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet f871e89a900b4e79a2b4ebb31ff80003 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:46.639829 10367 tablet_bootstrap.cc:654] T 88e511f69694484686f453530d0b7f30 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.640309 10375 tablet_replica.cc:333] T f871e89a900b4e79a2b4ebb31ff80003 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:46.640933 10375 raft_consensus.cc:2243] T f871e89a900b4e79a2b4ebb31ff80003 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:46.641424 10375 raft_consensus.cc:2272] T f871e89a900b4e79a2b4ebb31ff80003 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:46.643535 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a51f407c3c6466e83f491b98f44ff84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:46.643858 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a51f407c3c6466e83f491b98f44ff84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:46.645713 10375 ts_tablet_manager.cc:1916] T f871e89a900b4e79a2b4ebb31ff80003 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:46.615412 10371 ts_tablet_manager.cc:1916] T f871e89a900b4e79a2b4ebb31ff80003 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:46.647344 10378 raft_consensus.cc:493] T 99265c93337b49c1ba4d9ae59c05318b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:46.647543 10378 raft_consensus.cc:515] T 99265c93337b49c1ba4d9ae59c05318b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.648272 10378 leader_election.cc:290] T 99265c93337b49c1ba4d9ae59c05318b P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:46.655439 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 88e511f69694484686f453530d0b7f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:46.655606 10375 ts_tablet_manager.cc:1929] T f871e89a900b4e79a2b4ebb31ff80003 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:46.655814 10375 log.cc:1199] T f871e89a900b4e79a2b4ebb31ff80003 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/f871e89a900b4e79a2b4ebb31ff80003
I20260810 19:47:46.656411 10375 ts_tablet_manager.cc:1950] T f871e89a900b4e79a2b4ebb31ff80003 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:46.658638 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet f871e89a900b4e79a2b4ebb31ff80003 (table default.Table_9323129d801c4f3ca77cbcaad34448df [id=5bdb225dea3c4737945f5f249b74dfd1]) successfully deleted
I20260810 19:47:46.658746 10370 ts_tablet_manager.cc:1434] T 88e511f69694484686f453530d0b7f30 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.023s user 0.000s sys 0.003s
I20260810 19:47:46.658754 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f871e89a900b4e79a2b4ebb31ff80003" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:46.659911 10370 tablet_bootstrap.cc:492] T b3f52e1f94054c48859b0fe46d0908d2 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:46.658687 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99265c93337b49c1ba4d9ae59c05318b" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:47:46.661150 9795 tablet.cc:2406] T 6a51f407c3c6466e83f491b98f44ff84 P fcd31b1bbb0340cbacfce652b4ad8da4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 19:47:46.661369 9611 leader_election.cc:343] T f871e89a900b4e79a2b4ebb31ff80003 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:46.662804 9611 leader_election.cc:343] T 99265c93337b49c1ba4d9ae59c05318b P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:46.664222 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet e70d3c77a75d4aacb85bfaec774147e2
I20260810 19:47:46.665318 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet e70d3c77a75d4aacb85bfaec774147e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:46.665500 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet e70d3c77a75d4aacb85bfaec774147e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:46.668229 10370 tablet_bootstrap.cc:654] T b3f52e1f94054c48859b0fe46d0908d2 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.668282 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet e70d3c77a75d4aacb85bfaec774147e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:46.668388 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ee1e8ddb1a5441d6a4386715abbf552a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.669081 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee1e8ddb1a5441d6a4386715abbf552a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.669750 10366 tablet_bootstrap.cc:492] T f871e89a900b4e79a2b4ebb31ff80003 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:46.671614 10366 tablet_bootstrap.cc:654] T f871e89a900b4e79a2b4ebb31ff80003 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.673211 10375 tablet_replica.cc:333] T 6a51f407c3c6466e83f491b98f44ff84 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:46.673471 10375 raft_consensus.cc:2243] T 6a51f407c3c6466e83f491b98f44ff84 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:46.673660 10375 raft_consensus.cc:2272] T 6a51f407c3c6466e83f491b98f44ff84 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:46.673832 10377 ts_tablet_manager.cc:1929] T b3f52e1f94054c48859b0fe46d0908d2 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:46.674022 10377 log.cc:1199] T b3f52e1f94054c48859b0fe46d0908d2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/b3f52e1f94054c48859b0fe46d0908d2
I20260810 19:47:46.674516 10371 ts_tablet_manager.cc:1929] T f871e89a900b4e79a2b4ebb31ff80003 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:46.674572 10377 ts_tablet_manager.cc:1950] T b3f52e1f94054c48859b0fe46d0908d2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:46.674433 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99265c93337b49c1ba4d9ae59c05318b" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:46.674654 10375 ts_tablet_manager.cc:1916] T 6a51f407c3c6466e83f491b98f44ff84 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:46.674692 10371 log.cc:1199] T f871e89a900b4e79a2b4ebb31ff80003 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/f871e89a900b4e79a2b4ebb31ff80003
I20260810 19:47:46.675114 10371 ts_tablet_manager.cc:1950] T f871e89a900b4e79a2b4ebb31ff80003 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
W20260810 19:47:46.675920 9611 leader_election.cc:343] T f871e89a900b4e79a2b4ebb31ff80003 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Not found: Tablet not found: f871e89a900b4e79a2b4ebb31ff80003
I20260810 19:47:46.676074 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet f871e89a900b4e79a2b4ebb31ff80003 (table default.Table_9323129d801c4f3ca77cbcaad34448df [id=5bdb225dea3c4737945f5f249b74dfd1]) successfully deleted
I20260810 19:47:46.676080 9611 leader_election.cc:304] T f871e89a900b4e79a2b4ebb31ff80003 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
W20260810 19:47:46.676554 9611 raft_consensus.cc:2686] T f871e89a900b4e79a2b4ebb31ff80003 P fcd31b1bbb0340cbacfce652b4ad8da4: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260810 19:47:46.677541 9611 leader_election.cc:343] T 99265c93337b49c1ba4d9ae59c05318b P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:46.677706 9611 leader_election.cc:304] T 99265c93337b49c1ba4d9ae59c05318b P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:46.678220 10378 raft_consensus.cc:2749] T 99265c93337b49c1ba4d9ae59c05318b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:46.679704 10367 tablet_bootstrap.cc:492] T 88e511f69694484686f453530d0b7f30 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:46.679924 10367 ts_tablet_manager.cc:1403] T 88e511f69694484686f453530d0b7f30 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.055s user 0.005s sys 0.001s
I20260810 19:47:46.681504 10367 raft_consensus.cc:359] T 88e511f69694484686f453530d0b7f30 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.681754 10367 raft_consensus.cc:385] T 88e511f69694484686f453530d0b7f30 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:46.681836 10367 raft_consensus.cc:740] T 88e511f69694484686f453530d0b7f30 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:46.682253 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 537bcbf01b1d42768996cf5b80c2ae5d
I20260810 19:47:46.682189 10367 consensus_queue.cc:260] T 88e511f69694484686f453530d0b7f30 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.683271 10375 ts_tablet_manager.cc:1929] T 6a51f407c3c6466e83f491b98f44ff84 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:46.683447 10375 log.cc:1199] T 6a51f407c3c6466e83f491b98f44ff84 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/6a51f407c3c6466e83f491b98f44ff84
I20260810 19:47:46.683580 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 537bcbf01b1d42768996cf5b80c2ae5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:46.683899 10375 ts_tablet_manager.cc:1950] T 6a51f407c3c6466e83f491b98f44ff84 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:46.685197 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 537bcbf01b1d42768996cf5b80c2ae5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:46.685339 10367 ts_tablet_manager.cc:1434] T 88e511f69694484686f453530d0b7f30 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260810 19:47:46.685757 10367 tablet_bootstrap.cc:492] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:46.686251 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 537bcbf01b1d42768996cf5b80c2ae5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:46.687326 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 6a51f407c3c6466e83f491b98f44ff84 (table default.Table_6d0fe01100c94447a026749e395525d4 [id=374315d136c94e148f590805b89200a6]) successfully deleted
I20260810 19:47:46.687753 10375 tablet_replica.cc:333] T 88e511f69694484686f453530d0b7f30 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:46.687850 10367 tablet_bootstrap.cc:654] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.687975 10375 raft_consensus.cc:2243] T 88e511f69694484686f453530d0b7f30 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:46.688194 10375 raft_consensus.cc:2272] T 88e511f69694484686f453530d0b7f30 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:46.689090 10375 ts_tablet_manager.cc:1916] T 88e511f69694484686f453530d0b7f30 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:46.689725 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 88e511f69694484686f453530d0b7f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:46.693267 10370 tablet_bootstrap.cc:492] T b3f52e1f94054c48859b0fe46d0908d2 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:46.693454 10370 ts_tablet_manager.cc:1403] T b3f52e1f94054c48859b0fe46d0908d2 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.002s
I20260810 19:47:46.694443 10370 raft_consensus.cc:359] T b3f52e1f94054c48859b0fe46d0908d2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.694687 10370 raft_consensus.cc:385] T b3f52e1f94054c48859b0fe46d0908d2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:46.694805 10370 raft_consensus.cc:740] T b3f52e1f94054c48859b0fe46d0908d2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:46.695094 10370 consensus_queue.cc:260] T b3f52e1f94054c48859b0fe46d0908d2 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.695230 10371 tablet_replica.cc:333] T 99265c93337b49c1ba4d9ae59c05318b P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:46.695447 10371 raft_consensus.cc:2243] T 99265c93337b49c1ba4d9ae59c05318b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:46.695691 10370 ts_tablet_manager.cc:1434] T b3f52e1f94054c48859b0fe46d0908d2 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 19:47:46.695674 10371 raft_consensus.cc:2272] T 99265c93337b49c1ba4d9ae59c05318b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:46.695789 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ec142e3fcbce461e80ff2fb17a1e690b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.696451 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec142e3fcbce461e80ff2fb17a1e690b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.698236 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet b3f52e1f94054c48859b0fe46d0908d2 (table default.Table_3432f5ec7a7f4b948a397a4c118a8f1c [id=654afc1abde94b2b8e2a3c816c8200d8]) successfully deleted
W20260810 19:47:46.698621 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 0d16b53753324290b10e4bdebcd8e243 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d16b53753324290b10e4bdebcd8e243 already in progress: creating tablet
W20260810 19:47:46.698892 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 6a51f407c3c6466e83f491b98f44ff84 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a51f407c3c6466e83f491b98f44ff84 already in progress: creating tablet
W20260810 19:47:46.699134 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet e70d3c77a75d4aacb85bfaec774147e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e70d3c77a75d4aacb85bfaec774147e2 already in progress: creating tablet
I20260810 19:47:46.699211 10371 ts_tablet_manager.cc:1916] T 99265c93337b49c1ba4d9ae59c05318b P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:47:46.699394 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 537bcbf01b1d42768996cf5b80c2ae5d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 537bcbf01b1d42768996cf5b80c2ae5d already in progress: creating tablet
I20260810 19:47:46.702687 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet b3f52e1f94054c48859b0fe46d0908d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:46.703135 10370 tablet_bootstrap.cc:492] T ed5cea610aed4e0aae56cc4888ca6c4d P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:46.705299 10366 tablet_bootstrap.cc:492] T f871e89a900b4e79a2b4ebb31ff80003 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:46.705545 10366 ts_tablet_manager.cc:1403] T f871e89a900b4e79a2b4ebb31ff80003 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.036s user 0.007s sys 0.000s
I20260810 19:47:46.706547 10366 raft_consensus.cc:359] T f871e89a900b4e79a2b4ebb31ff80003 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.706835 10366 raft_consensus.cc:385] T f871e89a900b4e79a2b4ebb31ff80003 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:46.706986 10366 raft_consensus.cc:740] T f871e89a900b4e79a2b4ebb31ff80003 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:46.707355 10366 consensus_queue.cc:260] T f871e89a900b4e79a2b4ebb31ff80003 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.708000 10366 ts_tablet_manager.cc:1434] T f871e89a900b4e79a2b4ebb31ff80003 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:47:46.708824 10370 tablet_bootstrap.cc:654] T ed5cea610aed4e0aae56cc4888ca6c4d P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.710227 10367 tablet_bootstrap.cc:492] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:46.710446 10367 ts_tablet_manager.cc:1403] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.000s
I20260810 19:47:46.711473 10366 tablet_bootstrap.cc:492] T 88e511f69694484686f453530d0b7f30 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:46.713311 10366 tablet_bootstrap.cc:654] T 88e511f69694484686f453530d0b7f30 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.713191 10367 raft_consensus.cc:359] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.713402 10367 raft_consensus.cc:385] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:46.713498 10367 raft_consensus.cc:740] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:46.713837 10367 consensus_queue.cc:260] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.715988 10367 ts_tablet_manager.cc:1434] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260810 19:47:46.716292 10367 tablet_bootstrap.cc:492] T 7481a7e759454f7e989caf7bc4d0788e P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:46.717240 9681 tablet_service.cc:1511] Processing CreateTablet for tablet f495efb5bc9e47f4a353b497b9ae78a8 (DEFAULT_TABLE table=default.Table_f1f332ce5d104c2b889c1faf78a0510f [id=a5becac787b84d398e96784d005d21f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.717710 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f495efb5bc9e47f4a353b497b9ae78a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.718084 10367 tablet_bootstrap.cc:654] T 7481a7e759454f7e989caf7bc4d0788e P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.718837 10375 ts_tablet_manager.cc:1929] T 88e511f69694484686f453530d0b7f30 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:46.718971 10375 log.cc:1199] T 88e511f69694484686f453530d0b7f30 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/88e511f69694484686f453530d0b7f30
I20260810 19:47:46.719340 10375 ts_tablet_manager.cc:1950] T 88e511f69694484686f453530d0b7f30 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:46.721174 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0166430906c04e7fbf172ff0c3ede71f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.721815 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0166430906c04e7fbf172ff0c3ede71f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.722143 10375 tablet_replica.cc:333] T b3f52e1f94054c48859b0fe46d0908d2 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:46.722409 10375 raft_consensus.cc:2243] T b3f52e1f94054c48859b0fe46d0908d2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:46.722625 10375 raft_consensus.cc:2272] T b3f52e1f94054c48859b0fe46d0908d2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:46.723217 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_41a4f12ff0aa41d5aba6c2507de37c0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:46.723817 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41a4f12ff0aa41d5aba6c2507de37c0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.725015 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_bdbce93f86aa466bae793ccc1ac54a6b" } new_table_name: "default.Table_d9e5e24d09d44347bc472ff2f0ba20b6" modify_external_catalogs: true
I20260810 19:47:46.727185 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 994c70f8843e4b0ab744775d357c49c2 (DEFAULT_TABLE table=default.Table_4b9c0a9770784e0d850b9fd5481270e0 [id=88952654dedd4f77870e7f82cac12431]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.727799 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet f871e89a900b4e79a2b4ebb31ff80003 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:46.728024 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 88e511f69694484686f453530d0b7f30 (table default.Table_0228abc6973841f6af303c8a836cc2eb [id=e9aacfa2250843498ca298deebc22a0c]) successfully deleted
W20260810 19:47:46.728046 10030 tablet.cc:2406] T f871e89a900b4e79a2b4ebb31ff80003 P 6986ed920dcb4af29a5eeeda6f671691: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 19:47:46.728299 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet e70d3c77a75d4aacb85bfaec774147e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e70d3c77a75d4aacb85bfaec774147e2 already in progress: creating tablet
W20260810 19:47:46.728550 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 537bcbf01b1d42768996cf5b80c2ae5d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 537bcbf01b1d42768996cf5b80c2ae5d already in progress: creating tablet
I20260810 19:47:46.728601 10375 ts_tablet_manager.cc:1916] T b3f52e1f94054c48859b0fe46d0908d2 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:46.729316 10134 tablet_service.cc:1511] Processing CreateTablet for tablet f495efb5bc9e47f4a353b497b9ae78a8 (DEFAULT_TABLE table=default.Table_f1f332ce5d104c2b889c1faf78a0510f [id=a5becac787b84d398e96784d005d21f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.729807 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f495efb5bc9e47f4a353b497b9ae78a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.729719 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 994c70f8843e4b0ab744775d357c49c2 (DEFAULT_TABLE table=default.Table_4b9c0a9770784e0d850b9fd5481270e0 [id=88952654dedd4f77870e7f82cac12431]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.730139 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 994c70f8843e4b0ab744775d357c49c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.730738 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 994c70f8843e4b0ab744775d357c49c2 (DEFAULT_TABLE table=default.Table_4b9c0a9770784e0d850b9fd5481270e0 [id=88952654dedd4f77870e7f82cac12431]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.730993 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 994c70f8843e4b0ab744775d357c49c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.731307 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 5d4717c6fed24cbfab3f64fcc2c47153 (DEFAULT_TABLE table=default.Table_6084dcfa994e4313896e6f7b5e09953c [id=11015256d39042599eae0f05e96dca2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.734767 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d4717c6fed24cbfab3f64fcc2c47153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.735368 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 994c70f8843e4b0ab744775d357c49c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.738664 9899 tablet_service.cc:1511] Processing CreateTablet for tablet 5d4717c6fed24cbfab3f64fcc2c47153 (DEFAULT_TABLE table=default.Table_6084dcfa994e4313896e6f7b5e09953c [id=11015256d39042599eae0f05e96dca2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.739223 9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d4717c6fed24cbfab3f64fcc2c47153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.740101 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 6ae2df18a03a4e4ea8f0c2302866999c (DEFAULT_TABLE table=default.Table_d3d4ff6a369249fea07d925aa5bfcd23 [id=cb4a2b1054cc4067ba59466503c77f8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.740118 9677 tablet_service.cc:1511] Processing CreateTablet for tablet 5d4717c6fed24cbfab3f64fcc2c47153 (DEFAULT_TABLE table=default.Table_6084dcfa994e4313896e6f7b5e09953c [id=11015256d39042599eae0f05e96dca2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.740556 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d4717c6fed24cbfab3f64fcc2c47153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.740583 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 6ae2df18a03a4e4ea8f0c2302866999c (DEFAULT_TABLE table=default.Table_d3d4ff6a369249fea07d925aa5bfcd23 [id=cb4a2b1054cc4067ba59466503c77f8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.740752 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 6ae2df18a03a4e4ea8f0c2302866999c (DEFAULT_TABLE table=default.Table_d3d4ff6a369249fea07d925aa5bfcd23 [id=cb4a2b1054cc4067ba59466503c77f8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.741071 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae2df18a03a4e4ea8f0c2302866999c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.741169 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae2df18a03a4e4ea8f0c2302866999c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.741860 10371 ts_tablet_manager.cc:1929] T 99265c93337b49c1ba4d9ae59c05318b P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:46.742053 10371 log.cc:1199] T 99265c93337b49c1ba4d9ae59c05318b P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/99265c93337b49c1ba4d9ae59c05318b
I20260810 19:47:46.742528 10371 ts_tablet_manager.cc:1950] T 99265c93337b49c1ba4d9ae59c05318b P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:46.745566 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae2df18a03a4e4ea8f0c2302866999c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.751683 10366 tablet_bootstrap.cc:492] T 88e511f69694484686f453530d0b7f30 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:46.751926 10366 ts_tablet_manager.cc:1403] T 88e511f69694484686f453530d0b7f30 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.041s user 0.007s sys 0.005s
I20260810 19:47:46.753057 10366 raft_consensus.cc:359] T 88e511f69694484686f453530d0b7f30 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.753329 10366 raft_consensus.cc:385] T 88e511f69694484686f453530d0b7f30 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:46.753438 10366 raft_consensus.cc:740] T 88e511f69694484686f453530d0b7f30 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:46.756198 10366 consensus_queue.cc:260] T 88e511f69694484686f453530d0b7f30 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.756803 10366 ts_tablet_manager.cc:1434] T 88e511f69694484686f453530d0b7f30 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 19:47:46.757175 10366 tablet_bootstrap.cc:492] T 1f5eb1b5853046c2a28c46ed19312df7 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:46.759123 10366 tablet_bootstrap.cc:654] T 1f5eb1b5853046c2a28c46ed19312df7 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.767202 9913 tablet_service.cc:1511] Processing CreateTablet for tablet f495efb5bc9e47f4a353b497b9ae78a8 (DEFAULT_TABLE table=default.Table_f1f332ce5d104c2b889c1faf78a0510f [id=a5becac787b84d398e96784d005d21f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.767935 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f495efb5bc9e47f4a353b497b9ae78a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.774189 10375 ts_tablet_manager.cc:1929] T b3f52e1f94054c48859b0fe46d0908d2 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:46.774520 10375 log.cc:1199] T b3f52e1f94054c48859b0fe46d0908d2 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/b3f52e1f94054c48859b0fe46d0908d2
I20260810 19:47:46.774896 10375 ts_tablet_manager.cc:1950] T b3f52e1f94054c48859b0fe46d0908d2 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:46.775583 10366 tablet_bootstrap.cc:492] T 1f5eb1b5853046c2a28c46ed19312df7 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:46.775738 10366 ts_tablet_manager.cc:1403] T 1f5eb1b5853046c2a28c46ed19312df7 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.005s
I20260810 19:47:46.776163 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet b3f52e1f94054c48859b0fe46d0908d2 (table default.Table_3432f5ec7a7f4b948a397a4c118a8f1c [id=654afc1abde94b2b8e2a3c816c8200d8]) successfully deleted
I20260810 19:47:46.776659 10366 raft_consensus.cc:359] T 1f5eb1b5853046c2a28c46ed19312df7 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.776880 10366 raft_consensus.cc:385] T 1f5eb1b5853046c2a28c46ed19312df7 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:46.776980 10366 raft_consensus.cc:740] T 1f5eb1b5853046c2a28c46ed19312df7 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:46.777282 10370 tablet_bootstrap.cc:492] T ed5cea610aed4e0aae56cc4888ca6c4d P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:46.777486 10370 ts_tablet_manager.cc:1403] T ed5cea610aed4e0aae56cc4888ca6c4d P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.074s user 0.009s sys 0.004s
I20260810 19:47:46.778388 10370 raft_consensus.cc:359] T ed5cea610aed4e0aae56cc4888ca6c4d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.778646 10370 raft_consensus.cc:385] T ed5cea610aed4e0aae56cc4888ca6c4d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:46.778716 10370 raft_consensus.cc:740] T ed5cea610aed4e0aae56cc4888ca6c4d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:46.779045 10370 consensus_queue.cc:260] T ed5cea610aed4e0aae56cc4888ca6c4d P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.779165 10366 consensus_queue.cc:260] T 1f5eb1b5853046c2a28c46ed19312df7 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.779609 10370 ts_tablet_manager.cc:1434] T ed5cea610aed4e0aae56cc4888ca6c4d P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:47:46.780575 10366 ts_tablet_manager.cc:1434] T 1f5eb1b5853046c2a28c46ed19312df7 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 19:47:46.780926 10366 tablet_bootstrap.cc:492] T 7481a7e759454f7e989caf7bc4d0788e P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:46.782822 10366 tablet_bootstrap.cc:654] T 7481a7e759454f7e989caf7bc4d0788e P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.784435 10370 tablet_bootstrap.cc:492] T 7481a7e759454f7e989caf7bc4d0788e P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:46.786423 10370 tablet_bootstrap.cc:654] T 7481a7e759454f7e989caf7bc4d0788e P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.764950 10378 raft_consensus.cc:493] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:46.789829 10378 raft_consensus.cc:515] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.790653 10378 leader_election.cc:290] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:46.791071 10371 tablet_replica.cc:333] T 6a51f407c3c6466e83f491b98f44ff84 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:46.791245 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 99265c93337b49c1ba4d9ae59c05318b (table default.Table_d91fb3bbd3c74e48a77dee972fd26bce [id=590c71a2efbd4ae3b579dc1d180e8761]) successfully deleted
I20260810 19:47:46.791430 10371 raft_consensus.cc:2243] T 6a51f407c3c6466e83f491b98f44ff84 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:46.791415 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b27416e1a94ab98e66ad175f9bbbeb" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:46.791899 10371 raft_consensus.cc:2272] T 6a51f407c3c6466e83f491b98f44ff84 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:47:46.792016 9611 leader_election.cc:343] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:46.792740 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b27416e1a94ab98e66ad175f9bbbeb" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:47:46.793390 9611 leader_election.cc:343] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:46.793512 9611 leader_election.cc:304] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:46.793711 10377 tablet_replica.cc:333] T f871e89a900b4e79a2b4ebb31ff80003 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:46.793962 10378 raft_consensus.cc:2749] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:46.794636 10371 ts_tablet_manager.cc:1916] T 6a51f407c3c6466e83f491b98f44ff84 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:46.794008 10377 raft_consensus.cc:2243] T f871e89a900b4e79a2b4ebb31ff80003 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:46.796124 10377 raft_consensus.cc:2272] T f871e89a900b4e79a2b4ebb31ff80003 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:46.796950 10377 ts_tablet_manager.cc:1916] T f871e89a900b4e79a2b4ebb31ff80003 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:46.804121 10366 tablet_bootstrap.cc:492] T 7481a7e759454f7e989caf7bc4d0788e P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:46.804350 10366 ts_tablet_manager.cc:1403] T 7481a7e759454f7e989caf7bc4d0788e P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.000s
I20260810 19:47:46.804926 10371 ts_tablet_manager.cc:1929] T 6a51f407c3c6466e83f491b98f44ff84 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:46.805080 10371 log.cc:1199] T 6a51f407c3c6466e83f491b98f44ff84 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/6a51f407c3c6466e83f491b98f44ff84
I20260810 19:47:46.805258 10366 raft_consensus.cc:359] T 7481a7e759454f7e989caf7bc4d0788e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.805418 10371 ts_tablet_manager.cc:1950] T 6a51f407c3c6466e83f491b98f44ff84 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:46.805493 10366 raft_consensus.cc:385] T 7481a7e759454f7e989caf7bc4d0788e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:46.805569 10366 raft_consensus.cc:740] T 7481a7e759454f7e989caf7bc4d0788e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:46.805585 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b9b9f2dbf2db4c97b9316a35caf74ca9" } new_table_name: "default.Table_b0ed4458615243bebb70678601959f25" modify_external_catalogs: true
I20260810 19:47:46.805887 10366 consensus_queue.cc:260] T 7481a7e759454f7e989caf7bc4d0788e P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.806459 10366 ts_tablet_manager.cc:1434] T 7481a7e759454f7e989caf7bc4d0788e P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:47:46.806815 10366 tablet_bootstrap.cc:492] T 6a51f407c3c6466e83f491b98f44ff84 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:46.807193 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b74fb4e112f74b04ad782941c5f66ba2" } new_table_name: "default.Table_c923c8a480d64717857b0aff31983c9c" modify_external_catalogs: true
I20260810 19:47:46.808823 10366 tablet_bootstrap.cc:654] T 6a51f407c3c6466e83f491b98f44ff84 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.808996 9408 master_service.cc:960] ReplaceTablet: received request to replace tablet 65d2f6fcf0bd4f0e9650e880d305442b from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:46.809419 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e57c84cd8eb94daf9711603419d86cd2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:46.810462 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_47c121b1c8cf4d999324cc090246288b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:46.810861 10370 tablet_bootstrap.cc:492] T 7481a7e759454f7e989caf7bc4d0788e P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:46.811034 10370 ts_tablet_manager.cc:1403] T 7481a7e759454f7e989caf7bc4d0788e P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.007s
I20260810 19:47:46.811933 10370 raft_consensus.cc:359] T 7481a7e759454f7e989caf7bc4d0788e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.812146 10370 raft_consensus.cc:385] T 7481a7e759454f7e989caf7bc4d0788e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:46.812243 10370 raft_consensus.cc:740] T 7481a7e759454f7e989caf7bc4d0788e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:46.812502 10370 consensus_queue.cc:260] T 7481a7e759454f7e989caf7bc4d0788e P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.812755 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet 5d4717c6fed24cbfab3f64fcc2c47153 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:46.813066 10370 ts_tablet_manager.cc:1434] T 7481a7e759454f7e989caf7bc4d0788e P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:47:46.813382 10370 tablet_bootstrap.cc:492] T 99265c93337b49c1ba4d9ae59c05318b P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:46.813771 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 6a51f407c3c6466e83f491b98f44ff84 (table default.Table_6d0fe01100c94447a026749e395525d4 [id=374315d136c94e148f590805b89200a6]) successfully deleted
W20260810 19:47:46.814615 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 0d16b53753324290b10e4bdebcd8e243 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d16b53753324290b10e4bdebcd8e243 already in progress: creating tablet
W20260810 19:47:46.815253 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet e70d3c77a75d4aacb85bfaec774147e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e70d3c77a75d4aacb85bfaec774147e2 already in progress: creating tablet
I20260810 19:47:46.815389 10370 tablet_bootstrap.cc:654] T 99265c93337b49c1ba4d9ae59c05318b P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.815888 10377 ts_tablet_manager.cc:1929] T f871e89a900b4e79a2b4ebb31ff80003 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 19:47:46.815994 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 537bcbf01b1d42768996cf5b80c2ae5d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 537bcbf01b1d42768996cf5b80c2ae5d already in progress: creating tablet
W20260810 19:47:46.816136 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47c121b1c8cf4d999324cc090246288b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.816321 10371 tablet_replica.cc:333] T 88e511f69694484686f453530d0b7f30 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:46.816510 10371 raft_consensus.cc:2243] T 88e511f69694484686f453530d0b7f30 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:46.816691 10371 raft_consensus.cc:2272] T 88e511f69694484686f453530d0b7f30 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:47:46.817317 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e57c84cd8eb94daf9711603419d86cd2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:46.817458 10371 ts_tablet_manager.cc:1916] T 88e511f69694484686f453530d0b7f30 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:46.818217 10377 log.cc:1199] T f871e89a900b4e79a2b4ebb31ff80003 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/f871e89a900b4e79a2b4ebb31ff80003
I20260810 19:47:46.818742 10377 ts_tablet_manager.cc:1950] T f871e89a900b4e79a2b4ebb31ff80003 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:46.820300 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet f871e89a900b4e79a2b4ebb31ff80003 (table default.Table_9323129d801c4f3ca77cbcaad34448df [id=5bdb225dea3c4737945f5f249b74dfd1]) successfully deleted
I20260810 19:47:46.821568 10366 tablet_bootstrap.cc:492] T 6a51f407c3c6466e83f491b98f44ff84 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:46.821787 10366 ts_tablet_manager.cc:1403] T 6a51f407c3c6466e83f491b98f44ff84 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.003s
I20260810 19:47:46.822758 10366 raft_consensus.cc:359] T 6a51f407c3c6466e83f491b98f44ff84 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:46.823028 10366 raft_consensus.cc:385] T 6a51f407c3c6466e83f491b98f44ff84 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:46.823186 10366 raft_consensus.cc:740] T 6a51f407c3c6466e83f491b98f44ff84 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:46.823659 10366 consensus_queue.cc:260] T 6a51f407c3c6466e83f491b98f44ff84 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:46.824277 10366 ts_tablet_manager.cc:1434] T 6a51f407c3c6466e83f491b98f44ff84 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:47:46.824641 10366 tablet_bootstrap.cc:492] T 46d7f9bcff4140c7bad02526befc1a56 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:46.825358 10367 tablet_bootstrap.cc:492] T 7481a7e759454f7e989caf7bc4d0788e P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:46.825563 10367 ts_tablet_manager.cc:1403] T 7481a7e759454f7e989caf7bc4d0788e P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.109s user 0.010s sys 0.019s
I20260810 19:47:46.826529 10367 raft_consensus.cc:359] T 7481a7e759454f7e989caf7bc4d0788e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.826751 10367 raft_consensus.cc:385] T 7481a7e759454f7e989caf7bc4d0788e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:46.826772 10366 tablet_bootstrap.cc:654] T 46d7f9bcff4140c7bad02526befc1a56 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.826838 10367 raft_consensus.cc:740] T 7481a7e759454f7e989caf7bc4d0788e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:46.827105 10367 consensus_queue.cc:260] T 7481a7e759454f7e989caf7bc4d0788e P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.827615 10367 ts_tablet_manager.cc:1434] T 7481a7e759454f7e989caf7bc4d0788e P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 19:47:46.828004 10367 tablet_bootstrap.cc:492] T 1f5eb1b5853046c2a28c46ed19312df7 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:46.834910 10366 tablet_bootstrap.cc:492] T 46d7f9bcff4140c7bad02526befc1a56 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:46.835196 10366 ts_tablet_manager.cc:1403] T 46d7f9bcff4140c7bad02526befc1a56 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.000s
I20260810 19:47:46.836105 10366 raft_consensus.cc:359] T 46d7f9bcff4140c7bad02526befc1a56 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.836400 10366 raft_consensus.cc:385] T 46d7f9bcff4140c7bad02526befc1a56 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:46.836532 10366 raft_consensus.cc:740] T 46d7f9bcff4140c7bad02526befc1a56 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:46.836557 10367 tablet_bootstrap.cc:654] T 1f5eb1b5853046c2a28c46ed19312df7 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.837050 10366 consensus_queue.cc:260] T 46d7f9bcff4140c7bad02526befc1a56 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.839053 10366 ts_tablet_manager.cc:1434] T 46d7f9bcff4140c7bad02526befc1a56 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 19:47:46.840672 9415 master_service.cc:960] ReplaceTablet: received request to replace tablet ed5cea610aed4e0aae56cc4888ca6c4d from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:46.840869 10366 tablet_bootstrap.cc:492] T 99265c93337b49c1ba4d9ae59c05318b P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:46.842881 10366 tablet_bootstrap.cc:654] T 99265c93337b49c1ba4d9ae59c05318b P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.843029 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f5eb1b5853046c2a28c46ed19312df7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:45 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:46.843340 10377 tablet_replica.cc:333] T 1f5eb1b5853046c2a28c46ed19312df7 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:46.843318 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 88e511f69694484686f453530d0b7f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:46.843566 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet 7481a7e759454f7e989caf7bc4d0788e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:46.843564 10377 raft_consensus.cc:2243] T 1f5eb1b5853046c2a28c46ed19312df7 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:46.843791 10377 raft_consensus.cc:2272] T 1f5eb1b5853046c2a28c46ed19312df7 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:46.844624 10377 ts_tablet_manager.cc:1916] T 1f5eb1b5853046c2a28c46ed19312df7 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:46.845029 10370 tablet_bootstrap.cc:492] T 99265c93337b49c1ba4d9ae59c05318b P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:46.845112 10367 tablet_bootstrap.cc:492] T 1f5eb1b5853046c2a28c46ed19312df7 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:46.845218 10370 ts_tablet_manager.cc:1403] T 99265c93337b49c1ba4d9ae59c05318b P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.032s user 0.010s sys 0.015s
I20260810 19:47:46.845257 10367 ts_tablet_manager.cc:1403] T 1f5eb1b5853046c2a28c46ed19312df7 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.001s
I20260810 19:47:46.846058 10367 raft_consensus.cc:359] T 1f5eb1b5853046c2a28c46ed19312df7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.846251 10367 raft_consensus.cc:385] T 1f5eb1b5853046c2a28c46ed19312df7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:46.846376 10367 raft_consensus.cc:740] T 1f5eb1b5853046c2a28c46ed19312df7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:46.846618 10367 consensus_queue.cc:260] T 1f5eb1b5853046c2a28c46ed19312df7 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.846896 10396 raft_consensus.cc:493] T 46d7f9bcff4140c7bad02526befc1a56 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:46.847121 10367 ts_tablet_manager.cc:1434] T 1f5eb1b5853046c2a28c46ed19312df7 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 19:47:46.847146 10396 raft_consensus.cc:515] T 46d7f9bcff4140c7bad02526befc1a56 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.847450 10367 tablet_bootstrap.cc:492] T ed5cea610aed4e0aae56cc4888ca6c4d P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:46.849427 10367 tablet_bootstrap.cc:654] T ed5cea610aed4e0aae56cc4888ca6c4d P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.849370 10396 leader_election.cc:290] T 46d7f9bcff4140c7bad02526befc1a56 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:46.851486 10371 ts_tablet_manager.cc:1929] T 88e511f69694484686f453530d0b7f30 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:46.851629 10371 log.cc:1199] T 88e511f69694484686f453530d0b7f30 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/88e511f69694484686f453530d0b7f30
I20260810 19:47:46.852039 10371 ts_tablet_manager.cc:1950] T 88e511f69694484686f453530d0b7f30 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
W20260810 19:47:46.853180 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4ec0aa595d3c4e388eb7f07717ac4349 has no consensus state
I20260810 19:47:46.855448 9416 master_service.cc:960] ReplaceTablet: received request to replace tablet 5d4717c6fed24cbfab3f64fcc2c47153 from {username='slave'} at 127.0.0.1:56048
W20260810 19:47:46.855960 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7f5f05a042c4670a929d9a826c52667 consensus state has no leader
I20260810 19:47:46.856334 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_fe486cd2688f4cff81fa2103990736dc" } new_table_name: "default.Table_2a994cac12d24a589728d6edb766c2af" modify_external_catalogs: true
I20260810 19:47:46.856432 10370 raft_consensus.cc:359] T 99265c93337b49c1ba4d9ae59c05318b P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.856693 10370 raft_consensus.cc:385] T 99265c93337b49c1ba4d9ae59c05318b P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:46.856761 10370 raft_consensus.cc:740] T 99265c93337b49c1ba4d9ae59c05318b P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:46.857105 10370 consensus_queue.cc:260] T 99265c93337b49c1ba4d9ae59c05318b P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.858059 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ec142e3fcbce461e80ff2fb17a1e690b" } modify_external_catalogs: true
I20260810 19:47:46.858247 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ec142e3fcbce461e80ff2fb17a1e690b" } modify_external_catalogs: true
I20260810 19:47:46.858366 10370 ts_tablet_manager.cc:1434] T 99265c93337b49c1ba4d9ae59c05318b P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260810 19:47:46.858732 10370 tablet_bootstrap.cc:492] T 1f5eb1b5853046c2a28c46ed19312df7 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:46.859110 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_027211c3405146eebb29d662f9be9f77" } new_table_name: "default.Table_d1719a78ecc44b9fab7663d287857196" modify_external_catalogs: true
I20260810 19:47:46.864377 10370 tablet_bootstrap.cc:654] T 1f5eb1b5853046c2a28c46ed19312df7 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.867566 10377 ts_tablet_manager.cc:1929] T 1f5eb1b5853046c2a28c46ed19312df7 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:46.867712 10377 log.cc:1199] T 1f5eb1b5853046c2a28c46ed19312df7 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/1f5eb1b5853046c2a28c46ed19312df7
I20260810 19:47:46.868122 10377 ts_tablet_manager.cc:1950] T 1f5eb1b5853046c2a28c46ed19312df7 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:46.868081 9418 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 39b27416e1a94ab98e66ad175f9bbbeb (table default.Table_1b95ebac5ef2432ea62092ff83c4451d [id=9d3ea0ed528846718fdac913e46fc276]). Expected version 2 got 0
I20260810 19:47:46.868887 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0ba2d519828e48e29bb7af21dcac296e" } modify_external_catalogs: true
I20260810 19:47:46.869083 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0ba2d519828e48e29bb7af21dcac296e" } modify_external_catalogs: true
I20260810 19:47:46.869167 10377 tablet_replica.cc:333] T 88e511f69694484686f453530d0b7f30 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:46.869381 10377 raft_consensus.cc:2243] T 88e511f69694484686f453530d0b7f30 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:46.869549 10377 raft_consensus.cc:2272] T 88e511f69694484686f453530d0b7f30 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:46.870479 10377 ts_tablet_manager.cc:1916] T 88e511f69694484686f453530d0b7f30 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:46.872188 9413 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet ed5cea610aed4e0aae56cc4888ca6c4d (table default.Table_bdbce93f86aa466bae793ccc1ac54a6b [id=d537831ed0b04450bad2bed57f1d3b23]). Expected version 1 got 0
W20260810 19:47:46.872987 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ed5cea610aed4e0aae56cc4888ca6c4d consensus state has no leader
I20260810 19:47:46.874817 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_02491570846c46cf8b1b01467711a2f9" } modify_external_catalogs: true
I20260810 19:47:46.877094 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 9680053712644b4ca33c33031b1ad8bc (DEFAULT_TABLE table=default.Table_ec142e3fcbce461e80ff2fb17a1e690b [id=e6635cbcc8bc40d9b28fcae1ff0c2bef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.877117 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 6d4387725a1843a7a7344d10e956c712 (DEFAULT_TABLE table=default.Table_3b8308e996664215914e49d2819c2309 [id=7e8f45dba2404ef3b48b021b4d08bd3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.877617 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d4387725a1843a7a7344d10e956c712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.877835 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 3a7bb5fcac0a4207b4ee997099777b5b (DEFAULT_TABLE table=default.Table_ee1e8ddb1a5441d6a4386715abbf552a [id=95ba52709d804e93859d24bde3444696]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.877954 10377 ts_tablet_manager.cc:1929] T 88e511f69694484686f453530d0b7f30 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:46.878139 10377 log.cc:1199] T 88e511f69694484686f453530d0b7f30 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/88e511f69694484686f453530d0b7f30
I20260810 19:47:46.878243 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a7bb5fcac0a4207b4ee997099777b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.882709 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 389ed7d4651446869d404fb389d6ce9d (DEFAULT_TABLE table=default.Table_730d817e803a49e180281cc558c18e52 [id=1af6d2ea63b143dbab0acae33421936b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.883181 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 389ed7d4651446869d404fb389d6ce9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.885026 10377 ts_tablet_manager.cc:1950] T 88e511f69694484686f453530d0b7f30 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:46.886193 10377 tablet_replica.cc:333] T 7481a7e759454f7e989caf7bc4d0788e P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:46.886767 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 668b3514d9f64d44a8747647194e50be (DEFAULT_TABLE table=default.Table_027211c3405146eebb29d662f9be9f77 [id=f96d1bbf37954740825d721e6259ce3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.887182 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668b3514d9f64d44a8747647194e50be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.888083 10377 raft_consensus.cc:2243] T 7481a7e759454f7e989caf7bc4d0788e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:46.888310 10377 raft_consensus.cc:2272] T 7481a7e759454f7e989caf7bc4d0788e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:46.890759 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 4ec0aa595d3c4e388eb7f07717ac4349 (DEFAULT_TABLE table=default.Table_b0ed4458615243bebb70678601959f25 [id=18a231579184474c909db279bbba5751]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.891224 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec0aa595d3c4e388eb7f07717ac4349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.895957 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9680053712644b4ca33c33031b1ad8bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.901660 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 1f5eb1b5853046c2a28c46ed19312df7 (table default.Table_5a878853aea546eaa3d67f3fe16fd6a8 [id=8a7d81bb5a844974b4947535d6a3f577]) successfully deleted
I20260810 19:47:46.902294 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 88e511f69694484686f453530d0b7f30 (table default.Table_0228abc6973841f6af303c8a836cc2eb [id=e9aacfa2250843498ca298deebc22a0c]) successfully deleted
I20260810 19:47:46.903877 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 9680053712644b4ca33c33031b1ad8bc (DEFAULT_TABLE table=default.Table_ec142e3fcbce461e80ff2fb17a1e690b [id=e6635cbcc8bc40d9b28fcae1ff0c2bef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.904455 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9680053712644b4ca33c33031b1ad8bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.905055 10366 tablet_bootstrap.cc:492] T 99265c93337b49c1ba4d9ae59c05318b P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:46.905223 10366 ts_tablet_manager.cc:1403] T 99265c93337b49c1ba4d9ae59c05318b P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.066s user 0.000s sys 0.005s
I20260810 19:47:46.906086 10366 raft_consensus.cc:359] T 99265c93337b49c1ba4d9ae59c05318b P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.906299 10366 raft_consensus.cc:385] T 99265c93337b49c1ba4d9ae59c05318b P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:46.906416 10366 raft_consensus.cc:740] T 99265c93337b49c1ba4d9ae59c05318b P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:46.906664 10366 consensus_queue.cc:260] T 99265c93337b49c1ba4d9ae59c05318b P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.906756 9677 tablet_service.cc:1511] Processing CreateTablet for tablet 3a7bb5fcac0a4207b4ee997099777b5b (DEFAULT_TABLE table=default.Table_ee1e8ddb1a5441d6a4386715abbf552a [id=95ba52709d804e93859d24bde3444696]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.907199 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a7bb5fcac0a4207b4ee997099777b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.910768 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 389ed7d4651446869d404fb389d6ce9d (DEFAULT_TABLE table=default.Table_730d817e803a49e180281cc558c18e52 [id=1af6d2ea63b143dbab0acae33421936b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.911264 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 389ed7d4651446869d404fb389d6ce9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.914860 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 668b3514d9f64d44a8747647194e50be (DEFAULT_TABLE table=default.Table_027211c3405146eebb29d662f9be9f77 [id=f96d1bbf37954740825d721e6259ce3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.915385 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668b3514d9f64d44a8747647194e50be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.918823 9685 tablet_service.cc:1511] Processing CreateTablet for tablet 6d4387725a1843a7a7344d10e956c712 (DEFAULT_TABLE table=default.Table_3b8308e996664215914e49d2819c2309 [id=7e8f45dba2404ef3b48b021b4d08bd3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.919185 10366 ts_tablet_manager.cc:1434] T 99265c93337b49c1ba4d9ae59c05318b P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.014s user 0.000s sys 0.002s
I20260810 19:47:46.919289 9685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d4387725a1843a7a7344d10e956c712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.919636 10366 tablet_bootstrap.cc:492] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:46.921646 10366 tablet_bootstrap.cc:654] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.922717 9899 tablet_service.cc:1511] Processing CreateTablet for tablet 3a7bb5fcac0a4207b4ee997099777b5b (DEFAULT_TABLE table=default.Table_ee1e8ddb1a5441d6a4386715abbf552a [id=95ba52709d804e93859d24bde3444696]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.923215 9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a7bb5fcac0a4207b4ee997099777b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.923784 9897 tablet_service.cc:1511] Processing CreateTablet for tablet 389ed7d4651446869d404fb389d6ce9d (DEFAULT_TABLE table=default.Table_730d817e803a49e180281cc558c18e52 [id=1af6d2ea63b143dbab0acae33421936b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.924180 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 389ed7d4651446869d404fb389d6ce9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.926685 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 668b3514d9f64d44a8747647194e50be (DEFAULT_TABLE table=default.Table_027211c3405146eebb29d662f9be9f77 [id=f96d1bbf37954740825d721e6259ce3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.927150 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668b3514d9f64d44a8747647194e50be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.928889 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d7f9bcff4140c7bad02526befc1a56" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:46.930070 9830 leader_election.cc:343] T 46d7f9bcff4140c7bad02526befc1a56 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:46.930683 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 6d4387725a1843a7a7344d10e956c712 (DEFAULT_TABLE table=default.Table_3b8308e996664215914e49d2819c2309 [id=7e8f45dba2404ef3b48b021b4d08bd3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.931123 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d4387725a1843a7a7344d10e956c712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.934700 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 4ec0aa595d3c4e388eb7f07717ac4349 (DEFAULT_TABLE table=default.Table_b0ed4458615243bebb70678601959f25 [id=18a231579184474c909db279bbba5751]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.935217 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec0aa595d3c4e388eb7f07717ac4349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.940191 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a51f407c3c6466e83f491b98f44ff84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:46.940871 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 9680053712644b4ca33c33031b1ad8bc (DEFAULT_TABLE table=default.Table_ec142e3fcbce461e80ff2fb17a1e690b [id=e6635cbcc8bc40d9b28fcae1ff0c2bef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.941363 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9680053712644b4ca33c33031b1ad8bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.940482 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 46d7f9bcff4140c7bad02526befc1a56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:46.903893 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 4ec0aa595d3c4e388eb7f07717ac4349 (DEFAULT_TABLE table=default.Table_b0ed4458615243bebb70678601959f25 [id=18a231579184474c909db279bbba5751]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:46.942535 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec0aa595d3c4e388eb7f07717ac4349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:46.943117 10366 tablet_bootstrap.cc:492] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:46.943305 10366 ts_tablet_manager.cc:1403] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.002s
I20260810 19:47:46.946478 10366 raft_consensus.cc:359] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.946723 10366 raft_consensus.cc:385] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:46.946811 10366 raft_consensus.cc:740] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:46.946790 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 88e511f69694484686f453530d0b7f30 (table default.Table_0228abc6973841f6af303c8a836cc2eb [id=e9aacfa2250843498ca298deebc22a0c]) successfully deleted
I20260810 19:47:46.947062 10366 consensus_queue.cc:260] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:46.953783 10366 ts_tablet_manager.cc:1434] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.010s user 0.002s sys 0.001s
I20260810 19:47:46.957558 10366 tablet_bootstrap.cc:492] T e70d3c77a75d4aacb85bfaec774147e2 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:46.959654 10366 tablet_bootstrap.cc:654] T e70d3c77a75d4aacb85bfaec774147e2 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:46.995704 10366 tablet_bootstrap.cc:492] T e70d3c77a75d4aacb85bfaec774147e2 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:46.995926 10366 ts_tablet_manager.cc:1403] T e70d3c77a75d4aacb85bfaec774147e2 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.006s
I20260810 19:47:46.996876 10366 raft_consensus.cc:359] T e70d3c77a75d4aacb85bfaec774147e2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:46.997105 10366 raft_consensus.cc:385] T e70d3c77a75d4aacb85bfaec774147e2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:46.997200 10366 raft_consensus.cc:740] T e70d3c77a75d4aacb85bfaec774147e2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:46.997439 10366 consensus_queue.cc:260] T e70d3c77a75d4aacb85bfaec774147e2 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.001184 10366 ts_tablet_manager.cc:1434] T e70d3c77a75d4aacb85bfaec774147e2 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260810 19:47:47.003964 10366 tablet_bootstrap.cc:492] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:47.007236 10366 tablet_bootstrap.cc:654] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.021102 10366 tablet_bootstrap.cc:492] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:47.021342 10366 ts_tablet_manager.cc:1403] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.001s
I20260810 19:47:47.022289 10366 raft_consensus.cc:359] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.022552 10366 raft_consensus.cc:385] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.026549 10366 raft_consensus.cc:740] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.027467 10366 consensus_queue.cc:260] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.032065 10366 ts_tablet_manager.cc:1434] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.011s user 0.000s sys 0.003s
I20260810 19:47:47.036674 10366 tablet_bootstrap.cc:492] T ed5cea610aed4e0aae56cc4888ca6c4d P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:47.038729 10366 tablet_bootstrap.cc:654] T ed5cea610aed4e0aae56cc4888ca6c4d P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:47.052500 9400 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet d7f5f05a042c4670a929d9a826c52667 (table default.Table_c923c8a480d64717857b0aff31983c9c [id=683dbf29590844c692a645a7a60715e8], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet d7f5f05a042c4670a929d9a826c52667 consensus state has no leader
I20260810 19:47:47.054553 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 5d4717c6fed24cbfab3f64fcc2c47153
I20260810 19:47:47.054991 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 9680053712644b4ca33c33031b1ad8bc
I20260810 19:47:47.054911 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_02491570846c46cf8b1b01467711a2f9" } modify_external_catalogs: true
I20260810 19:47:47.056730 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 65d2f6fcf0bd4f0e9650e880d305442b
I20260810 19:47:47.057186 9408 catalog_manager.cc:6807] ReplaceTablet: tablet 65d2f6fcf0bd4f0e9650e880d305442b deleted and replaced by tablet 09ab62f482b14cd4b86115e9a0423e7c
I20260810 19:47:47.057614 9408 master_service.cc:960] ReplaceTablet: received request to replace tablet 46d7f9bcff4140c7bad02526befc1a56 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:47.058281 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4b9c0a9770784e0d850b9fd5481270e0" } modify_external_catalogs: true
I20260810 19:47:47.058537 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4b9c0a9770784e0d850b9fd5481270e0" } modify_external_catalogs: true
W20260810 19:47:47.060160 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f9e1f8b7b2d04c56bc89a6b42e60da50 consensus state has no leader
I20260810 19:47:47.060562 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_730d817e803a49e180281cc558c18e52" } modify_external_catalogs: true
I20260810 19:47:47.060760 10366 tablet_bootstrap.cc:492] T ed5cea610aed4e0aae56cc4888ca6c4d P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:47.060756 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_730d817e803a49e180281cc558c18e52" } modify_external_catalogs: true
I20260810 19:47:47.060949 10366 ts_tablet_manager.cc:1403] T ed5cea610aed4e0aae56cc4888ca6c4d P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.002s
I20260810 19:47:47.061112 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet ed5cea610aed4e0aae56cc4888ca6c4d
I20260810 19:47:47.061305 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 4df9d4be6ca042d3957e540d7ef44d8a
I20260810 19:47:47.061640 9415 catalog_manager.cc:6807] ReplaceTablet: tablet ed5cea610aed4e0aae56cc4888ca6c4d deleted and replaced by tablet 3cda6eb6d4b847edb2624a267bc3522d
I20260810 19:47:47.061887 10366 raft_consensus.cc:359] T ed5cea610aed4e0aae56cc4888ca6c4d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.062110 10366 raft_consensus.cc:385] T ed5cea610aed4e0aae56cc4888ca6c4d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.062018 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_4046a81514a14721b29a55155364916b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:47.062206 10366 raft_consensus.cc:740] T ed5cea610aed4e0aae56cc4888ca6c4d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.062096 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_7e36e79580bd4b40a81ca1b62475c0dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:47.062741 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e36e79580bd4b40a81ca1b62475c0dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:47.064221 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 668b3514d9f64d44a8747647194e50be consensus state has no leader
I20260810 19:47:47.064284 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_d700bb1ba5eb405ca7537b12884f0223"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:47.064626 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2adfdcdb33f543d49ea6f361bf8a55c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:47.064862 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d700bb1ba5eb405ca7537b12884f0223 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:47.065192 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2adfdcdb33f543d49ea6f361bf8a55c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:47.066726 10366 consensus_queue.cc:260] T ed5cea610aed4e0aae56cc4888ca6c4d P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.069733 9410 catalog_manager.cc:6807] ReplaceTablet: tablet 5d4717c6fed24cbfab3f64fcc2c47153 deleted and replaced by tablet a9e42e13617c4457ba88ae0e0269ec93
I20260810 19:47:47.070171 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_efa99143f4e842baacfda91408e3179d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:47.070832 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_efa99143f4e842baacfda91408e3179d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:47.070996 10366 ts_tablet_manager.cc:1434] T ed5cea610aed4e0aae56cc4888ca6c4d P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260810 19:47:47.074954 10366 tablet_bootstrap.cc:492] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:47.075295 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 99265c93337b49c1ba4d9ae59c05318b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.075508 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet 9680053712644b4ca33c33031b1ad8bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.075626 10142 tablet_service.cc:1558] Processing DeleteTablet for tablet 7481a7e759454f7e989caf7bc4d0788e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.075722 10139 tablet_service.cc:1558] Processing DeleteTablet for tablet 65d2f6fcf0bd4f0e9650e880d305442b with delete_type TABLET_DATA_DELETED (replaced by tablet 09ab62f482b14cd4b86115e9a0423e7c) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.075838 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d4717c6fed24cbfab3f64fcc2c47153 with delete_type TABLET_DATA_DELETED (replaced by tablet a9e42e13617c4457ba88ae0e0269ec93) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.075937 10128 tablet_service.cc:1558] Processing DeleteTablet for tablet ed5cea610aed4e0aae56cc4888ca6c4d with delete_type TABLET_DATA_DELETED (replaced by tablet 3cda6eb6d4b847edb2624a267bc3522d) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.076121 10375 tablet_replica.cc:333] T 99265c93337b49c1ba4d9ae59c05318b P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:47.076303 10375 raft_consensus.cc:2243] T 99265c93337b49c1ba4d9ae59c05318b P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:47.076527 10375 raft_consensus.cc:2272] T 99265c93337b49c1ba4d9ae59c05318b P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:47.076956 10366 tablet_bootstrap.cc:654] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.077013 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 65d2f6fcf0bd4f0e9650e880d305442b with delete_type TABLET_DATA_DELETED (replaced by tablet 09ab62f482b14cd4b86115e9a0423e7c) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:47.077270 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 4df9d4be6ca042d3957e540d7ef44d8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.077308 9911 tablet_service.cc:1558] Processing DeleteTablet for tablet 4df9d4be6ca042d3957e540d7ef44d8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:47.077574 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet ed5cea610aed4e0aae56cc4888ca6c4d with delete_type TABLET_DATA_DELETED (replaced by tablet 3cda6eb6d4b847edb2624a267bc3522d) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:47.077323 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d4717c6fed24cbfab3f64fcc2c47153 with delete_type TABLET_DATA_DELETED (replaced by tablet a9e42e13617c4457ba88ae0e0269ec93) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:47.078004 10375 ts_tablet_manager.cc:1916] T 99265c93337b49c1ba4d9ae59c05318b P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:47:47.062714 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4046a81514a14721b29a55155364916b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:47.084854 10375 ts_tablet_manager.cc:1929] T 99265c93337b49c1ba4d9ae59c05318b P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:47.085013 10375 log.cc:1199] T 99265c93337b49c1ba4d9ae59c05318b P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/99265c93337b49c1ba4d9ae59c05318b
I20260810 19:47:47.085420 10375 ts_tablet_manager.cc:1950] T 99265c93337b49c1ba4d9ae59c05318b P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:47.086534 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 99265c93337b49c1ba4d9ae59c05318b (table default.Table_d91fb3bbd3c74e48a77dee972fd26bce [id=590c71a2efbd4ae3b579dc1d180e8761]) successfully deleted
W20260810 19:47:47.087354 9395 catalog_manager.cc:5017] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 9680053712644b4ca33c33031b1ad8bc because the tablet was not found. No further retry: Not found: Tablet not found: 9680053712644b4ca33c33031b1ad8bc
I20260810 19:47:47.087754 10375 tablet_replica.cc:333] T 7481a7e759454f7e989caf7bc4d0788e P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:47.088018 10375 raft_consensus.cc:2243] T 7481a7e759454f7e989caf7bc4d0788e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:47.088266 10375 raft_consensus.cc:2272] T 7481a7e759454f7e989caf7bc4d0788e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:47.089212 10375 ts_tablet_manager.cc:1916] T 7481a7e759454f7e989caf7bc4d0788e P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:47.089351 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 9680053712644b4ca33c33031b1ad8bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:47.091100 10366 tablet_bootstrap.cc:492] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:47.091320 10366 ts_tablet_manager.cc:1403] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.004s
I20260810 19:47:47.091966 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 994c70f8843e4b0ab744775d357c49c2
I20260810 19:47:47.092214 10366 raft_consensus.cc:359] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.092423 10366 raft_consensus.cc:385] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.092504 10366 raft_consensus.cc:740] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.093624 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_00c06a91c9354d248755681fa27cf4fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:47.094256 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00c06a91c9354d248755681fa27cf4fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:47.096189 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 994c70f8843e4b0ab744775d357c49c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.096410 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 994c70f8843e4b0ab744775d357c49c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:47.096553 9135 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu
/tmp/dist-test-taskcRGNMp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.235.254:33891
--webserver_interface=127.8.235.254
--webserver_port=33371
--builtin_ntp_servers=127.8.235.212:46393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.235.254:33891,127.8.235.253:37397,127.8.235.252:43301
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260810 19:47:47.101737 10375 ts_tablet_manager.cc:1929] T 7481a7e759454f7e989caf7bc4d0788e P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:47.101917 10375 log.cc:1199] T 7481a7e759454f7e989caf7bc4d0788e P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/7481a7e759454f7e989caf7bc4d0788e
I20260810 19:47:47.102387 10375 ts_tablet_manager.cc:1950] T 7481a7e759454f7e989caf7bc4d0788e P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:47.103802 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 7481a7e759454f7e989caf7bc4d0788e (table default.Table_1a54e5f7520f4f2a9b675e28944d9f6d [id=fd19aa6322f041f38dd88e11224afdbb]) successfully deleted
I20260810 19:47:47.106532 10366 consensus_queue.cc:260] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:47.108938 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 65d2f6fcf0bd4f0e9650e880d305442b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65d2f6fcf0bd4f0e9650e880d305442b already in progress: creating tablet
W20260810 19:47:47.110097 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 5d4717c6fed24cbfab3f64fcc2c47153 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d4717c6fed24cbfab3f64fcc2c47153 already in progress: creating tablet
I20260810 19:47:47.110853 10375 tablet_replica.cc:333] T ed5cea610aed4e0aae56cc4888ca6c4d P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:47.111235 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_7f74fe4e5be248949f2ea2d8e3b628b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:47.111363 10375 raft_consensus.cc:2243] T ed5cea610aed4e0aae56cc4888ca6c4d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:47.111505 10366 ts_tablet_manager.cc:1434] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260810 19:47:47.111580 10375 raft_consensus.cc:2272] T ed5cea610aed4e0aae56cc4888ca6c4d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:47:47.111980 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f74fe4e5be248949f2ea2d8e3b628b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:47.112032 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_8759361d39fb4003a644f53ecd07d2d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:47.112612 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8759361d39fb4003a644f53ecd07d2d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:47.113847 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_72ff6ea7e8804869845ad4866d103346" } new_table_name: "default.Table_2b1afb8ab7154ccb9c116df3d5e9cf5f" modify_external_catalogs: true
I20260810 19:47:47.114881 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ef91fc9d3a8f433fb8aad8f8ed0e8ad3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:47.115442 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef91fc9d3a8f433fb8aad8f8ed0e8ad3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:47.115763 10366 tablet_bootstrap.cc:492] T 65d2f6fcf0bd4f0e9650e880d305442b P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:47.117700 10366 tablet_bootstrap.cc:654] T 65d2f6fcf0bd4f0e9650e880d305442b P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.120409 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3b8308e996664215914e49d2819c2309" } new_table_name: "default.Table_8d6a1f9bb09e4de7807970d6c9479ac5" modify_external_catalogs: true
I20260810 19:47:47.131494 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_130fb9e1e90b4c679e2c0ef4cec28827"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:47.132426 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_130fb9e1e90b4c679e2c0ef4cec28827 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:47.140375 10366 tablet_bootstrap.cc:492] T 65d2f6fcf0bd4f0e9650e880d305442b P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:47.140589 10366 ts_tablet_manager.cc:1403] T 65d2f6fcf0bd4f0e9650e880d305442b P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.025s user 0.007s sys 0.000s
I20260810 19:47:47.141561 10366 raft_consensus.cc:359] T 65d2f6fcf0bd4f0e9650e880d305442b P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.141791 10366 raft_consensus.cc:385] T 65d2f6fcf0bd4f0e9650e880d305442b P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.141928 10366 raft_consensus.cc:740] T 65d2f6fcf0bd4f0e9650e880d305442b P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.145586 9899 tablet_service.cc:1558] Processing DeleteTablet for tablet 99265c93337b49c1ba4d9ae59c05318b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:47.145678 10377 ts_tablet_manager.cc:1916] T 7481a7e759454f7e989caf7bc4d0788e P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:47.145934 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet ed5cea610aed4e0aae56cc4888ca6c4d with delete_type TABLET_DATA_DELETED (replaced by tablet 3cda6eb6d4b847edb2624a267bc3522d) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.146663 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet 4df9d4be6ca042d3957e540d7ef44d8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.146909 9673 tablet_service.cc:1558] Processing DeleteTablet for tablet 9680053712644b4ca33c33031b1ad8bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.147589 10366 consensus_queue.cc:260] T 65d2f6fcf0bd4f0e9650e880d305442b P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
W20260810 19:47:47.147927 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 043f418de5ee493eb2bc43f3bc61e7fa consensus state has no leader
W20260810 19:47:47.149792 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet ed5cea610aed4e0aae56cc4888ca6c4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed5cea610aed4e0aae56cc4888ca6c4d already in progress: creating tablet
W20260810 19:47:47.150082 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 4df9d4be6ca042d3957e540d7ef44d8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4df9d4be6ca042d3957e540d7ef44d8a already in progress: creating tablet
W20260810 19:47:47.150470 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6d4387725a1843a7a7344d10e956c712 consensus state has no leader
W20260810 19:47:47.150496 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 9680053712644b4ca33c33031b1ad8bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9680053712644b4ca33c33031b1ad8bc already in progress: creating tablet
I20260810 19:47:47.150902 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 994c70f8843e4b0ab744775d357c49c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.151145 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d4717c6fed24cbfab3f64fcc2c47153 with delete_type TABLET_DATA_DELETED (replaced by tablet a9e42e13617c4457ba88ae0e0269ec93) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:47.152072 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 994c70f8843e4b0ab744775d357c49c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 994c70f8843e4b0ab744775d357c49c2 already in progress: creating tablet
W20260810 19:47:47.152361 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 5d4717c6fed24cbfab3f64fcc2c47153 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d4717c6fed24cbfab3f64fcc2c47153 already in progress: creating tablet
I20260810 19:47:47.153662 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 65d2f6fcf0bd4f0e9650e880d305442b with delete_type TABLET_DATA_DELETED (replaced by tablet 09ab62f482b14cd4b86115e9a0423e7c) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.153681 10366 ts_tablet_manager.cc:1434] T 65d2f6fcf0bd4f0e9650e880d305442b P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.013s user 0.002s sys 0.001s
W20260810 19:47:47.154479 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 65d2f6fcf0bd4f0e9650e880d305442b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65d2f6fcf0bd4f0e9650e880d305442b already in progress: creating tablet
I20260810 19:47:47.155682 9412 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 39b27416e1a94ab98e66ad175f9bbbeb (table default.Table_1b95ebac5ef2432ea62092ff83c4451d [id=9d3ea0ed528846718fdac913e46fc276]). Expected version 2 got 0
I20260810 19:47:47.156558 9416 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 39b27416e1a94ab98e66ad175f9bbbeb (table default.Table_1b95ebac5ef2432ea62092ff83c4451d [id=9d3ea0ed528846718fdac913e46fc276]). Expected version 2 got 0
I20260810 19:47:47.156541 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 248e8954c46e4328a696f9799604e67f (DEFAULT_TABLE table=default.Table_e57c84cd8eb94daf9711603419d86cd2 [id=558424139ffe43aebb7011b7805574a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.156834 9416 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet d7f5f05a042c4670a929d9a826c52667 (table default.Table_c923c8a480d64717857b0aff31983c9c [id=683dbf29590844c692a645a7a60715e8]). Expected version 3 got 0
I20260810 19:47:47.157006 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 248e8954c46e4328a696f9799604e67f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.157902 10375 ts_tablet_manager.cc:1916] T ed5cea610aed4e0aae56cc4888ca6c4d P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:47.158416 10366 tablet_bootstrap.cc:492] T 537bcbf01b1d42768996cf5b80c2ae5d P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:47.159085 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 7481a7e759454f7e989caf7bc4d0788e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.159188 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet e70d3c77a75d4aacb85bfaec774147e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:47.159372 10371 tablet_replica.cc:333] T 7481a7e759454f7e989caf7bc4d0788e P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:47.159590 10371 raft_consensus.cc:2243] T 7481a7e759454f7e989caf7bc4d0788e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:47.159775 10371 raft_consensus.cc:2272] T 7481a7e759454f7e989caf7bc4d0788e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:47.160476 10366 tablet_bootstrap.cc:654] T 537bcbf01b1d42768996cf5b80c2ae5d P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.160511 10371 ts_tablet_manager.cc:1916] T 7481a7e759454f7e989caf7bc4d0788e P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:47.162142 9416 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet ba8c4420f5e345eeac30c805d673b5e9 (table default.Table_2080a27caba94bd8a8ab66b012cb20e4 [id=c421996810c34ce69ca7c00ed984dc54]). Expected version 2 got 0
I20260810 19:47:47.162498 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 1b0d0eeff07f410eacd8a2d006241cfb
I20260810 19:47:47.163607 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b0d0eeff07f410eacd8a2d006241cfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.165359 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b0d0eeff07f410eacd8a2d006241cfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.165839 10378 raft_consensus.cc:493] T 1f5eb1b5853046c2a28c46ed19312df7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:47.166045 10378 raft_consensus.cc:515] T 1f5eb1b5853046c2a28c46ed19312df7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.166792 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b0d0eeff07f410eacd8a2d006241cfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:47.166862 10378 leader_election.cc:290] T 1f5eb1b5853046c2a28c46ed19312df7 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:47.167702 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5eb1b5853046c2a28c46ed19312df7" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:47.168545 9611 leader_election.cc:343] T 1f5eb1b5853046c2a28c46ed19312df7 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:47.169019 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 389ed7d4651446869d404fb389d6ce9d
I20260810 19:47:47.170135 9675 tablet_service.cc:1511] Processing CreateTablet for tablet d15bcf97364046daa97f7461f4f6bc98 (DEFAULT_TABLE table=default.Table_47c121b1c8cf4d999324cc090246288b [id=e107df18522446d3bcf7bd46e78eb626]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.170161 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 248e8954c46e4328a696f9799604e67f (DEFAULT_TABLE table=default.Table_e57c84cd8eb94daf9711603419d86cd2 [id=558424139ffe43aebb7011b7805574a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.170897 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d15bcf97364046daa97f7461f4f6bc98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.171257 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 389ed7d4651446869d404fb389d6ce9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.171275 9897 tablet_service.cc:1511] Processing CreateTablet for tablet d15bcf97364046daa97f7461f4f6bc98 (DEFAULT_TABLE table=default.Table_47c121b1c8cf4d999324cc090246288b [id=e107df18522446d3bcf7bd46e78eb626]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.171677 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 248e8954c46e4328a696f9799604e67f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.172083 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d15bcf97364046daa97f7461f4f6bc98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.171974 10127 tablet_service.cc:1511] Processing CreateTablet for tablet d15bcf97364046daa97f7461f4f6bc98 (DEFAULT_TABLE table=default.Table_47c121b1c8cf4d999324cc090246288b [id=e107df18522446d3bcf7bd46e78eb626]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.172632 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d15bcf97364046daa97f7461f4f6bc98. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:47.176365 9611 leader_election.cc:343] T 1f5eb1b5853046c2a28c46ed19312df7 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 1f5eb1b5853046c2a28c46ed19312df7
I20260810 19:47:47.176549 9611 leader_election.cc:304] T 1f5eb1b5853046c2a28c46ed19312df7 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:47.177089 10378 raft_consensus.cc:2749] T 1f5eb1b5853046c2a28c46ed19312df7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:47.178970 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 389ed7d4651446869d404fb389d6ce9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.179714 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 204ef31f396a43a5bf06205560f987c9 (DEFAULT_TABLE table=default.Table_0166430906c04e7fbf172ff0c3ede71f [id=4ed93ad00edc4b06ba6b845cfd726631]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.180166 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 204ef31f396a43a5bf06205560f987c9 (DEFAULT_TABLE table=default.Table_0166430906c04e7fbf172ff0c3ede71f [id=4ed93ad00edc4b06ba6b845cfd726631]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.180946 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 204ef31f396a43a5bf06205560f987c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.181098 9899 tablet_service.cc:1558] Processing DeleteTablet for tablet 389ed7d4651446869d404fb389d6ce9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:47.182000 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 204ef31f396a43a5bf06205560f987c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.182083 10375 ts_tablet_manager.cc:1929] T ed5cea610aed4e0aae56cc4888ca6c4d P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:47.182356 10375 log.cc:1199] T ed5cea610aed4e0aae56cc4888ca6c4d P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/ed5cea610aed4e0aae56cc4888ca6c4d
I20260810 19:47:47.183247 10375 ts_tablet_manager.cc:1950] T ed5cea610aed4e0aae56cc4888ca6c4d P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:47.185382 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet ed5cea610aed4e0aae56cc4888ca6c4d (table default.Table_d9e5e24d09d44347bc472ff2f0ba20b6 [id=d537831ed0b04450bad2bed57f1d3b23]) successfully deleted
I20260810 19:47:47.185689 10377 ts_tablet_manager.cc:1929] T 7481a7e759454f7e989caf7bc4d0788e P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:47.185839 10377 log.cc:1199] T 7481a7e759454f7e989caf7bc4d0788e P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/7481a7e759454f7e989caf7bc4d0788e
W20260810 19:47:47.185947 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 4df9d4be6ca042d3957e540d7ef44d8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4df9d4be6ca042d3957e540d7ef44d8a already in progress: creating tablet
W20260810 19:47:47.186498 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 994c70f8843e4b0ab744775d357c49c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 994c70f8843e4b0ab744775d357c49c2 already in progress: creating tablet
W20260810 19:47:47.186748 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 1b0d0eeff07f410eacd8a2d006241cfb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b0d0eeff07f410eacd8a2d006241cfb already in progress: creating tablet
W20260810 19:47:47.187201 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 389ed7d4651446869d404fb389d6ce9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 389ed7d4651446869d404fb389d6ce9d already in progress: creating tablet
I20260810 19:47:47.189188 10371 ts_tablet_manager.cc:1929] T 7481a7e759454f7e989caf7bc4d0788e P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:47.189361 10371 log.cc:1199] T 7481a7e759454f7e989caf7bc4d0788e P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/7481a7e759454f7e989caf7bc4d0788e
I20260810 19:47:47.189713 10371 ts_tablet_manager.cc:1950] T 7481a7e759454f7e989caf7bc4d0788e P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:47.186280 10377 ts_tablet_manager.cc:1950] T 7481a7e759454f7e989caf7bc4d0788e P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:47.191078 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 7481a7e759454f7e989caf7bc4d0788e (table default.Table_1a54e5f7520f4f2a9b675e28944d9f6d [id=fd19aa6322f041f38dd88e11224afdbb]) successfully deleted
I20260810 19:47:47.191361 10370 tablet_bootstrap.cc:492] T 1f5eb1b5853046c2a28c46ed19312df7 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:47.191530 10370 ts_tablet_manager.cc:1403] T 1f5eb1b5853046c2a28c46ed19312df7 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.333s user 0.038s sys 0.067s
I20260810 19:47:47.192377 10370 raft_consensus.cc:359] T 1f5eb1b5853046c2a28c46ed19312df7 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.192579 10370 raft_consensus.cc:385] T 1f5eb1b5853046c2a28c46ed19312df7 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.192693 10370 raft_consensus.cc:740] T 1f5eb1b5853046c2a28c46ed19312df7 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.193115 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 7481a7e759454f7e989caf7bc4d0788e (table default.Table_1a54e5f7520f4f2a9b675e28944d9f6d [id=fd19aa6322f041f38dd88e11224afdbb]) successfully deleted
I20260810 19:47:47.192957 10370 consensus_queue.cc:260] T 1f5eb1b5853046c2a28c46ed19312df7 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.193674 10366 tablet_bootstrap.cc:492] T 537bcbf01b1d42768996cf5b80c2ae5d P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:47.194514 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f5eb1b5853046c2a28c46ed19312df7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:45 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.193846 10366 ts_tablet_manager.cc:1403] T 537bcbf01b1d42768996cf5b80c2ae5d P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.002s
I20260810 19:47:47.194815 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 248e8954c46e4328a696f9799604e67f (DEFAULT_TABLE table=default.Table_e57c84cd8eb94daf9711603419d86cd2 [id=558424139ffe43aebb7011b7805574a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.195497 10370 ts_tablet_manager.cc:1434] T 1f5eb1b5853046c2a28c46ed19312df7 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260810 19:47:47.197963 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f5eb1b5853046c2a28c46ed19312df7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:45 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.198331 10370 tablet_bootstrap.cc:492] T 39b27416e1a94ab98e66ad175f9bbbeb P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:47.198190 10366 raft_consensus.cc:359] T 537bcbf01b1d42768996cf5b80c2ae5d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.198446 10366 raft_consensus.cc:385] T 537bcbf01b1d42768996cf5b80c2ae5d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.198547 10366 raft_consensus.cc:740] T 537bcbf01b1d42768996cf5b80c2ae5d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.198940 10366 consensus_queue.cc:260] T 537bcbf01b1d42768996cf5b80c2ae5d P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.199872 10375 tablet_replica.cc:333] T 1f5eb1b5853046c2a28c46ed19312df7 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:47.200080 10375 raft_consensus.cc:2243] T 1f5eb1b5853046c2a28c46ed19312df7 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:47.200248 10375 raft_consensus.cc:2272] T 1f5eb1b5853046c2a28c46ed19312df7 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:47.201380 10375 ts_tablet_manager.cc:1916] T 1f5eb1b5853046c2a28c46ed19312df7 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:47.202754 10366 ts_tablet_manager.cc:1434] T 537bcbf01b1d42768996cf5b80c2ae5d P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260810 19:47:47.206063 9897 tablet_service.cc:1558] Processing DeleteTablet for tablet 537bcbf01b1d42768996cf5b80c2ae5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:47:47.206516 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 1b0d0eeff07f410eacd8a2d006241cfb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b0d0eeff07f410eacd8a2d006241cfb already in progress: creating tablet
I20260810 19:47:47.207209 10366 tablet_bootstrap.cc:492] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:47.207345 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 248e8954c46e4328a696f9799604e67f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.207732 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d7f9bcff4140c7bad02526befc1a56" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
W20260810 19:47:47.208842 9831 leader_election.cc:343] T 46d7f9bcff4140c7bad02526befc1a56 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:47.209061 9831 leader_election.cc:304] T 46d7f9bcff4140c7bad02526befc1a56 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:47.209242 10377 tablet_replica.cc:333] T 6a51f407c3c6466e83f491b98f44ff84 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:47.209546 10396 raft_consensus.cc:2749] T 46d7f9bcff4140c7bad02526befc1a56 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:47.210090 10377 raft_consensus.cc:2243] T 6a51f407c3c6466e83f491b98f44ff84 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:47.210799 10377 raft_consensus.cc:2272] T 6a51f407c3c6466e83f491b98f44ff84 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:47.211866 10377 ts_tablet_manager.cc:1916] T 6a51f407c3c6466e83f491b98f44ff84 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:47.209064 10366 tablet_bootstrap.cc:654] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:47.213740 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 389ed7d4651446869d404fb389d6ce9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 389ed7d4651446869d404fb389d6ce9d already in progress: creating tablet
I20260810 19:47:47.219374 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 204ef31f396a43a5bf06205560f987c9 (DEFAULT_TABLE table=default.Table_0166430906c04e7fbf172ff0c3ede71f [id=4ed93ad00edc4b06ba6b845cfd726631]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.220021 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 204ef31f396a43a5bf06205560f987c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.220863 10377 ts_tablet_manager.cc:1929] T 6a51f407c3c6466e83f491b98f44ff84 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:47.221057 10377 log.cc:1199] T 6a51f407c3c6466e83f491b98f44ff84 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/6a51f407c3c6466e83f491b98f44ff84
I20260810 19:47:47.221481 10377 ts_tablet_manager.cc:1950] T 6a51f407c3c6466e83f491b98f44ff84 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:47.222667 10377 tablet_replica.cc:333] T 46d7f9bcff4140c7bad02526befc1a56 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:47.222877 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 6a51f407c3c6466e83f491b98f44ff84 (table default.Table_6d0fe01100c94447a026749e395525d4 [id=374315d136c94e148f590805b89200a6]) successfully deleted
I20260810 19:47:47.223529 10377 raft_consensus.cc:2243] T 46d7f9bcff4140c7bad02526befc1a56 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:47.223810 10377 raft_consensus.cc:2272] T 46d7f9bcff4140c7bad02526befc1a56 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:47.224529 10377 ts_tablet_manager.cc:1916] T 46d7f9bcff4140c7bad02526befc1a56 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:47.224978 9684 tablet_service.cc:1511] Processing CreateTablet for tablet a71e3516f97c46f397de42f5c7089eeb (DEFAULT_TABLE table=default.Table_41a4f12ff0aa41d5aba6c2507de37c0f [id=a8bdf6ea608f4279971af4c9eff71db6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.225070 10134 tablet_service.cc:1511] Processing CreateTablet for tablet a71e3516f97c46f397de42f5c7089eeb (DEFAULT_TABLE table=default.Table_41a4f12ff0aa41d5aba6c2507de37c0f [id=a8bdf6ea608f4279971af4c9eff71db6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.225538 10370 tablet_bootstrap.cc:654] T 39b27416e1a94ab98e66ad175f9bbbeb P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.225600 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a71e3516f97c46f397de42f5c7089eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.226398 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a71e3516f97c46f397de42f5c7089eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.228330 10375 ts_tablet_manager.cc:1929] T 1f5eb1b5853046c2a28c46ed19312df7 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:47.228506 10375 log.cc:1199] T 1f5eb1b5853046c2a28c46ed19312df7 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/1f5eb1b5853046c2a28c46ed19312df7
I20260810 19:47:47.228921 10375 ts_tablet_manager.cc:1950] T 1f5eb1b5853046c2a28c46ed19312df7 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:47.229887 10366 tablet_bootstrap.cc:492] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:47.230057 10366 ts_tablet_manager.cc:1403] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.003s
I20260810 19:47:47.230199 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 1f5eb1b5853046c2a28c46ed19312df7 (table default.Table_5a878853aea546eaa3d67f3fe16fd6a8 [id=8a7d81bb5a844974b4947535d6a3f577]) successfully deleted
I20260810 19:47:47.231669 9897 tablet_service.cc:1511] Processing CreateTablet for tablet a71e3516f97c46f397de42f5c7089eeb (DEFAULT_TABLE table=default.Table_41a4f12ff0aa41d5aba6c2507de37c0f [id=a8bdf6ea608f4279971af4c9eff71db6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.232226 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a71e3516f97c46f397de42f5c7089eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.233076 10396 raft_consensus.cc:493] T e70d3c77a75d4aacb85bfaec774147e2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:47.233235 10396 raft_consensus.cc:515] T e70d3c77a75d4aacb85bfaec774147e2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.234043 10396 leader_election.cc:290] T e70d3c77a75d4aacb85bfaec774147e2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:47.234855 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70d3c77a75d4aacb85bfaec774147e2" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:47.235010 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70d3c77a75d4aacb85bfaec774147e2" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
W20260810 19:47:47.235571 9830 leader_election.cc:343] T e70d3c77a75d4aacb85bfaec774147e2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:47.236169 9831 leader_election.cc:343] T e70d3c77a75d4aacb85bfaec774147e2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:47.236389 9831 leader_election.cc:304] T e70d3c77a75d4aacb85bfaec774147e2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:47.236661 10377 ts_tablet_manager.cc:1929] T 46d7f9bcff4140c7bad02526befc1a56 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:47.236759 10396 raft_consensus.cc:2749] T e70d3c77a75d4aacb85bfaec774147e2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:47.236862 10377 log.cc:1199] T 46d7f9bcff4140c7bad02526befc1a56 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/46d7f9bcff4140c7bad02526befc1a56
I20260810 19:47:47.237316 10377 ts_tablet_manager.cc:1950] T 46d7f9bcff4140c7bad02526befc1a56 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:47.238346 10377 tablet_replica.cc:333] T 65d2f6fcf0bd4f0e9650e880d305442b P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:47.238394 10366 raft_consensus.cc:359] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.238569 10377 raft_consensus.cc:2243] T 65d2f6fcf0bd4f0e9650e880d305442b P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:47.238622 10366 raft_consensus.cc:385] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.238737 10377 raft_consensus.cc:2272] T 65d2f6fcf0bd4f0e9650e880d305442b P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:47.238713 10366 raft_consensus.cc:740] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.239053 10366 consensus_queue.cc:260] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.239603 10377 ts_tablet_manager.cc:1916] T 65d2f6fcf0bd4f0e9650e880d305442b P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:47.243800 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 46d7f9bcff4140c7bad02526befc1a56 (table default.Table_52b776d314ed4833b63f0dca563647c7 [id=fb5ae6ab2d20481992a9d0d99186a1cb]) successfully deleted
I20260810 19:47:47.243906 10366 ts_tablet_manager.cc:1434] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.014s user 0.001s sys 0.002s
I20260810 19:47:47.246433 10377 ts_tablet_manager.cc:1929] T 65d2f6fcf0bd4f0e9650e880d305442b P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:47.246706 10377 log.cc:1199] T 65d2f6fcf0bd4f0e9650e880d305442b P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/65d2f6fcf0bd4f0e9650e880d305442b
I20260810 19:47:47.247182 10377 ts_tablet_manager.cc:1950] T 65d2f6fcf0bd4f0e9650e880d305442b P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:47.247663 10366 tablet_bootstrap.cc:492] T 4c9c99ced15c4d3bac2330b8bcf36a26 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:47.248838 10377 tablet_replica.cc:333] T ed5cea610aed4e0aae56cc4888ca6c4d P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:47.249094 10377 raft_consensus.cc:2243] T ed5cea610aed4e0aae56cc4888ca6c4d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:47.249375 10377 raft_consensus.cc:2272] T ed5cea610aed4e0aae56cc4888ca6c4d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:47.249552 10366 tablet_bootstrap.cc:654] T 4c9c99ced15c4d3bac2330b8bcf36a26 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.250089 10370 tablet_bootstrap.cc:492] T 39b27416e1a94ab98e66ad175f9bbbeb P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:47.250505 10377 ts_tablet_manager.cc:1916] T ed5cea610aed4e0aae56cc4888ca6c4d P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:47.250458 10370 ts_tablet_manager.cc:1403] T 39b27416e1a94ab98e66ad175f9bbbeb P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.055s user 0.005s sys 0.000s
I20260810 19:47:47.252252 10370 raft_consensus.cc:359] T 39b27416e1a94ab98e66ad175f9bbbeb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.252676 10370 raft_consensus.cc:385] T 39b27416e1a94ab98e66ad175f9bbbeb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.252949 10370 raft_consensus.cc:740] T 39b27416e1a94ab98e66ad175f9bbbeb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.253520 10370 consensus_queue.cc:260] T 39b27416e1a94ab98e66ad175f9bbbeb P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.255371 10367 tablet_bootstrap.cc:492] T ed5cea610aed4e0aae56cc4888ca6c4d P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:47.255637 10367 ts_tablet_manager.cc:1403] T ed5cea610aed4e0aae56cc4888ca6c4d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.408s user 0.102s sys 0.163s
I20260810 19:47:47.256572 10367 raft_consensus.cc:359] T ed5cea610aed4e0aae56cc4888ca6c4d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.257098 10367 raft_consensus.cc:385] T ed5cea610aed4e0aae56cc4888ca6c4d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.257242 10367 raft_consensus.cc:740] T ed5cea610aed4e0aae56cc4888ca6c4d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.256992 10371 tablet_replica.cc:333] T 1f5eb1b5853046c2a28c46ed19312df7 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:47.257707 10371 raft_consensus.cc:2243] T 1f5eb1b5853046c2a28c46ed19312df7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:47.257716 10377 ts_tablet_manager.cc:1929] T ed5cea610aed4e0aae56cc4888ca6c4d P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:47.257856 10377 log.cc:1199] T ed5cea610aed4e0aae56cc4888ca6c4d P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/ed5cea610aed4e0aae56cc4888ca6c4d
I20260810 19:47:47.258502 10377 ts_tablet_manager.cc:1950] T ed5cea610aed4e0aae56cc4888ca6c4d P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:47.259272 10371 raft_consensus.cc:2272] T 1f5eb1b5853046c2a28c46ed19312df7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:47.258920 10367 consensus_queue.cc:260] T ed5cea610aed4e0aae56cc4888ca6c4d P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.260507 10366 tablet_bootstrap.cc:492] T 4c9c99ced15c4d3bac2330b8bcf36a26 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:47.260702 10366 ts_tablet_manager.cc:1403] T 4c9c99ced15c4d3bac2330b8bcf36a26 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260810 19:47:47.260779 10377 tablet_replica.cc:333] T 99265c93337b49c1ba4d9ae59c05318b P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:47.260978 10377 raft_consensus.cc:2243] T 99265c93337b49c1ba4d9ae59c05318b P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:47.261137 10377 raft_consensus.cc:2272] T 99265c93337b49c1ba4d9ae59c05318b P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:47.261783 10366 raft_consensus.cc:359] T 4c9c99ced15c4d3bac2330b8bcf36a26 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.262001 10366 raft_consensus.cc:385] T 4c9c99ced15c4d3bac2330b8bcf36a26 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.262045 10377 ts_tablet_manager.cc:1916] T 99265c93337b49c1ba4d9ae59c05318b P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:47.262087 10366 raft_consensus.cc:740] T 4c9c99ced15c4d3bac2330b8bcf36a26 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.262396 10366 consensus_queue.cc:260] T 4c9c99ced15c4d3bac2330b8bcf36a26 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.263811 10370 ts_tablet_manager.cc:1434] T 39b27416e1a94ab98e66ad175f9bbbeb P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260810 19:47:47.264578 10396 raft_consensus.cc:493] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:47.264732 10396 raft_consensus.cc:515] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.265357 10396 leader_election.cc:290] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:47.266386 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet ed5cea610aed4e0aae56cc4888ca6c4d with delete_type TABLET_DATA_DELETED (replaced by tablet 3cda6eb6d4b847edb2624a267bc3522d) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.248364 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 65d2f6fcf0bd4f0e9650e880d305442b (table default.Table_a76a0ccd7c9c473781c4ce3cabb2112d [id=4fda913821434991b62c8de128735a25]) successfully deleted
I20260810 19:47:47.267107 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba8c4420f5e345eeac30c805d673b5e9" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:47.267428 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 4df9d4be6ca042d3957e540d7ef44d8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4df9d4be6ca042d3957e540d7ef44d8a already in progress: creating tablet
I20260810 19:47:47.267691 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet ed5cea610aed4e0aae56cc4888ca6c4d (table default.Table_d9e5e24d09d44347bc472ff2f0ba20b6 [id=d537831ed0b04450bad2bed57f1d3b23]) successfully deleted
W20260810 19:47:47.267976 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 5d4717c6fed24cbfab3f64fcc2c47153 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d4717c6fed24cbfab3f64fcc2c47153 already in progress: creating tablet
I20260810 19:47:47.268111 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba8c4420f5e345eeac30c805d673b5e9" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
W20260810 19:47:47.268157 9830 leader_election.cc:343] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:47.268194 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 9680053712644b4ca33c33031b1ad8bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9680053712644b4ca33c33031b1ad8bc already in progress: creating tablet
W20260810 19:47:47.268445 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 994c70f8843e4b0ab744775d357c49c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 994c70f8843e4b0ab744775d357c49c2 already in progress: creating tablet
I20260810 19:47:47.268772 10370 tablet_bootstrap.cc:492] T d7f5f05a042c4670a929d9a826c52667 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:47:47.268891 9831 leader_election.cc:343] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:47.269011 9831 leader_election.cc:304] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:47.269629 10367 ts_tablet_manager.cc:1434] T ed5cea610aed4e0aae56cc4888ca6c4d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260810 19:47:47.267064 10371 ts_tablet_manager.cc:1916] T 1f5eb1b5853046c2a28c46ed19312df7 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:47.270339 10396 raft_consensus.cc:2749] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:47.270991 10366 ts_tablet_manager.cc:1434] T 4c9c99ced15c4d3bac2330b8bcf36a26 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260810 19:47:47.271850 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_00c06a91c9354d248755681fa27cf4fe" } modify_external_catalogs: true
I20260810 19:47:47.272068 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_00c06a91c9354d248755681fa27cf4fe" } modify_external_catalogs: true
I20260810 19:47:47.272313 10366 tablet_bootstrap.cc:492] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:47.272667 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d3d4ff6a369249fea07d925aa5bfcd23" } modify_external_catalogs: true
I20260810 19:47:47.272835 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d3d4ff6a369249fea07d925aa5bfcd23" } modify_external_catalogs: true
I20260810 19:47:47.273451 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c923c8a480d64717857b0aff31983c9c" } new_table_name: "default.Table_471b38d37f9d42fab33e3873f34d52a9" modify_external_catalogs: true
I20260810 19:47:47.274950 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a76a0ccd7c9c473781c4ce3cabb2112d" } new_table_name: "default.Table_5af45f52e4024048836c48234ef3a903" modify_external_catalogs: true
I20260810 19:47:47.275074 10366 tablet_bootstrap.cc:654] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.275503 10367 tablet_bootstrap.cc:492] T 46d7f9bcff4140c7bad02526befc1a56 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:47.281534 10367 tablet_bootstrap.cc:654] T 46d7f9bcff4140c7bad02526befc1a56 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.281680 10370 tablet_bootstrap.cc:654] T d7f5f05a042c4670a929d9a826c52667 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.284085 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7f74fe4e5be248949f2ea2d8e3b628b1" } new_table_name: "default.Table_80341f42384e4e1fa901ac2ef18d3f13" modify_external_catalogs: true
I20260810 19:47:47.286291 10371 ts_tablet_manager.cc:1929] T 1f5eb1b5853046c2a28c46ed19312df7 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:47.293394 10371 log.cc:1199] T 1f5eb1b5853046c2a28c46ed19312df7 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/1f5eb1b5853046c2a28c46ed19312df7
I20260810 19:47:47.294060 10371 ts_tablet_manager.cc:1950] T 1f5eb1b5853046c2a28c46ed19312df7 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:47.295177 9415 master_service.cc:960] ReplaceTablet: received request to replace tablet a71e3516f97c46f397de42f5c7089eeb from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:47.295553 9421 master_service.cc:960] ReplaceTablet: received request to replace tablet 4df9d4be6ca042d3957e540d7ef44d8a from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:47.296473 10370 tablet_bootstrap.cc:492] T d7f5f05a042c4670a929d9a826c52667 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:47.296666 10370 ts_tablet_manager.cc:1403] T d7f5f05a042c4670a929d9a826c52667 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.006s
W20260810 19:47:47.296669 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 09ab62f482b14cd4b86115e9a0423e7c has no consensus state
I20260810 19:47:47.296638 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 1f5eb1b5853046c2a28c46ed19312df7 (table default.Table_5a878853aea546eaa3d67f3fe16fd6a8 [id=8a7d81bb5a844974b4947535d6a3f577]) successfully deleted
I20260810 19:47:47.297565 10367 tablet_bootstrap.cc:492] T 46d7f9bcff4140c7bad02526befc1a56 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:47.297726 10367 ts_tablet_manager.cc:1403] T 46d7f9bcff4140c7bad02526befc1a56 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.000s
I20260810 19:47:47.297610 10370 raft_consensus.cc:359] T d7f5f05a042c4670a929d9a826c52667 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.297819 10370 raft_consensus.cc:385] T d7f5f05a042c4670a929d9a826c52667 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.297909 10370 raft_consensus.cc:740] T d7f5f05a042c4670a929d9a826c52667 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.298193 10370 consensus_queue.cc:260] T d7f5f05a042c4670a929d9a826c52667 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.298650 10367 raft_consensus.cc:359] T 46d7f9bcff4140c7bad02526befc1a56 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.298857 10367 raft_consensus.cc:385] T 46d7f9bcff4140c7bad02526befc1a56 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.298950 10367 raft_consensus.cc:740] T 46d7f9bcff4140c7bad02526befc1a56 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.299226 10367 consensus_queue.cc:260] T 46d7f9bcff4140c7bad02526befc1a56 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.302490 10370 ts_tablet_manager.cc:1434] T d7f5f05a042c4670a929d9a826c52667 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
W20260810 19:47:47.302996 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7f5f05a042c4670a929d9a826c52667 consensus state has no leader
I20260810 19:47:47.303290 9408 master_service.cc:960] ReplaceTablet: received request to replace tablet a71e3516f97c46f397de42f5c7089eeb from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:47.303684 10367 ts_tablet_manager.cc:1434] T 46d7f9bcff4140c7bad02526befc1a56 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260810 19:47:47.304942 10370 tablet_bootstrap.cc:492] T 46d7f9bcff4140c7bad02526befc1a56 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:47.308094 10367 tablet_bootstrap.cc:492] T 07a7203a875c40e394a00c1ac44874d8 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:47.309996 10371 tablet_replica.cc:333] T ed5cea610aed4e0aae56cc4888ca6c4d P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:47.311298 10370 tablet_bootstrap.cc:654] T 46d7f9bcff4140c7bad02526befc1a56 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.311347 10366 tablet_bootstrap.cc:492] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:47.311513 10366 ts_tablet_manager.cc:1403] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.000s
I20260810 19:47:47.312459 10366 raft_consensus.cc:359] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.312683 10366 raft_consensus.cc:385] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.312773 10366 raft_consensus.cc:740] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.313135 10366 consensus_queue.cc:260] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.313553 10377 ts_tablet_manager.cc:1929] T 99265c93337b49c1ba4d9ae59c05318b P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:47.313964 10377 log.cc:1199] T 99265c93337b49c1ba4d9ae59c05318b P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/99265c93337b49c1ba4d9ae59c05318b
I20260810 19:47:47.314375 10377 ts_tablet_manager.cc:1950] T 99265c93337b49c1ba4d9ae59c05318b P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:47.315578 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 99265c93337b49c1ba4d9ae59c05318b (table default.Table_d91fb3bbd3c74e48a77dee972fd26bce [id=590c71a2efbd4ae3b579dc1d180e8761]) successfully deleted
I20260810 19:47:47.316928 10366 ts_tablet_manager.cc:1434] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260810 19:47:47.318632 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1b95ebac5ef2432ea62092ff83c4451d" } modify_external_catalogs: true
I20260810 19:47:47.318831 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1b95ebac5ef2432ea62092ff83c4451d" } modify_external_catalogs: true
I20260810 19:47:47.319736 10366 tablet_bootstrap.cc:492] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:47.319752 9421 master_service.cc:960] ReplaceTablet: received request to replace tablet 6ae2df18a03a4e4ea8f0c2302866999c from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:47.321650 10366 tablet_bootstrap.cc:654] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.324281 10366 tablet_bootstrap.cc:492] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:47.324311 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet f495efb5bc9e47f4a353b497b9ae78a8 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:47.324476 10366 ts_tablet_manager.cc:1403] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260810 19:47:47.325337 10366 raft_consensus.cc:359] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.325706 10366 raft_consensus.cc:385] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.323025 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet 46d7f9bcff4140c7bad02526befc1a56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.325798 10366 raft_consensus.cc:740] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.326107 10366 consensus_queue.cc:260] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.327557 10371 raft_consensus.cc:2243] T ed5cea610aed4e0aae56cc4888ca6c4d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:47.330642 10371 raft_consensus.cc:2272] T ed5cea610aed4e0aae56cc4888ca6c4d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:47.331166 10367 tablet_bootstrap.cc:654] T 07a7203a875c40e394a00c1ac44874d8 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.331722 10370 tablet_bootstrap.cc:492] T 46d7f9bcff4140c7bad02526befc1a56 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:47.331909 10370 ts_tablet_manager.cc:1403] T 46d7f9bcff4140c7bad02526befc1a56 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.001s
I20260810 19:47:47.333895 10366 ts_tablet_manager.cc:1434] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260810 19:47:47.337203 9407 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 043f418de5ee493eb2bc43f3bc61e7fa (table default.Table_2b1afb8ab7154ccb9c116df3d5e9cf5f [id=d0343c1dbf284737b5183387c8ef1483]). Expected version 1 got 0
I20260810 19:47:47.337764 9897 tablet_service.cc:1511] Processing CreateTablet for tablet 9e09483838f0459da3041ee4fe5d55cc (DEFAULT_TABLE table=default.Table_ef91fc9d3a8f433fb8aad8f8ed0e8ad3 [id=fd840f00bdc5477aaad0b7fa114870dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.338268 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e09483838f0459da3041ee4fe5d55cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.338559 9413 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 39b27416e1a94ab98e66ad175f9bbbeb (table default.Table_1b95ebac5ef2432ea62092ff83c4451d [id=9d3ea0ed528846718fdac913e46fc276]). Expected version 2 got 0
I20260810 19:47:47.341950 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 9e09483838f0459da3041ee4fe5d55cc (DEFAULT_TABLE table=default.Table_ef91fc9d3a8f433fb8aad8f8ed0e8ad3 [id=fd840f00bdc5477aaad0b7fa114870dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.342516 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e09483838f0459da3041ee4fe5d55cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.343982 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 8851f5c0c2fd4600bb99793ddd151daa (DEFAULT_TABLE table=default.Table_7f74fe4e5be248949f2ea2d8e3b628b1 [id=503738899b2347aaae2c2645ce8a930d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.344449 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8851f5c0c2fd4600bb99793ddd151daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.346662 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 5f0d4ce494b4459eb05716d6e62d7a09 (DEFAULT_TABLE table=default.Table_00c06a91c9354d248755681fa27cf4fe [id=6e28810aef52474fbe2a51e601877ab6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.347079 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0d4ce494b4459eb05716d6e62d7a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.349349 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 5f0d4ce494b4459eb05716d6e62d7a09 (DEFAULT_TABLE table=default.Table_00c06a91c9354d248755681fa27cf4fe [id=6e28810aef52474fbe2a51e601877ab6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.349778 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0d4ce494b4459eb05716d6e62d7a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.350504 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 176d4e72b8e44e4b88bdf89d06f2f79a (DEFAULT_TABLE table=default.Table_4046a81514a14721b29a55155364916b [id=09fa54104d0f46dbb3f19138bfa2313d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.350728 10145 tablet_service.cc:1511] Processing CreateTablet for tablet c5625c6f78f14d629bcd7f8c9522c4ba (DEFAULT_TABLE table=default.Table_d700bb1ba5eb405ca7537b12884f0223 [id=3ec1bdaeba584422a569a6f070344b6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.351136 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 176d4e72b8e44e4b88bdf89d06f2f79a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.351140 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5625c6f78f14d629bcd7f8c9522c4ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.354676 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 0efa6f35ed284933b9fc53c1cb32da82 (DEFAULT_TABLE table=default.Table_7e36e79580bd4b40a81ca1b62475c0dc [id=e8a45897ddcf4bd2a31db1b1d8f6ee12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.354976 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 176d4e72b8e44e4b88bdf89d06f2f79a (DEFAULT_TABLE table=default.Table_4046a81514a14721b29a55155364916b [id=09fa54104d0f46dbb3f19138bfa2313d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.355115 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0efa6f35ed284933b9fc53c1cb32da82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.355356 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 176d4e72b8e44e4b88bdf89d06f2f79a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.356395 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 2ddeefaa826b4033b2e79eff7240887f (DEFAULT_TABLE table=default.Table_2adfdcdb33f543d49ea6f361bf8a55c4 [id=cfd27e7efc8f4c529e7dace21742b656]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.356805 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ddeefaa826b4033b2e79eff7240887f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.357373 9681 tablet_service.cc:1511] Processing CreateTablet for tablet c5625c6f78f14d629bcd7f8c9522c4ba (DEFAULT_TABLE table=default.Table_d700bb1ba5eb405ca7537b12884f0223 [id=3ec1bdaeba584422a569a6f070344b6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.357777 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5625c6f78f14d629bcd7f8c9522c4ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.358902 9685 tablet_service.cc:1511] Processing CreateTablet for tablet 0efa6f35ed284933b9fc53c1cb32da82 (DEFAULT_TABLE table=default.Table_7e36e79580bd4b40a81ca1b62475c0dc [id=e8a45897ddcf4bd2a31db1b1d8f6ee12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.359293 9685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0efa6f35ed284933b9fc53c1cb32da82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.335716 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 9e09483838f0459da3041ee4fe5d55cc (DEFAULT_TABLE table=default.Table_ef91fc9d3a8f433fb8aad8f8ed0e8ad3 [id=fd840f00bdc5477aaad0b7fa114870dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.366214 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e09483838f0459da3041ee4fe5d55cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.336181 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 8851f5c0c2fd4600bb99793ddd151daa (DEFAULT_TABLE table=default.Table_7f74fe4e5be248949f2ea2d8e3b628b1 [id=503738899b2347aaae2c2645ce8a930d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.366760 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8851f5c0c2fd4600bb99793ddd151daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.366909 10370 raft_consensus.cc:359] T 46d7f9bcff4140c7bad02526befc1a56 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.367130 10370 raft_consensus.cc:385] T 46d7f9bcff4140c7bad02526befc1a56 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.367198 10370 raft_consensus.cc:740] T 46d7f9bcff4140c7bad02526befc1a56 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.367461 10370 consensus_queue.cc:260] T 46d7f9bcff4140c7bad02526befc1a56 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.369786 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 09ab62f482b14cd4b86115e9a0423e7c (DEFAULT_TABLE table=default.Table_5af45f52e4024048836c48234ef3a903 [id=4fda913821434991b62c8de128735a25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.370193 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09ab62f482b14cd4b86115e9a0423e7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.339138 10371 ts_tablet_manager.cc:1916] T ed5cea610aed4e0aae56cc4888ca6c4d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:47.366214 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 2ddeefaa826b4033b2e79eff7240887f (DEFAULT_TABLE table=default.Table_2adfdcdb33f543d49ea6f361bf8a55c4 [id=cfd27e7efc8f4c529e7dace21742b656]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.374291 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 3cda6eb6d4b847edb2624a267bc3522d (DEFAULT_TABLE table=default.Table_d9e5e24d09d44347bc472ff2f0ba20b6 [id=d537831ed0b04450bad2bed57f1d3b23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.374619 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ddeefaa826b4033b2e79eff7240887f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.375021 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 3cda6eb6d4b847edb2624a267bc3522d (DEFAULT_TABLE table=default.Table_d9e5e24d09d44347bc472ff2f0ba20b6 [id=d537831ed0b04450bad2bed57f1d3b23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.375017 10140 tablet_service.cc:1511] Processing CreateTablet for tablet 651a1f5011de4db495dbbab2d19ff096 (DEFAULT_TABLE table=default.Table_8759361d39fb4003a644f53ecd07d2d1 [id=e10b3ffceb96420494d92992411ff2ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.375411 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cda6eb6d4b847edb2624a267bc3522d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.376106 9687 tablet_service.cc:1511] Processing CreateTablet for tablet a9e42e13617c4457ba88ae0e0269ec93 (DEFAULT_TABLE table=default.Table_6084dcfa994e4313896e6f7b5e09953c [id=11015256d39042599eae0f05e96dca2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.376497 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e42e13617c4457ba88ae0e0269ec93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.379076 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cda6eb6d4b847edb2624a267bc3522d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.382675 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 651a1f5011de4db495dbbab2d19ff096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.387540 10370 ts_tablet_manager.cc:1434] T 46d7f9bcff4140c7bad02526befc1a56 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.056s user 0.001s sys 0.001s
I20260810 19:47:47.388173 10370 tablet_bootstrap.cc:492] T 0d16b53753324290b10e4bdebcd8e243 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:47.390147 10370 tablet_bootstrap.cc:654] T 0d16b53753324290b10e4bdebcd8e243 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.391009 9899 tablet_service.cc:1511] Processing CreateTablet for tablet 5f0d4ce494b4459eb05716d6e62d7a09 (DEFAULT_TABLE table=default.Table_00c06a91c9354d248755681fa27cf4fe [id=6e28810aef52474fbe2a51e601877ab6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.391618 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 09ab62f482b14cd4b86115e9a0423e7c (DEFAULT_TABLE table=default.Table_5af45f52e4024048836c48234ef3a903 [id=4fda913821434991b62c8de128735a25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.392001 10366 tablet_bootstrap.cc:492] T f9e1f8b7b2d04c56bc89a6b42e60da50 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:47.392975 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09ab62f482b14cd4b86115e9a0423e7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.373821 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 651a1f5011de4db495dbbab2d19ff096 (DEFAULT_TABLE table=default.Table_8759361d39fb4003a644f53ecd07d2d1 [id=e10b3ffceb96420494d92992411ff2ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.394598 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 651a1f5011de4db495dbbab2d19ff096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.394822 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 09ab62f482b14cd4b86115e9a0423e7c (DEFAULT_TABLE table=default.Table_5af45f52e4024048836c48234ef3a903 [id=4fda913821434991b62c8de128735a25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.395403 9911 tablet_service.cc:1511] Processing CreateTablet for tablet 651a1f5011de4db495dbbab2d19ff096 (DEFAULT_TABLE table=default.Table_8759361d39fb4003a644f53ecd07d2d1 [id=e10b3ffceb96420494d92992411ff2ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.396257 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a289f25ff60e4733899134f73a70715c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:47.396863 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a289f25ff60e4733899134f73a70715c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:47.398072 9898 tablet_service.cc:1511] Processing CreateTablet for tablet c5625c6f78f14d629bcd7f8c9522c4ba (DEFAULT_TABLE table=default.Table_d700bb1ba5eb405ca7537b12884f0223 [id=3ec1bdaeba584422a569a6f070344b6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.400283 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 8851f5c0c2fd4600bb99793ddd151daa (DEFAULT_TABLE table=default.Table_7f74fe4e5be248949f2ea2d8e3b628b1 [id=503738899b2347aaae2c2645ce8a930d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.400514 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 176d4e72b8e44e4b88bdf89d06f2f79a (DEFAULT_TABLE table=default.Table_4046a81514a14721b29a55155364916b [id=09fa54104d0f46dbb3f19138bfa2313d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.400691 9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0d4ce494b4459eb05716d6e62d7a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.401062 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 0efa6f35ed284933b9fc53c1cb32da82 (DEFAULT_TABLE table=default.Table_7e36e79580bd4b40a81ca1b62475c0dc [id=e8a45897ddcf4bd2a31db1b1d8f6ee12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.401262 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 2ddeefaa826b4033b2e79eff7240887f (DEFAULT_TABLE table=default.Table_2adfdcdb33f543d49ea6f361bf8a55c4 [id=cfd27e7efc8f4c529e7dace21742b656]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.401494 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 3cda6eb6d4b847edb2624a267bc3522d (DEFAULT_TABLE table=default.Table_d9e5e24d09d44347bc472ff2f0ba20b6 [id=d537831ed0b04450bad2bed57f1d3b23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.401544 10396 raft_consensus.cc:493] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:47.401736 10396 raft_consensus.cc:515] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.402690 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 651a1f5011de4db495dbbab2d19ff096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.404346 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ddeefaa826b4033b2e79eff7240887f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.404987 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cda6eb6d4b847edb2624a267bc3522d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.405674 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0efa6f35ed284933b9fc53c1cb32da82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.407687 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b27416e1a94ab98e66ad175f9bbbeb" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:47.407819 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b27416e1a94ab98e66ad175f9bbbeb" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:47.408067 10168 raft_consensus.cc:2468] T 39b27416e1a94ab98e66ad175f9bbbeb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:47.408095 9717 raft_consensus.cc:2468] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:47.408447 10396 leader_election.cc:290] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:47.409144 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 176d4e72b8e44e4b88bdf89d06f2f79a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.409427 10367 tablet_bootstrap.cc:492] T 07a7203a875c40e394a00c1ac44874d8 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:47.409446 10370 tablet_bootstrap.cc:492] T 0d16b53753324290b10e4bdebcd8e243 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
W20260810 19:47:47.409482 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8851f5c0c2fd4600bb99793ddd151daa consensus state has no leader
I20260810 19:47:47.409581 10370 ts_tablet_manager.cc:1403] T 0d16b53753324290b10e4bdebcd8e243 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20260810 19:47:47.409610 10367 ts_tablet_manager.cc:1403] T 07a7203a875c40e394a00c1ac44874d8 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.102s user 0.004s sys 0.000s
I20260810 19:47:47.409896 9831 leader_election.cc:304] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:47.410187 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8851f5c0c2fd4600bb99793ddd151daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.410471 10370 raft_consensus.cc:359] T 0d16b53753324290b10e4bdebcd8e243 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.410449 10367 raft_consensus.cc:359] T 07a7203a875c40e394a00c1ac44874d8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.410638 10370 raft_consensus.cc:385] T 0d16b53753324290b10e4bdebcd8e243 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.410665 10367 raft_consensus.cc:385] T 07a7203a875c40e394a00c1ac44874d8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.410727 10370 raft_consensus.cc:740] T 0d16b53753324290b10e4bdebcd8e243 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.410735 10367 raft_consensus.cc:740] T 07a7203a875c40e394a00c1ac44874d8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.411005 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09ab62f482b14cd4b86115e9a0423e7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.410969 10370 consensus_queue.cc:260] T 0d16b53753324290b10e4bdebcd8e243 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.411023 10367 consensus_queue.cc:260] T 07a7203a875c40e394a00c1ac44874d8 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.411304 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5625c6f78f14d629bcd7f8c9522c4ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.412463 10370 ts_tablet_manager.cc:1434] T 0d16b53753324290b10e4bdebcd8e243 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 19:47:47.412789 10370 tablet_bootstrap.cc:492] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:47.413067 10396 raft_consensus.cc:2804] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:47.413200 10396 raft_consensus.cc:493] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:47.413295 10396 raft_consensus.cc:3060] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:47.414085 10367 ts_tablet_manager.cc:1434] T 07a7203a875c40e394a00c1ac44874d8 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 19:47:47.414685 10367 tablet_bootstrap.cc:492] T ba8c4420f5e345eeac30c805d673b5e9 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:47.414763 10370 tablet_bootstrap.cc:654] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.416640 10367 tablet_bootstrap.cc:654] T ba8c4420f5e345eeac30c805d673b5e9 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.418505 10366 tablet_bootstrap.cc:654] T f9e1f8b7b2d04c56bc89a6b42e60da50 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.419832 9675 tablet_service.cc:1511] Processing CreateTablet for tablet a78f955a3ca946189de7ea96baee35f6 (DEFAULT_TABLE table=default.Table_130fb9e1e90b4c679e2c0ef4cec28827 [id=3225dd83c5dc4e6c9ad6c37794312256]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.420290 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78f955a3ca946189de7ea96baee35f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.421329 9906 tablet_service.cc:1511] Processing CreateTablet for tablet a9e42e13617c4457ba88ae0e0269ec93 (DEFAULT_TABLE table=default.Table_6084dcfa994e4313896e6f7b5e09953c [id=11015256d39042599eae0f05e96dca2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.421811 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e42e13617c4457ba88ae0e0269ec93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.423015 9687 tablet_service.cc:1511] Processing CreateTablet for tablet c1777a713b1d4a58919b5f6abe779ab8 (DEFAULT_TABLE table=default.Table_efa99143f4e842baacfda91408e3179d [id=59935ce778c84929aa6ae71a1e33c63f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.423331 10130 tablet_service.cc:1511] Processing CreateTablet for tablet a78f955a3ca946189de7ea96baee35f6 (DEFAULT_TABLE table=default.Table_130fb9e1e90b4c679e2c0ef4cec28827 [id=3225dd83c5dc4e6c9ad6c37794312256]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.423465 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1777a713b1d4a58919b5f6abe779ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.423853 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78f955a3ca946189de7ea96baee35f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.418084 10371 ts_tablet_manager.cc:1929] T ed5cea610aed4e0aae56cc4888ca6c4d P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:47.429455 10371 log.cc:1199] T ed5cea610aed4e0aae56cc4888ca6c4d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/ed5cea610aed4e0aae56cc4888ca6c4d
I20260810 19:47:47.429979 10371 ts_tablet_manager.cc:1950] T ed5cea610aed4e0aae56cc4888ca6c4d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:47.430914 10140 tablet_service.cc:1511] Processing CreateTablet for tablet c1777a713b1d4a58919b5f6abe779ab8 (DEFAULT_TABLE table=default.Table_efa99143f4e842baacfda91408e3179d [id=59935ce778c84929aa6ae71a1e33c63f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.431372 10370 tablet_bootstrap.cc:492] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:47.431519 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1777a713b1d4a58919b5f6abe779ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.431617 10370 ts_tablet_manager.cc:1403] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260810 19:47:47.432657 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet ed5cea610aed4e0aae56cc4888ca6c4d (table default.Table_d9e5e24d09d44347bc472ff2f0ba20b6 [id=d537831ed0b04450bad2bed57f1d3b23]) successfully deleted
I20260810 19:47:47.432617 10370 raft_consensus.cc:359] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.432850 10370 raft_consensus.cc:385] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.432941 10370 raft_consensus.cc:740] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.433235 10370 consensus_queue.cc:260] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.435461 9896 tablet_service.cc:1511] Processing CreateTablet for tablet a78f955a3ca946189de7ea96baee35f6 (DEFAULT_TABLE table=default.Table_130fb9e1e90b4c679e2c0ef4cec28827 [id=3225dd83c5dc4e6c9ad6c37794312256]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.436060 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78f955a3ca946189de7ea96baee35f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.436920 10370 ts_tablet_manager.cc:1434] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260810 19:47:47.437505 9895 tablet_service.cc:1511] Processing CreateTablet for tablet c1777a713b1d4a58919b5f6abe779ab8 (DEFAULT_TABLE table=default.Table_efa99143f4e842baacfda91408e3179d [id=59935ce778c84929aa6ae71a1e33c63f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.438108 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1777a713b1d4a58919b5f6abe779ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.440021 10371 tablet_replica.cc:333] T 46d7f9bcff4140c7bad02526befc1a56 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:47.439987 10370 tablet_bootstrap.cc:492] T e70d3c77a75d4aacb85bfaec774147e2 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:47.440374 10371 raft_consensus.cc:2243] T 46d7f9bcff4140c7bad02526befc1a56 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:47.440681 10371 raft_consensus.cc:2272] T 46d7f9bcff4140c7bad02526befc1a56 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:47.441653 10371 ts_tablet_manager.cc:1916] T 46d7f9bcff4140c7bad02526befc1a56 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:47.442116 10370 tablet_bootstrap.cc:654] T e70d3c77a75d4aacb85bfaec774147e2 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.443120 10367 tablet_bootstrap.cc:492] T ba8c4420f5e345eeac30c805d673b5e9 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:47.446573 10367 ts_tablet_manager.cc:1403] T ba8c4420f5e345eeac30c805d673b5e9 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.003s
I20260810 19:47:47.447532 10367 raft_consensus.cc:359] T ba8c4420f5e345eeac30c805d673b5e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.447840 10367 raft_consensus.cc:385] T ba8c4420f5e345eeac30c805d673b5e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.447976 10367 raft_consensus.cc:740] T ba8c4420f5e345eeac30c805d673b5e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.448320 10367 consensus_queue.cc:260] T ba8c4420f5e345eeac30c805d673b5e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.451548 10370 tablet_bootstrap.cc:492] T e70d3c77a75d4aacb85bfaec774147e2 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:47.451735 10370 ts_tablet_manager.cc:1403] T e70d3c77a75d4aacb85bfaec774147e2 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.004s
I20260810 19:47:47.452034 10367 ts_tablet_manager.cc:1434] T ba8c4420f5e345eeac30c805d673b5e9 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 19:47:47.453603 10370 raft_consensus.cc:359] T e70d3c77a75d4aacb85bfaec774147e2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.453821 10370 raft_consensus.cc:385] T e70d3c77a75d4aacb85bfaec774147e2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.453908 10370 raft_consensus.cc:740] T e70d3c77a75d4aacb85bfaec774147e2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.454185 10370 consensus_queue.cc:260] T e70d3c77a75d4aacb85bfaec774147e2 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.455200 10367 tablet_bootstrap.cc:492] T d7f5f05a042c4670a929d9a826c52667 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:47.455922 10370 ts_tablet_manager.cc:1434] T e70d3c77a75d4aacb85bfaec774147e2 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 19:47:47.456260 10370 tablet_bootstrap.cc:492] T 07a7203a875c40e394a00c1ac44874d8 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:47.459311 10370 tablet_bootstrap.cc:654] T 07a7203a875c40e394a00c1ac44874d8 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.460626 10367 tablet_bootstrap.cc:654] T d7f5f05a042c4670a929d9a826c52667 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.467978 10371 ts_tablet_manager.cc:1929] T 46d7f9bcff4140c7bad02526befc1a56 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:47.472189 10367 tablet_bootstrap.cc:492] T d7f5f05a042c4670a929d9a826c52667 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:47.473824 10371 log.cc:1199] T 46d7f9bcff4140c7bad02526befc1a56 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/46d7f9bcff4140c7bad02526befc1a56
I20260810 19:47:47.473948 10367 ts_tablet_manager.cc:1403] T d7f5f05a042c4670a929d9a826c52667 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260810 19:47:47.474462 10371 ts_tablet_manager.cc:1950] T 46d7f9bcff4140c7bad02526befc1a56 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:47.474946 10367 raft_consensus.cc:359] T d7f5f05a042c4670a929d9a826c52667 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.475209 10367 raft_consensus.cc:385] T d7f5f05a042c4670a929d9a826c52667 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.475339 10367 raft_consensus.cc:740] T d7f5f05a042c4670a929d9a826c52667 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.475670 10367 consensus_queue.cc:260] T d7f5f05a042c4670a929d9a826c52667 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.475947 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 46d7f9bcff4140c7bad02526befc1a56 (table default.Table_52b776d314ed4833b63f0dca563647c7 [id=fb5ae6ab2d20481992a9d0d99186a1cb]) successfully deleted
I20260810 19:47:47.476230 10367 ts_tablet_manager.cc:1434] T d7f5f05a042c4670a929d9a826c52667 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 19:47:47.476577 10367 tablet_bootstrap.cc:492] T e70d3c77a75d4aacb85bfaec774147e2 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:47.478446 10367 tablet_bootstrap.cc:654] T e70d3c77a75d4aacb85bfaec774147e2 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.481706 10396 raft_consensus.cc:515] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.483240 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b27416e1a94ab98e66ad175f9bbbeb" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:47.483500 9717 raft_consensus.cc:3060] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:47.486706 10396 leader_election.cc:290] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:47.487721 9717 raft_consensus.cc:2468] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:47.488370 9831 leader_election.cc:304] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:47.489683 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b27416e1a94ab98e66ad175f9bbbeb" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:47.489949 10168 raft_consensus.cc:3060] T 39b27416e1a94ab98e66ad175f9bbbeb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:47.493384 10168 raft_consensus.cc:2468] T 39b27416e1a94ab98e66ad175f9bbbeb P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:47.494833 10367 tablet_bootstrap.cc:492] T e70d3c77a75d4aacb85bfaec774147e2 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:47.495121 10367 ts_tablet_manager.cc:1403] T e70d3c77a75d4aacb85bfaec774147e2 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.005s
I20260810 19:47:47.504326 10367 raft_consensus.cc:359] T e70d3c77a75d4aacb85bfaec774147e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.510440 10367 raft_consensus.cc:385] T e70d3c77a75d4aacb85bfaec774147e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.510677 10367 raft_consensus.cc:740] T e70d3c77a75d4aacb85bfaec774147e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.511041 10367 consensus_queue.cc:260] T e70d3c77a75d4aacb85bfaec774147e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.512691 10367 ts_tablet_manager.cc:1434] T e70d3c77a75d4aacb85bfaec774147e2 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260810 19:47:47.513105 10367 tablet_bootstrap.cc:492] T 4c9c99ced15c4d3bac2330b8bcf36a26 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:47.515823 10367 tablet_bootstrap.cc:654] T 4c9c99ced15c4d3bac2330b8bcf36a26 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.518791 10366 tablet_bootstrap.cc:492] T f9e1f8b7b2d04c56bc89a6b42e60da50 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:47.518989 10366 ts_tablet_manager.cc:1403] T f9e1f8b7b2d04c56bc89a6b42e60da50 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.128s user 0.013s sys 0.030s
I20260810 19:47:47.519922 10366 raft_consensus.cc:359] T f9e1f8b7b2d04c56bc89a6b42e60da50 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.520156 10366 raft_consensus.cc:385] T f9e1f8b7b2d04c56bc89a6b42e60da50 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.521126 10366 raft_consensus.cc:740] T f9e1f8b7b2d04c56bc89a6b42e60da50 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.521467 10366 consensus_queue.cc:260] T f9e1f8b7b2d04c56bc89a6b42e60da50 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.520999 10486 raft_consensus.cc:2804] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:47.547881 10396 raft_consensus.cc:493] T 537bcbf01b1d42768996cf5b80c2ae5d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:47.548095 10396 raft_consensus.cc:515] T 537bcbf01b1d42768996cf5b80c2ae5d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.549137 10396 leader_election.cc:290] T 537bcbf01b1d42768996cf5b80c2ae5d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:47.550130 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537bcbf01b1d42768996cf5b80c2ae5d" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
W20260810 19:47:47.550904 9831 leader_election.cc:343] T 537bcbf01b1d42768996cf5b80c2ae5d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:47.551280 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537bcbf01b1d42768996cf5b80c2ae5d" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:47.551959 9830 leader_election.cc:343] T 537bcbf01b1d42768996cf5b80c2ae5d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:47.552114 9830 leader_election.cc:304] T 537bcbf01b1d42768996cf5b80c2ae5d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:47.557602 10128 tablet_service.cc:1511] Processing CreateTablet for tablet a9e42e13617c4457ba88ae0e0269ec93 (DEFAULT_TABLE table=default.Table_6084dcfa994e4313896e6f7b5e09953c [id=11015256d39042599eae0f05e96dca2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.558277 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e42e13617c4457ba88ae0e0269ec93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.561160 10396 raft_consensus.cc:2749] T 537bcbf01b1d42768996cf5b80c2ae5d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:47.575052 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 6ae2df18a03a4e4ea8f0c2302866999c
I20260810 19:47:47.577478 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ae2df18a03a4e4ea8f0c2302866999c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.577862 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 5f0d4ce494b4459eb05716d6e62d7a09
I20260810 19:47:47.578949 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet a71e3516f97c46f397de42f5c7089eeb
I20260810 19:47:47.579409 9415 catalog_manager.cc:6807] ReplaceTablet: tablet a71e3516f97c46f397de42f5c7089eeb deleted and replaced by tablet 4d654dada92a4939914d26ab72a5f5e8
W20260810 19:47:47.581488 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 6ae2df18a03a4e4ea8f0c2302866999c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ae2df18a03a4e4ea8f0c2302866999c already in progress: creating tablet
I20260810 19:47:47.581511 10396 raft_consensus.cc:493] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:47.581699 10396 raft_consensus.cc:515] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.581951 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet a71e3516f97c46f397de42f5c7089eeb with delete_type TABLET_DATA_DELETED (replaced by tablet 4d654dada92a4939914d26ab72a5f5e8) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.582553 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f0d4ce494b4459eb05716d6e62d7a09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.582861 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ae2df18a03a4e4ea8f0c2302866999c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:47.582557 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet a71e3516f97c46f397de42f5c7089eeb with delete_type TABLET_DATA_DELETED (replaced by tablet 4d654dada92a4939914d26ab72a5f5e8) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.582963 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f0d4ce494b4459eb05716d6e62d7a09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.583119 9899 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f0d4ce494b4459eb05716d6e62d7a09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:47:47.583760 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 5f0d4ce494b4459eb05716d6e62d7a09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f0d4ce494b4459eb05716d6e62d7a09 already in progress: creating tablet
W20260810 19:47:47.583958 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet a71e3516f97c46f397de42f5c7089eeb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a71e3516f97c46f397de42f5c7089eeb already in progress: creating tablet
W20260810 19:47:47.584074 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet a71e3516f97c46f397de42f5c7089eeb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a71e3516f97c46f397de42f5c7089eeb already in progress: creating tablet
I20260810 19:47:47.584080 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a7203a875c40e394a00c1ac44874d8" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
W20260810 19:47:47.584231 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 5f0d4ce494b4459eb05716d6e62d7a09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f0d4ce494b4459eb05716d6e62d7a09 already in progress: creating tablet
I20260810 19:47:47.584311 9717 raft_consensus.cc:2468] T 07a7203a875c40e394a00c1ac44874d8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:47.584801 9831 leader_election.cc:304] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:47.584897 10377 tablet_replica.cc:333] T e70d3c77a75d4aacb85bfaec774147e2 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:47.585103 10377 raft_consensus.cc:2243] T e70d3c77a75d4aacb85bfaec774147e2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:47.585191 9899 tablet_service.cc:1558] Processing DeleteTablet for tablet a71e3516f97c46f397de42f5c7089eeb with delete_type TABLET_DATA_DELETED (replaced by tablet 4d654dada92a4939914d26ab72a5f5e8) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:47.585376 10377 raft_consensus.cc:2272] T e70d3c77a75d4aacb85bfaec774147e2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:47.585616 10396 leader_election.cc:290] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:47.585825 10396 raft_consensus.cc:2804] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:47.585978 10396 raft_consensus.cc:493] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:47.586114 10396 raft_consensus.cc:3060] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:47.586175 10377 ts_tablet_manager.cc:1916] T e70d3c77a75d4aacb85bfaec774147e2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:47.589332 10396 raft_consensus.cc:515] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.590395 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a7203a875c40e394a00c1ac44874d8" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:47.591437 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ae2df18a03a4e4ea8f0c2302866999c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:47:47.592332 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 6ae2df18a03a4e4ea8f0c2302866999c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ae2df18a03a4e4ea8f0c2302866999c already in progress: creating tablet
W20260810 19:47:47.591132 9830 leader_election.cc:343] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:47.597429 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a7203a875c40e394a00c1ac44874d8" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:47.597714 9717 raft_consensus.cc:3060] T 07a7203a875c40e394a00c1ac44874d8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:47.599542 10370 tablet_bootstrap.cc:492] T 07a7203a875c40e394a00c1ac44874d8 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:47.599725 10370 ts_tablet_manager.cc:1403] T 07a7203a875c40e394a00c1ac44874d8 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.144s user 0.017s sys 0.023s
I20260810 19:47:47.600539 10370 raft_consensus.cc:359] T 07a7203a875c40e394a00c1ac44874d8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.600749 10370 raft_consensus.cc:385] T 07a7203a875c40e394a00c1ac44874d8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.600849 9717 raft_consensus.cc:2468] T 07a7203a875c40e394a00c1ac44874d8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:47.601837 9831 leader_election.cc:304] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:47.602506 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_143ff27d69cf41a79a51f8e391528ed5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:47.603308 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_143ff27d69cf41a79a51f8e391528ed5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:47.603621 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0c6321a554ff4c1a82855f8178d69454"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:47.604264 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c6321a554ff4c1a82855f8178d69454 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:47.604970 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_bc109c4a41b649f0843393e4184b81be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:47.605566 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_aa6623172834464d8eda5b98fc129eb9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:47.606076 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa6623172834464d8eda5b98fc129eb9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:47.605571 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc109c4a41b649f0843393e4184b81be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:47.608839 10489 raft_consensus.cc:493] T f9e1f8b7b2d04c56bc89a6b42e60da50 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:47.609055 10489 raft_consensus.cc:515] T f9e1f8b7b2d04c56bc89a6b42e60da50 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.612623 10486 raft_consensus.cc:697] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:47:47.613991 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 39b27416e1a94ab98e66ad175f9bbbeb
I20260810 19:47:47.614562 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet f495efb5bc9e47f4a353b497b9ae78a8
I20260810 19:47:47.615018 9410 catalog_manager.cc:6807] ReplaceTablet: tablet f495efb5bc9e47f4a353b497b9ae78a8 deleted and replaced by tablet f2931130e9354f16a238712234c19217
I20260810 19:47:47.616288 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet f495efb5bc9e47f4a353b497b9ae78a8 with delete_type TABLET_DATA_DELETED (replaced by tablet f2931130e9354f16a238712234c19217) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.616714 9420 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 07a7203a875c40e394a00c1ac44874d8 (table default.Table_bf651ef28af14d53b75748d0719a987d [id=d9f804aed5ee40fa90152b6475aea1af]). Expected version 2 got 0
I20260810 19:47:47.617125 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 39b27416e1a94ab98e66ad175f9bbbeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.617322 10488 raft_consensus.cc:493] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:47.617689 10366 ts_tablet_manager.cc:1434] T f9e1f8b7b2d04c56bc89a6b42e60da50 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.095s user 0.003s sys 0.015s
I20260810 19:47:47.617795 9416 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 043f418de5ee493eb2bc43f3bc61e7fa (table default.Table_2b1afb8ab7154ccb9c116df3d5e9cf5f [id=d0343c1dbf284737b5183387c8ef1483]). Expected version 1 got 0
I20260810 19:47:47.618048 9416 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 07a7203a875c40e394a00c1ac44874d8 (table default.Table_bf651ef28af14d53b75748d0719a987d [id=d9f804aed5ee40fa90152b6475aea1af]). Expected version 2 got 0
I20260810 19:47:47.618284 10366 tablet_bootstrap.cc:492] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:47.618779 10375 tablet_replica.cc:333] T 39b27416e1a94ab98e66ad175f9bbbeb P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:47.618971 10375 raft_consensus.cc:2243] T 39b27416e1a94ab98e66ad175f9bbbeb P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:47.619174 10375 raft_consensus.cc:2272] T 39b27416e1a94ab98e66ad175f9bbbeb P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:47.620630 10489 leader_election.cc:290] T f9e1f8b7b2d04c56bc89a6b42e60da50 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:47.621202 10489 raft_consensus.cc:2804] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:47.621253 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 39b27416e1a94ab98e66ad175f9bbbeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.621384 10370 raft_consensus.cc:740] T 07a7203a875c40e394a00c1ac44874d8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.621579 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet f495efb5bc9e47f4a353b497b9ae78a8 with delete_type TABLET_DATA_DELETED (replaced by tablet f2931130e9354f16a238712234c19217) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.621953 10489 raft_consensus.cc:697] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:47:47.622921 10371 tablet_replica.cc:333] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:47.623153 10371 raft_consensus.cc:2243] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:47.623330 10371 raft_consensus.cc:2272] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:47.623301 10370 consensus_queue.cc:260] T 07a7203a875c40e394a00c1ac44874d8 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.623629 10375 ts_tablet_manager.cc:1916] T 39b27416e1a94ab98e66ad175f9bbbeb P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:47.623831 10370 ts_tablet_manager.cc:1434] T 07a7203a875c40e394a00c1ac44874d8 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.024s user 0.001s sys 0.001s
I20260810 19:47:47.623895 10371 ts_tablet_manager.cc:1916] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:47.624212 10370 tablet_bootstrap.cc:492] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:47.617494 10488 raft_consensus.cc:515] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.622244 10489 consensus_queue.cc:237] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.626823 10488 leader_election.cc:290] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:47.627595 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e1f8b7b2d04c56bc89a6b42e60da50" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:47.627635 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a7203a875c40e394a00c1ac44874d8" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:47.627832 10171 raft_consensus.cc:3060] T 07a7203a875c40e394a00c1ac44874d8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:47.631269 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f5f05a042c4670a929d9a826c52667" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:47.631477 10168 raft_consensus.cc:2468] T d7f5f05a042c4670a929d9a826c52667 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:47.632218 10371 ts_tablet_manager.cc:1929] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:47.632383 10371 log.cc:1199] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/39b27416e1a94ab98e66ad175f9bbbeb
I20260810 19:47:47.632746 10371 ts_tablet_manager.cc:1950] T 39b27416e1a94ab98e66ad175f9bbbeb P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:47.632714 10171 raft_consensus.cc:2468] T 07a7203a875c40e394a00c1ac44874d8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:47.632900 10375 ts_tablet_manager.cc:1929] T 39b27416e1a94ab98e66ad175f9bbbeb P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:47.633009 10375 log.cc:1199] T 39b27416e1a94ab98e66ad175f9bbbeb P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/39b27416e1a94ab98e66ad175f9bbbeb
I20260810 19:47:47.633483 10375 ts_tablet_manager.cc:1950] T 39b27416e1a94ab98e66ad175f9bbbeb P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:47.633785 9899 tablet_service.cc:1558] Processing DeleteTablet for tablet 39b27416e1a94ab98e66ad175f9bbbeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:47.633900 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 39b27416e1a94ab98e66ad175f9bbbeb (table default.Table_1b95ebac5ef2432ea62092ff83c4451d [id=9d3ea0ed528846718fdac913e46fc276]) successfully deleted
I20260810 19:47:47.634550 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2b1afb8ab7154ccb9c116df3d5e9cf5f" } new_table_name: "default.Table_3d204c57a3154b73b51379fd4fe89ad7" modify_external_catalogs: true
I20260810 19:47:47.636089 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e5485c974283475aa7a3163163686d38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:47.636698 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e5485c974283475aa7a3163163686d38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:47.638229 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_12b12f4993a449a48336de17e0c39fc1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:47.638803 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12b12f4993a449a48336de17e0c39fc1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:47.639169 10370 tablet_bootstrap.cc:654] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:47.640723 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet f495efb5bc9e47f4a353b497b9ae78a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f495efb5bc9e47f4a353b497b9ae78a8 already in progress: creating tablet
W20260810 19:47:47.641747 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet f495efb5bc9e47f4a353b497b9ae78a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f495efb5bc9e47f4a353b497b9ae78a8 already in progress: creating tablet
I20260810 19:47:47.643028 10367 tablet_bootstrap.cc:492] T 4c9c99ced15c4d3bac2330b8bcf36a26 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:47.643271 10367 ts_tablet_manager.cc:1403] T 4c9c99ced15c4d3bac2330b8bcf36a26 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.130s user 0.028s sys 0.033s
I20260810 19:47:47.643572 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 39b27416e1a94ab98e66ad175f9bbbeb (table default.Table_1b95ebac5ef2432ea62092ff83c4451d [id=9d3ea0ed528846718fdac913e46fc276]) successfully deleted
I20260810 19:47:47.647768 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_bdec8c7d7aec442c8f6e994af3c4e4bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:47.649353 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bdec8c7d7aec442c8f6e994af3c4e4bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:47.650053 10370 tablet_bootstrap.cc:492] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:47.650214 10370 ts_tablet_manager.cc:1403] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.005s
I20260810 19:47:47.651736 10367 raft_consensus.cc:359] T 4c9c99ced15c4d3bac2330b8bcf36a26 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.652100 10367 raft_consensus.cc:385] T 4c9c99ced15c4d3bac2330b8bcf36a26 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.652253 10367 raft_consensus.cc:740] T 4c9c99ced15c4d3bac2330b8bcf36a26 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.652632 10367 consensus_queue.cc:260] T 4c9c99ced15c4d3bac2330b8bcf36a26 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.652886 10370 raft_consensus.cc:359] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.653087 10370 raft_consensus.cc:385] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.653164 10370 raft_consensus.cc:740] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.654618 10367 ts_tablet_manager.cc:1434] T 4c9c99ced15c4d3bac2330b8bcf36a26 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 19:47:47.655056 10367 tablet_bootstrap.cc:492] T 65d2f6fcf0bd4f0e9650e880d305442b P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:47.656522 10370 consensus_queue.cc:260] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.658403 10367 tablet_bootstrap.cc:654] T 65d2f6fcf0bd4f0e9650e880d305442b P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.658761 10370 ts_tablet_manager.cc:1434] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260810 19:47:47.660526 10370 tablet_bootstrap.cc:492] T 65d2f6fcf0bd4f0e9650e880d305442b P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:47.662438 10370 tablet_bootstrap.cc:654] T 65d2f6fcf0bd4f0e9650e880d305442b P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.663066 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3716ce5bda064fe3bc3d27c7b0e61fd7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:47.663827 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3716ce5bda064fe3bc3d27c7b0e61fd7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:47.667439 9830 leader_election.cc:343] T f9e1f8b7b2d04c56bc89a6b42e60da50 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:47.668843 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c9c99ced15c4d3bac2330b8bcf36a26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:47.668828 9830 leader_election.cc:304] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:47.670140 10488 raft_consensus.cc:2804] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:47.670298 10396 leader_election.cc:290] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:47.670661 10488 raft_consensus.cc:493] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:47.670799 10488 raft_consensus.cc:3060] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:47.674417 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet f495efb5bc9e47f4a353b497b9ae78a8 with delete_type TABLET_DATA_DELETED (replaced by tablet f2931130e9354f16a238712234c19217) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:47.613834 10486 consensus_queue.cc:237] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:47.675354 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0bcf4f258fad4bb1a6fd8c6aea3ad22e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:47.675519 10367 tablet_bootstrap.cc:492] T 65d2f6fcf0bd4f0e9650e880d305442b P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:47.675717 10367 ts_tablet_manager.cc:1403] T 65d2f6fcf0bd4f0e9650e880d305442b P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.016s
I20260810 19:47:47.675829 9899 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d16b53753324290b10e4bdebcd8e243 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:47:47.676011 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0bcf4f258fad4bb1a6fd8c6aea3ad22e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:47.676651 10367 raft_consensus.cc:359] T 65d2f6fcf0bd4f0e9650e880d305442b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.676837 10367 raft_consensus.cc:385] T 65d2f6fcf0bd4f0e9650e880d305442b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.676927 10367 raft_consensus.cc:740] T 65d2f6fcf0bd4f0e9650e880d305442b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.677167 10367 consensus_queue.cc:260] T 65d2f6fcf0bd4f0e9650e880d305442b P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.677739 10367 ts_tablet_manager.cc:1434] T 65d2f6fcf0bd4f0e9650e880d305442b P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:47:47.679013 10370 tablet_bootstrap.cc:492] T 65d2f6fcf0bd4f0e9650e880d305442b P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:47.679214 10370 ts_tablet_manager.cc:1403] T 65d2f6fcf0bd4f0e9650e880d305442b P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.003s
I20260810 19:47:47.680429 10370 raft_consensus.cc:359] T 65d2f6fcf0bd4f0e9650e880d305442b P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.680641 10370 raft_consensus.cc:385] T 65d2f6fcf0bd4f0e9650e880d305442b P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.680717 10370 raft_consensus.cc:740] T 65d2f6fcf0bd4f0e9650e880d305442b P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.681056 10370 consensus_queue.cc:260] T 65d2f6fcf0bd4f0e9650e880d305442b P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.682698 10367 tablet_bootstrap.cc:492] T 0d16b53753324290b10e4bdebcd8e243 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:47.685353 10370 ts_tablet_manager.cc:1434] T 65d2f6fcf0bd4f0e9650e880d305442b P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260810 19:47:47.686939 10370 tablet_bootstrap.cc:492] T 4c9c99ced15c4d3bac2330b8bcf36a26 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:47.688268 10367 tablet_bootstrap.cc:654] T 0d16b53753324290b10e4bdebcd8e243 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.689280 10370 tablet_bootstrap.cc:654] T 4c9c99ced15c4d3bac2330b8bcf36a26 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.689574 10366 tablet_bootstrap.cc:654] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.690078 10492 raft_consensus.cc:493] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:47.690267 10492 raft_consensus.cc:515] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.691469 10377 ts_tablet_manager.cc:1929] T e70d3c77a75d4aacb85bfaec774147e2 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:47.691057 10488 raft_consensus.cc:515] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.693790 10488 leader_election.cc:290] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:47.694834 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4046a81514a14721b29a55155364916b" } new_table_name: "default.Table_03fbd70a4ed44530a3fab8f17c0769db" modify_external_catalogs: true
I20260810 19:47:47.696604 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5af45f52e4024048836c48234ef3a903" } modify_external_catalogs: true
I20260810 19:47:47.696806 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5af45f52e4024048836c48234ef3a903" } modify_external_catalogs: true
I20260810 19:47:47.698155 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f5f05a042c4670a929d9a826c52667" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:47.698455 10171 raft_consensus.cc:3060] T d7f5f05a042c4670a929d9a826c52667 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:47.701680 10171 raft_consensus.cc:2468] T d7f5f05a042c4670a929d9a826c52667 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:47.702840 10370 tablet_bootstrap.cc:492] T 4c9c99ced15c4d3bac2330b8bcf36a26 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:47.703027 10370 ts_tablet_manager.cc:1403] T 4c9c99ced15c4d3bac2330b8bcf36a26 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.007s
I20260810 19:47:47.704104 10370 raft_consensus.cc:359] T 4c9c99ced15c4d3bac2330b8bcf36a26 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.704352 10370 raft_consensus.cc:385] T 4c9c99ced15c4d3bac2330b8bcf36a26 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.704464 10370 raft_consensus.cc:740] T 4c9c99ced15c4d3bac2330b8bcf36a26 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.704772 10370 consensus_queue.cc:260] T 4c9c99ced15c4d3bac2330b8bcf36a26 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.705605 9830 leader_election.cc:304] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:47.706997 10370 ts_tablet_manager.cc:1434] T 4c9c99ced15c4d3bac2330b8bcf36a26 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 19:47:47.708900 10370 tablet_bootstrap.cc:492] T 537bcbf01b1d42768996cf5b80c2ae5d P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:47.711365 10370 tablet_bootstrap.cc:654] T 537bcbf01b1d42768996cf5b80c2ae5d P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.712585 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ee1e8ddb1a5441d6a4386715abbf552a" } modify_external_catalogs: true
I20260810 19:47:47.712819 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ee1e8ddb1a5441d6a4386715abbf552a" } modify_external_catalogs: true
I20260810 19:47:47.713320 10381 raft_consensus.cc:493] T e70d3c77a75d4aacb85bfaec774147e2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:47.713366 10377 log.cc:1199] T e70d3c77a75d4aacb85bfaec774147e2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/e70d3c77a75d4aacb85bfaec774147e2
I20260810 19:47:47.713542 10381 raft_consensus.cc:515] T e70d3c77a75d4aacb85bfaec774147e2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.713896 10492 leader_election.cc:290] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:47.714094 10492 raft_consensus.cc:2804] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:47.714246 10492 raft_consensus.cc:697] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:47:47.714669 10492 consensus_queue.cc:237] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.715526 10367 tablet_bootstrap.cc:492] T 0d16b53753324290b10e4bdebcd8e243 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:47.715656 10381 leader_election.cc:290] T e70d3c77a75d4aacb85bfaec774147e2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:47.715713 10367 ts_tablet_manager.cc:1403] T 0d16b53753324290b10e4bdebcd8e243 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.000s
I20260810 19:47:47.716702 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7e36e79580bd4b40a81ca1b62475c0dc" } new_table_name: "default.Table_ae2dd57783584bfbba91180b3a74d071" modify_external_catalogs: true
I20260810 19:47:47.718791 10377 ts_tablet_manager.cc:1950] T e70d3c77a75d4aacb85bfaec774147e2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:47.719902 10377 tablet_replica.cc:333] T 537bcbf01b1d42768996cf5b80c2ae5d P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:47.720156 10377 raft_consensus.cc:2243] T 537bcbf01b1d42768996cf5b80c2ae5d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:47.720364 10377 raft_consensus.cc:2272] T 537bcbf01b1d42768996cf5b80c2ae5d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:47.716614 10367 raft_consensus.cc:359] T 0d16b53753324290b10e4bdebcd8e243 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.720878 10367 raft_consensus.cc:385] T 0d16b53753324290b10e4bdebcd8e243 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.720968 10367 raft_consensus.cc:740] T 0d16b53753324290b10e4bdebcd8e243 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.721480 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet e70d3c77a75d4aacb85bfaec774147e2 (table default.Table_d3a9560cb9364ab6beb532186e4dc76d [id=87adb026d28943cb9a16184b8112db22]) successfully deleted
W20260810 19:47:47.721840 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 1b0d0eeff07f410eacd8a2d006241cfb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b0d0eeff07f410eacd8a2d006241cfb already in progress: creating tablet
W20260810 19:47:47.722103 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 389ed7d4651446869d404fb389d6ce9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 389ed7d4651446869d404fb389d6ce9d already in progress: creating tablet
I20260810 19:47:47.722158 10367 consensus_queue.cc:260] T 0d16b53753324290b10e4bdebcd8e243 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.723219 10367 ts_tablet_manager.cc:1434] T 0d16b53753324290b10e4bdebcd8e243 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260810 19:47:47.724946 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d16b53753324290b10e4bdebcd8e243" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:47.725292 10171 raft_consensus.cc:2468] T 0d16b53753324290b10e4bdebcd8e243 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:47.725745 10367 tablet_bootstrap.cc:492] T 043f418de5ee493eb2bc43f3bc61e7fa P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:47.728142 10367 tablet_bootstrap.cc:654] T 043f418de5ee493eb2bc43f3bc61e7fa P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.734512 9407 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 07a7203a875c40e394a00c1ac44874d8 (table default.Table_bf651ef28af14d53b75748d0719a987d [id=d9f804aed5ee40fa90152b6475aea1af]). Expected version 2 got 0
I20260810 19:47:47.734828 9407 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet ba8c4420f5e345eeac30c805d673b5e9 (table default.Table_2080a27caba94bd8a8ab66b012cb20e4 [id=c421996810c34ce69ca7c00ed984dc54]). Expected version 2 got 0
I20260810 19:47:47.735023 9407 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet d7f5f05a042c4670a929d9a826c52667 (table default.Table_471b38d37f9d42fab33e3873f34d52a9 [id=683dbf29590844c692a645a7a60715e8]). Expected version 4 got 0
I20260810 19:47:47.739295 9415 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 043f418de5ee493eb2bc43f3bc61e7fa (table default.Table_2b1afb8ab7154ccb9c116df3d5e9cf5f [id=d0343c1dbf284737b5183387c8ef1483]). Expected version 1 got 0
I20260810 19:47:47.739605 9415 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet d7f5f05a042c4670a929d9a826c52667 (table default.Table_471b38d37f9d42fab33e3873f34d52a9 [id=683dbf29590844c692a645a7a60715e8]). Expected version 4 got 0
W20260810 19:47:47.740512 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 043f418de5ee493eb2bc43f3bc61e7fa consensus state has no leader
I20260810 19:47:47.743469 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 58b33df59ffe49a9b07606b6dc9279eb (DEFAULT_TABLE table=default.Table_a289f25ff60e4733899134f73a70715c [id=356d1ec0f2784810895aecd1f2eed86a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.743618 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 4d654dada92a4939914d26ab72a5f5e8 (DEFAULT_TABLE table=default.Table_41a4f12ff0aa41d5aba6c2507de37c0f [id=a8bdf6ea608f4279971af4c9eff71db6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.744014 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58b33df59ffe49a9b07606b6dc9279eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.744014 10140 tablet_service.cc:1511] Processing CreateTablet for tablet f2931130e9354f16a238712234c19217 (DEFAULT_TABLE table=default.Table_f1f332ce5d104c2b889c1faf78a0510f [id=a5becac787b84d398e96784d005d21f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.746939 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2931130e9354f16a238712234c19217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.755553 10127 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d16b53753324290b10e4bdebcd8e243 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.756422 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 4d654dada92a4939914d26ab72a5f5e8 (DEFAULT_TABLE table=default.Table_41a4f12ff0aa41d5aba6c2507de37c0f [id=a8bdf6ea608f4279971af4c9eff71db6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.756881 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d654dada92a4939914d26ab72a5f5e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.759238 9899 tablet_service.cc:1511] Processing CreateTablet for tablet 58b33df59ffe49a9b07606b6dc9279eb (DEFAULT_TABLE table=default.Table_a289f25ff60e4733899134f73a70715c [id=356d1ec0f2784810895aecd1f2eed86a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.759783 9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58b33df59ffe49a9b07606b6dc9279eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.763015 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet e70d3c77a75d4aacb85bfaec774147e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.763595 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet 39b27416e1a94ab98e66ad175f9bbbeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.764125 10375 tablet_replica.cc:333] T 0d16b53753324290b10e4bdebcd8e243 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:47.767757 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 58b33df59ffe49a9b07606b6dc9279eb (DEFAULT_TABLE table=default.Table_a289f25ff60e4733899134f73a70715c [id=356d1ec0f2784810895aecd1f2eed86a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.768313 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58b33df59ffe49a9b07606b6dc9279eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.770949 10375 raft_consensus.cc:2243] T 0d16b53753324290b10e4bdebcd8e243 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:47.771199 10375 raft_consensus.cc:2272] T 0d16b53753324290b10e4bdebcd8e243 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:47.776496 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 4d654dada92a4939914d26ab72a5f5e8 (DEFAULT_TABLE table=default.Table_41a4f12ff0aa41d5aba6c2507de37c0f [id=a8bdf6ea608f4279971af4c9eff71db6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.777033 10375 ts_tablet_manager.cc:1916] T 0d16b53753324290b10e4bdebcd8e243 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:47.777155 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d654dada92a4939914d26ab72a5f5e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.777325 10127 tablet_service.cc:1558] Processing DeleteTablet for tablet 46d7f9bcff4140c7bad02526befc1a56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.777753 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet e70d3c77a75d4aacb85bfaec774147e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.778072 10371 tablet_replica.cc:333] T e70d3c77a75d4aacb85bfaec774147e2 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:47.778275 10371 raft_consensus.cc:2243] T e70d3c77a75d4aacb85bfaec774147e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:47.778685 10371 raft_consensus.cc:2272] T e70d3c77a75d4aacb85bfaec774147e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:47.779495 9669 tablet_service.cc:1511] Processing CreateTablet for tablet f2931130e9354f16a238712234c19217 (DEFAULT_TABLE table=default.Table_f1f332ce5d104c2b889c1faf78a0510f [id=a5becac787b84d398e96784d005d21f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.780224 10371 ts_tablet_manager.cc:1916] T e70d3c77a75d4aacb85bfaec774147e2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:47.781240 9913 tablet_service.cc:1511] Processing CreateTablet for tablet f2931130e9354f16a238712234c19217 (DEFAULT_TABLE table=default.Table_f1f332ce5d104c2b889c1faf78a0510f [id=a5becac787b84d398e96784d005d21f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.781675 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2931130e9354f16a238712234c19217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.786746 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2931130e9354f16a238712234c19217. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:47.796257 9831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 79733.1us
I20260810 19:47:47.798136 10371 ts_tablet_manager.cc:1929] T e70d3c77a75d4aacb85bfaec774147e2 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:47.800062 10371 log.cc:1199] T e70d3c77a75d4aacb85bfaec774147e2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/e70d3c77a75d4aacb85bfaec774147e2
I20260810 19:47:47.801107 10371 ts_tablet_manager.cc:1950] T e70d3c77a75d4aacb85bfaec774147e2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:47.801528 10377 ts_tablet_manager.cc:1916] T 537bcbf01b1d42768996cf5b80c2ae5d P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:47.801903 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e1f8b7b2d04c56bc89a6b42e60da50" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:47.803290 9716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f5f05a042c4670a929d9a826c52667" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:47.805322 9716 raft_consensus.cc:2468] T d7f5f05a042c4670a929d9a826c52667 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:47.804610 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f5f05a042c4670a929d9a826c52667" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:47.805637 9715 raft_consensus.cc:3060] T d7f5f05a042c4670a929d9a826c52667 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:47.805510 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d16b53753324290b10e4bdebcd8e243" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:47.805842 9714 raft_consensus.cc:2468] T 0d16b53753324290b10e4bdebcd8e243 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:47.809511 9715 raft_consensus.cc:2468] T d7f5f05a042c4670a929d9a826c52667 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:47.811487 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet e70d3c77a75d4aacb85bfaec774147e2 (table default.Table_d3a9560cb9364ab6beb532186e4dc76d [id=87adb026d28943cb9a16184b8112db22]) successfully deleted
W20260810 19:47:47.822752 9831 leader_election.cc:343] T f9e1f8b7b2d04c56bc89a6b42e60da50 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:47.823093 9831 leader_election.cc:304] T f9e1f8b7b2d04c56bc89a6b42e60da50 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:47.823573 10488 raft_consensus.cc:2749] T f9e1f8b7b2d04c56bc89a6b42e60da50 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:47.824012 9831 leader_election.cc:304] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:47.824316 10488 raft_consensus.cc:2804] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:47.824484 10488 raft_consensus.cc:493] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:47.824636 10488 raft_consensus.cc:3060] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:47.833128 10488 raft_consensus.cc:515] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.838696 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ef91fc9d3a8f433fb8aad8f8ed0e8ad3" } new_table_name: "default.Table_5e6891ff4aa040be8b327aafa596bc7e" modify_external_catalogs: true
I20260810 19:47:47.840466 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_efa99143f4e842baacfda91408e3179d" } new_table_name: "default.Table_2819131cbbda496d8acccf4b8e83c322" modify_external_catalogs: true
I20260810 19:47:47.838717 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e57c84cd8eb94daf9711603419d86cd2" } modify_external_catalogs: true
I20260810 19:47:47.840803 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e57c84cd8eb94daf9711603419d86cd2" } modify_external_catalogs: true
I20260810 19:47:47.843518 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b0ed4458615243bebb70678601959f25" } modify_external_catalogs: true
I20260810 19:47:47.843724 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b0ed4458615243bebb70678601959f25" } modify_external_catalogs: true
I20260810 19:47:47.847506 10367 tablet_bootstrap.cc:492] T 043f418de5ee493eb2bc43f3bc61e7fa P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:47.847703 10367 ts_tablet_manager.cc:1403] T 043f418de5ee493eb2bc43f3bc61e7fa P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.122s user 0.037s sys 0.024s
I20260810 19:47:47.848650 10367 raft_consensus.cc:359] T 043f418de5ee493eb2bc43f3bc61e7fa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.848855 10367 raft_consensus.cc:385] T 043f418de5ee493eb2bc43f3bc61e7fa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.848953 10367 raft_consensus.cc:740] T 043f418de5ee493eb2bc43f3bc61e7fa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.849272 10367 consensus_queue.cc:260] T 043f418de5ee493eb2bc43f3bc61e7fa P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.849864 10367 ts_tablet_manager.cc:1434] T 043f418de5ee493eb2bc43f3bc61e7fa P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:47:47.851116 10367 tablet_bootstrap.cc:492] T 537bcbf01b1d42768996cf5b80c2ae5d P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:47.854719 10367 tablet_bootstrap.cc:654] T 537bcbf01b1d42768996cf5b80c2ae5d P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.857355 10367 tablet_bootstrap.cc:492] T 537bcbf01b1d42768996cf5b80c2ae5d P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:47.857544 10367 ts_tablet_manager.cc:1403] T 537bcbf01b1d42768996cf5b80c2ae5d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260810 19:47:47.838768 10377 ts_tablet_manager.cc:1929] T 537bcbf01b1d42768996cf5b80c2ae5d P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:47.858711 10377 log.cc:1199] T 537bcbf01b1d42768996cf5b80c2ae5d P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/537bcbf01b1d42768996cf5b80c2ae5d
I20260810 19:47:47.859169 10377 ts_tablet_manager.cc:1950] T 537bcbf01b1d42768996cf5b80c2ae5d P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:47.859140 10367 raft_consensus.cc:359] T 537bcbf01b1d42768996cf5b80c2ae5d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.859345 10367 raft_consensus.cc:385] T 537bcbf01b1d42768996cf5b80c2ae5d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.859421 10367 raft_consensus.cc:740] T 537bcbf01b1d42768996cf5b80c2ae5d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.859669 10367 consensus_queue.cc:260] T 537bcbf01b1d42768996cf5b80c2ae5d P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.860221 10367 ts_tablet_manager.cc:1434] T 537bcbf01b1d42768996cf5b80c2ae5d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 19:47:47.860306 10377 tablet_replica.cc:333] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:47.860499 10377 raft_consensus.cc:2243] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:47.860579 10367 tablet_bootstrap.cc:492] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:47.861078 10377 pending_rounds.cc:70] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691: Trying to abort 1 pending ops.
I20260810 19:47:47.861342 10377 pending_rounds.cc:77] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058632438816768 op_type: NO_OP noop_request { }
I20260810 19:47:47.861564 10377 raft_consensus.cc:2889] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:47.861690 10377 raft_consensus.cc:2272] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:47.862545 10367 tablet_bootstrap.cc:654] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.862928 10377 ts_tablet_manager.cc:1916] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:47.864759 10367 tablet_bootstrap.cc:492] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:47.865007 10367 ts_tablet_manager.cc:1403] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260810 19:47:47.865664 10367 raft_consensus.cc:359] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.865816 10367 raft_consensus.cc:385] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.865904 10367 raft_consensus.cc:740] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.866176 10367 consensus_queue.cc:260] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.868341 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 537bcbf01b1d42768996cf5b80c2ae5d (table default.Table_abe7676ae72548798853314dc36977ad [id=f4297c4f80854d1a88438b2591a6d5b5]) successfully deleted
W20260810 19:47:47.868705 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 6ae2df18a03a4e4ea8f0c2302866999c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ae2df18a03a4e4ea8f0c2302866999c already in progress: creating tablet
I20260810 19:47:47.866765 10367 ts_tablet_manager.cc:1434] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260810 19:47:47.868980 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 5f0d4ce494b4459eb05716d6e62d7a09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f0d4ce494b4459eb05716d6e62d7a09 already in progress: creating tablet
I20260810 19:47:47.869112 10367 tablet_bootstrap.cc:492] T 4df9d4be6ca042d3957e540d7ef44d8a P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
W20260810 19:47:47.869225 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet a71e3516f97c46f397de42f5c7089eeb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a71e3516f97c46f397de42f5c7089eeb already in progress: creating tablet
I20260810 19:47:47.871023 10367 tablet_bootstrap.cc:654] T 4df9d4be6ca042d3957e540d7ef44d8a P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.875880 10488 leader_election.cc:290] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:47.879355 10377 ts_tablet_manager.cc:1929] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:47.879529 10377 log.cc:1199] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/39b27416e1a94ab98e66ad175f9bbbeb
W20260810 19:47:47.879566 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 176d4e72b8e44e4b88bdf89d06f2f79a consensus state has no leader
I20260810 19:47:47.879992 10377 ts_tablet_manager.cc:1950] T 39b27416e1a94ab98e66ad175f9bbbeb P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
W20260810 19:47:47.881227 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0efa6f35ed284933b9fc53c1cb32da82 consensus state has no leader
I20260810 19:47:47.881465 10366 tablet_bootstrap.cc:492] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:47.881680 10366 ts_tablet_manager.cc:1403] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.263s user 0.007s sys 0.000s
I20260810 19:47:47.881615 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_471b38d37f9d42fab33e3873f34d52a9" } modify_external_catalogs: true
I20260810 19:47:47.881855 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_471b38d37f9d42fab33e3873f34d52a9" } modify_external_catalogs: true
I20260810 19:47:47.882107 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 248e8954c46e4328a696f9799604e67f
I20260810 19:47:47.882611 10366 raft_consensus.cc:359] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.882834 10366 raft_consensus.cc:385] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.882902 10366 raft_consensus.cc:740] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.883037 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c8a03c287048450bbc3765f3e2c2b752"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:47.883168 10366 consensus_queue.cc:260] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.883678 10366 ts_tablet_manager.cc:1434] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
W20260810 19:47:47.883724 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8a03c287048450bbc3765f3e2c2b752 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:47.884143 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 3a7bb5fcac0a4207b4ee997099777b5b
I20260810 19:47:47.884379 10366 tablet_bootstrap.cc:492] T 00dabf43505f4fc89be39ee8fb41c7ee P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:47.884912 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c86a4dc697bd4628bba90b74b908b5f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:47.885458 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c86a4dc697bd4628bba90b74b908b5f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:47.885865 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e09483838f0459da3041ee4fe5d55cc consensus state has no leader
I20260810 19:47:47.886410 10366 tablet_bootstrap.cc:654] T 00dabf43505f4fc89be39ee8fb41c7ee P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.886305 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f833a088b72e42e789d82f2594875bb0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:47.886904 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f833a088b72e42e789d82f2594875bb0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:47.887650 10377 tablet_replica.cc:333] T 4c9c99ced15c4d3bac2330b8bcf36a26 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:47.887857 10377 raft_consensus.cc:2243] T 4c9c99ced15c4d3bac2330b8bcf36a26 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:47.888111 10377 raft_consensus.cc:2272] T 4c9c99ced15c4d3bac2330b8bcf36a26 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:47:47.881870 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c1777a713b1d4a58919b5f6abe779ab8 consensus state has no leader
I20260810 19:47:47.889084 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet c5625c6f78f14d629bcd7f8c9522c4ba from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:47.889678 10377 ts_tablet_manager.cc:1916] T 4c9c99ced15c4d3bac2330b8bcf36a26 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:47.898854 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet 248e8954c46e4328a696f9799604e67f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.899176 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a7bb5fcac0a4207b4ee997099777b5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.900033 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet c5625c6f78f14d629bcd7f8c9522c4ba
I20260810 19:47:47.900668 9410 catalog_manager.cc:6807] ReplaceTablet: tablet c5625c6f78f14d629bcd7f8c9522c4ba deleted and replaced by tablet 9e9603994555425289db23bd5c38cc99
I20260810 19:47:47.901031 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet 1b0d0eeff07f410eacd8a2d006241cfb from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:47.901693 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_6a56935e5e6145379899af090dfe23d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:47.902297 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a56935e5e6145379899af090dfe23d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:47.903254 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet d7f5f05a042c4670a929d9a826c52667
I20260810 19:47:47.903972 9418 master_service.cc:960] ReplaceTablet: received request to replace tablet c5625c6f78f14d629bcd7f8c9522c4ba from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:47.904711 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d16b53753324290b10e4bdebcd8e243" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:47.904657 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3736033c32ef4301b26d70ea7a207ff7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:47.904934 9715 raft_consensus.cc:3060] T 0d16b53753324290b10e4bdebcd8e243 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:47:47.905251 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3736033c32ef4301b26d70ea7a207ff7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:47.906803 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet c5625c6f78f14d629bcd7f8c9522c4ba with delete_type TABLET_DATA_DELETED (replaced by tablet 9e9603994555425289db23bd5c38cc99) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.908243 9715 raft_consensus.cc:2468] T 0d16b53753324290b10e4bdebcd8e243 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:47.908439 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 39b27416e1a94ab98e66ad175f9bbbeb (table default.Table_1b95ebac5ef2432ea62092ff83c4451d [id=9d3ea0ed528846718fdac913e46fc276]) successfully deleted
I20260810 19:47:47.909502 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a7bb5fcac0a4207b4ee997099777b5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:47:47.909541 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 248e8954c46e4328a696f9799604e67f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 248e8954c46e4328a696f9799604e67f already in progress: creating tablet
I20260810 19:47:47.909605 9899 tablet_service.cc:1558] Processing DeleteTablet for tablet 248e8954c46e4328a696f9799604e67f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:47:47.909811 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 3a7bb5fcac0a4207b4ee997099777b5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a7bb5fcac0a4207b4ee997099777b5b already in progress: creating tablet
I20260810 19:47:47.909832 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet c5625c6f78f14d629bcd7f8c9522c4ba with delete_type TABLET_DATA_DELETED (replaced by tablet 9e9603994555425289db23bd5c38cc99) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:47.909466 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet d7f5f05a042c4670a929d9a826c52667 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:47.913379 9413 master_service.cc:960] ReplaceTablet: received request to replace tablet 4df9d4be6ca042d3957e540d7ef44d8a from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:47.916751 9831 leader_election.cc:304] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:47.916895 9413 master_service.cc:960] ReplaceTablet: received request to replace tablet f9e1f8b7b2d04c56bc89a6b42e60da50 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:47.917161 10488 raft_consensus.cc:2804] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
W20260810 19:47:47.917165 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet c5625c6f78f14d629bcd7f8c9522c4ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5625c6f78f14d629bcd7f8c9522c4ba already in progress: creating tablet
I20260810 19:47:47.917326 10488 raft_consensus.cc:697] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:47:47.917662 10488 consensus_queue.cc:237] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.918207 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet d7f5f05a042c4670a929d9a826c52667 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.918607 10371 tablet_replica.cc:333] T d7f5f05a042c4670a929d9a826c52667 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:47.918862 10371 raft_consensus.cc:2243] T d7f5f05a042c4670a929d9a826c52667 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:47.919080 10371 raft_consensus.cc:2272] T d7f5f05a042c4670a929d9a826c52667 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:47.921975 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 4ec0aa595d3c4e388eb7f07717ac4349
I20260810 19:47:47.922021 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_60869a2a939f4cc8813040573f05bd41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:47.922698 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60869a2a939f4cc8813040573f05bd41 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:47.924119 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ec0aa595d3c4e388eb7f07717ac4349 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.925671 10370 tablet_bootstrap.cc:492] T 537bcbf01b1d42768996cf5b80c2ae5d P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:47.926156 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet f9e1f8b7b2d04c56bc89a6b42e60da50
I20260810 19:47:47.926743 9413 catalog_manager.cc:6807] ReplaceTablet: tablet f9e1f8b7b2d04c56bc89a6b42e60da50 deleted and replaced by tablet 46005eead530459eb2b636ae0a6767ad
I20260810 19:47:47.928756 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet f9e1f8b7b2d04c56bc89a6b42e60da50 with delete_type TABLET_DATA_DELETED (replaced by tablet 46005eead530459eb2b636ae0a6767ad) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.930977 10370 ts_tablet_manager.cc:1403] T 537bcbf01b1d42768996cf5b80c2ae5d P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.217s user 0.000s sys 0.012s
I20260810 19:47:47.931846 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ec0aa595d3c4e388eb7f07717ac4349 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:47.932099 10370 raft_consensus.cc:359] T 537bcbf01b1d42768996cf5b80c2ae5d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.932874 10371 ts_tablet_manager.cc:1916] T d7f5f05a042c4670a929d9a826c52667 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:47.935215 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet f9e1f8b7b2d04c56bc89a6b42e60da50 with delete_type TABLET_DATA_DELETED (replaced by tablet 46005eead530459eb2b636ae0a6767ad) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:47.936208 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_4b39478b329141c790e4b1160cd6ffc2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:47.936897 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b39478b329141c790e4b1160cd6ffc2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:47.937104 10366 tablet_bootstrap.cc:492] T 00dabf43505f4fc89be39ee8fb41c7ee P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:47.937289 10366 ts_tablet_manager.cc:1403] T 00dabf43505f4fc89be39ee8fb41c7ee P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.053s user 0.004s sys 0.000s
I20260810 19:47:47.938613 10367 tablet_bootstrap.cc:492] T 4df9d4be6ca042d3957e540d7ef44d8a P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:47.938756 10366 raft_consensus.cc:359] T 00dabf43505f4fc89be39ee8fb41c7ee P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.939107 10366 raft_consensus.cc:385] T 00dabf43505f4fc89be39ee8fb41c7ee P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.939208 10366 raft_consensus.cc:740] T 00dabf43505f4fc89be39ee8fb41c7ee P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.940079 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d654dada92a4939914d26ab72a5f5e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.940086 10367 ts_tablet_manager.cc:1403] T 4df9d4be6ca042d3957e540d7ef44d8a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.071s user 0.021s sys 0.026s
I20260810 19:47:47.940733 10370 raft_consensus.cc:385] T 537bcbf01b1d42768996cf5b80c2ae5d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.943218 10371 ts_tablet_manager.cc:1929] T d7f5f05a042c4670a929d9a826c52667 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:47.943488 10371 log.cc:1199] T d7f5f05a042c4670a929d9a826c52667 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/d7f5f05a042c4670a929d9a826c52667
I20260810 19:47:47.943990 10371 ts_tablet_manager.cc:1950] T d7f5f05a042c4670a929d9a826c52667 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:47.944072 10367 raft_consensus.cc:359] T 4df9d4be6ca042d3957e540d7ef44d8a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.944332 10367 raft_consensus.cc:385] T 4df9d4be6ca042d3957e540d7ef44d8a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:47.944427 10367 raft_consensus.cc:740] T 4df9d4be6ca042d3957e540d7ef44d8a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:47.945477 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet d7f5f05a042c4670a929d9a826c52667 (table default.Table_471b38d37f9d42fab33e3873f34d52a9 [id=683dbf29590844c692a645a7a60715e8]) successfully deleted
I20260810 19:47:47.945559 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d16b53753324290b10e4bdebcd8e243" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:47.945690 10367 consensus_queue.cc:260] T 4df9d4be6ca042d3957e540d7ef44d8a P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.946264 10367 ts_tablet_manager.cc:1434] T 4df9d4be6ca042d3957e540d7ef44d8a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
W20260810 19:47:47.946461 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 4ec0aa595d3c4e388eb7f07717ac4349 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ec0aa595d3c4e388eb7f07717ac4349 already in progress: creating tablet
I20260810 19:47:47.946731 10367 tablet_bootstrap.cc:492] T f9e1f8b7b2d04c56bc89a6b42e60da50 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
W20260810 19:47:47.947227 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet f9e1f8b7b2d04c56bc89a6b42e60da50 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9e1f8b7b2d04c56bc89a6b42e60da50 already in progress: creating tablet
I20260810 19:47:47.947274 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet 248e8954c46e4328a696f9799604e67f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.945626 10370 raft_consensus.cc:740] T 537bcbf01b1d42768996cf5b80c2ae5d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
W20260810 19:47:47.948381 9830 leader_election.cc:343] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: Tablet not RUNNING: STOPPED
I20260810 19:47:47.948706 10367 tablet_bootstrap.cc:654] T f9e1f8b7b2d04c56bc89a6b42e60da50 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:47.950186 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_798bf26932ec4547b2ed311ccba8467b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:47.950685 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_d533329b9e424fa0abce94bd85345b36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:47.950856 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_798bf26932ec4547b2ed311ccba8467b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:47.951293 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d533329b9e424fa0abce94bd85345b36 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:47.953225 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d700bb1ba5eb405ca7537b12884f0223" } new_table_name: "default.Table_ca21c8a2ff1044e3949e389427373777" modify_external_catalogs: true
I20260810 19:47:47.954052 9415 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 07a7203a875c40e394a00c1ac44874d8 (table default.Table_bf651ef28af14d53b75748d0719a987d [id=d9f804aed5ee40fa90152b6475aea1af]). Expected version 2 got 0
I20260810 19:47:47.954278 9415 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet ba8c4420f5e345eeac30c805d673b5e9 (table default.Table_2080a27caba94bd8a8ab66b012cb20e4 [id=c421996810c34ce69ca7c00ed984dc54]). Expected version 2 got 0
I20260810 19:47:47.955053 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 09ab62f482b14cd4b86115e9a0423e7c
I20260810 19:47:47.956136 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 09ab62f482b14cd4b86115e9a0423e7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.958344 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 09ab62f482b14cd4b86115e9a0423e7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:47.959131 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b16a88e0061b4ab692e6ae76672eb918"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:47.958725 9408 catalog_manager.cc:5719] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
W20260810 19:47:47.960165 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b16a88e0061b4ab692e6ae76672eb918 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:47.960227 9408 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 07a7203a875c40e394a00c1ac44874d8 (table default.Table_bf651ef28af14d53b75748d0719a987d [id=d9f804aed5ee40fa90152b6475aea1af]). Expected version 2 got 0
I20260810 19:47:47.960549 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d16b53753324290b10e4bdebcd8e243 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.960837 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c9c99ced15c4d3bac2330b8bcf36a26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.961048 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 65d2f6fcf0bd4f0e9650e880d305442b with delete_type TABLET_DATA_DELETED (replaced by tablet 09ab62f482b14cd4b86115e9a0423e7c) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.961481 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet c5625c6f78f14d629bcd7f8c9522c4ba with delete_type TABLET_DATA_DELETED (replaced by tablet 9e9603994555425289db23bd5c38cc99) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.962551 9415 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 043f418de5ee493eb2bc43f3bc61e7fa (table default.Table_3d204c57a3154b73b51379fd4fe89ad7 [id=d0343c1dbf284737b5183387c8ef1483]). Expected version 2 got 0
I20260810 19:47:47.963249 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 4f8bf9f998ad44df98239767d17e3486 (DEFAULT_TABLE table=default.Table_3716ce5bda064fe3bc3d27c7b0e61fd7 [id=dbb22676ab2e4df580db999a0116fdee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.963454 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 4f8bf9f998ad44df98239767d17e3486 (DEFAULT_TABLE table=default.Table_3716ce5bda064fe3bc3d27c7b0e61fd7 [id=dbb22676ab2e4df580db999a0116fdee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.963708 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f8bf9f998ad44df98239767d17e3486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.964028 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f8bf9f998ad44df98239767d17e3486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.967571 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 38ee7973736c4a0a921261d37b74f290 (DEFAULT_TABLE table=default.Table_12b12f4993a449a48336de17e0c39fc1 [id=f6c45c0da9e6448dbb64115902fef084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.967593 9899 tablet_service.cc:1511] Processing CreateTablet for tablet a01d3ec3c8914fe495f7a0f3c7c312f8 (DEFAULT_TABLE table=default.Table_e5485c974283475aa7a3163163686d38 [id=aec405416e584af6bfb8194b357d6dbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.967610 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 5b2ee8ebe11e4e5cb6a91592170c6c3d (DEFAULT_TABLE table=default.Table_bc109c4a41b649f0843393e4184b81be [id=932a3e3e563546b6b0cb7850cc4f3e1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.968271 9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a01d3ec3c8914fe495f7a0f3c7c312f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.968806 9415 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 00dabf43505f4fc89be39ee8fb41c7ee (table default.Table_257ddf6dffe443b7bb3a6d5e7f1e93a2 [id=6b30bf93c566421593a182e1768c0482]). Expected version 1 got 0
I20260810 19:47:47.970638 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 5b2ee8ebe11e4e5cb6a91592170c6c3d (DEFAULT_TABLE table=default.Table_bc109c4a41b649f0843393e4184b81be [id=932a3e3e563546b6b0cb7850cc4f3e1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.971082 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b2ee8ebe11e4e5cb6a91592170c6c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.971259 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38ee7973736c4a0a921261d37b74f290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.972311 9687 tablet_service.cc:1511] Processing CreateTablet for tablet a01d3ec3c8914fe495f7a0f3c7c312f8 (DEFAULT_TABLE table=default.Table_e5485c974283475aa7a3163163686d38 [id=aec405416e584af6bfb8194b357d6dbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.973348 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a01d3ec3c8914fe495f7a0f3c7c312f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.974304 9685 tablet_service.cc:1511] Processing CreateTablet for tablet e177140cad404e978b927c810b87ae0c (DEFAULT_TABLE table=default.Table_143ff27d69cf41a79a51f8e391528ed5 [id=08a2a58f0f5646a9890870eda636e52a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.974694 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 38ee7973736c4a0a921261d37b74f290 (DEFAULT_TABLE table=default.Table_12b12f4993a449a48336de17e0c39fc1 [id=f6c45c0da9e6448dbb64115902fef084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.975147 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38ee7973736c4a0a921261d37b74f290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.975262 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b2ee8ebe11e4e5cb6a91592170c6c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.979197 9911 tablet_service.cc:1511] Processing CreateTablet for tablet e177140cad404e978b927c810b87ae0c (DEFAULT_TABLE table=default.Table_143ff27d69cf41a79a51f8e391528ed5 [id=08a2a58f0f5646a9890870eda636e52a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.979624 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e177140cad404e978b927c810b87ae0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.981980 9685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e177140cad404e978b927c810b87ae0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.982592 10370 consensus_queue.cc:260] T 537bcbf01b1d42768996cf5b80c2ae5d P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:47.982671 9904 tablet_service.cc:1511] Processing CreateTablet for tablet b9e761e94dbf4baba5e44a89b6c6a81c (DEFAULT_TABLE table=default.Table_aa6623172834464d8eda5b98fc129eb9 [id=d277a804313e4f35a31b58d4f682efe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.983078 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e761e94dbf4baba5e44a89b6c6a81c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.983243 10370 ts_tablet_manager.cc:1434] T 537bcbf01b1d42768996cf5b80c2ae5d P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.052s user 0.000s sys 0.002s
I20260810 19:47:47.983666 10370 tablet_bootstrap.cc:492] T f9e1f8b7b2d04c56bc89a6b42e60da50 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:47.983800 9673 tablet_service.cc:1511] Processing CreateTablet for tablet b9e761e94dbf4baba5e44a89b6c6a81c (DEFAULT_TABLE table=default.Table_aa6623172834464d8eda5b98fc129eb9 [id=d277a804313e4f35a31b58d4f682efe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.984195 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e761e94dbf4baba5e44a89b6c6a81c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.984592 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ec0aa595d3c4e388eb7f07717ac4349 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.985615 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 4df9d4be6ca042d3957e540d7ef44d8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.986104 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 537bcbf01b1d42768996cf5b80c2ae5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:47.986351 10127 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a7bb5fcac0a4207b4ee997099777b5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.986531 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet d7f5f05a042c4670a929d9a826c52667 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.986649 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 74dddd12f2314d6ab5a6717025b13a51 (DEFAULT_TABLE table=default.Table_bdec8c7d7aec442c8f6e994af3c4e4bc [id=9fd5b60a3ce44aaca14478da98f66bc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.986750 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 74dddd12f2314d6ab5a6717025b13a51 (DEFAULT_TABLE table=default.Table_bdec8c7d7aec442c8f6e994af3c4e4bc [id=9fd5b60a3ce44aaca14478da98f66bc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.987061 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74dddd12f2314d6ab5a6717025b13a51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.987113 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74dddd12f2314d6ab5a6717025b13a51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.988296 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 3ca9d34cb609413d9df495bf191cc409 (DEFAULT_TABLE table=default.Table_0c6321a554ff4c1a82855f8178d69454 [id=4eec13b150fe4e169ac63d4cd23b6c02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.988631 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca9d34cb609413d9df495bf191cc409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.990116 9677 tablet_service.cc:1511] Processing CreateTablet for tablet aa5702d7b3bd421eb7b8a4e0f181d2d4 (DEFAULT_TABLE table=default.Table_0bcf4f258fad4bb1a6fd8c6aea3ad22e [id=a837d5f74eac4f74b2029f46d73acc93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.990633 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa5702d7b3bd421eb7b8a4e0f181d2d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.990595 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet f9e1f8b7b2d04c56bc89a6b42e60da50 with delete_type TABLET_DATA_DELETED (replaced by tablet 46005eead530459eb2b636ae0a6767ad) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.991680 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 3ca9d34cb609413d9df495bf191cc409 (DEFAULT_TABLE table=default.Table_0c6321a554ff4c1a82855f8178d69454 [id=4eec13b150fe4e169ac63d4cd23b6c02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.991750 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 09ab62f482b14cd4b86115e9a0423e7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.992095 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca9d34cb609413d9df495bf191cc409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.994679 9896 tablet_service.cc:1511] Processing CreateTablet for tablet aa5702d7b3bd421eb7b8a4e0f181d2d4 (DEFAULT_TABLE table=default.Table_0bcf4f258fad4bb1a6fd8c6aea3ad22e [id=a837d5f74eac4f74b2029f46d73acc93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.995136 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa5702d7b3bd421eb7b8a4e0f181d2d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:47.996236 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c9c99ced15c4d3bac2330b8bcf36a26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:47.998067 10134 tablet_service.cc:1511] Processing CreateTablet for tablet e177140cad404e978b927c810b87ae0c (DEFAULT_TABLE table=default.Table_143ff27d69cf41a79a51f8e391528ed5 [id=08a2a58f0f5646a9890870eda636e52a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.998186 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 5b2ee8ebe11e4e5cb6a91592170c6c3d (DEFAULT_TABLE table=default.Table_bc109c4a41b649f0843393e4184b81be [id=932a3e3e563546b6b0cb7850cc4f3e1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.998075 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 74dddd12f2314d6ab5a6717025b13a51 (DEFAULT_TABLE table=default.Table_bdec8c7d7aec442c8f6e994af3c4e4bc [id=9fd5b60a3ce44aaca14478da98f66bc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.998642 10139 tablet_service.cc:1511] Processing CreateTablet for tablet b9e761e94dbf4baba5e44a89b6c6a81c (DEFAULT_TABLE table=default.Table_aa6623172834464d8eda5b98fc129eb9 [id=d277a804313e4f35a31b58d4f682efe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.999022 10142 tablet_service.cc:1511] Processing CreateTablet for tablet 3ca9d34cb609413d9df495bf191cc409 (DEFAULT_TABLE table=default.Table_0c6321a554ff4c1a82855f8178d69454 [id=4eec13b150fe4e169ac63d4cd23b6c02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:47.999388 10135 tablet_service.cc:1511] Processing CreateTablet for tablet aa5702d7b3bd421eb7b8a4e0f181d2d4 (DEFAULT_TABLE table=default.Table_0bcf4f258fad4bb1a6fd8c6aea3ad22e [id=a837d5f74eac4f74b2029f46d73acc93]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:47.999850 10067 leader_election.cc:343] T e70d3c77a75d4aacb85bfaec774147e2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: e70d3c77a75d4aacb85bfaec774147e2
I20260810 19:47:48.000362 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 38ee7973736c4a0a921261d37b74f290 (DEFAULT_TABLE table=default.Table_12b12f4993a449a48336de17e0c39fc1 [id=f6c45c0da9e6448dbb64115902fef084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.000741 10140 tablet_service.cc:1511] Processing CreateTablet for tablet a01d3ec3c8914fe495f7a0f3c7c312f8 (DEFAULT_TABLE table=default.Table_e5485c974283475aa7a3163163686d38 [id=aec405416e584af6bfb8194b357d6dbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.001173 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 4f8bf9f998ad44df98239767d17e3486 (DEFAULT_TABLE table=default.Table_3716ce5bda064fe3bc3d27c7b0e61fd7 [id=dbb22676ab2e4df580db999a0116fdee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.001525 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 65d2f6fcf0bd4f0e9650e880d305442b with delete_type TABLET_DATA_DELETED (replaced by tablet 09ab62f482b14cd4b86115e9a0423e7c) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:48.003611 10375 ts_tablet_manager.cc:1929] T 0d16b53753324290b10e4bdebcd8e243 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:48.005236 10370 tablet_bootstrap.cc:654] T f9e1f8b7b2d04c56bc89a6b42e60da50 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:48.014847 10375 log.cc:1199] T 0d16b53753324290b10e4bdebcd8e243 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/0d16b53753324290b10e4bdebcd8e243
I20260810 19:47:48.015667 10375 ts_tablet_manager.cc:1950] T 0d16b53753324290b10e4bdebcd8e243 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:48.013499 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 537bcbf01b1d42768996cf5b80c2ae5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:48.005738 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e177140cad404e978b927c810b87ae0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.017043 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38ee7973736c4a0a921261d37b74f290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.022578 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b2ee8ebe11e4e5cb6a91592170c6c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.026533 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e761e94dbf4baba5e44a89b6c6a81c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.030441 10381 raft_consensus.cc:493] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:48.030656 10381 raft_consensus.cc:515] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:48.031447 10381 leader_election.cc:290] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:48.033613 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74dddd12f2314d6ab5a6717025b13a51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.034565 10142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca9d34cb609413d9df495bf191cc409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.038499 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa5702d7b3bd421eb7b8a4e0f181d2d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.044181 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba8c4420f5e345eeac30c805d673b5e9" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:48.044484 9948 raft_consensus.cc:2468] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:47:48.044974 10381 raft_consensus.cc:493] T 46d7f9bcff4140c7bad02526befc1a56 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:48.045140 10381 raft_consensus.cc:515] T 46d7f9bcff4140c7bad02526befc1a56 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:48.045688 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 09ab62f482b14cd4b86115e9a0423e7c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09ab62f482b14cd4b86115e9a0423e7c already in progress: creating tablet
I20260810 19:47:48.045873 10381 leader_election.cc:290] T 46d7f9bcff4140c7bad02526befc1a56 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:48.046146 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a01d3ec3c8914fe495f7a0f3c7c312f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.046442 10371 tablet_replica.cc:333] T 0d16b53753324290b10e4bdebcd8e243 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:48.046669 10371 raft_consensus.cc:2243] T 0d16b53753324290b10e4bdebcd8e243 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:48.046875 10371 raft_consensus.cc:2272] T 0d16b53753324290b10e4bdebcd8e243 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:48.046700 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 0d16b53753324290b10e4bdebcd8e243 (table default.Table_369bd7e9555d45dd84c434fb07f7d103 [id=0294677b9ff14aaa9d9ad515d1b77f8f]) successfully deleted
I20260810 19:47:48.047843 10375 tablet_replica.cc:333] T e70d3c77a75d4aacb85bfaec774147e2 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:48.048056 10375 raft_consensus.cc:2243] T e70d3c77a75d4aacb85bfaec774147e2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:48.048271 10375 raft_consensus.cc:2272] T e70d3c77a75d4aacb85bfaec774147e2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:48.048380 10067 leader_election.cc:304] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:48.048964 10375 ts_tablet_manager.cc:1916] T e70d3c77a75d4aacb85bfaec774147e2 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:48.050091 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f8bf9f998ad44df98239767d17e3486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.051537 10371 ts_tablet_manager.cc:1916] T 0d16b53753324290b10e4bdebcd8e243 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:48.055296 10366 consensus_queue.cc:260] T 00dabf43505f4fc89be39ee8fb41c7ee P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.058262 10366 ts_tablet_manager.cc:1434] T 00dabf43505f4fc89be39ee8fb41c7ee P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.121s user 0.002s sys 0.000s
I20260810 19:47:48.060963 10366 tablet_bootstrap.cc:492] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:48.063099 10366 tablet_bootstrap.cc:654] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:48.064087 10371 ts_tablet_manager.cc:1929] T 0d16b53753324290b10e4bdebcd8e243 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:48.064239 10371 log.cc:1199] T 0d16b53753324290b10e4bdebcd8e243 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/0d16b53753324290b10e4bdebcd8e243
I20260810 19:47:48.066803 10371 ts_tablet_manager.cc:1950] T 0d16b53753324290b10e4bdebcd8e243 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:48.067910 10377 ts_tablet_manager.cc:1929] T 4c9c99ced15c4d3bac2330b8bcf36a26 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:48.068056 10377 log.cc:1199] T 4c9c99ced15c4d3bac2330b8bcf36a26 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/4c9c99ced15c4d3bac2330b8bcf36a26
I20260810 19:47:48.068233 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 0d16b53753324290b10e4bdebcd8e243 (table default.Table_369bd7e9555d45dd84c434fb07f7d103 [id=0294677b9ff14aaa9d9ad515d1b77f8f]) successfully deleted
I20260810 19:47:48.068461 10377 ts_tablet_manager.cc:1950] T 4c9c99ced15c4d3bac2330b8bcf36a26 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:48.068781 10371 tablet_replica.cc:333] T 4c9c99ced15c4d3bac2330b8bcf36a26 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:48.069087 10371 raft_consensus.cc:2243] T 4c9c99ced15c4d3bac2330b8bcf36a26 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:48.069762 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 4c9c99ced15c4d3bac2330b8bcf36a26 (table default.Table_43a8dfd72855490a9430e0783eb17f20 [id=7f76320f426748e79b1e7f0446d7cb51]) successfully deleted
I20260810 19:47:48.070097 10371 raft_consensus.cc:2272] T 4c9c99ced15c4d3bac2330b8bcf36a26 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:47:48.070259 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e9603994555425289db23bd5c38cc99 has no consensus state
I20260810 19:47:48.071158 10371 ts_tablet_manager.cc:1916] T 4c9c99ced15c4d3bac2330b8bcf36a26 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:48.072252 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 39b27416e1a94ab98e66ad175f9bbbeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:48.072623 10381 raft_consensus.cc:2804] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:48.072798 10381 raft_consensus.cc:493] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:48.072908 10381 raft_consensus.cc:3060] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:47:48.073060 9395 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 043f418de5ee493eb2bc43f3bc61e7fa (table default.Table_3d204c57a3154b73b51379fd4fe89ad7 [id=d0343c1dbf284737b5183387c8ef1483], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 043f418de5ee493eb2bc43f3bc61e7fa consensus state has no leader
W20260810 19:47:48.074572 10067 leader_election.cc:343] T 46d7f9bcff4140c7bad02526befc1a56 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 46d7f9bcff4140c7bad02526befc1a56
I20260810 19:47:48.082967 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba8c4420f5e345eeac30c805d673b5e9" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:48.083220 9715 raft_consensus.cc:2468] T ba8c4420f5e345eeac30c805d673b5e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
W20260810 19:47:48.084452 10068 leader_election.cc:343] T e70d3c77a75d4aacb85bfaec774147e2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: e70d3c77a75d4aacb85bfaec774147e2
I20260810 19:47:48.084707 10068 leader_election.cc:304] T e70d3c77a75d4aacb85bfaec774147e2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:47:48.085085 10068 raft_consensus.cc:2686] T e70d3c77a75d4aacb85bfaec774147e2 P eadde59fd6504d679e47f03a60c64bb0: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260810 19:47:48.085896 10068 leader_election.cc:343] T 46d7f9bcff4140c7bad02526befc1a56 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 46d7f9bcff4140c7bad02526befc1a56
I20260810 19:47:48.086329 10068 leader_election.cc:304] T 46d7f9bcff4140c7bad02526befc1a56 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:48.088299 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 25e15a8d1e7d41e68eef25d30d668e61 (DEFAULT_TABLE table=default.Table_6a56935e5e6145379899af090dfe23d4 [id=8c8a7865a0374b29a853783941137afb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.089314 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 2d90d9c9f6524859a0e33e649dd80f7c (DEFAULT_TABLE table=default.Table_c8a03c287048450bbc3765f3e2c2b752 [id=cec00e7815514025aee218d41250d360]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.089941 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 2d90d9c9f6524859a0e33e649dd80f7c (DEFAULT_TABLE table=default.Table_c8a03c287048450bbc3765f3e2c2b752 [id=cec00e7815514025aee218d41250d360]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.090469 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d90d9c9f6524859a0e33e649dd80f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.090293 9685 tablet_service.cc:1511] Processing CreateTablet for tablet 9e9603994555425289db23bd5c38cc99 (DEFAULT_TABLE table=default.Table_ca21c8a2ff1044e3949e389427373777 [id=3ec1bdaeba584422a569a6f070344b6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.090924 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e15a8d1e7d41e68eef25d30d668e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.091496 9685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e9603994555425289db23bd5c38cc99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.092006 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d90d9c9f6524859a0e33e649dd80f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.093500 10381 raft_consensus.cc:515] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:48.095875 9677 tablet_service.cc:1511] Processing CreateTablet for tablet 7b995f3c3bca4501a6c62cf9025051b2 (DEFAULT_TABLE table=default.Table_4b39478b329141c790e4b1160cd6ffc2 [id=b05460b1d468433f9a6501203eb5f4ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.095932 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_aa6623172834464d8eda5b98fc129eb9" } new_table_name: "default.Table_3ffc95fe00014a0b8398de5aced22f11" modify_external_catalogs: true
I20260810 19:47:48.096163 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 860dbb6d0a004c43bdce09075272fa70 (DEFAULT_TABLE table=default.Table_c86a4dc697bd4628bba90b74b908b5f9 [id=097f014eed014a6782f331bf23f6b2f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.096320 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b995f3c3bca4501a6c62cf9025051b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.096557 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 860dbb6d0a004c43bdce09075272fa70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.097712 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c8a03c287048450bbc3765f3e2c2b752" } new_table_name: "default.Table_4d9757a90ce34541a2c047891e32a42c" modify_external_catalogs: true
I20260810 19:47:48.098242 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 9e9603994555425289db23bd5c38cc99 (DEFAULT_TABLE table=default.Table_ca21c8a2ff1044e3949e389427373777 [id=3ec1bdaeba584422a569a6f070344b6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.098681 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e9603994555425289db23bd5c38cc99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.098672 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 34fdc03b114b405da9e3a17ef1ad87c4 (DEFAULT_TABLE table=default.Table_60869a2a939f4cc8813040573f05bd41 [id=5cf32f9df60d4b04a704522da9f7973d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.099030 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34fdc03b114b405da9e3a17ef1ad87c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.099160 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_143ff27d69cf41a79a51f8e391528ed5" } modify_external_catalogs: true
I20260810 19:47:48.099349 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_143ff27d69cf41a79a51f8e391528ed5" } modify_external_catalogs: true
I20260810 19:47:48.101956 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3736033c32ef4301b26d70ea7a207ff7" } new_table_name: "default.Table_9381401bf3f44ef488064afeb31098bb" modify_external_catalogs: true
I20260810 19:47:48.102108 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 46005eead530459eb2b636ae0a6767ad (DEFAULT_TABLE table=default.Table_2a994cac12d24a589728d6edb766c2af [id=098d4c95bab142c2b56fecac4113a429]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.095877 9681 tablet_service.cc:1511] Processing CreateTablet for tablet aa457d1f5cf2445eb3d869bc6ecf60b3 (DEFAULT_TABLE table=default.Table_3736033c32ef4301b26d70ea7a207ff7 [id=c8a0313d7b6a4b4fa813727cf4e8e38d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.103348 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6a56935e5e6145379899af090dfe23d4" } modify_external_catalogs: true
I20260810 19:47:48.103518 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6a56935e5e6145379899af090dfe23d4" } modify_external_catalogs: true
I20260810 19:47:48.103729 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 46005eead530459eb2b636ae0a6767ad (DEFAULT_TABLE table=default.Table_2a994cac12d24a589728d6edb766c2af [id=098d4c95bab142c2b56fecac4113a429]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.104188 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46005eead530459eb2b636ae0a6767ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.105290 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46005eead530459eb2b636ae0a6767ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.105907 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ae2dd57783584bfbba91180b3a74d071" } new_table_name: "default.Table_133f8005d08641b68da5bb9faa1e2d7b" modify_external_catalogs: true
I20260810 19:47:48.106885 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 7b995f3c3bca4501a6c62cf9025051b2 (DEFAULT_TABLE table=default.Table_4b39478b329141c790e4b1160cd6ffc2 [id=b05460b1d468433f9a6501203eb5f4ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.107319 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b995f3c3bca4501a6c62cf9025051b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.107311 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 842a5dacf9d145889e97069d3c8084b8 (DEFAULT_TABLE table=default.Table_f833a088b72e42e789d82f2594875bb0 [id=d3257081af314bd898924c879f2d15e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.107697 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 842a5dacf9d145889e97069d3c8084b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.106925 9911 tablet_service.cc:1511] Processing CreateTablet for tablet 842a5dacf9d145889e97069d3c8084b8 (DEFAULT_TABLE table=default.Table_f833a088b72e42e789d82f2594875bb0 [id=d3257081af314bd898924c879f2d15e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.110731 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 842a5dacf9d145889e97069d3c8084b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.111205 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 860dbb6d0a004c43bdce09075272fa70 (DEFAULT_TABLE table=default.Table_c86a4dc697bd4628bba90b74b908b5f9 [id=097f014eed014a6782f331bf23f6b2f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.111589 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 860dbb6d0a004c43bdce09075272fa70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.112641 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa457d1f5cf2445eb3d869bc6ecf60b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.107337 9899 tablet_service.cc:1511] Processing CreateTablet for tablet 34fdc03b114b405da9e3a17ef1ad87c4 (DEFAULT_TABLE table=default.Table_60869a2a939f4cc8813040573f05bd41 [id=5cf32f9df60d4b04a704522da9f7973d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.115151 9898 tablet_service.cc:1511] Processing CreateTablet for tablet aa457d1f5cf2445eb3d869bc6ecf60b3 (DEFAULT_TABLE table=default.Table_3736033c32ef4301b26d70ea7a207ff7 [id=c8a0313d7b6a4b4fa813727cf4e8e38d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.115324 9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34fdc03b114b405da9e3a17ef1ad87c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.115700 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 9e9603994555425289db23bd5c38cc99 (DEFAULT_TABLE table=default.Table_ca21c8a2ff1044e3949e389427373777 [id=3ec1bdaeba584422a569a6f070344b6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.117097 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_43a169cacafa4fb7a011cbe861de63c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:48.117699 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43a169cacafa4fb7a011cbe861de63c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:48.122715 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e9603994555425289db23bd5c38cc99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.123183 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_59b5d4d82ac044e0a101d8f598a44e43"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:48.123836 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59b5d4d82ac044e0a101d8f598a44e43 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:48.125372 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8d6a1f9bb09e4de7807970d6c9479ac5" } modify_external_catalogs: true
I20260810 19:47:48.125735 10486 raft_consensus.cc:493] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:48.125942 10486 raft_consensus.cc:515] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.126690 10486 leader_election.cc:290] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:48.127558 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043f418de5ee493eb2bc43f3bc61e7fa" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:48.127794 9715 raft_consensus.cc:2468] T 043f418de5ee493eb2bc43f3bc61e7fa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:48.129468 9831 leader_election.cc:304] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:48.131999 10486 raft_consensus.cc:2804] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:48.132109 10486 raft_consensus.cc:493] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:48.132212 10486 raft_consensus.cc:3060] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:47:48.135344 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b9e761e94dbf4baba5e44a89b6c6a81c consensus state has no leader
I20260810 19:47:48.135394 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_bf651ef28af14d53b75748d0719a987d" } modify_external_catalogs: true
I20260810 19:47:48.135593 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_bf651ef28af14d53b75748d0719a987d" } modify_external_catalogs: true
I20260810 19:47:48.136703 10486 raft_consensus.cc:515] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.138295 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043f418de5ee493eb2bc43f3bc61e7fa" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:48.138571 9715 raft_consensus.cc:3060] T 043f418de5ee493eb2bc43f3bc61e7fa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:48.142470 9715 raft_consensus.cc:2468] T 043f418de5ee493eb2bc43f3bc61e7fa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:48.143224 9831 leader_election.cc:304] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:48.143637 10492 raft_consensus.cc:2804] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:48.143779 10492 raft_consensus.cc:697] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:47:48.144235 10492 consensus_queue.cc:237] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.147711 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_7a765ce368bb42c8b6f4b0cd27d917f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:48.148494 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a765ce368bb42c8b6f4b0cd27d917f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:48.151088 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d90d9c9f6524859a0e33e649dd80f7c consensus state has no leader
I20260810 19:47:48.153968 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0de524b66ecf4dea8ab5e6b87c4f6261"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:48.154671 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0de524b66ecf4dea8ab5e6b87c4f6261 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:48.156512 10486 leader_election.cc:290] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:48.156833 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8d6a1f9bb09e4de7807970d6c9479ac5" } modify_external_catalogs: true
I20260810 19:47:48.159287 10144 tablet_service.cc:1511] Processing CreateTablet for tablet aa457d1f5cf2445eb3d869bc6ecf60b3 (DEFAULT_TABLE table=default.Table_3736033c32ef4301b26d70ea7a207ff7 [id=c8a0313d7b6a4b4fa813727cf4e8e38d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.159890 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa457d1f5cf2445eb3d869bc6ecf60b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.160881 10371 ts_tablet_manager.cc:1929] T 4c9c99ced15c4d3bac2330b8bcf36a26 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:48.161075 10371 log.cc:1199] T 4c9c99ced15c4d3bac2330b8bcf36a26 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/4c9c99ced15c4d3bac2330b8bcf36a26
I20260810 19:47:48.161540 10371 ts_tablet_manager.cc:1950] T 4c9c99ced15c4d3bac2330b8bcf36a26 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:48.161798 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 7b995f3c3bca4501a6c62cf9025051b2 (DEFAULT_TABLE table=default.Table_4b39478b329141c790e4b1160cd6ffc2 [id=b05460b1d468433f9a6501203eb5f4ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.162209 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba8c4420f5e345eeac30c805d673b5e9" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:48.162475 9948 raft_consensus.cc:3060] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:48.089054 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 25e15a8d1e7d41e68eef25d30d668e61 (DEFAULT_TABLE table=default.Table_6a56935e5e6145379899af090dfe23d4 [id=8c8a7865a0374b29a853783941137afb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.162879 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 4c9c99ced15c4d3bac2330b8bcf36a26 (table default.Table_43a8dfd72855490a9430e0783eb17f20 [id=7f76320f426748e79b1e7f0446d7cb51]) successfully deleted
I20260810 19:47:48.163327 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 2d90d9c9f6524859a0e33e649dd80f7c (DEFAULT_TABLE table=default.Table_c8a03c287048450bbc3765f3e2c2b752 [id=cec00e7815514025aee218d41250d360]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.164100 10371 tablet_replica.cc:333] T 65d2f6fcf0bd4f0e9650e880d305442b P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:48.164314 10371 raft_consensus.cc:2243] T 65d2f6fcf0bd4f0e9650e880d305442b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:48.164503 10371 raft_consensus.cc:2272] T 65d2f6fcf0bd4f0e9650e880d305442b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:48.164289 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa457d1f5cf2445eb3d869bc6ecf60b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.166261 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet e177140cad404e978b927c810b87ae0c
I20260810 19:47:48.166673 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 25e15a8d1e7d41e68eef25d30d668e61
I20260810 19:47:48.167162 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_aa9a8825478043949020967cf580deca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:48.167520 10371 ts_tablet_manager.cc:1916] T 65d2f6fcf0bd4f0e9650e880d305442b P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:48.167429 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a9d40ecd9c0349e2b7b385d0accc32e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:48.167799 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa9a8825478043949020967cf580deca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:48.167999 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a9d40ecd9c0349e2b7b385d0accc32e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:48.169283 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0efa6f35ed284933b9fc53c1cb32da82 consensus state has no leader
I20260810 19:47:48.169636 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_130fb9e1e90b4c679e2c0ef4cec28827" } modify_external_catalogs: true
I20260810 19:47:48.169859 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_130fb9e1e90b4c679e2c0ef4cec28827" } modify_external_catalogs: true
I20260810 19:47:48.170555 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 25e15a8d1e7d41e68eef25d30d668e61 (DEFAULT_TABLE table=default.Table_6a56935e5e6145379899af090dfe23d4 [id=8c8a7865a0374b29a853783941137afb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.171432 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 25e15a8d1e7d41e68eef25d30d668e61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:48.171710 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet e177140cad404e978b927c810b87ae0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:48.172964 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d90d9c9f6524859a0e33e649dd80f7c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:48.173239 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet aa457d1f5cf2445eb3d869bc6ecf60b3 consensus state has no leader
I20260810 19:47:48.174943 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e15a8d1e7d41e68eef25d30d668e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.166227 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e3195870d5b74675ab7cf09ff5383063"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:48.175524 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e3195870d5b74675ab7cf09ff5383063 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:48.177752 9948 raft_consensus.cc:2468] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:47:48.182397 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 46005eead530459eb2b636ae0a6767ad (DEFAULT_TABLE table=default.Table_2a994cac12d24a589728d6edb766c2af [id=098d4c95bab142c2b56fecac4113a429]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.183056 10381 leader_election.cc:290] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:48.184926 10371 ts_tablet_manager.cc:1929] T 65d2f6fcf0bd4f0e9650e880d305442b P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:48.185176 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet e177140cad404e978b927c810b87ae0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:48.186460 10371 log.cc:1199] T 65d2f6fcf0bd4f0e9650e880d305442b P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/65d2f6fcf0bd4f0e9650e880d305442b
I20260810 19:47:48.186820 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 07a7203a875c40e394a00c1ac44874d8
I20260810 19:47:48.188352 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 07a7203a875c40e394a00c1ac44874d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:48.188819 10371 ts_tablet_manager.cc:1950] T 65d2f6fcf0bd4f0e9650e880d305442b P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:48.189082 10067 leader_election.cc:304] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:48.190848 10120 tablet_service.cc:1511] Processing CreateTablet for tablet 34fdc03b114b405da9e3a17ef1ad87c4 (DEFAULT_TABLE table=default.Table_60869a2a939f4cc8813040573f05bd41 [id=5cf32f9df60d4b04a704522da9f7973d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.191412 9899 tablet_service.cc:1558] Processing DeleteTablet for tablet 25e15a8d1e7d41e68eef25d30d668e61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:48.192265 9899 tablet_service.cc:1558] Processing DeleteTablet for tablet 07a7203a875c40e394a00c1ac44874d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:48.193006 10371 tablet_replica.cc:333] T 4df9d4be6ca042d3957e540d7ef44d8a P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:48.193460 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 65d2f6fcf0bd4f0e9650e880d305442b (table default.Table_5af45f52e4024048836c48234ef3a903 [id=4fda913821434991b62c8de128735a25]) successfully deleted
I20260810 19:47:48.193501 10371 raft_consensus.cc:2243] T 4df9d4be6ca042d3957e540d7ef44d8a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:48.193831 10371 raft_consensus.cc:2272] T 4df9d4be6ca042d3957e540d7ef44d8a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:48.199302 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 860dbb6d0a004c43bdce09075272fa70 (DEFAULT_TABLE table=default.Table_c86a4dc697bd4628bba90b74b908b5f9 [id=097f014eed014a6782f331bf23f6b2f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.201467 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet a78f955a3ca946189de7ea96baee35f6
I20260810 19:47:48.202790 10381 raft_consensus.cc:2749] T 46d7f9bcff4140c7bad02526befc1a56 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:48.204013 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 842a5dacf9d145889e97069d3c8084b8 (DEFAULT_TABLE table=default.Table_f833a088b72e42e789d82f2594875bb0 [id=d3257081af314bd898924c879f2d15e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.204576 10127 tablet_service.cc:1558] Processing DeleteTablet for tablet 07a7203a875c40e394a00c1ac44874d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:48.205474 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet e177140cad404e978b927c810b87ae0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:48.207404 10381 raft_consensus.cc:2804] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:48.208876 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet a78f955a3ca946189de7ea96baee35f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:48.207118 10546 raft_consensus.cc:493] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:48.213482 9899 tablet_service.cc:1558] Processing DeleteTablet for tablet a78f955a3ca946189de7ea96baee35f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:48.213501 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet a78f955a3ca946189de7ea96baee35f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:48.210551 10381 raft_consensus.cc:697] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:47:48.217041 10136 tablet_service.cc:1558] Processing DeleteTablet for tablet 25e15a8d1e7d41e68eef25d30d668e61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:48.218362 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e15a8d1e7d41e68eef25d30d668e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.219494 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 6d4387725a1843a7a7344d10e956c712
I20260810 19:47:48.219954 10371 ts_tablet_manager.cc:1916] T 4df9d4be6ca042d3957e540d7ef44d8a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:48.228572 10371 ts_tablet_manager.cc:1929] T 4df9d4be6ca042d3957e540d7ef44d8a P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:48.228767 10371 log.cc:1199] T 4df9d4be6ca042d3957e540d7ef44d8a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/4df9d4be6ca042d3957e540d7ef44d8a
I20260810 19:47:48.229187 10371 ts_tablet_manager.cc:1950] T 4df9d4be6ca042d3957e540d7ef44d8a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:48.230439 10371 tablet_replica.cc:333] T 537bcbf01b1d42768996cf5b80c2ae5d P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:48.230661 10371 raft_consensus.cc:2243] T 537bcbf01b1d42768996cf5b80c2ae5d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:48.230764 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 4df9d4be6ca042d3957e540d7ef44d8a (table default.Table_0ba2d519828e48e29bb7af21dcac296e [id=f641e04b9f7c4052b81c7364bc2d1cde]) successfully deleted
I20260810 19:47:48.235441 9899 tablet_service.cc:1511] Processing CreateTablet for tablet 92e3d52bd5b741a4adcabb343b6770b8 (DEFAULT_TABLE table=default.Table_b16a88e0061b4ab692e6ae76672eb918 [id=495386acd3524a388b83e38f07bf9967]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.236111 9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e3d52bd5b741a4adcabb343b6770b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.237293 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34fdc03b114b405da9e3a17ef1ad87c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.236806 10381 consensus_queue.cc:237] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:48.241187 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 92e3d52bd5b741a4adcabb343b6770b8 (DEFAULT_TABLE table=default.Table_b16a88e0061b4ab692e6ae76672eb918 [id=495386acd3524a388b83e38f07bf9967]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.242415 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e3d52bd5b741a4adcabb343b6770b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.243825 10370 tablet_bootstrap.cc:492] T f9e1f8b7b2d04c56bc89a6b42e60da50 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:48.218559 10546 raft_consensus.cc:515] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.244047 10370 ts_tablet_manager.cc:1403] T f9e1f8b7b2d04c56bc89a6b42e60da50 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.261s user 0.001s sys 0.004s
I20260810 19:47:48.244839 9911 tablet_service.cc:1511] Processing CreateTablet for tablet e4a92eb8626f465caf563b72598a685f (DEFAULT_TABLE table=default.Table_d533329b9e424fa0abce94bd85345b36 [id=7112ce97719c47919a3d24d1af7d07cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.245319 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4a92eb8626f465caf563b72598a685f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.246402 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 5d3598b5743244e39efd12703ec15aea (DEFAULT_TABLE table=default.Table_798bf26932ec4547b2ed311ccba8467b [id=72812b2c16734101b42ea305500c759c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.246860 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3598b5743244e39efd12703ec15aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.250448 9677 tablet_service.cc:1511] Processing CreateTablet for tablet e4a92eb8626f465caf563b72598a685f (DEFAULT_TABLE table=default.Table_d533329b9e424fa0abce94bd85345b36 [id=7112ce97719c47919a3d24d1af7d07cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.251053 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4a92eb8626f465caf563b72598a685f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.253575 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 5d3598b5743244e39efd12703ec15aea (DEFAULT_TABLE table=default.Table_798bf26932ec4547b2ed311ccba8467b [id=72812b2c16734101b42ea305500c759c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.254169 10136 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d4387725a1843a7a7344d10e956c712 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:48.258906 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_8680fc2abacb464c8d39fae15165ea39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:48.259809 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8680fc2abacb464c8d39fae15165ea39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:48.260046 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 860dbb6d0a004c43bdce09075272fa70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.261752 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 92e3d52bd5b741a4adcabb343b6770b8 (DEFAULT_TABLE table=default.Table_b16a88e0061b4ab692e6ae76672eb918 [id=495386acd3524a388b83e38f07bf9967]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.262791 10370 raft_consensus.cc:359] T f9e1f8b7b2d04c56bc89a6b42e60da50 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.263036 10370 raft_consensus.cc:385] T f9e1f8b7b2d04c56bc89a6b42e60da50 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:48.263199 10370 raft_consensus.cc:740] T f9e1f8b7b2d04c56bc89a6b42e60da50 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:48.263530 10370 consensus_queue.cc:260] T f9e1f8b7b2d04c56bc89a6b42e60da50 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.264210 10370 ts_tablet_manager.cc:1434] T f9e1f8b7b2d04c56bc89a6b42e60da50 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20260810 19:47:48.264586 10370 tablet_bootstrap.cc:492] T 4df9d4be6ca042d3957e540d7ef44d8a P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:48.265259 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d4387725a1843a7a7344d10e956c712 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:48.265170 10136 tablet_service.cc:1511] Processing CreateTablet for tablet e4a92eb8626f465caf563b72598a685f (DEFAULT_TABLE table=default.Table_d533329b9e424fa0abce94bd85345b36 [id=7112ce97719c47919a3d24d1af7d07cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.267844 10371 raft_consensus.cc:2272] T 537bcbf01b1d42768996cf5b80c2ae5d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:48.269107 9911 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d4387725a1843a7a7344d10e956c712 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:48.270638 10371 ts_tablet_manager.cc:1916] T 537bcbf01b1d42768996cf5b80c2ae5d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:48.282827 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b75cdd8724cb40aa81117d76d46b5518"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:48.283553 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b75cdd8724cb40aa81117d76d46b5518 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:48.283704 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46005eead530459eb2b636ae0a6767ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.286011 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ca21c8a2ff1044e3949e389427373777" } new_table_name: "default.Table_0dafd75d95394cdda8062e308591219d" modify_external_catalogs: true
I20260810 19:47:48.287563 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_da2146aa6d244f3f892e8cf1c68bda8f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:48.288501 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da2146aa6d244f3f892e8cf1c68bda8f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:48.291805 10546 leader_election.cc:290] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:48.294416 9418 catalog_manager.cc:5719] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195). New cstate: current_term: 1 leader_uuid: "eadde59fd6504d679e47f03a60c64bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: HEALTHY } } }
I20260810 19:47:48.294862 9418 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet ba8c4420f5e345eeac30c805d673b5e9 (table default.Table_2080a27caba94bd8a8ab66b012cb20e4 [id=c421996810c34ce69ca7c00ed984dc54]). Expected version 2 got 0
I20260810 19:47:48.307426 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 842a5dacf9d145889e97069d3c8084b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.312870 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b995f3c3bca4501a6c62cf9025051b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.316560 10371 ts_tablet_manager.cc:1929] T 537bcbf01b1d42768996cf5b80c2ae5d P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:48.317821 10367 tablet_bootstrap.cc:492] T f9e1f8b7b2d04c56bc89a6b42e60da50 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:48.318038 10367 ts_tablet_manager.cc:1403] T f9e1f8b7b2d04c56bc89a6b42e60da50 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.371s user 0.042s sys 0.073s
I20260810 19:47:48.319130 10367 raft_consensus.cc:359] T f9e1f8b7b2d04c56bc89a6b42e60da50 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.319386 10367 raft_consensus.cc:385] T f9e1f8b7b2d04c56bc89a6b42e60da50 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:48.319497 10367 raft_consensus.cc:740] T f9e1f8b7b2d04c56bc89a6b42e60da50 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:48.319795 10367 consensus_queue.cc:260] T f9e1f8b7b2d04c56bc89a6b42e60da50 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.320268 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043f418de5ee493eb2bc43f3bc61e7fa" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:48.320945 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 5d3598b5743244e39efd12703ec15aea (DEFAULT_TABLE table=default.Table_798bf26932ec4547b2ed311ccba8467b [id=72812b2c16734101b42ea305500c759c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.323551 10367 ts_tablet_manager.cc:1434] T f9e1f8b7b2d04c56bc89a6b42e60da50 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260810 19:47:48.326043 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet f9e1f8b7b2d04c56bc89a6b42e60da50 with delete_type TABLET_DATA_DELETED (replaced by tablet 46005eead530459eb2b636ae0a6767ad) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:48.326412 10367 tablet_bootstrap.cc:492] T 1b0d0eeff07f410eacd8a2d006241cfb P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
W20260810 19:47:48.326603 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet f495efb5bc9e47f4a353b497b9ae78a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f495efb5bc9e47f4a353b497b9ae78a8 already in progress: creating tablet
I20260810 19:47:48.329188 10366 tablet_bootstrap.cc:492] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:48.329855 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3598b5743244e39efd12703ec15aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.330572 10377 tablet_replica.cc:333] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:48.332867 10367 tablet_bootstrap.cc:654] T 1b0d0eeff07f410eacd8a2d006241cfb P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:48.340474 10371 log.cc:1199] T 537bcbf01b1d42768996cf5b80c2ae5d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/537bcbf01b1d42768996cf5b80c2ae5d
I20260810 19:47:48.340940 10371 ts_tablet_manager.cc:1950] T 537bcbf01b1d42768996cf5b80c2ae5d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:48.342157 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 537bcbf01b1d42768996cf5b80c2ae5d (table default.Table_abe7676ae72548798853314dc36977ad [id=f4297c4f80854d1a88438b2591a6d5b5]) successfully deleted
I20260810 19:47:48.343317 10366 ts_tablet_manager.cc:1403] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.269s user 0.005s sys 0.000s
W20260810 19:47:48.346405 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 25e15a8d1e7d41e68eef25d30d668e61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25e15a8d1e7d41e68eef25d30d668e61 already in progress: creating tablet
I20260810 19:47:48.347293 10377 raft_consensus.cc:2243] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
W20260810 19:47:48.347569 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet e177140cad404e978b927c810b87ae0c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e177140cad404e978b927c810b87ae0c already in progress: creating tablet
I20260810 19:47:48.347940 10371 tablet_replica.cc:333] T 07a7203a875c40e394a00c1ac44874d8 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:48.347999 10377 pending_rounds.cc:70] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691: Trying to abort 1 pending ops.
I20260810 19:47:48.348174 10371 raft_consensus.cc:2243] T 07a7203a875c40e394a00c1ac44874d8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:48.348363 10371 raft_consensus.cc:2272] T 07a7203a875c40e394a00c1ac44874d8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:48.348461 10377 pending_rounds.cc:77] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058633393754112 op_type: NO_OP noop_request { }
I20260810 19:47:48.348594 10377 raft_consensus.cc:2889] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:48.349036 10371 ts_tablet_manager.cc:1916] T 07a7203a875c40e394a00c1ac44874d8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:48.350659 10377 raft_consensus.cc:2272] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:48.361330 10371 ts_tablet_manager.cc:1929] T 07a7203a875c40e394a00c1ac44874d8 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:48.361533 10371 log.cc:1199] T 07a7203a875c40e394a00c1ac44874d8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/07a7203a875c40e394a00c1ac44874d8
I20260810 19:47:48.361954 10371 ts_tablet_manager.cc:1950] T 07a7203a875c40e394a00c1ac44874d8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:48.367645 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 07a7203a875c40e394a00c1ac44874d8 (table default.Table_bf651ef28af14d53b75748d0719a987d [id=d9f804aed5ee40fa90152b6475aea1af]) successfully deleted
I20260810 19:47:48.368750 10366 raft_consensus.cc:359] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
W20260810 19:47:48.369655 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet a78f955a3ca946189de7ea96baee35f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a78f955a3ca946189de7ea96baee35f6 already in progress: creating tablet
I20260810 19:47:48.370962 10366 raft_consensus.cc:385] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 19:47:48.370997 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 6d4387725a1843a7a7344d10e956c712 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d4387725a1843a7a7344d10e956c712 already in progress: creating tablet
I20260810 19:47:48.371181 10366 raft_consensus.cc:740] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:48.371837 10371 tablet_replica.cc:333] T f9e1f8b7b2d04c56bc89a6b42e60da50 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:48.372049 10371 raft_consensus.cc:2243] T f9e1f8b7b2d04c56bc89a6b42e60da50 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:48.375928 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_336441014db542c6ba0f204ef41d4747"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:48.376592 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_336441014db542c6ba0f204ef41d4747 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:48.376926 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b75cdd8724cb40aa81117d76d46b5518" } new_table_name: "default.Table_e4aeb59e91c24097bac9517b3c62b75a" modify_external_catalogs: true
I20260810 19:47:48.378142 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b8c16d5ca4ee41fbaf84f9e6e6fbb3bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:48.378829 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8c16d5ca4ee41fbaf84f9e6e6fbb3bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:48.379186 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e5485c974283475aa7a3163163686d38" } new_table_name: "default.Table_21072ac9dbe04f258deedc9729a7c094" modify_external_catalogs: true
I20260810 19:47:48.380194 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a289f25ff60e4733899134f73a70715c" } modify_external_catalogs: true
I20260810 19:47:48.380389 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a289f25ff60e4733899134f73a70715c" } modify_external_catalogs: true
I20260810 19:47:48.380955 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0c6321a554ff4c1a82855f8178d69454" } modify_external_catalogs: true
I20260810 19:47:48.381117 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0c6321a554ff4c1a82855f8178d69454" } modify_external_catalogs: true
I20260810 19:47:48.382395 10371 raft_consensus.cc:2272] T f9e1f8b7b2d04c56bc89a6b42e60da50 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:48.383260 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d1719a78ecc44b9fab7663d287857196" } new_table_name: "default.Table_ac3c40912d96436d8ff55c48873a0057" modify_external_catalogs: true
I20260810 19:47:48.383424 10371 ts_tablet_manager.cc:1916] T f9e1f8b7b2d04c56bc89a6b42e60da50 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:48.385023 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_80341f42384e4e1fa901ac2ef18d3f13" } new_table_name: "default.Table_feeb41d918e24137a0d1da856cfd8e8d" modify_external_catalogs: true
W20260810 19:47:48.391211 10068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 188245us
I20260810 19:47:48.394555 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043f418de5ee493eb2bc43f3bc61e7fa" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:48.394636 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba8c4420f5e345eeac30c805d673b5e9" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:48.394891 9715 raft_consensus.cc:3060] T ba8c4420f5e345eeac30c805d673b5e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:48.396027 10371 ts_tablet_manager.cc:1929] T f9e1f8b7b2d04c56bc89a6b42e60da50 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:48.396204 10371 log.cc:1199] T f9e1f8b7b2d04c56bc89a6b42e60da50 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/f9e1f8b7b2d04c56bc89a6b42e60da50
I20260810 19:47:48.396680 10371 ts_tablet_manager.cc:1950] T f9e1f8b7b2d04c56bc89a6b42e60da50 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
W20260810 19:47:48.397112 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e9603994555425289db23bd5c38cc99 consensus state has no leader
I20260810 19:47:48.397480 9415 master_service.cc:960] ReplaceTablet: received request to replace tablet 651a1f5011de4db495dbbab2d19ff096 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:48.397811 9715 raft_consensus.cc:2468] T ba8c4420f5e345eeac30c805d673b5e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:47:48.398450 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043f418de5ee493eb2bc43f3bc61e7fa" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:48.398972 9714 raft_consensus.cc:2393] T 043f418de5ee493eb2bc43f3bc61e7fa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eadde59fd6504d679e47f03a60c64bb0 in current term 1: Already voted for candidate 6986ed920dcb4af29a5eeeda6f671691 in this term.
I20260810 19:47:48.399830 10171 raft_consensus.cc:2468] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:48.372598 10366 consensus_queue.cc:260] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.400326 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3598b5743244e39efd12703ec15aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.401136 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet f9e1f8b7b2d04c56bc89a6b42e60da50 (table default.Table_2a994cac12d24a589728d6edb766c2af [id=098d4c95bab142c2b56fecac4113a429]) successfully deleted
I20260810 19:47:48.401208 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043f418de5ee493eb2bc43f3bc61e7fa" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:48.401396 10168 raft_consensus.cc:3060] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:48.403632 10366 ts_tablet_manager.cc:1434] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.060s user 0.003s sys 0.000s
I20260810 19:47:48.404331 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e3d52bd5b741a4adcabb343b6770b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.410595 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4a92eb8626f465caf563b72598a685f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.415118 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_133f8005d08641b68da5bb9faa1e2d7b" } modify_external_catalogs: true
I20260810 19:47:48.421092 10068 leader_election.cc:304] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:48.425899 10367 tablet_bootstrap.cc:492] T 1b0d0eeff07f410eacd8a2d006241cfb P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
W20260810 19:47:48.425911 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 81720b897a674b5380c6469d1600a979 has no consensus state
I20260810 19:47:48.426118 10367 ts_tablet_manager.cc:1403] T 1b0d0eeff07f410eacd8a2d006241cfb P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.100s user 0.009s sys 0.033s
I20260810 19:47:48.426424 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3e50c2a587f045f090cdb0a281a1267f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:48.427019 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e50c2a587f045f090cdb0a281a1267f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:48.427138 10367 raft_consensus.cc:359] T 1b0d0eeff07f410eacd8a2d006241cfb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.427345 10367 raft_consensus.cc:385] T 1b0d0eeff07f410eacd8a2d006241cfb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:48.427420 10367 raft_consensus.cc:740] T 1b0d0eeff07f410eacd8a2d006241cfb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:48.427671 10367 consensus_queue.cc:260] T 1b0d0eeff07f410eacd8a2d006241cfb P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.428004 10370 tablet_bootstrap.cc:654] T 4df9d4be6ca042d3957e540d7ef44d8a P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:48.428843 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_133f8005d08641b68da5bb9faa1e2d7b" } modify_external_catalogs: true
I20260810 19:47:48.429816 10546 raft_consensus.cc:493] T 537bcbf01b1d42768996cf5b80c2ae5d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:48.429997 10546 raft_consensus.cc:515] T 537bcbf01b1d42768996cf5b80c2ae5d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.430437 10367 ts_tablet_manager.cc:1434] T 1b0d0eeff07f410eacd8a2d006241cfb P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 19:47:48.430699 10546 leader_election.cc:290] T 537bcbf01b1d42768996cf5b80c2ae5d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:48.431788 10367 tablet_bootstrap.cc:492] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:48.434054 10375 ts_tablet_manager.cc:1929] T e70d3c77a75d4aacb85bfaec774147e2 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 19:47:48.438536 10531 log.cc:927] Time spent T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691: Append to log took a long time: real 0.058s user 0.000s sys 0.000s
I20260810 19:47:48.439845 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_9417c867265449d5b1be02c69d183657"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:48.440593 10366 tablet_bootstrap.cc:492] T 994c70f8843e4b0ab744775d357c49c2 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:48.440984 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b0d0eeff07f410eacd8a2d006241cfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:48.441277 10375 log.cc:1199] T e70d3c77a75d4aacb85bfaec774147e2 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/e70d3c77a75d4aacb85bfaec774147e2
I20260810 19:47:48.441957 10375 ts_tablet_manager.cc:1950] T e70d3c77a75d4aacb85bfaec774147e2 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:48.442687 10371 tablet_replica.cc:333] T 1b0d0eeff07f410eacd8a2d006241cfb P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:48.442931 10371 raft_consensus.cc:2243] T 1b0d0eeff07f410eacd8a2d006241cfb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:48.443117 10371 raft_consensus.cc:2272] T 1b0d0eeff07f410eacd8a2d006241cfb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:47:48.443775 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9417c867265449d5b1be02c69d183657 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:48.443815 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet e70d3c77a75d4aacb85bfaec774147e2 (table default.Table_d3a9560cb9364ab6beb532186e4dc76d [id=87adb026d28943cb9a16184b8112db22]) successfully deleted
W20260810 19:47:48.444300 10067 leader_election.cc:343] T 537bcbf01b1d42768996cf5b80c2ae5d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 537bcbf01b1d42768996cf5b80c2ae5d
W20260810 19:47:48.445354 9395 catalog_manager.cc:5017] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 39b27416e1a94ab98e66ad175f9bbbeb because the tablet was not found. No further retry: Not found: Tablet not found: 39b27416e1a94ab98e66ad175f9bbbeb
I20260810 19:47:48.446002 10375 tablet_replica.cc:333] T 46d7f9bcff4140c7bad02526befc1a56 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:48.446586 10375 raft_consensus.cc:2243] T 46d7f9bcff4140c7bad02526befc1a56 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:48.447110 10375 raft_consensus.cc:2272] T 46d7f9bcff4140c7bad02526befc1a56 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:48.448006 10375 ts_tablet_manager.cc:1916] T 46d7f9bcff4140c7bad02526befc1a56 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:47:48.451460 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a01d3ec3c8914fe495f7a0f3c7c312f8 consensus state has no leader
I20260810 19:47:48.456192 9421 master_service.cc:960] ReplaceTablet: received request to replace tablet 9e09483838f0459da3041ee4fe5d55cc from {username='slave'} at 127.0.0.1:56048
W20260810 19:47:48.458951 10531 consensus_queue.cc:1175] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6986ed920dcb4af29a5eeeda6f671691" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260810 19:47:48.460322 10377 ts_tablet_manager.cc:1916] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:47:48.462898 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 668b3514d9f64d44a8747647194e50be consensus state has no leader
I20260810 19:47:48.464022 10366 tablet_bootstrap.cc:654] T 994c70f8843e4b0ab744775d357c49c2 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:48.466063 10068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 46083.2us
W20260810 19:47:48.469275 10068 leader_election.cc:343] T 537bcbf01b1d42768996cf5b80c2ae5d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 537bcbf01b1d42768996cf5b80c2ae5d
I20260810 19:47:48.471340 10068 leader_election.cc:304] T 537bcbf01b1d42768996cf5b80c2ae5d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:48.472339 10381 raft_consensus.cc:2749] T 537bcbf01b1d42768996cf5b80c2ae5d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:48.474516 10377 ts_tablet_manager.cc:1929] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:48.476332 10168 raft_consensus.cc:2468] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:48.476722 10546 raft_consensus.cc:2749] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:48.478371 10378 raft_consensus.cc:493] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:48.478753 10377 log.cc:1199] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/0d16b53753324290b10e4bdebcd8e243
I20260810 19:47:48.479518 10377 ts_tablet_manager.cc:1950] T 0d16b53753324290b10e4bdebcd8e243 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:48.479460 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9381401bf3f44ef488064afeb31098bb" } modify_external_catalogs: true
I20260810 19:47:48.479708 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9381401bf3f44ef488064afeb31098bb" } modify_external_catalogs: true
I20260810 19:47:48.483567 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 0d16b53753324290b10e4bdebcd8e243 (table default.Table_369bd7e9555d45dd84c434fb07f7d103 [id=0294677b9ff14aaa9d9ad515d1b77f8f]) successfully deleted
W20260810 19:47:48.484668 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 3a7bb5fcac0a4207b4ee997099777b5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a7bb5fcac0a4207b4ee997099777b5b already in progress: creating tablet
I20260810 19:47:48.485401 10378 raft_consensus.cc:515] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
W20260810 19:47:48.485811 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 248e8954c46e4328a696f9799604e67f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 248e8954c46e4328a696f9799604e67f already in progress: creating tablet
W20260810 19:47:48.487006 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet c5625c6f78f14d629bcd7f8c9522c4ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5625c6f78f14d629bcd7f8c9522c4ba already in progress: creating tablet
I20260810 19:47:48.487123 10371 ts_tablet_manager.cc:1916] T 1b0d0eeff07f410eacd8a2d006241cfb P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:48.487635 10378 leader_election.cc:290] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:48.488349 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dabf43505f4fc89be39ee8fb41c7ee" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:48.488528 10370 tablet_bootstrap.cc:492] T 4df9d4be6ca042d3957e540d7ef44d8a P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:48.488586 9948 raft_consensus.cc:2468] T 00dabf43505f4fc89be39ee8fb41c7ee P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:48.489338 10370 ts_tablet_manager.cc:1403] T 4df9d4be6ca042d3957e540d7ef44d8a P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.224s user 0.008s sys 0.005s
I20260810 19:47:48.489914 10377 tablet_replica.cc:333] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:48.490422 10377 raft_consensus.cc:2243] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
W20260810 19:47:48.491061 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8851f5c0c2fd4600bb99793ddd151daa consensus state has no leader
I20260810 19:47:48.491999 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dabf43505f4fc89be39ee8fb41c7ee" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:48.492089 10370 raft_consensus.cc:359] T 4df9d4be6ca042d3957e540d7ef44d8a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.492594 10370 raft_consensus.cc:385] T 4df9d4be6ca042d3957e540d7ef44d8a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:48.492602 9611 leader_election.cc:304] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:48.492743 10370 raft_consensus.cc:740] T 4df9d4be6ca042d3957e540d7ef44d8a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:48.493069 10370 consensus_queue.cc:260] T 4df9d4be6ca042d3957e540d7ef44d8a P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.493458 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c253b5f6f93744b0990aecf5a52bb10d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:48.494010 10377 pending_rounds.cc:70] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691: Trying to abort 1 pending ops.
W20260810 19:47:48.494108 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c253b5f6f93744b0990aecf5a52bb10d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:48.494481 10377 pending_rounds.cc:77] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058632562327552 op_type: NO_OP noop_request { }
I20260810 19:47:48.494617 10377 raft_consensus.cc:2889] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:48.495091 10377 raft_consensus.cc:2272] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:48.502774 10377 ts_tablet_manager.cc:1916] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:48.505385 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b07e02fd7d2e481e81bb153584c51dc2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:48.505597 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet 4df9d4be6ca042d3957e540d7ef44d8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:47:48.505985 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b07e02fd7d2e481e81bb153584c51dc2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:48.506222 10366 tablet_bootstrap.cc:492] T 994c70f8843e4b0ab744775d357c49c2 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:48.506413 10366 ts_tablet_manager.cc:1403] T 994c70f8843e4b0ab744775d357c49c2 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.100s user 0.008s sys 0.003s
I20260810 19:47:48.507226 10366 raft_consensus.cc:359] T 994c70f8843e4b0ab744775d357c49c2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.507412 10366 raft_consensus.cc:385] T 994c70f8843e4b0ab744775d357c49c2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:48.507534 10366 raft_consensus.cc:740] T 994c70f8843e4b0ab744775d357c49c2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:48.507834 10366 consensus_queue.cc:260] T 994c70f8843e4b0ab744775d357c49c2 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.509096 9407 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 00dabf43505f4fc89be39ee8fb41c7ee (table default.Table_257ddf6dffe443b7bb3a6d5e7f1e93a2 [id=6b30bf93c566421593a182e1768c0482]). Expected version 1 got 0
I20260810 19:47:48.510627 10370 ts_tablet_manager.cc:1434] T 4df9d4be6ca042d3957e540d7ef44d8a P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20260810 19:47:48.510684 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_443b8f3510e5405f933993a05ab4bd8e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:48.510802 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d16b53753324290b10e4bdebcd8e243 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:48.511062 10370 tablet_bootstrap.cc:492] T 1b0d0eeff07f410eacd8a2d006241cfb P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:47:48.511261 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_443b8f3510e5405f933993a05ab4bd8e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:48.513051 10370 tablet_bootstrap.cc:654] T 1b0d0eeff07f410eacd8a2d006241cfb P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:48.516041 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 5f560ed7ea0c4075bad1375d86738861 (DEFAULT_TABLE table=default.Table_0de524b66ecf4dea8ab5e6b87c4f6261 [id=4de43e2ae0424104aa75c5d872b72d3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.516382 10375 ts_tablet_manager.cc:1929] T 46d7f9bcff4140c7bad02526befc1a56 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:48.516477 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f560ed7ea0c4075bad1375d86738861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.516445 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 5f560ed7ea0c4075bad1375d86738861 (DEFAULT_TABLE table=default.Table_0de524b66ecf4dea8ab5e6b87c4f6261 [id=4de43e2ae0424104aa75c5d872b72d3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.516722 10375 log.cc:1199] T 46d7f9bcff4140c7bad02526befc1a56 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/46d7f9bcff4140c7bad02526befc1a56
I20260810 19:47:48.516784 9902 tablet_service.cc:1511] Processing CreateTablet for tablet dad16ea0f82942de8587dd7c98c0d2df (DEFAULT_TABLE table=default.Table_59b5d4d82ac044e0a101d8f598a44e43 [id=4fde0c720763432cac09c13172372936]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.517154 10375 ts_tablet_manager.cc:1950] T 46d7f9bcff4140c7bad02526befc1a56 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:48.517170 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dad16ea0f82942de8587dd7c98c0d2df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.517848 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f560ed7ea0c4075bad1375d86738861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.519465 10370 tablet_bootstrap.cc:492] T 1b0d0eeff07f410eacd8a2d006241cfb P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:48.519626 10370 ts_tablet_manager.cc:1403] T 1b0d0eeff07f410eacd8a2d006241cfb P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.001s
I20260810 19:47:48.520474 10370 raft_consensus.cc:359] T 1b0d0eeff07f410eacd8a2d006241cfb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.520696 10370 raft_consensus.cc:385] T 1b0d0eeff07f410eacd8a2d006241cfb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:48.520785 10370 raft_consensus.cc:740] T 1b0d0eeff07f410eacd8a2d006241cfb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:48.522765 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 46d7f9bcff4140c7bad02526befc1a56 (table default.Table_52b776d314ed4833b63f0dca563647c7 [id=fb5ae6ab2d20481992a9d0d99186a1cb]) successfully deleted
W20260810 19:47:48.523093 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 248e8954c46e4328a696f9799604e67f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 248e8954c46e4328a696f9799604e67f already in progress: creating tablet
W20260810 19:47:48.523358 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet c5625c6f78f14d629bcd7f8c9522c4ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5625c6f78f14d629bcd7f8c9522c4ba already in progress: creating tablet
I20260810 19:47:48.524031 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 4df9d4be6ca042d3957e540d7ef44d8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:47:48.524058 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 4ec0aa595d3c4e388eb7f07717ac4349 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ec0aa595d3c4e388eb7f07717ac4349 already in progress: creating tablet
W20260810 19:47:48.524894 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 3a7bb5fcac0a4207b4ee997099777b5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a7bb5fcac0a4207b4ee997099777b5b already in progress: creating tablet
I20260810 19:47:48.525477 10366 ts_tablet_manager.cc:1434] T 994c70f8843e4b0ab744775d357c49c2 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260810 19:47:48.525508 10375 tablet_replica.cc:333] T d7f5f05a042c4670a929d9a826c52667 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:48.525701 10375 raft_consensus.cc:2243] T d7f5f05a042c4670a929d9a826c52667 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:48.526701 10375 raft_consensus.cc:2272] T d7f5f05a042c4670a929d9a826c52667 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:48.527189 10125 tablet_service.cc:1511] Processing CreateTablet for tablet dad16ea0f82942de8587dd7c98c0d2df (DEFAULT_TABLE table=default.Table_59b5d4d82ac044e0a101d8f598a44e43 [id=4fde0c720763432cac09c13172372936]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.525952 10370 consensus_queue.cc:260] T 1b0d0eeff07f410eacd8a2d006241cfb P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.527835 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 4f2d7c165d2c465d9080b927d54807f7 (DEFAULT_TABLE table=default.Table_43a169cacafa4fb7a011cbe861de63c6 [id=fa3844f34a5b4d55b6e87ec2164eb8fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.528055 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dad16ea0f82942de8587dd7c98c0d2df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.528331 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f2d7c165d2c465d9080b927d54807f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.529042 10370 ts_tablet_manager.cc:1434] T 1b0d0eeff07f410eacd8a2d006241cfb P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260810 19:47:48.529395 10370 tablet_bootstrap.cc:492] T 00dabf43505f4fc89be39ee8fb41c7ee P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:48.530391 10366 tablet_bootstrap.cc:492] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:48.532164 10366 tablet_bootstrap.cc:654] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:48.533062 10375 ts_tablet_manager.cc:1916] T d7f5f05a042c4670a929d9a826c52667 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:48.536983 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 4f2d7c165d2c465d9080b927d54807f7 (DEFAULT_TABLE table=default.Table_43a169cacafa4fb7a011cbe861de63c6 [id=fa3844f34a5b4d55b6e87ec2164eb8fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.537501 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f2d7c165d2c465d9080b927d54807f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.537473 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 3badc88d94a34ff7a053ed312f0dd646 (DEFAULT_TABLE table=default.Table_aa9a8825478043949020967cf580deca [id=7a0ce9b2817b49649075fde8c8bf9070]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.537900 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3badc88d94a34ff7a053ed312f0dd646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.539431 10370 tablet_bootstrap.cc:654] T 00dabf43505f4fc89be39ee8fb41c7ee P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:48.543601 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 3badc88d94a34ff7a053ed312f0dd646 (DEFAULT_TABLE table=default.Table_aa9a8825478043949020967cf580deca [id=7a0ce9b2817b49649075fde8c8bf9070]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.544075 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3badc88d94a34ff7a053ed312f0dd646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.544595 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5 (DEFAULT_TABLE table=default.Table_e3195870d5b74675ab7cf09ff5383063 [id=d6d2d95e5e9f4e10a7d5a8153e66e4b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.544952 10370 tablet_bootstrap.cc:492] T 00dabf43505f4fc89be39ee8fb41c7ee P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:48.545032 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.545156 10370 ts_tablet_manager.cc:1403] T 00dabf43505f4fc89be39ee8fb41c7ee P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.004s
I20260810 19:47:48.546043 10370 raft_consensus.cc:359] T 00dabf43505f4fc89be39ee8fb41c7ee P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.549880 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5 (DEFAULT_TABLE table=default.Table_e3195870d5b74675ab7cf09ff5383063 [id=d6d2d95e5e9f4e10a7d5a8153e66e4b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.550109 10375 ts_tablet_manager.cc:1929] T d7f5f05a042c4670a929d9a826c52667 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:48.550249 10375 log.cc:1199] T d7f5f05a042c4670a929d9a826c52667 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/d7f5f05a042c4670a929d9a826c52667
I20260810 19:47:48.550351 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.546272 10370 raft_consensus.cc:385] T 00dabf43505f4fc89be39ee8fb41c7ee P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:48.552069 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 31c8699875b54be888b3128df1b673aa (DEFAULT_TABLE table=default.Table_7a765ce368bb42c8b6f4b0cd27d917f2 [id=5abc1f7beec444a4a988fbfcb8b45623]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.552546 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31c8699875b54be888b3128df1b673aa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:48.557900 9397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.254:33891, user_credentials={real_user=slave}} blocked reactor thread for 58906.1us
W20260810 19:47:48.560225 9397 consensus_peers.cc:597] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a -> Peer 5268e710af3c43ddab70eb7dd1aaa575 (127.8.235.254:33891): Couldn't send request to peer 5268e710af3c43ddab70eb7dd1aaa575. Status: Network error: Client connection negotiation failed: client connection to 127.8.235.254:33891: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260810 19:47:48.560410 9611 leader_election.cc:343] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:48.560799 9611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.195:43797, user_credentials={real_user=slave}} blocked reactor thread for 67813.1us
I20260810 19:47:48.562126 10378 raft_consensus.cc:2804] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:48.562181 10367 tablet_bootstrap.cc:654] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:48.562592 10378 raft_consensus.cc:493] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:48.563076 10378 raft_consensus.cc:3060] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:48.569382 10370 raft_consensus.cc:740] T 00dabf43505f4fc89be39ee8fb41c7ee P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:48.569774 10370 consensus_queue.cc:260] T 00dabf43505f4fc89be39ee8fb41c7ee P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.573350 10370 ts_tablet_manager.cc:1434] T 00dabf43505f4fc89be39ee8fb41c7ee P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.028s user 0.003s sys 0.000s
I20260810 19:47:48.573998 9408 master_service.cc:960] ReplaceTablet: received request to replace tablet 3cda6eb6d4b847edb2624a267bc3522d from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:48.576243 10370 tablet_bootstrap.cc:492] T f495efb5bc9e47f4a353b497b9ae78a8 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:48.577651 10366 tablet_bootstrap.cc:492] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:48.577840 10366 ts_tablet_manager.cc:1403] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.048s user 0.003s sys 0.000s
I20260810 19:47:48.578157 10370 tablet_bootstrap.cc:654] T f495efb5bc9e47f4a353b497b9ae78a8 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:48.578390 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 5f560ed7ea0c4075bad1375d86738861 (DEFAULT_TABLE table=default.Table_0de524b66ecf4dea8ab5e6b87c4f6261 [id=4de43e2ae0424104aa75c5d872b72d3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.578775 10366 raft_consensus.cc:359] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.578980 10366 raft_consensus.cc:385] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:48.579052 10366 raft_consensus.cc:740] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:48.579209 10375 ts_tablet_manager.cc:1950] T d7f5f05a042c4670a929d9a826c52667 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:48.579339 10366 consensus_queue.cc:260] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.580345 10366 ts_tablet_manager.cc:1434] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 19:47:48.580466 10375 tablet_replica.cc:333] T f9e1f8b7b2d04c56bc89a6b42e60da50 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:48.580793 10366 tablet_bootstrap.cc:492] T 6ae2df18a03a4e4ea8f0c2302866999c P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:48.580788 10375 raft_consensus.cc:2243] T f9e1f8b7b2d04c56bc89a6b42e60da50 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:48.580971 10375 raft_consensus.cc:2272] T f9e1f8b7b2d04c56bc89a6b42e60da50 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:48.583384 10366 tablet_bootstrap.cc:654] T 6ae2df18a03a4e4ea8f0c2302866999c P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:48.584313 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5 (DEFAULT_TABLE table=default.Table_e3195870d5b74675ab7cf09ff5383063 [id=d6d2d95e5e9f4e10a7d5a8153e66e4b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.584803 9681 tablet_service.cc:1511] Processing CreateTablet for tablet dad16ea0f82942de8587dd7c98c0d2df (DEFAULT_TABLE table=default.Table_59b5d4d82ac044e0a101d8f598a44e43 [id=4fde0c720763432cac09c13172372936]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.586071 10377 ts_tablet_manager.cc:1929] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:48.586030 9677 tablet_service.cc:1511] Processing CreateTablet for tablet 4f2d7c165d2c465d9080b927d54807f7 (DEFAULT_TABLE table=default.Table_43a169cacafa4fb7a011cbe861de63c6 [id=fa3844f34a5b4d55b6e87ec2164eb8fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.586741 10168 raft_consensus.cc:1275] T 07a7203a875c40e394a00c1ac44874d8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Refusing update from remote peer 6986ed920dcb4af29a5eeeda6f671691: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 19:47:48.587297 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f560ed7ea0c4075bad1375d86738861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.588403 10375 ts_tablet_manager.cc:1916] T f9e1f8b7b2d04c56bc89a6b42e60da50 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:48.591984 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 3badc88d94a34ff7a053ed312f0dd646 (DEFAULT_TABLE table=default.Table_aa9a8825478043949020967cf580deca [id=7a0ce9b2817b49649075fde8c8bf9070]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.592378 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 10617bdf2eed4dbd8d13ea1821443863 (DEFAULT_TABLE table=default.Table_a9d40ecd9c0349e2b7b385d0accc32e2 [id=f1973d72068847eaabc823653402d194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.593058 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 31c8699875b54be888b3128df1b673aa (DEFAULT_TABLE table=default.Table_7a765ce368bb42c8b6f4b0cd27d917f2 [id=5abc1f7beec444a4a988fbfcb8b45623]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.593086 10371 ts_tablet_manager.cc:1929] T 1b0d0eeff07f410eacd8a2d006241cfb P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:48.594698 9366 master_runner.cc:187] Error getting master registration for 127.8.235.254:33891: Network error: Client connection negotiation failed: client connection to 127.8.235.254:33891: connect: Connection refused (error 111),
I20260810 19:47:48.594887 9366 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260810 19:47:48.595044 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.595376 10371 log.cc:1199] T 1b0d0eeff07f410eacd8a2d006241cfb P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/1b0d0eeff07f410eacd8a2d006241cfb
I20260810 19:47:48.595471 10546 raft_consensus.cc:493] T 4c9c99ced15c4d3bac2330b8bcf36a26 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:48.595646 10546 raft_consensus.cc:515] T 4c9c99ced15c4d3bac2330b8bcf36a26 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.595821 10371 ts_tablet_manager.cc:1950] T 1b0d0eeff07f410eacd8a2d006241cfb P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:48.596295 10546 leader_election.cc:290] T 4c9c99ced15c4d3bac2330b8bcf36a26 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:48.596494 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31c8699875b54be888b3128df1b673aa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:48.597568 10067 leader_election.cc:343] T 4c9c99ced15c4d3bac2330b8bcf36a26 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 4c9c99ced15c4d3bac2330b8bcf36a26
I20260810 19:47:48.592938 10378 raft_consensus.cc:515] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
W20260810 19:47:48.598677 10068 leader_election.cc:343] T 4c9c99ced15c4d3bac2330b8bcf36a26 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 4c9c99ced15c4d3bac2330b8bcf36a26
I20260810 19:47:48.598802 10068 leader_election.cc:304] T 4c9c99ced15c4d3bac2330b8bcf36a26 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:48.599079 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 1b0d0eeff07f410eacd8a2d006241cfb (table default.Table_02491570846c46cf8b1b01467711a2f9 [id=b40853681dfa4d5381e47c894f8f6b9f]) successfully deleted
I20260810 19:47:48.599241 10546 raft_consensus.cc:2749] T 4c9c99ced15c4d3bac2330b8bcf36a26 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:48.601795 10375 ts_tablet_manager.cc:1929] T f9e1f8b7b2d04c56bc89a6b42e60da50 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:48.602366 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10617bdf2eed4dbd8d13ea1821443863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.603013 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dad16ea0f82942de8587dd7c98c0d2df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.604343 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3badc88d94a34ff7a053ed312f0dd646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.604606 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f2d7c165d2c465d9080b927d54807f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.602921 10546 raft_consensus.cc:493] T 65d2f6fcf0bd4f0e9650e880d305442b P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:48.606490 10546 raft_consensus.cc:515] T 65d2f6fcf0bd4f0e9650e880d305442b P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.607156 10546 leader_election.cc:290] T 65d2f6fcf0bd4f0e9650e880d305442b P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
W20260810 19:47:48.608353 10067 leader_election.cc:343] T 65d2f6fcf0bd4f0e9650e880d305442b P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 65d2f6fcf0bd4f0e9650e880d305442b
I20260810 19:47:48.604275 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 31c8699875b54be888b3128df1b673aa (DEFAULT_TABLE table=default.Table_7a765ce368bb42c8b6f4b0cd27d917f2 [id=5abc1f7beec444a4a988fbfcb8b45623]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.608899 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31c8699875b54be888b3128df1b673aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.608984 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 0efa6f35ed284933b9fc53c1cb32da82
I20260810 19:47:48.609702 9413 master_service.cc:960] ReplaceTablet: received request to replace tablet 58b33df59ffe49a9b07606b6dc9279eb from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:48.610100 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 3ca9d34cb609413d9df495bf191cc409
I20260810 19:47:48.587495 10488 raft_consensus.cc:493] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:48.587693 10492 consensus_queue.cc:1048] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:48.610513 10488 raft_consensus.cc:515] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.611171 10488 leader_election.cc:290] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:48.611279 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 651a1f5011de4db495dbbab2d19ff096
I20260810 19:47:48.611341 9407 master_service.cc:960] ReplaceTablet: received request to replace tablet 176d4e72b8e44e4b88bdf89d06f2f79a from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:48.611375 10377 log.cc:1199] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/d7f5f05a042c4670a929d9a826c52667
I20260810 19:47:48.611747 9415 catalog_manager.cc:6807] ReplaceTablet: tablet 651a1f5011de4db495dbbab2d19ff096 deleted and replaced by tablet 02cd41da21364a868f5b6c980765d0cd
I20260810 19:47:48.611851 10377 ts_tablet_manager.cc:1950] T d7f5f05a042c4670a929d9a826c52667 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
W20260810 19:47:48.611956 9831 consensus_peers.cc:597] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 07a7203a875c40e394a00c1ac44874d8. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:48.612118 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4d9757a90ce34541a2c047891e32a42c" } modify_external_catalogs: true
I20260810 19:47:48.612315 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4d9757a90ce34541a2c047891e32a42c" } modify_external_catalogs: true
I20260810 19:47:48.612416 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df9d4be6ca042d3957e540d7ef44d8a" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:48.612692 10171 raft_consensus.cc:2468] T 4df9d4be6ca042d3957e540d7ef44d8a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:48.612860 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 9e09483838f0459da3041ee4fe5d55cc
I20260810 19:47:48.613350 9421 catalog_manager.cc:6807] ReplaceTablet: tablet 9e09483838f0459da3041ee4fe5d55cc deleted and replaced by tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d
I20260810 19:47:48.613674 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_7b186c06f7bd4a98937d92630880d907"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:48.613921 9831 leader_election.cc:343] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 4df9d4be6ca042d3957e540d7ef44d8a
W20260810 19:47:48.614274 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b186c06f7bd4a98937d92630880d907 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:48.614334 9830 leader_election.cc:304] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:48.614771 10488 raft_consensus.cc:2804] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:48.614850 10488 raft_consensus.cc:493] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:48.614934 10488 raft_consensus.cc:3060] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:48.616863 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 58b33df59ffe49a9b07606b6dc9279eb
I20260810 19:47:48.617516 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet aa457d1f5cf2445eb3d869bc6ecf60b3
I20260810 19:47:48.617576 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_bba569be45404fd39e6744251a60688c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:48.617758 10488 raft_consensus.cc:515] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
W20260810 19:47:48.618181 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bba569be45404fd39e6744251a60688c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:48.618268 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e2e810e459f24d0b9d348d428782a761"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:48.618819 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2e810e459f24d0b9d348d428782a761 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:48.620484 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_41a4f12ff0aa41d5aba6c2507de37c0f" } new_table_name: "default.Table_dcf48c67df284776aca6205b880fbbc5" modify_external_catalogs: true
I20260810 19:47:48.621769 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 10617bdf2eed4dbd8d13ea1821443863 (DEFAULT_TABLE table=default.Table_a9d40ecd9c0349e2b7b385d0accc32e2 [id=f1973d72068847eaabc823653402d194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.622244 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10617bdf2eed4dbd8d13ea1821443863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.623255 10488 leader_election.cc:290] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:48.624258 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f90f1a0c22fa4781812518f44c9d7b17"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:48.624780 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f90f1a0c22fa4781812518f44c9d7b17 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:48.605302 10370 tablet_bootstrap.cc:492] T f495efb5bc9e47f4a353b497b9ae78a8 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:48.626581 10370 ts_tablet_manager.cc:1403] T f495efb5bc9e47f4a353b497b9ae78a8 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.050s user 0.004s sys 0.003s
I20260810 19:47:48.626740 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df9d4be6ca042d3957e540d7ef44d8a" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:48.626991 10377 tablet_replica.cc:333] T f9e1f8b7b2d04c56bc89a6b42e60da50 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:48.627017 10171 raft_consensus.cc:3060] T 4df9d4be6ca042d3957e540d7ef44d8a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:48.627205 10377 raft_consensus.cc:2243] T f9e1f8b7b2d04c56bc89a6b42e60da50 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:48.627380 10377 raft_consensus.cc:2272] T f9e1f8b7b2d04c56bc89a6b42e60da50 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:48.627601 10370 raft_consensus.cc:359] T f495efb5bc9e47f4a353b497b9ae78a8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.627799 10370 raft_consensus.cc:385] T f495efb5bc9e47f4a353b497b9ae78a8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:48.627898 10370 raft_consensus.cc:740] T f495efb5bc9e47f4a353b497b9ae78a8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:48.628029 10377 ts_tablet_manager.cc:1916] T f9e1f8b7b2d04c56bc89a6b42e60da50 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:48.630546 10370 consensus_queue.cc:260] T f495efb5bc9e47f4a353b497b9ae78a8 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
W20260810 19:47:48.632452 9831 leader_election.cc:343] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 4df9d4be6ca042d3957e540d7ef44d8a
I20260810 19:47:48.633363 10171 raft_consensus.cc:2468] T 4df9d4be6ca042d3957e540d7ef44d8a P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:48.633749 9685 tablet_service.cc:1558] Processing DeleteTablet for tablet 0efa6f35ed284933b9fc53c1cb32da82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:48.633916 9830 leader_election.cc:304] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:48.634078 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ca9d34cb609413d9df495bf191cc409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:48.634438 10488 raft_consensus.cc:2804] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:48.634737 10488 raft_consensus.cc:697] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:47:48.635145 10488 consensus_queue.cc:237] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.636210 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dabf43505f4fc89be39ee8fb41c7ee" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:48.636427 9948 raft_consensus.cc:3060] T 00dabf43505f4fc89be39ee8fb41c7ee P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:47:48.638896 10068 leader_election.cc:343] T 65d2f6fcf0bd4f0e9650e880d305442b P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 65d2f6fcf0bd4f0e9650e880d305442b
I20260810 19:47:48.639048 10068 leader_election.cc:304] T 65d2f6fcf0bd4f0e9650e880d305442b P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:48.639129 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 10617bdf2eed4dbd8d13ea1821443863 (DEFAULT_TABLE table=default.Table_a9d40ecd9c0349e2b7b385d0accc32e2 [id=f1973d72068847eaabc823653402d194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.639642 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10617bdf2eed4dbd8d13ea1821443863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.639432 10546 raft_consensus.cc:2749] T 65d2f6fcf0bd4f0e9650e880d305442b P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:48.639750 9948 raft_consensus.cc:2468] T 00dabf43505f4fc89be39ee8fb41c7ee P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:48.639222 10370 ts_tablet_manager.cc:1434] T f495efb5bc9e47f4a353b497b9ae78a8 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260810 19:47:48.640559 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dabf43505f4fc89be39ee8fb41c7ee" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:48.640782 10171 raft_consensus.cc:3060] T 00dabf43505f4fc89be39ee8fb41c7ee P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:48.644110 10136 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b0d0eeff07f410eacd8a2d006241cfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:48.645689 10375 log.cc:1199] T f9e1f8b7b2d04c56bc89a6b42e60da50 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/f9e1f8b7b2d04c56bc89a6b42e60da50
I20260810 19:47:48.646834 10375 ts_tablet_manager.cc:1950] T f9e1f8b7b2d04c56bc89a6b42e60da50 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
W20260810 19:47:48.647743 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 0efa6f35ed284933b9fc53c1cb32da82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0efa6f35ed284933b9fc53c1cb32da82 already in progress: creating tablet
I20260810 19:47:48.649401 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet aa457d1f5cf2445eb3d869bc6ecf60b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:48.649572 10370 tablet_bootstrap.cc:492] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:48.653657 10370 tablet_bootstrap.cc:654] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:48.654809 9685 tablet_service.cc:1558] Processing DeleteTablet for tablet 651a1f5011de4db495dbbab2d19ff096 with delete_type TABLET_DATA_DELETED (replaced by tablet 02cd41da21364a868f5b6c980765d0cd) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:48.655018 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e09483838f0459da3041ee4fe5d55cc with delete_type TABLET_DATA_DELETED (replaced by tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:48.655339 10375 tablet_replica.cc:333] T 4c9c99ced15c4d3bac2330b8bcf36a26 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:48.655725 10375 raft_consensus.cc:2243] T 4c9c99ced15c4d3bac2330b8bcf36a26 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:48.656255 10375 raft_consensus.cc:2272] T 4c9c99ced15c4d3bac2330b8bcf36a26 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:48.657537 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 58b33df59ffe49a9b07606b6dc9279eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:48.657591 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 3ca9d34cb609413d9df495bf191cc409 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ca9d34cb609413d9df495bf191cc409 already in progress: creating tablet
I20260810 19:47:48.658737 9611 leader_election.cc:304] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
W20260810 19:47:48.659170 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet aa457d1f5cf2445eb3d869bc6ecf60b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aa457d1f5cf2445eb3d869bc6ecf60b3 already in progress: creating tablet
W20260810 19:47:48.661695 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 651a1f5011de4db495dbbab2d19ff096 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 651a1f5011de4db495dbbab2d19ff096 already in progress: creating tablet
I20260810 19:47:48.663400 10375 ts_tablet_manager.cc:1916] T 4c9c99ced15c4d3bac2330b8bcf36a26 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:48.656800 10171 raft_consensus.cc:2468] T 00dabf43505f4fc89be39ee8fb41c7ee P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:48.664711 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 651a1f5011de4db495dbbab2d19ff096 with delete_type TABLET_DATA_DELETED (replaced by tablet 02cd41da21364a868f5b6c980765d0cd) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:48.665596 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 651a1f5011de4db495dbbab2d19ff096 with delete_type TABLET_DATA_DELETED (replaced by tablet 02cd41da21364a868f5b6c980765d0cd) from {username='slave'} at 127.0.0.1:38276
W20260810 19:47:48.666659 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 9e09483838f0459da3041ee4fe5d55cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e09483838f0459da3041ee4fe5d55cc already in progress: creating tablet
I20260810 19:47:48.666860 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e09483838f0459da3041ee4fe5d55cc with delete_type TABLET_DATA_DELETED (replaced by tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:48.667655 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e09483838f0459da3041ee4fe5d55cc with delete_type TABLET_DATA_DELETED (replaced by tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:48.668388 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 58b33df59ffe49a9b07606b6dc9279eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:48.668911 10370 tablet_bootstrap.cc:492] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:48.669099 10370 ts_tablet_manager.cc:1403] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.004s
I20260810 19:47:48.669198 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 58b33df59ffe49a9b07606b6dc9279eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:48.670079 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet aa457d1f5cf2445eb3d869bc6ecf60b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:48.670982 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet aa457d1f5cf2445eb3d869bc6ecf60b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:48.671633 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ca9d34cb609413d9df495bf191cc409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:48.671979 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 0efa6f35ed284933b9fc53c1cb32da82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:48.672577 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ca9d34cb609413d9df495bf191cc409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:48.673722 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet d7f5f05a042c4670a929d9a826c52667 (table default.Table_471b38d37f9d42fab33e3873f34d52a9 [id=683dbf29590844c692a645a7a60715e8]) successfully deleted
I20260810 19:47:48.674094 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet 0efa6f35ed284933b9fc53c1cb32da82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:48.675432 10378 leader_election.cc:290] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:48.675510 10370 raft_consensus.cc:359] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.676594 10370 raft_consensus.cc:385] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:48.676802 10370 raft_consensus.cc:740] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:48.677112 10370 consensus_queue.cc:260] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.677480 10377 ts_tablet_manager.cc:1929] T f9e1f8b7b2d04c56bc89a6b42e60da50 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 19:47:48.679945 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 4ec0aa595d3c4e388eb7f07717ac4349 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ec0aa595d3c4e388eb7f07717ac4349 already in progress: creating tablet
I20260810 19:47:48.680053 10370 ts_tablet_manager.cc:1434] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.011s user 0.001s sys 0.002s
I20260810 19:47:48.682066 10370 tablet_bootstrap.cc:492] T 994c70f8843e4b0ab744775d357c49c2 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:48.684295 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet d7f5f05a042c4670a929d9a826c52667 (table default.Table_471b38d37f9d42fab33e3873f34d52a9 [id=683dbf29590844c692a645a7a60715e8]) successfully deleted
W20260810 19:47:48.684144 10449 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 19:47:48.685485 10449 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 19:47:48.685911 10449 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260810 19:47:48.686422 10377 log.cc:1199] T f9e1f8b7b2d04c56bc89a6b42e60da50 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/f9e1f8b7b2d04c56bc89a6b42e60da50
I20260810 19:47:48.687045 10377 ts_tablet_manager.cc:1950] T f9e1f8b7b2d04c56bc89a6b42e60da50 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:48.686969 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 3cda6eb6d4b847edb2624a267bc3522d
I20260810 19:47:48.691706 10378 raft_consensus.cc:2804] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:48.692235 9408 catalog_manager.cc:6807] ReplaceTablet: tablet 3cda6eb6d4b847edb2624a267bc3522d deleted and replaced by tablet 3e8d34d723134d9289d96e633fed3fde
I20260810 19:47:48.694555 10377 tablet_replica.cc:333] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:48.694756 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet f9e1f8b7b2d04c56bc89a6b42e60da50 (table default.Table_2a994cac12d24a589728d6edb766c2af [id=098d4c95bab142c2b56fecac4113a429]) successfully deleted
I20260810 19:47:48.694936 10377 raft_consensus.cc:2243] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:48.695389 10377 pending_rounds.cc:70] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691: Trying to abort 2 pending ops.
I20260810 19:47:48.697744 10377 pending_rounds.cc:77] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7317058636079325184 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "07a7203a875c40e394a00c1ac44874d8" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 2 new_table_name: "default.Table_bf651ef28af14d53b75748d0719a987d" dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" new_extra_config { } }
I20260810 19:47:48.698925 10378 raft_consensus.cc:697] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:48.699465 10378 consensus_queue.cc:237] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.702586 10488 raft_consensus.cc:493] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:48.702838 10488 raft_consensus.cc:515] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.703662 10488 leader_election.cc:290] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:48.704623 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0d0eeff07f410eacd8a2d006241cfb" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:48.704893 10171 raft_consensus.cc:2468] T 1b0d0eeff07f410eacd8a2d006241cfb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:48.705686 9830 leader_election.cc:304] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:48.706188 10488 raft_consensus.cc:2804] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:48.706329 10488 raft_consensus.cc:493] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:48.706414 10488 raft_consensus.cc:3060] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:48.695379 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6084dcfa994e4313896e6f7b5e09953c" } new_table_name: "default.Table_203437f97be84f7180b7ee13b862d16c" modify_external_catalogs: true
W20260810 19:47:48.708657 9831 leader_election.cc:343] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 1b0d0eeff07f410eacd8a2d006241cfb
I20260810 19:47:48.709411 10488 raft_consensus.cc:515] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.709720 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cda6eb6d4b847edb2624a267bc3522d with delete_type TABLET_DATA_DELETED (replaced by tablet 3e8d34d723134d9289d96e633fed3fde) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:48.704911 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_67bea23de98f4ac097b6723f617bd43f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:48.710511 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67bea23de98f4ac097b6723f617bd43f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:48.710860 10377 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:38276: Aborted: Op aborted
I20260810 19:47:48.711006 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0d0eeff07f410eacd8a2d006241cfb" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:48.711238 10171 raft_consensus.cc:3060] T 1b0d0eeff07f410eacd8a2d006241cfb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:48.711788 10377 pending_rounds.cc:77] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058632386588672 op_type: NO_OP noop_request { }
I20260810 19:47:48.711937 10377 raft_consensus.cc:2889] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260810 19:47:48.712436 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 09ab62f482b14cd4b86115e9a0423e7c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09ab62f482b14cd4b86115e9a0423e7c already in progress: creating tablet
I20260810 19:47:48.714087 10136 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cda6eb6d4b847edb2624a267bc3522d with delete_type TABLET_DATA_DELETED (replaced by tablet 3e8d34d723134d9289d96e633fed3fde) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:48.714591 10171 raft_consensus.cc:2468] T 1b0d0eeff07f410eacd8a2d006241cfb P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:48.717427 10370 tablet_bootstrap.cc:654] T 994c70f8843e4b0ab744775d357c49c2 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:48.718429 10377 raft_consensus.cc:2272] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:48.717072 9830 leader_election.cc:304] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:48.716588 10375 ts_tablet_manager.cc:1929] T 4c9c99ced15c4d3bac2330b8bcf36a26 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:48.718676 10375 log.cc:1199] T 4c9c99ced15c4d3bac2330b8bcf36a26 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/4c9c99ced15c4d3bac2330b8bcf36a26
I20260810 19:47:48.718916 10492 raft_consensus.cc:2804] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:48.719098 10375 ts_tablet_manager.cc:1950] T 4c9c99ced15c4d3bac2330b8bcf36a26 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:48.720206 10375 tablet_replica.cc:333] T 65d2f6fcf0bd4f0e9650e880d305442b P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:48.720511 10375 raft_consensus.cc:2243] T 65d2f6fcf0bd4f0e9650e880d305442b P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:48.720765 10375 raft_consensus.cc:2272] T 65d2f6fcf0bd4f0e9650e880d305442b P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:48.721426 10375 ts_tablet_manager.cc:1916] T 65d2f6fcf0bd4f0e9650e880d305442b P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:48.721474 10488 leader_election.cc:290] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:48.713331 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cda6eb6d4b847edb2624a267bc3522d with delete_type TABLET_DATA_DELETED (replaced by tablet 3e8d34d723134d9289d96e633fed3fde) from {username='slave'} at 127.0.0.1:38276
W20260810 19:47:48.724329 9831 leader_election.cc:343] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 1b0d0eeff07f410eacd8a2d006241cfb
I20260810 19:47:48.724661 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet f9e1f8b7b2d04c56bc89a6b42e60da50 (table default.Table_2a994cac12d24a589728d6edb766c2af [id=098d4c95bab142c2b56fecac4113a429]) successfully deleted
W20260810 19:47:48.725040 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 09ab62f482b14cd4b86115e9a0423e7c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09ab62f482b14cd4b86115e9a0423e7c already in progress: creating tablet
W20260810 19:47:48.725569 9395 catalog_manager.cc:5017] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 39b27416e1a94ab98e66ad175f9bbbeb because the tablet was not found. No further retry: Not found: Tablet not found: 39b27416e1a94ab98e66ad175f9bbbeb
I20260810 19:47:48.727203 9948 raft_consensus.cc:1275] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Refusing update from remote peer eadde59fd6504d679e47f03a60c64bb0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 19:47:48.727429 10377 ts_tablet_manager.cc:1916] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:48.728657 10546 raft_consensus.cc:493] T f495efb5bc9e47f4a353b497b9ae78a8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:48.728899 10546 raft_consensus.cc:515] T f495efb5bc9e47f4a353b497b9ae78a8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.728207 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_21072ac9dbe04f258deedc9729a7c094" } new_table_name: "default.Table_50b96f2fdacb49cdbbce6a9e02ad2132" modify_external_catalogs: true
I20260810 19:47:48.729616 10546 leader_election.cc:290] T f495efb5bc9e47f4a353b497b9ae78a8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:48.729805 10546 consensus_queue.cc:1048] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:48.728328 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7a765ce368bb42c8b6f4b0cd27d917f2" } new_table_name: "default.Table_c35c3a44fcc44bba8a8c334292245b49" modify_external_catalogs: true
W20260810 19:47:48.731449 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet e177140cad404e978b927c810b87ae0c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e177140cad404e978b927c810b87ae0c already in progress: creating tablet
I20260810 19:47:48.732884 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f495efb5bc9e47f4a353b497b9ae78a8" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:47:48.733194 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 25e15a8d1e7d41e68eef25d30d668e61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25e15a8d1e7d41e68eef25d30d668e61 already in progress: creating tablet
W20260810 19:47:48.733692 10067 leader_election.cc:343] T f495efb5bc9e47f4a353b497b9ae78a8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:48.734027 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 4c9c99ced15c4d3bac2330b8bcf36a26 (table default.Table_43a8dfd72855490a9430e0783eb17f20 [id=7f76320f426748e79b1e7f0446d7cb51]) successfully deleted
I20260810 19:47:48.736210 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f495efb5bc9e47f4a353b497b9ae78a8" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
W20260810 19:47:48.737691 10068 leader_election.cc:343] T f495efb5bc9e47f4a353b497b9ae78a8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:48.737848 10068 leader_election.cc:304] T f495efb5bc9e47f4a353b497b9ae78a8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:48.738493 10546 raft_consensus.cc:2749] T f495efb5bc9e47f4a353b497b9ae78a8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:47:48.739166 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d654dada92a4939914d26ab72a5f5e8 consensus state has no leader
I20260810 19:47:48.739488 9715 raft_consensus.cc:1275] T ba8c4420f5e345eeac30c805d673b5e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Refusing update from remote peer eadde59fd6504d679e47f03a60c64bb0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 19:47:48.740424 10546 consensus_queue.cc:1048] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:48.742925 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0bcf4f258fad4bb1a6fd8c6aea3ad22e" } new_table_name: "default.Table_3d6b5606c1454e6297b993e3eaf7f084" modify_external_catalogs: true
I20260810 19:47:48.747501 10377 ts_tablet_manager.cc:1929] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:47:48.751993 10370 tablet_bootstrap.cc:492] T 994c70f8843e4b0ab744775d357c49c2 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:48.752210 10370 ts_tablet_manager.cc:1403] T 994c70f8843e4b0ab744775d357c49c2 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.072s user 0.006s sys 0.000s
I20260810 19:47:48.753187 10370 raft_consensus.cc:359] T 994c70f8843e4b0ab744775d357c49c2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.753417 10370 raft_consensus.cc:385] T 994c70f8843e4b0ab744775d357c49c2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:48.753506 10370 raft_consensus.cc:740] T 994c70f8843e4b0ab744775d357c49c2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:48.753777 10370 consensus_queue.cc:260] T 994c70f8843e4b0ab744775d357c49c2 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.754237 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_98357f787dbf48958872d3de9003c202"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:48.755033 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98357f787dbf48958872d3de9003c202 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:48.757030 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 58b33df59ffe49a9b07606b6dc9279eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58b33df59ffe49a9b07606b6dc9279eb already in progress: creating tablet
I20260810 19:47:48.758615 10370 ts_tablet_manager.cc:1434] T 994c70f8843e4b0ab744775d357c49c2 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260810 19:47:48.759063 10370 tablet_bootstrap.cc:492] T 5d4717c6fed24cbfab3f64fcc2c47153 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:47:48.760072 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 3cda6eb6d4b847edb2624a267bc3522d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3cda6eb6d4b847edb2624a267bc3522d already in progress: creating tablet
I20260810 19:47:48.764165 10370 tablet_bootstrap.cc:654] T 5d4717c6fed24cbfab3f64fcc2c47153 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:48.766179 9418 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 00dabf43505f4fc89be39ee8fb41c7ee (table default.Table_257ddf6dffe443b7bb3a6d5e7f1e93a2 [id=6b30bf93c566421593a182e1768c0482]). Expected version 1 got 0
I20260810 19:47:48.768955 9416 catalog_manager.cc:5719] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } }
I20260810 19:47:48.769429 9416 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 043f418de5ee493eb2bc43f3bc61e7fa (table default.Table_3d204c57a3154b73b51379fd4fe89ad7 [id=d0343c1dbf284737b5183387c8ef1483]). Expected version 2 got 0
I20260810 19:47:48.771618 10367 tablet_bootstrap.cc:492] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:48.771864 10367 ts_tablet_manager.cc:1403] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.340s user 0.008s sys 0.011s
I20260810 19:47:48.772871 10367 raft_consensus.cc:359] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.773699 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 3916a976efef43428942135e777edcec (DEFAULT_TABLE table=default.Table_3e50c2a587f045f090cdb0a281a1267f [id=f881fab647be45f786665629ab8baaee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.774448 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3916a976efef43428942135e777edcec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.776361 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 3916a976efef43428942135e777edcec (DEFAULT_TABLE table=default.Table_3e50c2a587f045f090cdb0a281a1267f [id=f881fab647be45f786665629ab8baaee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.776564 10377 log.cc:1199] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/07a7203a875c40e394a00c1ac44874d8
I20260810 19:47:48.776857 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3916a976efef43428942135e777edcec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.777112 10377 ts_tablet_manager.cc:1950] T 07a7203a875c40e394a00c1ac44874d8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:48.777487 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 7d3395886420455d9bdaf816c19ebae2 (DEFAULT_TABLE table=default.Table_da2146aa6d244f3f892e8cf1c68bda8f [id=febfd4d57fd54ce0bd4a406cc965303f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.777911 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d3395886420455d9bdaf816c19ebae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.782986 9677 tablet_service.cc:1511] Processing CreateTablet for tablet 6f0150de0d60425b807be532ce0ba6c3 (DEFAULT_TABLE table=default.Table_336441014db542c6ba0f204ef41d4747 [id=c9d6f79ab23248c69ee6d6984f6fd55c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.783115 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 3916a976efef43428942135e777edcec (DEFAULT_TABLE table=default.Table_3e50c2a587f045f090cdb0a281a1267f [id=f881fab647be45f786665629ab8baaee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.783535 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f0150de0d60425b807be532ce0ba6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.784337 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 6f0150de0d60425b807be532ce0ba6c3 (DEFAULT_TABLE table=default.Table_336441014db542c6ba0f204ef41d4747 [id=c9d6f79ab23248c69ee6d6984f6fd55c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.784754 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 07a7203a875c40e394a00c1ac44874d8 (table default.Table_bf651ef28af14d53b75748d0719a987d [id=d9f804aed5ee40fa90152b6475aea1af]) successfully deleted
W20260810 19:47:48.784868 10449 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
I20260810 19:47:48.786115 10370 tablet_bootstrap.cc:492] T 5d4717c6fed24cbfab3f64fcc2c47153 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:48.786592 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 81720b897a674b5380c6469d1600a979 (DEFAULT_TABLE table=default.Table_e4aeb59e91c24097bac9517b3c62b75a [id=8d7f043045ff44cd886367b5860f8433]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.786674 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 7d3395886420455d9bdaf816c19ebae2 (DEFAULT_TABLE table=default.Table_da2146aa6d244f3f892e8cf1c68bda8f [id=febfd4d57fd54ce0bd4a406cc965303f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.786904 10370 ts_tablet_manager.cc:1403] T 5d4717c6fed24cbfab3f64fcc2c47153 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.000s
I20260810 19:47:48.786969 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81720b897a674b5380c6469d1600a979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.787842 10370 raft_consensus.cc:359] T 5d4717c6fed24cbfab3f64fcc2c47153 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.788064 10370 raft_consensus.cc:385] T 5d4717c6fed24cbfab3f64fcc2c47153 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:48.788137 10370 raft_consensus.cc:740] T 5d4717c6fed24cbfab3f64fcc2c47153 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:48.788792 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 81720b897a674b5380c6469d1600a979 (DEFAULT_TABLE table=default.Table_e4aeb59e91c24097bac9517b3c62b75a [id=8d7f043045ff44cd886367b5860f8433]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.788934 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3916a976efef43428942135e777edcec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.789160 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81720b897a674b5380c6469d1600a979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.789371 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d3395886420455d9bdaf816c19ebae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.789911 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f0150de0d60425b807be532ce0ba6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.790750 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 7d3395886420455d9bdaf816c19ebae2 (DEFAULT_TABLE table=default.Table_da2146aa6d244f3f892e8cf1c68bda8f [id=febfd4d57fd54ce0bd4a406cc965303f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.791718 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ae6b06e8ae0c4fd19fe26b1b08db672a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:48.791806 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 81720b897a674b5380c6469d1600a979 (DEFAULT_TABLE table=default.Table_e4aeb59e91c24097bac9517b3c62b75a [id=8d7f043045ff44cd886367b5860f8433]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.792181 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81720b897a674b5380c6469d1600a979. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:48.792366 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae6b06e8ae0c4fd19fe26b1b08db672a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:48.793267 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 11272d47d96f443187d63c184049871f (DEFAULT_TABLE table=default.Table_b8c16d5ca4ee41fbaf84f9e6e6fbb3bd [id=6e9c569b1e104415ba75fb011a08a6d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.793640 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11272d47d96f443187d63c184049871f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.793967 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 6f0150de0d60425b807be532ce0ba6c3 (DEFAULT_TABLE table=default.Table_336441014db542c6ba0f204ef41d4747 [id=c9d6f79ab23248c69ee6d6984f6fd55c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.797206 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d3395886420455d9bdaf816c19ebae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.797595 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 11272d47d96f443187d63c184049871f (DEFAULT_TABLE table=default.Table_b8c16d5ca4ee41fbaf84f9e6e6fbb3bd [id=6e9c569b1e104415ba75fb011a08a6d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.798013 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f0150de0d60425b807be532ce0ba6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.798035 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11272d47d96f443187d63c184049871f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.809876 10375 ts_tablet_manager.cc:1929] T 65d2f6fcf0bd4f0e9650e880d305442b P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:48.810473 10375 log.cc:1199] T 65d2f6fcf0bd4f0e9650e880d305442b P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/65d2f6fcf0bd4f0e9650e880d305442b
I20260810 19:47:48.811141 10375 ts_tablet_manager.cc:1950] T 65d2f6fcf0bd4f0e9650e880d305442b P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:48.812933 10370 consensus_queue.cc:260] T 5d4717c6fed24cbfab3f64fcc2c47153 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.813055 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 65d2f6fcf0bd4f0e9650e880d305442b (table default.Table_5af45f52e4024048836c48234ef3a903 [id=4fda913821434991b62c8de128735a25]) successfully deleted
I20260810 19:47:48.816865 10370 ts_tablet_manager.cc:1434] T 5d4717c6fed24cbfab3f64fcc2c47153 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.030s user 0.001s sys 0.001s
I20260810 19:47:48.818857 10375 tablet_replica.cc:333] T 537bcbf01b1d42768996cf5b80c2ae5d P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:48.819413 10367 raft_consensus.cc:385] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:48.819584 10367 raft_consensus.cc:740] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
W20260810 19:47:48.819691 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a9e42e13617c4457ba88ae0e0269ec93 consensus state has no leader
I20260810 19:47:48.819902 10367 consensus_queue.cc:260] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.820394 10377 tablet_replica.cc:333] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:48.820621 10377 raft_consensus.cc:2243] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:48.820979 10377 pending_rounds.cc:70] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691: Trying to abort 1 pending ops.
I20260810 19:47:48.824930 10370 tablet_bootstrap.cc:492] T 6d4387725a1843a7a7344d10e956c712 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:48.827086 10370 tablet_bootstrap.cc:654] T 6d4387725a1843a7a7344d10e956c712 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:48.828451 10375 raft_consensus.cc:2243] T 537bcbf01b1d42768996cf5b80c2ae5d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:48.828693 10375 raft_consensus.cc:2272] T 537bcbf01b1d42768996cf5b80c2ae5d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:48.830307 9675 tablet_service.cc:1511] Processing CreateTablet for tablet ffc4466b82bd49fcaad30e4d5325c7db (DEFAULT_TABLE table=default.Table_8680fc2abacb464c8d39fae15165ea39 [id=6d8b87531495425da6e953f4e5c2fb08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.831575 10375 ts_tablet_manager.cc:1916] T 537bcbf01b1d42768996cf5b80c2ae5d P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:47:48.831875 10449 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 19:47:48.832082 10449 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 19:47:48.832218 10449 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260810 19:47:48.832765 10377 pending_rounds.cc:77] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058636332490752 op_type: NO_OP noop_request { }
I20260810 19:47:48.832984 10377 raft_consensus.cc:2889] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:48.833153 10377 raft_consensus.cc:2272] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:48.828590 10589 raft_consensus.cc:493] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:48.832607 10492 raft_consensus.cc:697] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:47:48.833702 10492 consensus_queue.cc:237] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.835350 10589 raft_consensus.cc:515] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
W20260810 19:47:48.836911 9611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 189357us
I20260810 19:47:48.836951 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4717c6fed24cbfab3f64fcc2c47153" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:48.837358 10168 raft_consensus.cc:2468] T 5d4717c6fed24cbfab3f64fcc2c47153 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:48.838825 9830 leader_election.cc:304] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:48.839267 10488 raft_consensus.cc:2804] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:48.839375 10488 raft_consensus.cc:493] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:48.839488 10488 raft_consensus.cc:3060] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:48.842614 10366 tablet_bootstrap.cc:492] T 6ae2df18a03a4e4ea8f0c2302866999c P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:48.842880 10366 ts_tablet_manager.cc:1403] T 6ae2df18a03a4e4ea8f0c2302866999c P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.262s user 0.008s sys 0.003s
I20260810 19:47:48.843320 10488 raft_consensus.cc:515] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.844036 10366 raft_consensus.cc:359] T 6ae2df18a03a4e4ea8f0c2302866999c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.844328 10366 raft_consensus.cc:385] T 6ae2df18a03a4e4ea8f0c2302866999c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:48.844489 10366 raft_consensus.cc:740] T 6ae2df18a03a4e4ea8f0c2302866999c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:48.844699 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4717c6fed24cbfab3f64fcc2c47153" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:48.844828 10366 consensus_queue.cc:260] T 6ae2df18a03a4e4ea8f0c2302866999c P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.845060 10168 raft_consensus.cc:3060] T 5d4717c6fed24cbfab3f64fcc2c47153 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:48.845105 10488 leader_election.cc:290] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:48.846228 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e2c3250ad65342b6b93438349218f41a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:48.847019 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2c3250ad65342b6b93438349218f41a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:48.847177 10377 ts_tablet_manager.cc:1916] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:48.848173 10367 ts_tablet_manager.cc:1434] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.076s user 0.001s sys 0.002s
I20260810 19:47:48.848472 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4717c6fed24cbfab3f64fcc2c47153" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:48.848604 10168 raft_consensus.cc:2468] T 5d4717c6fed24cbfab3f64fcc2c47153 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:48.848976 9716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4717c6fed24cbfab3f64fcc2c47153" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:48.849206 9830 leader_election.cc:304] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:48.849547 10488 raft_consensus.cc:2804] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:48.849733 10488 raft_consensus.cc:697] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
W20260810 19:47:48.849922 9831 leader_election.cc:343] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:48.849575 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet a78f955a3ca946189de7ea96baee35f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a78f955a3ca946189de7ea96baee35f6 already in progress: creating tablet
I20260810 19:47:48.850049 10488 consensus_queue.cc:237] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
W20260810 19:47:48.850181 9831 leader_election.cc:343] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:48.851382 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc4466b82bd49fcaad30e4d5325c7db. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:48.852507 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 6d4387725a1843a7a7344d10e956c712 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d4387725a1843a7a7344d10e956c712 already in progress: creating tablet
I20260810 19:47:48.854406 10589 leader_election.cc:290] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:48.853909 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 11272d47d96f443187d63c184049871f (DEFAULT_TABLE table=default.Table_b8c16d5ca4ee41fbaf84f9e6e6fbb3bd [id=6e9c569b1e104415ba75fb011a08a6d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.855477 10367 tablet_bootstrap.cc:492] T 6ae2df18a03a4e4ea8f0c2302866999c P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
W20260810 19:47:48.855243 9395 catalog_manager.cc:5017] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 0d16b53753324290b10e4bdebcd8e243 because the tablet was not found. No further retry: Not found: Tablet not found: 0d16b53753324290b10e4bdebcd8e243
I20260810 19:47:48.856474 10607 tablet.cc:1724] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:47:48.859218 9896 tablet_service.cc:1511] Processing CreateTablet for tablet ffc4466b82bd49fcaad30e4d5325c7db (DEFAULT_TABLE table=default.Table_8680fc2abacb464c8d39fae15165ea39 [id=6d8b87531495425da6e953f4e5c2fb08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.859580 10367 tablet_bootstrap.cc:654] T 6ae2df18a03a4e4ea8f0c2302866999c P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:48.860397 10604 tablet.cc:1724] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:47:48.862234 10136 tablet_service.cc:1511] Processing CreateTablet for tablet ffc4466b82bd49fcaad30e4d5325c7db (DEFAULT_TABLE table=default.Table_8680fc2abacb464c8d39fae15165ea39 [id=6d8b87531495425da6e953f4e5c2fb08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:48.862720 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc4466b82bd49fcaad30e4d5325c7db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.868501 10367 tablet_bootstrap.cc:492] T 6ae2df18a03a4e4ea8f0c2302866999c P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:48.868703 10367 ts_tablet_manager.cc:1403] T 6ae2df18a03a4e4ea8f0c2302866999c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.002s
I20260810 19:47:48.876838 10366 ts_tablet_manager.cc:1434] T 6ae2df18a03a4e4ea8f0c2302866999c P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.034s user 0.000s sys 0.002s
I20260810 19:47:48.877853 10367 raft_consensus.cc:359] T 6ae2df18a03a4e4ea8f0c2302866999c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.878268 10367 raft_consensus.cc:385] T 6ae2df18a03a4e4ea8f0c2302866999c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:48.878597 10367 raft_consensus.cc:740] T 6ae2df18a03a4e4ea8f0c2302866999c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:48.879257 10367 consensus_queue.cc:260] T 6ae2df18a03a4e4ea8f0c2302866999c P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.882367 10367 ts_tablet_manager.cc:1434] T 6ae2df18a03a4e4ea8f0c2302866999c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.013s user 0.004s sys 0.000s
I20260810 19:47:48.884095 10367 tablet_bootstrap.cc:492] T 994c70f8843e4b0ab744775d357c49c2 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
W20260810 19:47:48.888419 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a01d3ec3c8914fe495f7a0f3c7c312f8 consensus state has no leader
I20260810 19:47:48.889619 10375 ts_tablet_manager.cc:1929] T 537bcbf01b1d42768996cf5b80c2ae5d P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:48.889600 9410 catalog_manager.cc:5719] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193). New cstate: current_term: 1 leader_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: HEALTHY } } }
I20260810 19:47:48.890127 9410 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 00dabf43505f4fc89be39ee8fb41c7ee (table default.Table_257ddf6dffe443b7bb3a6d5e7f1e93a2 [id=6b30bf93c566421593a182e1768c0482]). Expected version 1 got 0
W20260810 19:47:48.891814 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 31c8699875b54be888b3128df1b673aa consensus state has no leader
I20260810 19:47:48.892338 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1fbfe698e86d4003a8da30f7988b9501"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:48.892961 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1fbfe698e86d4003a8da30f7988b9501 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:48.894202 10367 tablet_bootstrap.cc:654] T 994c70f8843e4b0ab744775d357c49c2 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:48.861027 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11272d47d96f443187d63c184049871f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.900151 10366 tablet_bootstrap.cc:492] T f495efb5bc9e47f4a353b497b9ae78a8 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:48.900298 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc4466b82bd49fcaad30e4d5325c7db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:48.903095 10366 tablet_bootstrap.cc:654] T f495efb5bc9e47f4a353b497b9ae78a8 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:48.895092 10546 raft_consensus.cc:493] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:48.914638 10546 raft_consensus.cc:515] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.915874 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae2df18a03a4e4ea8f0c2302866999c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:48.916115 9951 raft_consensus.cc:2468] T 6ae2df18a03a4e4ea8f0c2302866999c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:47:48.916167 9716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae2df18a03a4e4ea8f0c2302866999c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:48.916431 9716 raft_consensus.cc:2468] T 6ae2df18a03a4e4ea8f0c2302866999c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:47:48.916640 10067 leader_election.cc:304] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:48.917217 10546 leader_election.cc:290] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:48.905592 10572 mvcc.cc:204] Tried to move back new op lower bound from 7317058636625276928 to 7317058634716921856. Current Snapshot: MvccSnapshot[applied={T|T < 7317058636625276928}]
I20260810 19:47:48.917909 10546 raft_consensus.cc:2804] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:48.918129 10546 raft_consensus.cc:493] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:48.918363 10546 raft_consensus.cc:3060] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:47:48.918924 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet aa5702d7b3bd421eb7b8a4e0f181d2d4 consensus state has no leader
I20260810 19:47:48.921209 10608 consensus_queue.cc:1048] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:48.923074 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_745ec8d1fd994242990bec7acd5bd9cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:48.923797 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_745ec8d1fd994242990bec7acd5bd9cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:48.926384 10546 raft_consensus.cc:515] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.929531 9716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae2df18a03a4e4ea8f0c2302866999c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:48.929816 9716 raft_consensus.cc:3060] T 6ae2df18a03a4e4ea8f0c2302866999c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:48.933157 9716 raft_consensus.cc:2468] T 6ae2df18a03a4e4ea8f0c2302866999c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:47:48.933830 10068 leader_election.cc:304] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:48.934927 10546 leader_election.cc:290] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:48.937165 10377 ts_tablet_manager.cc:1929] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:48.937299 10546 raft_consensus.cc:2804] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:48.937479 10546 raft_consensus.cc:697] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:47:48.938773 10546 consensus_queue.cc:237] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.940111 10604 tablet.cc:1719] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0: Skipping requested alter to schema version 2, tablet already version 2
I20260810 19:47:48.943477 10375 log.cc:1199] T 537bcbf01b1d42768996cf5b80c2ae5d P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/537bcbf01b1d42768996cf5b80c2ae5d
I20260810 19:47:48.944741 10375 ts_tablet_manager.cc:1950] T 537bcbf01b1d42768996cf5b80c2ae5d P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:48.948743 10377 log.cc:1199] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/4df9d4be6ca042d3957e540d7ef44d8a
I20260810 19:47:48.949425 10377 ts_tablet_manager.cc:1950] T 4df9d4be6ca042d3957e540d7ef44d8a P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:48.956415 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 537bcbf01b1d42768996cf5b80c2ae5d (table default.Table_abe7676ae72548798853314dc36977ad [id=f4297c4f80854d1a88438b2591a6d5b5]) successfully deleted
I20260810 19:47:48.956843 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 4df9d4be6ca042d3957e540d7ef44d8a (table default.Table_0ba2d519828e48e29bb7af21dcac296e [id=f641e04b9f7c4052b81c7364bc2d1cde]) successfully deleted
W20260810 19:47:48.958135 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 651a1f5011de4db495dbbab2d19ff096 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 651a1f5011de4db495dbbab2d19ff096 already in progress: creating tablet
I20260810 19:47:48.958638 10366 tablet_bootstrap.cc:492] T f495efb5bc9e47f4a353b497b9ae78a8 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:48.958904 10366 ts_tablet_manager.cc:1403] T f495efb5bc9e47f4a353b497b9ae78a8 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.059s user 0.009s sys 0.002s
W20260810 19:47:48.959088 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 9e09483838f0459da3041ee4fe5d55cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e09483838f0459da3041ee4fe5d55cc already in progress: creating tablet
I20260810 19:47:48.959861 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8759361d39fb4003a644f53ecd07d2d1" } modify_external_catalogs: true
I20260810 19:47:48.959978 10366 raft_consensus.cc:359] T f495efb5bc9e47f4a353b497b9ae78a8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.960188 10366 raft_consensus.cc:385] T f495efb5bc9e47f4a353b497b9ae78a8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:48.960253 10366 raft_consensus.cc:740] T f495efb5bc9e47f4a353b497b9ae78a8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:48.960198 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8759361d39fb4003a644f53ecd07d2d1" } modify_external_catalogs: true
I20260810 19:47:48.960563 10366 consensus_queue.cc:260] T f495efb5bc9e47f4a353b497b9ae78a8 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.961755 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d9e5e24d09d44347bc472ff2f0ba20b6" } modify_external_catalogs: true
I20260810 19:47:48.961975 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d9e5e24d09d44347bc472ff2f0ba20b6" } modify_external_catalogs: true
I20260810 19:47:48.958519 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c86a4dc697bd4628bba90b74b908b5f9" } modify_external_catalogs: true
I20260810 19:47:48.963572 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c86a4dc697bd4628bba90b74b908b5f9" } modify_external_catalogs: true
I20260810 19:47:48.963789 10375 tablet_replica.cc:333] T 07a7203a875c40e394a00c1ac44874d8 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:48.964107 10375 raft_consensus.cc:2243] T 07a7203a875c40e394a00c1ac44874d8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:48.964334 10375 pending_rounds.cc:70] T 07a7203a875c40e394a00c1ac44874d8 P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 2 pending ops.
I20260810 19:47:48.964567 10375 pending_rounds.cc:77] T 07a7203a875c40e394a00c1ac44874d8 P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7317058636079325184 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "07a7203a875c40e394a00c1ac44874d8" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 2 new_table_name: "default.Table_bf651ef28af14d53b75748d0719a987d" dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" new_extra_config { } }
I20260810 19:47:48.965126 10375 pending_rounds.cc:77] T 07a7203a875c40e394a00c1ac44874d8 P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058632386588672 op_type: NO_OP noop_request { }
I20260810 19:47:48.965395 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b0d0eeff07f410eacd8a2d006241cfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:48.968891 10624 tablet.cc:1724] T ba8c4420f5e345eeac30c805d673b5e9 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:47:48.970230 10377 tablet_replica.cc:333] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
W20260810 19:47:48.970595 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 58b33df59ffe49a9b07606b6dc9279eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58b33df59ffe49a9b07606b6dc9279eb already in progress: creating tablet
I20260810 19:47:48.970932 10377 raft_consensus.cc:2243] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
W20260810 19:47:48.971292 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet aa457d1f5cf2445eb3d869bc6ecf60b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aa457d1f5cf2445eb3d869bc6ecf60b3 already in progress: creating tablet
I20260810 19:47:48.971709 10377 pending_rounds.cc:70] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691: Trying to abort 1 pending ops.
W20260810 19:47:48.972048 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 3ca9d34cb609413d9df495bf191cc409 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ca9d34cb609413d9df495bf191cc409 already in progress: creating tablet
I20260810 19:47:48.972251 10377 pending_rounds.cc:77] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058637147906048 op_type: NO_OP noop_request { }
W20260810 19:47:48.972625 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 0efa6f35ed284933b9fc53c1cb32da82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0efa6f35ed284933b9fc53c1cb32da82 already in progress: creating tablet
I20260810 19:47:48.972829 10377 raft_consensus.cc:2889] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:48.973018 10377 raft_consensus.cc:2272] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:48.968761 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet f495efb5bc9e47f4a353b497b9ae78a8 with delete_type TABLET_DATA_DELETED (replaced by tablet f2931130e9354f16a238712234c19217) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:48.969802 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet 994c70f8843e4b0ab744775d357c49c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:48.970136 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ae2df18a03a4e4ea8f0c2302866999c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:47:48.973366 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 3cda6eb6d4b847edb2624a267bc3522d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3cda6eb6d4b847edb2624a267bc3522d already in progress: creating tablet
I20260810 19:47:48.975431 10366 ts_tablet_manager.cc:1434] T f495efb5bc9e47f4a353b497b9ae78a8 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.016s user 0.000s sys 0.002s
I20260810 19:47:48.974674 10375 raft_consensus.cc:2889] T 07a7203a875c40e394a00c1ac44874d8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:48.977494 10375 raft_consensus.cc:2272] T 07a7203a875c40e394a00c1ac44874d8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:48.978453 10377 ts_tablet_manager.cc:1916] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:48.979108 10366 tablet_bootstrap.cc:492] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:48.983809 10367 tablet_bootstrap.cc:492] T 994c70f8843e4b0ab744775d357c49c2 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:48.984006 10367 ts_tablet_manager.cc:1403] T 994c70f8843e4b0ab744775d357c49c2 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.100s user 0.004s sys 0.007s
I20260810 19:47:48.984725 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 994c70f8843e4b0ab744775d357c49c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:48.984906 10367 raft_consensus.cc:359] T 994c70f8843e4b0ab744775d357c49c2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.985113 10367 raft_consensus.cc:385] T 994c70f8843e4b0ab744775d357c49c2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:48.985215 10367 raft_consensus.cc:740] T 994c70f8843e4b0ab744775d357c49c2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:48.985487 10367 consensus_queue.cc:260] T 994c70f8843e4b0ab744775d357c49c2 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:48.986617 10366 tablet_bootstrap.cc:654] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:48.986506 10375 ts_tablet_manager.cc:1916] T 07a7203a875c40e394a00c1ac44874d8 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:47:48.987812 10067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 71212.1us
I20260810 19:47:48.988790 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae2df18a03a4e4ea8f0c2302866999c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:48.989033 9951 raft_consensus.cc:3060] T 6ae2df18a03a4e4ea8f0c2302866999c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:48.989225 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 176d4e72b8e44e4b88bdf89d06f2f79a
I20260810 19:47:48.989823 9407 catalog_manager.cc:6807] ReplaceTablet: tablet 176d4e72b8e44e4b88bdf89d06f2f79a deleted and replaced by tablet 0c0a1e360ac648eeb0c734215bc200f6
I20260810 19:47:48.990177 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet 176d4e72b8e44e4b88bdf89d06f2f79a with delete_type TABLET_DATA_DELETED (replaced by tablet 0c0a1e360ac648eeb0c734215bc200f6) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:48.991137 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 176d4e72b8e44e4b88bdf89d06f2f79a with delete_type TABLET_DATA_DELETED (replaced by tablet 0c0a1e360ac648eeb0c734215bc200f6) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:48.992828 9951 raft_consensus.cc:2468] T 6ae2df18a03a4e4ea8f0c2302866999c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:47:48.993387 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 2d90d9c9f6524859a0e33e649dd80f7c
I20260810 19:47:48.993871 10377 ts_tablet_manager.cc:1929] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:48.994161 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3716ce5bda064fe3bc3d27c7b0e61fd7" } modify_external_catalogs: true
I20260810 19:47:48.994381 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3716ce5bda064fe3bc3d27c7b0e61fd7" } modify_external_catalogs: true
I20260810 19:47:48.995698 10370 tablet_bootstrap.cc:492] T 6d4387725a1843a7a7344d10e956c712 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:48.996801 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d90d9c9f6524859a0e33e649dd80f7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:48.997205 10370 ts_tablet_manager.cc:1403] T 6d4387725a1843a7a7344d10e956c712 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.172s user 0.001s sys 0.014s
W20260810 19:47:48.997907 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 2d90d9c9f6524859a0e33e649dd80f7c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d90d9c9f6524859a0e33e649dd80f7c already in progress: creating tablet
I20260810 19:47:48.999225 10367 ts_tablet_manager.cc:1434] T 994c70f8843e4b0ab744775d357c49c2 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.015s user 0.000s sys 0.003s
I20260810 19:47:49.001012 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d90d9c9f6524859a0e33e649dd80f7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.001370 10367 tablet_bootstrap.cc:492] T 5d4717c6fed24cbfab3f64fcc2c47153 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:48.994153 10607 tablet.cc:1719] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691: Skipping requested alter to schema version 2, tablet already version 2
I20260810 19:47:49.001962 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d90d9c9f6524859a0e33e649dd80f7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.000470 10589 consensus_queue.cc:1048] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:49.004410 10377 log.cc:1199] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/1b0d0eeff07f410eacd8a2d006241cfb
I20260810 19:47:49.005517 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 176d4e72b8e44e4b88bdf89d06f2f79a with delete_type TABLET_DATA_DELETED (replaced by tablet 0c0a1e360ac648eeb0c734215bc200f6) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:49.005959 10377 ts_tablet_manager.cc:1950] T 1b0d0eeff07f410eacd8a2d006241cfb P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
W20260810 19:47:49.006343 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 176d4e72b8e44e4b88bdf89d06f2f79a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 176d4e72b8e44e4b88bdf89d06f2f79a already in progress: creating tablet
I20260810 19:47:49.007684 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 1b0d0eeff07f410eacd8a2d006241cfb (table default.Table_02491570846c46cf8b1b01467711a2f9 [id=b40853681dfa4d5381e47c894f8f6b9f]) successfully deleted
I20260810 19:47:49.009836 10366 tablet_bootstrap.cc:492] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:49.010010 10366 ts_tablet_manager.cc:1403] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.003s
I20260810 19:47:49.010231 10377 tablet_replica.cc:333] T 994c70f8843e4b0ab744775d357c49c2 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:49.010524 10377 raft_consensus.cc:2243] T 994c70f8843e4b0ab744775d357c49c2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:49.010852 10377 raft_consensus.cc:2272] T 994c70f8843e4b0ab744775d357c49c2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:49.003218 10367 tablet_bootstrap.cc:654] T 5d4717c6fed24cbfab3f64fcc2c47153 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.010946 10366 raft_consensus.cc:359] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.011842 10366 raft_consensus.cc:385] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.011970 10366 raft_consensus.cc:740] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.012265 10366 consensus_queue.cc:260] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.013669 10377 ts_tablet_manager.cc:1916] T 994c70f8843e4b0ab744775d357c49c2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:49.015684 9418 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 043f418de5ee493eb2bc43f3bc61e7fa (table default.Table_3d204c57a3154b73b51379fd4fe89ad7 [id=d0343c1dbf284737b5183387c8ef1483]). Expected version 2 got 0
I20260810 19:47:49.015720 10366 ts_tablet_manager.cc:1434] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260810 19:47:49.020246 10366 tablet_bootstrap.cc:492] T 668b3514d9f64d44a8747647194e50be P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:49.023599 10366 tablet_bootstrap.cc:654] T 668b3514d9f64d44a8747647194e50be P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.027354 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_20332cc0e9df49adb98c82a60784c4bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:49.028059 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20332cc0e9df49adb98c82a60784c4bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:49.026360 10370 raft_consensus.cc:359] T 6d4387725a1843a7a7344d10e956c712 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.029067 10370 raft_consensus.cc:385] T 6d4387725a1843a7a7344d10e956c712 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.031036 10370 raft_consensus.cc:740] T 6d4387725a1843a7a7344d10e956c712 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.035499 10366 tablet_bootstrap.cc:492] T 668b3514d9f64d44a8747647194e50be P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:49.035705 10366 ts_tablet_manager.cc:1403] T 668b3514d9f64d44a8747647194e50be P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.004s
I20260810 19:47:49.035732 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet a71e3516f97c46f397de42f5c7089eeb from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:49.034528 10370 consensus_queue.cc:260] T 6d4387725a1843a7a7344d10e956c712 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.036613 10366 raft_consensus.cc:359] T 668b3514d9f64d44a8747647194e50be P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.036820 10366 raft_consensus.cc:385] T 668b3514d9f64d44a8747647194e50be P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.036899 10366 raft_consensus.cc:740] T 668b3514d9f64d44a8747647194e50be P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.038941 10366 consensus_queue.cc:260] T 668b3514d9f64d44a8747647194e50be P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.041249 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet 860dbb6d0a004c43bdce09075272fa70 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:49.042773 10377 ts_tablet_manager.cc:1929] T 994c70f8843e4b0ab744775d357c49c2 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:49.043589 10377 log.cc:1199] T 994c70f8843e4b0ab744775d357c49c2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/994c70f8843e4b0ab744775d357c49c2
I20260810 19:47:49.045445 10377 ts_tablet_manager.cc:1950] T 994c70f8843e4b0ab744775d357c49c2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:49.047025 10366 ts_tablet_manager.cc:1434] T 668b3514d9f64d44a8747647194e50be P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.011s user 0.002s sys 0.001s
I20260810 19:47:49.047297 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 994c70f8843e4b0ab744775d357c49c2 (table default.Table_4b9c0a9770784e0d850b9fd5481270e0 [id=88952654dedd4f77870e7f82cac12431]) successfully deleted
I20260810 19:47:49.049881 9412 master_service.cc:960] ReplaceTablet: received request to replace tablet 58b33df59ffe49a9b07606b6dc9279eb from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:49.049420 10370 ts_tablet_manager.cc:1434] T 6d4387725a1843a7a7344d10e956c712 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.051s user 0.001s sys 0.004s
W20260810 19:47:49.050274 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 176d4e72b8e44e4b88bdf89d06f2f79a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 176d4e72b8e44e4b88bdf89d06f2f79a already in progress: creating tablet
I20260810 19:47:49.051031 10366 tablet_bootstrap.cc:492] T 3a7bb5fcac0a4207b4ee997099777b5b P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
W20260810 19:47:49.051783 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 2d90d9c9f6524859a0e33e649dd80f7c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d90d9c9f6524859a0e33e649dd80f7c already in progress: creating tablet
I20260810 19:47:49.053056 10366 tablet_bootstrap.cc:654] T 3a7bb5fcac0a4207b4ee997099777b5b P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.054508 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2e7c9e56b8194281bbde511afe54b03f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:49.055290 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e7c9e56b8194281bbde511afe54b03f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:49.060078 10370 tablet_bootstrap.cc:492] T 668b3514d9f64d44a8747647194e50be P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:49.069532 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_6e4259d122294c46bd79d8abbb79c520"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:49.070303 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e4259d122294c46bd79d8abbb79c520 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:49.072173 10370 tablet_bootstrap.cc:654] T 668b3514d9f64d44a8747647194e50be P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.074034 10449 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.235.212:46393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.235.254:33891,127.8.235.253:37397,127.8.235.252:43301
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.235.254:33891
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.235.254
--webserver_port=33371
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 19:43:23 UTC on bdcb31816ec0
build id 13278
ASAN enabled
I20260810 19:47:49.078636 9416 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 02cd41da21364a868f5b6c980765d0cd
I20260810 19:47:49.079015 10624 tablet.cc:1719] T ba8c4420f5e345eeac30c805d673b5e9 P fcd31b1bbb0340cbacfce652b4ad8da4: Skipping requested alter to schema version 2, tablet already version 2
I20260810 19:47:49.084966 10449 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
W20260810 19:47:49.085839 9400 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 9e09483838f0459da3041ee4fe5d55cc (table default.Table_5e6891ff4aa040be8b327aafa596bc7e [id=fd840f00bdc5477aaad0b7fa114870dd], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 9e09483838f0459da3041ee4fe5d55cc consensus state has no leader
I20260810 19:47:49.088152 10367 tablet_bootstrap.cc:492] T 5d4717c6fed24cbfab3f64fcc2c47153 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:49.078275 10375 ts_tablet_manager.cc:1929] T 07a7203a875c40e394a00c1ac44874d8 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:47:49.088389 10367 ts_tablet_manager.cc:1403] T 5d4717c6fed24cbfab3f64fcc2c47153 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.087s user 0.008s sys 0.014s
I20260810 19:47:49.088624 10375 log.cc:1199] T 07a7203a875c40e394a00c1ac44874d8 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/07a7203a875c40e394a00c1ac44874d8
I20260810 19:47:49.089180 10375 ts_tablet_manager.cc:1950] T 07a7203a875c40e394a00c1ac44874d8 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:49.089320 10367 raft_consensus.cc:359] T 5d4717c6fed24cbfab3f64fcc2c47153 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.089560 10367 raft_consensus.cc:385] T 5d4717c6fed24cbfab3f64fcc2c47153 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.089650 10367 raft_consensus.cc:740] T 5d4717c6fed24cbfab3f64fcc2c47153 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.090005 10367 consensus_queue.cc:260] T 5d4717c6fed24cbfab3f64fcc2c47153 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.091323 10367 ts_tablet_manager.cc:1434] T 5d4717c6fed24cbfab3f64fcc2c47153 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260810 19:47:49.092018 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 07a7203a875c40e394a00c1ac44874d8 (table default.Table_bf651ef28af14d53b75748d0719a987d [id=d9f804aed5ee40fa90152b6475aea1af]) successfully deleted
I20260810 19:47:49.092188 10367 tablet_bootstrap.cc:492] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:49.093550 10449 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260810 19:47:49.093776 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 860dbb6d0a004c43bdce09075272fa70
I20260810 19:47:49.094523 10367 tablet_bootstrap.cc:654] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.094905 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet 860dbb6d0a004c43bdce09075272fa70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.096357 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet e4a92eb8626f465caf563b72598a685f from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:49.096818 10370 tablet_bootstrap.cc:492] T 668b3514d9f64d44a8747647194e50be P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:49.097036 10370 ts_tablet_manager.cc:1403] T 668b3514d9f64d44a8747647194e50be P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.002s
I20260810 19:47:49.099336 10370 raft_consensus.cc:359] T 668b3514d9f64d44a8747647194e50be P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
W20260810 19:47:49.099448 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet e177140cad404e978b927c810b87ae0c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e177140cad404e978b927c810b87ae0c already in progress: creating tablet
I20260810 19:47:49.099617 10370 raft_consensus.cc:385] T 668b3514d9f64d44a8747647194e50be P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.099686 10136 tablet_service.cc:1558] Processing DeleteTablet for tablet 860dbb6d0a004c43bdce09075272fa70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:47:49.099723 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet a78f955a3ca946189de7ea96baee35f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a78f955a3ca946189de7ea96baee35f6 already in progress: creating tablet
I20260810 19:47:49.099727 10370 raft_consensus.cc:740] T 668b3514d9f64d44a8747647194e50be P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
W20260810 19:47:49.099923 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 25e15a8d1e7d41e68eef25d30d668e61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25e15a8d1e7d41e68eef25d30d668e61 already in progress: creating tablet
I20260810 19:47:49.100096 10375 tablet_replica.cc:333] T 6d4387725a1843a7a7344d10e956c712 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
W20260810 19:47:49.100092 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 860dbb6d0a004c43bdce09075272fa70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 860dbb6d0a004c43bdce09075272fa70 already in progress: creating tablet
I20260810 19:47:49.100030 10370 consensus_queue.cc:260] T 668b3514d9f64d44a8747647194e50be P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.100654 10370 ts_tablet_manager.cc:1434] T 668b3514d9f64d44a8747647194e50be P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 19:47:49.102281 10370 tablet_bootstrap.cc:492] T 4ec0aa595d3c4e388eb7f07717ac4349 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:49.103590 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 860dbb6d0a004c43bdce09075272fa70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:49.103951 10367 tablet_bootstrap.cc:492] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:49.104105 10367 ts_tablet_manager.cc:1403] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.005s
W20260810 19:47:49.104676 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 860dbb6d0a004c43bdce09075272fa70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 860dbb6d0a004c43bdce09075272fa70 already in progress: creating tablet
I20260810 19:47:49.104970 10367 raft_consensus.cc:359] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.105278 10367 raft_consensus.cc:385] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.105391 10367 raft_consensus.cc:740] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.105782 10370 tablet_bootstrap.cc:654] T 4ec0aa595d3c4e388eb7f07717ac4349 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.107693 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_203437f97be84f7180b7ee13b862d16c" } new_table_name: "default.Table_83926431e06b4b8fb2cb2024ed370a13" modify_external_catalogs: true
I20260810 19:47:49.107690 10367 consensus_queue.cc:260] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.109127 10367 ts_tablet_manager.cc:1434] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 19:47:49.109488 10367 tablet_bootstrap.cc:492] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:49.112908 10375 raft_consensus.cc:2243] T 6d4387725a1843a7a7344d10e956c712 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:49.113283 10375 raft_consensus.cc:2272] T 6d4387725a1843a7a7344d10e956c712 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:49.114070 10367 tablet_bootstrap.cc:654] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.116504 10375 ts_tablet_manager.cc:1916] T 6d4387725a1843a7a7344d10e956c712 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:49.119513 9408 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 3e8d34d723134d9289d96e633fed3fde
I20260810 19:47:49.121778 10367 tablet_bootstrap.cc:492] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:49.121989 10367 ts_tablet_manager.cc:1403] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.004s
I20260810 19:47:49.122920 10367 raft_consensus.cc:359] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.123132 10367 raft_consensus.cc:385] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.123210 10367 raft_consensus.cc:740] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.125043 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0689244b1b034fd58974b1979666463f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:49.125253 10367 consensus_queue.cc:260] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
W20260810 19:47:49.125751 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0689244b1b034fd58974b1979666463f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:49.126703 10367 ts_tablet_manager.cc:1434] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260810 19:47:49.127085 10367 tablet_bootstrap.cc:492] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:49.132674 10367 tablet_bootstrap.cc:654] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.133708 10375 ts_tablet_manager.cc:1929] T 6d4387725a1843a7a7344d10e956c712 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:49.136189 10375 log.cc:1199] T 6d4387725a1843a7a7344d10e956c712 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/6d4387725a1843a7a7344d10e956c712
I20260810 19:47:49.136703 10375 ts_tablet_manager.cc:1950] T 6d4387725a1843a7a7344d10e956c712 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:49.137362 10370 tablet_bootstrap.cc:492] T 4ec0aa595d3c4e388eb7f07717ac4349 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:49.137624 10370 ts_tablet_manager.cc:1403] T 4ec0aa595d3c4e388eb7f07717ac4349 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.036s user 0.017s sys 0.008s
I20260810 19:47:49.138161 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 6d4387725a1843a7a7344d10e956c712 (table default.Table_8d6a1f9bb09e4de7807970d6c9479ac5 [id=7e8f45dba2404ef3b48b021b4d08bd3d]) successfully deleted
I20260810 19:47:49.137899 10375 tablet_replica.cc:333] T 4df9d4be6ca042d3957e540d7ef44d8a P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:49.139349 10375 raft_consensus.cc:2243] T 4df9d4be6ca042d3957e540d7ef44d8a P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:49.139611 10370 raft_consensus.cc:359] T 4ec0aa595d3c4e388eb7f07717ac4349 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.139633 10375 raft_consensus.cc:2272] T 4df9d4be6ca042d3957e540d7ef44d8a P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:49.140450 10367 tablet_bootstrap.cc:492] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:49.140570 10375 ts_tablet_manager.cc:1916] T 4df9d4be6ca042d3957e540d7ef44d8a P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:49.140635 10367 ts_tablet_manager.cc:1403] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.001s
I20260810 19:47:49.141480 10367 raft_consensus.cc:359] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.141840 10367 raft_consensus.cc:385] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.141958 10367 raft_consensus.cc:740] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.142259 10367 consensus_queue.cc:260] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.139878 10370 raft_consensus.cc:385] T 4ec0aa595d3c4e388eb7f07717ac4349 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.143675 10370 raft_consensus.cc:740] T 4ec0aa595d3c4e388eb7f07717ac4349 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.144080 10367 ts_tablet_manager.cc:1434] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:47:49.144062 10370 consensus_queue.cc:260] T 4ec0aa595d3c4e388eb7f07717ac4349 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.144892 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 4f8bf9f998ad44df98239767d17e3486
I20260810 19:47:49.145000 10367 tablet_bootstrap.cc:492] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:49.147003 10367 tablet_bootstrap.cc:654] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.147884 10370 ts_tablet_manager.cc:1434] T 4ec0aa595d3c4e388eb7f07717ac4349 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260810 19:47:49.148710 10136 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f8bf9f998ad44df98239767d17e3486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.148941 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f8bf9f998ad44df98239767d17e3486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.149900 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f8bf9f998ad44df98239767d17e3486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:49.150611 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 4f8bf9f998ad44df98239767d17e3486 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f8bf9f998ad44df98239767d17e3486 already in progress: creating tablet
W20260810 19:47:49.152349 10648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 19:47:49.152951 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 4f8bf9f998ad44df98239767d17e3486 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f8bf9f998ad44df98239767d17e3486 already in progress: creating tablet
I20260810 19:47:49.153143 10370 tablet_bootstrap.cc:492] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:49.156186 10366 tablet_bootstrap.cc:492] T 3a7bb5fcac0a4207b4ee997099777b5b P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:49.156237 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a9d40ecd9c0349e2b7b385d0accc32e2" } new_table_name: "default.Table_c541f938fadd4f3f977d218a6c0dca8c" modify_external_catalogs: true
I20260810 19:47:49.156379 10366 ts_tablet_manager.cc:1403] T 3a7bb5fcac0a4207b4ee997099777b5b P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.105s user 0.016s sys 0.019s
I20260810 19:47:49.157235 10366 raft_consensus.cc:359] T 3a7bb5fcac0a4207b4ee997099777b5b P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.157452 10366 raft_consensus.cc:385] T 3a7bb5fcac0a4207b4ee997099777b5b P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.157549 10366 raft_consensus.cc:740] T 3a7bb5fcac0a4207b4ee997099777b5b P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.157795 10366 consensus_queue.cc:260] T 3a7bb5fcac0a4207b4ee997099777b5b P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.158432 10366 ts_tablet_manager.cc:1434] T 3a7bb5fcac0a4207b4ee997099777b5b P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260810 19:47:49.159473 10375 ts_tablet_manager.cc:1929] T 4df9d4be6ca042d3957e540d7ef44d8a P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:49.160974 10370 tablet_bootstrap.cc:654] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:49.161520 10652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 19:47:49.162456 10375 log.cc:1199] T 4df9d4be6ca042d3957e540d7ef44d8a P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/4df9d4be6ca042d3957e540d7ef44d8a
I20260810 19:47:49.162901 10375 ts_tablet_manager.cc:1950] T 4df9d4be6ca042d3957e540d7ef44d8a P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:49.161875 10366 tablet_bootstrap.cc:492] T 9680053712644b4ca33c33031b1ad8bc P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:49.165071 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 4df9d4be6ca042d3957e540d7ef44d8a (table default.Table_0ba2d519828e48e29bb7af21dcac296e [id=f641e04b9f7c4052b81c7364bc2d1cde]) successfully deleted
I20260810 19:47:49.165809 10375 tablet_replica.cc:333] T 1b0d0eeff07f410eacd8a2d006241cfb P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:49.165853 10366 tablet_bootstrap.cc:654] T 9680053712644b4ca33c33031b1ad8bc P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.166554 10375 raft_consensus.cc:2243] T 1b0d0eeff07f410eacd8a2d006241cfb P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:49.166841 10367 tablet_bootstrap.cc:492] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:49.167063 10367 ts_tablet_manager.cc:1403] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.003s
I20260810 19:47:49.167227 10375 raft_consensus.cc:2272] T 1b0d0eeff07f410eacd8a2d006241cfb P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:49.168156 10367 raft_consensus.cc:359] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.168381 10367 raft_consensus.cc:385] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.168478 10367 raft_consensus.cc:740] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.168609 10370 tablet_bootstrap.cc:492] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:49.168841 10370 ts_tablet_manager.cc:1403] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.003s
W20260810 19:47:49.168802 10658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 19:47:49.168808 10367 consensus_queue.cc:260] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.169802 10370 raft_consensus.cc:359] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.170066 10370 raft_consensus.cc:385] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.170178 10370 raft_consensus.cc:740] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.170518 10370 consensus_queue.cc:260] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.170797 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_5fec01b720074528bb967b379211864f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:49.171430 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5fec01b720074528bb967b379211864f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:49.171787 10367 ts_tablet_manager.cc:1434] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 19:47:49.172297 10449 server_base.cc:1061] running on GCE node
I20260810 19:47:49.172811 10367 tablet_bootstrap.cc:492] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:49.175367 10370 ts_tablet_manager.cc:1434] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260810 19:47:49.175586 10367 tablet_bootstrap.cc:654] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.175894 10449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 19:47:49.178056 10370 tablet_bootstrap.cc:492] T 9680053712644b4ca33c33031b1ad8bc P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:49.179361 10375 ts_tablet_manager.cc:1916] T 1b0d0eeff07f410eacd8a2d006241cfb P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:49.181797 10366 tablet_bootstrap.cc:492] T 9680053712644b4ca33c33031b1ad8bc P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:49.182013 10366 ts_tablet_manager.cc:1403] T 9680053712644b4ca33c33031b1ad8bc P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
I20260810 19:47:49.182096 10370 tablet_bootstrap.cc:654] T 9680053712644b4ca33c33031b1ad8bc P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.182682 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e3195870d5b74675ab7cf09ff5383063" } new_table_name: "default.Table_fbd39ba8232d4e87817232b88300650a" modify_external_catalogs: true
I20260810 19:47:49.183002 10366 raft_consensus.cc:359] T 9680053712644b4ca33c33031b1ad8bc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.183241 10366 raft_consensus.cc:385] T 9680053712644b4ca33c33031b1ad8bc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.183322 10366 raft_consensus.cc:740] T 9680053712644b4ca33c33031b1ad8bc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.183588 10366 consensus_queue.cc:260] T 9680053712644b4ca33c33031b1ad8bc P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.184144 10366 ts_tablet_manager.cc:1434] T 9680053712644b4ca33c33031b1ad8bc P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:47:49.187700 10366 tablet_bootstrap.cc:492] T 4ec0aa595d3c4e388eb7f07717ac4349 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:49.189318 10375 ts_tablet_manager.cc:1929] T 1b0d0eeff07f410eacd8a2d006241cfb P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:49.189870 10366 tablet_bootstrap.cc:654] T 4ec0aa595d3c4e388eb7f07717ac4349 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.190835 10375 log.cc:1199] T 1b0d0eeff07f410eacd8a2d006241cfb P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/1b0d0eeff07f410eacd8a2d006241cfb
I20260810 19:47:49.191499 10375 ts_tablet_manager.cc:1950] T 1b0d0eeff07f410eacd8a2d006241cfb P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:49.193269 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 1b0d0eeff07f410eacd8a2d006241cfb (table default.Table_02491570846c46cf8b1b01467711a2f9 [id=b40853681dfa4d5381e47c894f8f6b9f]) successfully deleted
W20260810 19:47:49.196080 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 9e09483838f0459da3041ee4fe5d55cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e09483838f0459da3041ee4fe5d55cc already in progress: creating tablet
W20260810 19:47:49.197125 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 58b33df59ffe49a9b07606b6dc9279eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58b33df59ffe49a9b07606b6dc9279eb already in progress: creating tablet
I20260810 19:47:49.197062 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_bdec8c7d7aec442c8f6e994af3c4e4bc" } new_table_name: "default.Table_b0123864189f4f8bbe188d35a6e10013" modify_external_catalogs: true
W20260810 19:47:49.198518 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 3ca9d34cb609413d9df495bf191cc409 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ca9d34cb609413d9df495bf191cc409 already in progress: creating tablet
W20260810 19:47:49.199450 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet aa457d1f5cf2445eb3d869bc6ecf60b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aa457d1f5cf2445eb3d869bc6ecf60b3 already in progress: creating tablet
W20260810 19:47:49.200389 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 0efa6f35ed284933b9fc53c1cb32da82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0efa6f35ed284933b9fc53c1cb32da82 already in progress: creating tablet
I20260810 19:47:49.201735 10375 tablet_replica.cc:333] T f495efb5bc9e47f4a353b497b9ae78a8 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:49.202287 10375 raft_consensus.cc:2243] T f495efb5bc9e47f4a353b497b9ae78a8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:49.202924 10375 raft_consensus.cc:2272] T f495efb5bc9e47f4a353b497b9ae78a8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:49.203933 10375 ts_tablet_manager.cc:1916] T f495efb5bc9e47f4a353b497b9ae78a8 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:47:49.205493 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a9e42e13617c4457ba88ae0e0269ec93 consensus state has no leader
I20260810 19:47:49.214308 10366 tablet_bootstrap.cc:492] T 4ec0aa595d3c4e388eb7f07717ac4349 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:49.214357 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_bba569be45404fd39e6744251a60688c" } new_table_name: "default.Table_259904d1cb8e432d88e40cbdac93d13d" modify_external_catalogs: true
I20260810 19:47:49.214570 10366 ts_tablet_manager.cc:1403] T 4ec0aa595d3c4e388eb7f07717ac4349 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.030s user 0.006s sys 0.004s
I20260810 19:47:49.217825 10375 ts_tablet_manager.cc:1929] T f495efb5bc9e47f4a353b497b9ae78a8 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:49.220901 10375 log.cc:1199] T f495efb5bc9e47f4a353b497b9ae78a8 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/f495efb5bc9e47f4a353b497b9ae78a8
I20260810 19:47:49.221670 10375 ts_tablet_manager.cc:1950] T f495efb5bc9e47f4a353b497b9ae78a8 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:49.222457 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet e4a92eb8626f465caf563b72598a685f
I20260810 19:47:49.223039 9410 catalog_manager.cc:6807] ReplaceTablet: tablet e4a92eb8626f465caf563b72598a685f deleted and replaced by tablet 08e29e23d54f47968a06be98b313918d
I20260810 19:47:49.225359 10375 tablet_replica.cc:333] T 994c70f8843e4b0ab744775d357c49c2 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:49.225579 10375 raft_consensus.cc:2243] T 994c70f8843e4b0ab744775d357c49c2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:49.225792 10375 raft_consensus.cc:2272] T 994c70f8843e4b0ab744775d357c49c2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:49.226812 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet f495efb5bc9e47f4a353b497b9ae78a8 (table default.Table_f1f332ce5d104c2b889c1faf78a0510f [id=a5becac787b84d398e96784d005d21f6]) successfully deleted
I20260810 19:47:49.227236 10366 raft_consensus.cc:359] T 4ec0aa595d3c4e388eb7f07717ac4349 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.227473 10366 raft_consensus.cc:385] T 4ec0aa595d3c4e388eb7f07717ac4349 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.227598 10366 raft_consensus.cc:740] T 4ec0aa595d3c4e388eb7f07717ac4349 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.227586 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet e4a92eb8626f465caf563b72598a685f with delete_type TABLET_DATA_DELETED (replaced by tablet 08e29e23d54f47968a06be98b313918d) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:49.228086 10375 ts_tablet_manager.cc:1916] T 994c70f8843e4b0ab744775d357c49c2 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:49.228596 10136 tablet_service.cc:1558] Processing DeleteTablet for tablet e4a92eb8626f465caf563b72598a685f with delete_type TABLET_DATA_DELETED (replaced by tablet 08e29e23d54f47968a06be98b313918d) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.229139 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet e4a92eb8626f465caf563b72598a685f with delete_type TABLET_DATA_DELETED (replaced by tablet 08e29e23d54f47968a06be98b313918d) from {username='slave'} at 127.0.0.1:38276
W20260810 19:47:49.229267 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet e4a92eb8626f465caf563b72598a685f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4a92eb8626f465caf563b72598a685f already in progress: creating tablet
W20260810 19:47:49.230111 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet e4a92eb8626f465caf563b72598a685f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4a92eb8626f465caf563b72598a685f already in progress: creating tablet
I20260810 19:47:49.235358 10449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 19:47:49.236094 10366 consensus_queue.cc:260] T 4ec0aa595d3c4e388eb7f07717ac4349 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.236835 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_700bae09815f40a1a543173e1188670f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:49.237082 10375 ts_tablet_manager.cc:1929] T 994c70f8843e4b0ab744775d357c49c2 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:49.237229 10375 log.cc:1199] T 994c70f8843e4b0ab744775d357c49c2 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/994c70f8843e4b0ab744775d357c49c2
W20260810 19:47:49.237610 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_700bae09815f40a1a543173e1188670f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:49.237684 10375 ts_tablet_manager.cc:1950] T 994c70f8843e4b0ab744775d357c49c2 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:49.238354 10366 ts_tablet_manager.cc:1434] T 4ec0aa595d3c4e388eb7f07717ac4349 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.024s user 0.001s sys 0.002s
I20260810 19:47:49.240054 10366 tablet_bootstrap.cc:492] T 389ed7d4651446869d404fb389d6ce9d P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:49.247733 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 994c70f8843e4b0ab744775d357c49c2 (table default.Table_4b9c0a9770784e0d850b9fd5481270e0 [id=88952654dedd4f77870e7f82cac12431]) successfully deleted
I20260810 19:47:49.248673 10375 tablet_replica.cc:333] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:49.249327 10375 raft_consensus.cc:2243] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:49.251102 10375 pending_rounds.cc:70] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:47:49.251456 10375 pending_rounds.cc:77] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058637599277056 op_type: NO_OP noop_request { }
I20260810 19:47:49.251863 10375 raft_consensus.cc:2889] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:49.252206 10375 raft_consensus.cc:2272] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:49.253211 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_bc109c4a41b649f0843393e4184b81be" } modify_external_catalogs: true
I20260810 19:47:49.253432 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_bc109c4a41b649f0843393e4184b81be" } modify_external_catalogs: true
I20260810 19:47:49.255074 10375 ts_tablet_manager.cc:1916] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:49.263307 10375 ts_tablet_manager.cc:1929] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:49.263859 10449 hybrid_clock.cc:648] HybridClock initialized: now 1786391269263685 us; error 132 us; skew 500 ppm
I20260810 19:47:49.264598 10449 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 19:47:49.269474 10598 raft_consensus.cc:493] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:49.269840 10375 log.cc:1199] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/6ae2df18a03a4e4ea8f0c2302866999c
I20260810 19:47:49.269681 10598 raft_consensus.cc:515] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.270391 10375 ts_tablet_manager.cc:1950] T 6ae2df18a03a4e4ea8f0c2302866999c P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:49.270767 10598 leader_election.cc:290] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:47:49.270946 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 10617bdf2eed4dbd8d13ea1821443863 consensus state has no leader
I20260810 19:47:49.271283 9415 master_service.cc:960] ReplaceTablet: received request to replace tablet 043f418de5ee493eb2bc43f3bc61e7fa from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:49.272053 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_6d2e6ad78a7841e891fae5f687a3c392"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:49.272324 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9680053712644b4ca33c33031b1ad8bc" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:49.272571 9951 raft_consensus.cc:2468] T 9680053712644b4ca33c33031b1ad8bc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
W20260810 19:47:49.272699 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d2e6ad78a7841e891fae5f687a3c392 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:49.273073 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9680053712644b4ca33c33031b1ad8bc" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:49.273662 10366 tablet_bootstrap.cc:654] T 389ed7d4651446869d404fb389d6ce9d P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.274093 9611 leader_election.cc:304] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
W20260810 19:47:49.274508 9611 leader_election.cc:343] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:49.274991 10598 raft_consensus.cc:2804] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:49.275115 10598 raft_consensus.cc:493] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:49.272665 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 6ae2df18a03a4e4ea8f0c2302866999c (table default.Table_d3d4ff6a369249fea07d925aa5bfcd23 [id=cb4a2b1054cc4067ba59466503c77f8f]) successfully deleted
I20260810 19:47:49.275211 10598 raft_consensus.cc:3060] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:47:49.275413 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 176d4e72b8e44e4b88bdf89d06f2f79a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 176d4e72b8e44e4b88bdf89d06f2f79a already in progress: creating tablet
W20260810 19:47:49.275688 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 2d90d9c9f6524859a0e33e649dd80f7c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d90d9c9f6524859a0e33e649dd80f7c already in progress: creating tablet
W20260810 19:47:49.275908 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 860dbb6d0a004c43bdce09075272fa70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 860dbb6d0a004c43bdce09075272fa70 already in progress: creating tablet
W20260810 19:47:49.276319 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 4f8bf9f998ad44df98239767d17e3486 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f8bf9f998ad44df98239767d17e3486 already in progress: creating tablet
W20260810 19:47:49.277209 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet e4a92eb8626f465caf563b72598a685f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4a92eb8626f465caf563b72598a685f already in progress: creating tablet
I20260810 19:47:49.278136 10598 raft_consensus.cc:515] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.279197 10370 tablet_bootstrap.cc:492] T 9680053712644b4ca33c33031b1ad8bc P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:49.279349 10370 ts_tablet_manager.cc:1403] T 9680053712644b4ca33c33031b1ad8bc P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.101s user 0.027s sys 0.015s
I20260810 19:47:49.279932 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9680053712644b4ca33c33031b1ad8bc" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:49.280210 9951 raft_consensus.cc:3060] T 9680053712644b4ca33c33031b1ad8bc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:49.280313 10370 raft_consensus.cc:359] T 9680053712644b4ca33c33031b1ad8bc P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.280495 10370 raft_consensus.cc:385] T 9680053712644b4ca33c33031b1ad8bc P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.280586 10370 raft_consensus.cc:740] T 9680053712644b4ca33c33031b1ad8bc P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.284247 9951 raft_consensus.cc:2468] T 9680053712644b4ca33c33031b1ad8bc P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:49.285043 9611 leader_election.cc:304] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:49.285475 10585 raft_consensus.cc:2804] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:49.285642 10585 raft_consensus.cc:697] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:49.285977 10585 consensus_queue.cc:237] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
W20260810 19:47:49.286777 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5 consensus state has no leader
I20260810 19:47:49.289978 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9680053712644b4ca33c33031b1ad8bc" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:49.290587 10598 leader_election.cc:290] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:49.291141 10366 tablet_bootstrap.cc:492] T 389ed7d4651446869d404fb389d6ce9d P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:49.291417 10366 ts_tablet_manager.cc:1403] T 389ed7d4651446869d404fb389d6ce9d P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.053s user 0.005s sys 0.004s
I20260810 19:47:49.292323 10366 raft_consensus.cc:359] T 389ed7d4651446869d404fb389d6ce9d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.292622 10366 raft_consensus.cc:385] T 389ed7d4651446869d404fb389d6ce9d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.292752 10366 raft_consensus.cc:740] T 389ed7d4651446869d404fb389d6ce9d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.293144 10366 consensus_queue.cc:260] T 389ed7d4651446869d404fb389d6ce9d P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.294809 10366 ts_tablet_manager.cc:1434] T 389ed7d4651446869d404fb389d6ce9d P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 19:47:49.295258 10366 tablet_bootstrap.cc:492] T d15bcf97364046daa97f7461f4f6bc98 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:49.295701 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_8d68cddeb5f84601ab82e52cbc26b10f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:49.296392 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d68cddeb5f84601ab82e52cbc26b10f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:49.297277 10449 webserver.cc:533] Webserver started at http://127.8.235.254:33371/ using document root <none> and password file <none>
I20260810 19:47:49.299032 10449 fs_manager.cc:362] Metadata directory not provided
I20260810 19:47:49.299269 10449 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
W20260810 19:47:49.304193 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 74dddd12f2314d6ab5a6717025b13a51 consensus state has no leader
I20260810 19:47:49.305488 10366 tablet_bootstrap.cc:654] T d15bcf97364046daa97f7461f4f6bc98 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.308468 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_4ba52e1a6c3b42688033e6fd1cdcd7ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:49.309258 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ba52e1a6c3b42688033e6fd1cdcd7ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:49.313884 10367 tablet_bootstrap.cc:492] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:49.314172 10367 ts_tablet_manager.cc:1403] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.141s user 0.028s sys 0.080s
I20260810 19:47:49.315291 10449 fs_manager.cc:714] Time spent opening directory manager: real 0.013s user 0.007s sys 0.001s
I20260810 19:47:49.316159 10367 raft_consensus.cc:359] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.316560 10367 raft_consensus.cc:385] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 19:47:49.317303 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 06af03c8a87141febef768bd56c72c39 has no consensus state
I20260810 19:47:49.317463 10367 raft_consensus.cc:740] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.317652 9413 master_service.cc:960] ReplaceTablet: received request to replace tablet 34fdc03b114b405da9e3a17ef1ad87c4 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:49.317960 10367 consensus_queue.cc:260] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.319639 10366 tablet_bootstrap.cc:492] T d15bcf97364046daa97f7461f4f6bc98 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:49.319883 10366 ts_tablet_manager.cc:1403] T d15bcf97364046daa97f7461f4f6bc98 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.004s
I20260810 19:47:49.320775 10366 raft_consensus.cc:359] T d15bcf97364046daa97f7461f4f6bc98 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.321065 10366 raft_consensus.cc:385] T d15bcf97364046daa97f7461f4f6bc98 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.321220 10366 raft_consensus.cc:740] T d15bcf97364046daa97f7461f4f6bc98 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.321599 10366 consensus_queue.cc:260] T d15bcf97364046daa97f7461f4f6bc98 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.322436 10366 ts_tablet_manager.cc:1434] T d15bcf97364046daa97f7461f4f6bc98 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:47:49.323091 10598 raft_consensus.cc:493] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:49.323263 10598 raft_consensus.cc:515] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.324007 10598 leader_election.cc:290] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:49.325169 10366 tablet_bootstrap.cc:492] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
W20260810 19:47:49.325867 9611 leader_election.cc:343] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Not found: Tablet not found: f495efb5bc9e47f4a353b497b9ae78a8
I20260810 19:47:49.326915 10367 ts_tablet_manager.cc:1434] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260810 19:47:49.327450 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f495efb5bc9e47f4a353b497b9ae78a8" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:49.280853 10370 consensus_queue.cc:260] T 9680053712644b4ca33c33031b1ad8bc P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.328351 10370 ts_tablet_manager.cc:1434] T 9680053712644b4ca33c33031b1ad8bc P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.049s user 0.001s sys 0.001s
I20260810 19:47:49.328733 10370 tablet_bootstrap.cc:492] T 3a7bb5fcac0a4207b4ee997099777b5b P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:49.328858 10168 raft_consensus.cc:3060] T 9680053712644b4ca33c33031b1ad8bc P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:49.330989 10370 tablet_bootstrap.cc:654] T 3a7bb5fcac0a4207b4ee997099777b5b P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.332139 10168 raft_consensus.cc:2468] T 9680053712644b4ca33c33031b1ad8bc P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:49.332680 10596 raft_consensus.cc:493] T 5d4717c6fed24cbfab3f64fcc2c47153 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:49.332854 10596 raft_consensus.cc:515] T 5d4717c6fed24cbfab3f64fcc2c47153 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.333886 10596 leader_election.cc:290] T 5d4717c6fed24cbfab3f64fcc2c47153 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:49.334929 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4717c6fed24cbfab3f64fcc2c47153" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:49.335203 9416 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 043f418de5ee493eb2bc43f3bc61e7fa (table default.Table_3d204c57a3154b73b51379fd4fe89ad7 [id=d0343c1dbf284737b5183387c8ef1483]). Expected version 2 got 0
I20260810 19:47:49.335175 9951 raft_consensus.cc:2468] T f495efb5bc9e47f4a353b497b9ae78a8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:49.335310 10168 raft_consensus.cc:2393] T 5d4717c6fed24cbfab3f64fcc2c47153 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcd31b1bbb0340cbacfce652b4ad8da4 in current term 1: Already voted for candidate 6986ed920dcb4af29a5eeeda6f671691 in this term.
I20260810 19:47:49.336567 9611 leader_election.cc:304] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:49.337065 10598 raft_consensus.cc:2804] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:49.337181 10598 raft_consensus.cc:493] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:49.337263 10366 tablet_bootstrap.cc:654] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.337262 10598 raft_consensus.cc:3060] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:49.338459 9407 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_2080a27caba94bd8a8ab66b012cb20e4 [id=c421996810c34ce69ca7c00ed984dc54] alter complete (version 2)
I20260810 19:47:49.340476 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4717c6fed24cbfab3f64fcc2c47153" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:49.341336 9611 leader_election.cc:304] T 5d4717c6fed24cbfab3f64fcc2c47153 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:49.342379 10596 raft_consensus.cc:3060] T 5d4717c6fed24cbfab3f64fcc2c47153 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:49.343058 9418 master_service.cc:960] ReplaceTablet: received request to replace tablet 6d4387725a1843a7a7344d10e956c712 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:49.343688 9675 tablet_service.cc:1511] Processing CreateTablet for tablet d99b34f901484fad87cff4bb9ab56fc8 (DEFAULT_TABLE table=default.Table_67bea23de98f4ac097b6723f617bd43f [id=8fac27396c0e45458c9f668d6349fc03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.344172 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d99b34f901484fad87cff4bb9ab56fc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.345680 10596 raft_consensus.cc:2749] T 5d4717c6fed24cbfab3f64fcc2c47153 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:49.346048 10366 tablet_bootstrap.cc:492] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:49.346380 10366 ts_tablet_manager.cc:1403] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.005s
I20260810 19:47:49.346684 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 06af03c8a87141febef768bd56c72c39 (DEFAULT_TABLE table=default.Table_259904d1cb8e432d88e40cbdac93d13d [id=aa329023fb1a498cb6dc964edbaccb77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.347039 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 6992e7ef8e794ddc879ae04f9f78b8bd (DEFAULT_TABLE table=default.Table_443b8f3510e5405f933993a05ab4bd8e [id=3b14f80137654337b24c2bb4131e58d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.347139 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06af03c8a87141febef768bd56c72c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.347409 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6992e7ef8e794ddc879ae04f9f78b8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.347378 10366 raft_consensus.cc:359] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.347613 10366 raft_consensus.cc:385] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.347681 10366 raft_consensus.cc:740] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.348061 10366 consensus_queue.cc:260] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.348799 10366 ts_tablet_manager.cc:1434] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 19:47:49.349234 10366 tablet_bootstrap.cc:492] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:49.350685 9677 tablet_service.cc:1511] Processing CreateTablet for tablet 45194cae6ea44d9d8cf856d256fd534f (DEFAULT_TABLE table=default.Table_b07e02fd7d2e481e81bb153584c51dc2 [id=cf61b40b912d40368890dc6dfc5d1162]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.351132 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45194cae6ea44d9d8cf856d256fd534f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.351603 10366 tablet_bootstrap.cc:654] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.346664 10598 raft_consensus.cc:515] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.352820 10598 leader_election.cc:290] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:49.353652 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f495efb5bc9e47f4a353b497b9ae78a8" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:49.353840 9951 raft_consensus.cc:3060] T f495efb5bc9e47f4a353b497b9ae78a8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:49.354737 9904 tablet_service.cc:1511] Processing CreateTablet for tablet d99b34f901484fad87cff4bb9ab56fc8 (DEFAULT_TABLE table=default.Table_67bea23de98f4ac097b6723f617bd43f [id=8fac27396c0e45458c9f668d6349fc03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.353211 10676 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 19:47:49.355209 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d99b34f901484fad87cff4bb9ab56fc8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:49.356631 9611 leader_election.cc:343] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Not found: Tablet not found: f495efb5bc9e47f4a353b497b9ae78a8
I20260810 19:47:49.357537 10449 fs_manager.cc:730] Time spent opening block manager: real 0.033s user 0.004s sys 0.004s
I20260810 19:47:49.357604 9951 raft_consensus.cc:2468] T f495efb5bc9e47f4a353b497b9ae78a8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:49.358127 9611 leader_election.cc:304] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:49.358536 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 06af03c8a87141febef768bd56c72c39 (DEFAULT_TABLE table=default.Table_259904d1cb8e432d88e40cbdac93d13d [id=aa329023fb1a498cb6dc964edbaccb77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.358687 10596 raft_consensus.cc:2804] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:49.357781 10449 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/data,/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/wal
uuid: "5268e710af3c43ddab70eb7dd1aaa575"
format_stamp: "Formatted at 2026-08-10 19:47:42 on dist-test-slave-fgb3"
I20260810 19:47:49.359002 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06af03c8a87141febef768bd56c72c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.359061 10449 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 19:47:49.362524 10596 raft_consensus.cc:697] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:49.363067 10136 tablet_service.cc:1511] Processing CreateTablet for tablet d99b34f901484fad87cff4bb9ab56fc8 (DEFAULT_TABLE table=default.Table_67bea23de98f4ac097b6723f617bd43f [id=8fac27396c0e45458c9f668d6349fc03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.363564 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d99b34f901484fad87cff4bb9ab56fc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.363222 10596 consensus_queue.cc:237] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.363757 10370 tablet_bootstrap.cc:492] T 3a7bb5fcac0a4207b4ee997099777b5b P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:49.363982 10370 ts_tablet_manager.cc:1403] T 3a7bb5fcac0a4207b4ee997099777b5b P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.013s
I20260810 19:47:49.364946 10370 raft_consensus.cc:359] T 3a7bb5fcac0a4207b4ee997099777b5b P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.365196 10370 raft_consensus.cc:385] T 3a7bb5fcac0a4207b4ee997099777b5b P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.365276 10370 raft_consensus.cc:740] T 3a7bb5fcac0a4207b4ee997099777b5b P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.366708 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 06af03c8a87141febef768bd56c72c39 (DEFAULT_TABLE table=default.Table_259904d1cb8e432d88e40cbdac93d13d [id=aa329023fb1a498cb6dc964edbaccb77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.367148 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06af03c8a87141febef768bd56c72c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.372210 10370 consensus_queue.cc:260] T 3a7bb5fcac0a4207b4ee997099777b5b P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.374794 10367 tablet_bootstrap.cc:492] T 389ed7d4651446869d404fb389d6ce9d P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:49.376341 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b0d0eeff07f410eacd8a2d006241cfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.376888 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 6992e7ef8e794ddc879ae04f9f78b8bd (DEFAULT_TABLE table=default.Table_443b8f3510e5405f933993a05ab4bd8e [id=3b14f80137654337b24c2bb4131e58d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.377058 10370 ts_tablet_manager.cc:1434] T 3a7bb5fcac0a4207b4ee997099777b5b P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.013s user 0.001s sys 0.002s
I20260810 19:47:49.376663 9899 tablet_service.cc:1558] Processing DeleteTablet for tablet f495efb5bc9e47f4a353b497b9ae78a8 with delete_type TABLET_DATA_DELETED (replaced by tablet f2931130e9354f16a238712234c19217) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.377593 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6992e7ef8e794ddc879ae04f9f78b8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.378387 10377 tablet_replica.cc:333] T f495efb5bc9e47f4a353b497b9ae78a8 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:49.378336 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 6992e7ef8e794ddc879ae04f9f78b8bd (DEFAULT_TABLE table=default.Table_443b8f3510e5405f933993a05ab4bd8e [id=3b14f80137654337b24c2bb4131e58d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.378877 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6992e7ef8e794ddc879ae04f9f78b8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.379987 10367 tablet_bootstrap.cc:654] T 389ed7d4651446869d404fb389d6ce9d P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.381577 10370 tablet_bootstrap.cc:492] T 204ef31f396a43a5bf06205560f987c9 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:49.382501 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d4717c6fed24cbfab3f64fcc2c47153 with delete_type TABLET_DATA_DELETED (replaced by tablet a9e42e13617c4457ba88ae0e0269ec93) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.382856 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ae2df18a03a4e4ea8f0c2302866999c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.383790 10370 tablet_bootstrap.cc:654] T 204ef31f396a43a5bf06205560f987c9 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.383872 10375 tablet_replica.cc:333] T 5d4717c6fed24cbfab3f64fcc2c47153 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:49.384135 10375 raft_consensus.cc:2243] T 5d4717c6fed24cbfab3f64fcc2c47153 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:49.384337 10375 raft_consensus.cc:2272] T 5d4717c6fed24cbfab3f64fcc2c47153 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:49.385033 10375 ts_tablet_manager.cc:1916] T 5d4717c6fed24cbfab3f64fcc2c47153 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:49.385699 10377 raft_consensus.cc:2243] T f495efb5bc9e47f4a353b497b9ae78a8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:49.385965 10377 raft_consensus.cc:2272] T f495efb5bc9e47f4a353b497b9ae78a8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:49.386229 10589 raft_consensus.cc:493] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:49.386420 10589 raft_consensus.cc:515] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.386936 10377 ts_tablet_manager.cc:1916] T f495efb5bc9e47f4a353b497b9ae78a8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:49.387149 10589 leader_election.cc:290] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:49.387385 9911 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ae2df18a03a4e4ea8f0c2302866999c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.387595 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d4717c6fed24cbfab3f64fcc2c47153 with delete_type TABLET_DATA_DELETED (replaced by tablet a9e42e13617c4457ba88ae0e0269ec93) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.387759 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 994c70f8843e4b0ab744775d357c49c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.390784 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4387725a1843a7a7344d10e956c712" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:49.391050 9715 raft_consensus.cc:2468] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:49.391664 9831 leader_election.cc:304] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:49.392130 10589 raft_consensus.cc:2804] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:49.392270 10589 raft_consensus.cc:493] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:49.392369 10589 raft_consensus.cc:3060] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:49.394726 10377 ts_tablet_manager.cc:1929] T f495efb5bc9e47f4a353b497b9ae78a8 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:49.394953 10377 log.cc:1199] T f495efb5bc9e47f4a353b497b9ae78a8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/f495efb5bc9e47f4a353b497b9ae78a8
I20260810 19:47:49.395399 10377 ts_tablet_manager.cc:1950] T f495efb5bc9e47f4a353b497b9ae78a8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:49.396495 10377 tablet_replica.cc:333] T 6ae2df18a03a4e4ea8f0c2302866999c P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:49.396764 10377 raft_consensus.cc:2243] T 6ae2df18a03a4e4ea8f0c2302866999c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:49.397127 10598 raft_consensus.cc:493] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:49.397311 10598 raft_consensus.cc:515] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.398093 10598 leader_election.cc:290] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:49.398701 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ae2df18a03a4e4ea8f0c2302866999c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:49.398989 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 994c70f8843e4b0ab744775d357c49c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:49.399118 10371 tablet_replica.cc:333] T 6ae2df18a03a4e4ea8f0c2302866999c P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:49.399159 10370 tablet_bootstrap.cc:492] T 204ef31f396a43a5bf06205560f987c9 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:49.399334 10371 raft_consensus.cc:2243] T 6ae2df18a03a4e4ea8f0c2302866999c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:49.399358 10370 ts_tablet_manager.cc:1403] T 204ef31f396a43a5bf06205560f987c9 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.009s
W20260810 19:47:49.399528 9611 leader_election.cc:343] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Not found: Tablet not found: 6d4387725a1843a7a7344d10e956c712
I20260810 19:47:49.400246 10370 raft_consensus.cc:359] T 204ef31f396a43a5bf06205560f987c9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.400467 10370 raft_consensus.cc:385] T 204ef31f396a43a5bf06205560f987c9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 19:47:49.400485 9395 catalog_manager.cc:5017] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 1b0d0eeff07f410eacd8a2d006241cfb because the tablet was not found. No further retry: Not found: Tablet not found: 1b0d0eeff07f410eacd8a2d006241cfb
I20260810 19:47:49.400553 10370 raft_consensus.cc:740] T 204ef31f396a43a5bf06205560f987c9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.399544 10371 raft_consensus.cc:2272] T 6ae2df18a03a4e4ea8f0c2302866999c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:49.400816 10370 consensus_queue.cc:260] T 204ef31f396a43a5bf06205560f987c9 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.401420 10370 ts_tablet_manager.cc:1434] T 204ef31f396a43a5bf06205560f987c9 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:47:49.401507 10371 ts_tablet_manager.cc:1916] T 6ae2df18a03a4e4ea8f0c2302866999c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:49.401711 10370 tablet_bootstrap.cc:492] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:49.403644 10370 tablet_bootstrap.cc:654] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.407403 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4387725a1843a7a7344d10e956c712" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:49.407771 10589 raft_consensus.cc:515] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.409029 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4387725a1843a7a7344d10e956c712" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:49.409149 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 7737acd216204209ba0327e26e85cfe6 (DEFAULT_TABLE table=default.Table_f90f1a0c22fa4781812518f44c9d7b17 [id=d12cb82567fd409988672b04a2e05a5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.409251 9715 raft_consensus.cc:3060] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:49.409569 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7737acd216204209ba0327e26e85cfe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.411151 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet f495efb5bc9e47f4a353b497b9ae78a8 (table default.Table_f1f332ce5d104c2b889c1faf78a0510f [id=a5becac787b84d398e96784d005d21f6]) successfully deleted
I20260810 19:47:49.411989 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 45194cae6ea44d9d8cf856d256fd534f (DEFAULT_TABLE table=default.Table_b07e02fd7d2e481e81bb153584c51dc2 [id=cf61b40b912d40368890dc6dfc5d1162]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.412619 9715 raft_consensus.cc:2468] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:49.412585 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 7737acd216204209ba0327e26e85cfe6 (DEFAULT_TABLE table=default.Table_f90f1a0c22fa4781812518f44c9d7b17 [id=d12cb82567fd409988672b04a2e05a5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.413342 9831 leader_election.cc:304] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:49.413704 10488 raft_consensus.cc:2804] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:49.413843 10488 raft_consensus.cc:697] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:47:49.414148 10488 consensus_queue.cc:237] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
W20260810 19:47:49.416847 9830 leader_election.cc:343] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Not found: Tablet not found: 6d4387725a1843a7a7344d10e956c712
I20260810 19:47:49.416908 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 45194cae6ea44d9d8cf856d256fd534f (DEFAULT_TABLE table=default.Table_b07e02fd7d2e481e81bb153584c51dc2 [id=cf61b40b912d40368890dc6dfc5d1162]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:49.417256 9830 leader_election.cc:343] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Not found: Tablet not found: 6d4387725a1843a7a7344d10e956c712
I20260810 19:47:49.417356 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45194cae6ea44d9d8cf856d256fd534f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.418401 10589 leader_election.cc:290] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:49.418756 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 7737acd216204209ba0327e26e85cfe6 (DEFAULT_TABLE table=default.Table_f90f1a0c22fa4781812518f44c9d7b17 [id=d12cb82567fd409988672b04a2e05a5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.419200 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7737acd216204209ba0327e26e85cfe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.425033 10377 raft_consensus.cc:2272] T 6ae2df18a03a4e4ea8f0c2302866999c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:49.425906 10377 ts_tablet_manager.cc:1916] T 6ae2df18a03a4e4ea8f0c2302866999c P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:49.426157 10607 tablet.cc:1724] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:47:49.427613 10604 tablet.cc:1724] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:47:49.438184 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45194cae6ea44d9d8cf856d256fd534f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.438885 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7737acd216204209ba0327e26e85cfe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.447824 10377 ts_tablet_manager.cc:1929] T 6ae2df18a03a4e4ea8f0c2302866999c P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:49.462330 9906 tablet_service.cc:1511] Processing CreateTablet for tablet dd632a01fe424a3a956d445ce01e31d2 (DEFAULT_TABLE table=default.Table_c253b5f6f93744b0990aecf5a52bb10d [id=2358cd5d19d24c88803e7861bcfec22c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.463111 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd632a01fe424a3a956d445ce01e31d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.463652 9911 tablet_service.cc:1511] Processing CreateTablet for tablet f8e4de89977b4caf91b2c0a49d147d17 (DEFAULT_TABLE table=default.Table_7b186c06f7bd4a98937d92630880d907 [id=aaa80fee4a8b4bed8ca573347cd60268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.464124 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e4de89977b4caf91b2c0a49d147d17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.467379 10589 raft_consensus.cc:493] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:49.467562 10589 raft_consensus.cc:515] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.469161 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "248e8954c46e4328a696f9799604e67f" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:49.470139 9716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "248e8954c46e4328a696f9799604e67f" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:49.470778 10120 tablet_service.cc:1511] Processing CreateTablet for tablet c7235af514fa47d899d7e38ee5662f6c (DEFAULT_TABLE table=default.Table_9417c867265449d5b1be02c69d183657 [id=7c6a3df13ef44571a127a5ef2e73683a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.471266 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7235af514fa47d899d7e38ee5662f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.473867 9673 tablet_service.cc:1511] Processing CreateTablet for tablet c7235af514fa47d899d7e38ee5662f6c (DEFAULT_TABLE table=default.Table_9417c867265449d5b1be02c69d183657 [id=7c6a3df13ef44571a127a5ef2e73683a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.474390 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7235af514fa47d899d7e38ee5662f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.475318 10621 raft_consensus.cc:493] T 204ef31f396a43a5bf06205560f987c9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:49.475504 10621 raft_consensus.cc:515] T 204ef31f396a43a5bf06205560f987c9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.474963 9688 tablet_service.cc:1511] Processing CreateTablet for tablet dd632a01fe424a3a956d445ce01e31d2 (DEFAULT_TABLE table=default.Table_c253b5f6f93744b0990aecf5a52bb10d [id=2358cd5d19d24c88803e7861bcfec22c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.476239 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd632a01fe424a3a956d445ce01e31d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.476356 10621 leader_election.cc:290] T 204ef31f396a43a5bf06205560f987c9 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:49.477131 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet f495efb5bc9e47f4a353b497b9ae78a8 with delete_type TABLET_DATA_DELETED (replaced by tablet f2931130e9354f16a238712234c19217) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:49.479432 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_55f86d7f1c8e47b18267b6f427c46aca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:49.480036 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55f86d7f1c8e47b18267b6f427c46aca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:49.481184 10371 ts_tablet_manager.cc:1929] T 6ae2df18a03a4e4ea8f0c2302866999c P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:49.481339 10371 log.cc:1199] T 6ae2df18a03a4e4ea8f0c2302866999c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/6ae2df18a03a4e4ea8f0c2302866999c
I20260810 19:47:49.481734 10371 ts_tablet_manager.cc:1950] T 6ae2df18a03a4e4ea8f0c2302866999c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:49.474777 10598 raft_consensus.cc:493] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:49.482542 10598 raft_consensus.cc:515] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.483003 10449 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 19:47:49.483309 10598 leader_election.cc:290] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:49.484200 10449 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 19:47:49.484534 10449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 19:47:49.485483 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668b3514d9f64d44a8747647194e50be" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:49.485769 10168 raft_consensus.cc:2468] T 668b3514d9f64d44a8747647194e50be P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:49.486598 9611 leader_election.cc:304] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:49.487078 10598 raft_consensus.cc:2804] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:49.487180 10598 raft_consensus.cc:493] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:49.487298 10598 raft_consensus.cc:3060] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:49.490933 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "204ef31f396a43a5bf06205560f987c9" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:49.491117 10370 tablet_bootstrap.cc:492] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:49.491300 10370 ts_tablet_manager.cc:1403] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.090s user 0.014s sys 0.026s
I20260810 19:47:49.491425 10598 raft_consensus.cc:515] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.492193 10370 raft_consensus.cc:359] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.492420 10370 raft_consensus.cc:385] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.492507 10370 raft_consensus.cc:740] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.492784 10370 consensus_queue.cc:260] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.493343 10370 ts_tablet_manager.cc:1434] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:47:49.493664 10370 tablet_bootstrap.cc:492] T d15bcf97364046daa97f7461f4f6bc98 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:49.495448 10598 leader_election.cc:290] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:49.495658 10370 tablet_bootstrap.cc:654] T d15bcf97364046daa97f7461f4f6bc98 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.496131 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668b3514d9f64d44a8747647194e50be" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:49.496340 10168 raft_consensus.cc:3060] T 668b3514d9f64d44a8747647194e50be P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:49.498966 10371 tablet_replica.cc:333] T 994c70f8843e4b0ab744775d357c49c2 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:49.499226 10371 raft_consensus.cc:2243] T 994c70f8843e4b0ab744775d357c49c2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:49.499387 10168 raft_consensus.cc:2468] T 668b3514d9f64d44a8747647194e50be P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:49.499454 10371 raft_consensus.cc:2272] T 994c70f8843e4b0ab744775d357c49c2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:49.500211 10371 ts_tablet_manager.cc:1916] T 994c70f8843e4b0ab744775d357c49c2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:49.504565 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 6ae2df18a03a4e4ea8f0c2302866999c (table default.Table_d3d4ff6a369249fea07d925aa5bfcd23 [id=cb4a2b1054cc4067ba59466503c77f8f]) successfully deleted
I20260810 19:47:49.506842 9412 master_service.cc:960] ReplaceTablet: received request to replace tablet 2ddeefaa826b4033b2e79eff7240887f from {username='slave'} at 127.0.0.1:56048
W20260810 19:47:49.508916 10068 leader_election.cc:343] T 204ef31f396a43a5bf06205560f987c9 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:49.509872 9611 leader_election.cc:304] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:49.510390 10598 raft_consensus.cc:2804] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:49.511363 10598 raft_consensus.cc:697] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:49.511874 10598 consensus_queue.cc:237] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.513427 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d (DEFAULT_TABLE table=default.Table_5e6891ff4aa040be8b327aafa596bc7e [id=fd840f00bdc5477aaad0b7fa114870dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.513957 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.515165 10136 tablet_service.cc:1511] Processing CreateTablet for tablet e959898b2c4c4173aea107d3f090ca07 (DEFAULT_TABLE table=default.Table_e2e810e459f24d0b9d348d428782a761 [id=3babf53bc29e4d4f9be8b2c19be6e2bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.515628 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e959898b2c4c4173aea107d3f090ca07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.518708 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d (DEFAULT_TABLE table=default.Table_5e6891ff4aa040be8b327aafa596bc7e [id=fd840f00bdc5477aaad0b7fa114870dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.519134 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.520007 9675 tablet_service.cc:1511] Processing CreateTablet for tablet f8e4de89977b4caf91b2c0a49d147d17 (DEFAULT_TABLE table=default.Table_7b186c06f7bd4a98937d92630880d907 [id=aaa80fee4a8b4bed8ca573347cd60268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.520480 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e4de89977b4caf91b2c0a49d147d17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.521970 9684 tablet_service.cc:1511] Processing CreateTablet for tablet e959898b2c4c4173aea107d3f090ca07 (DEFAULT_TABLE table=default.Table_e2e810e459f24d0b9d348d428782a761 [id=3babf53bc29e4d4f9be8b2c19be6e2bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.522440 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e959898b2c4c4173aea107d3f090ca07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.537273 10367 tablet_bootstrap.cc:492] T 389ed7d4651446869d404fb389d6ce9d P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:49.538340 10367 ts_tablet_manager.cc:1403] T 389ed7d4651446869d404fb389d6ce9d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.163s user 0.005s sys 0.004s
I20260810 19:47:49.539390 10367 raft_consensus.cc:359] T 389ed7d4651446869d404fb389d6ce9d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.541473 10145 tablet_service.cc:1511] Processing CreateTablet for tablet dd632a01fe424a3a956d445ce01e31d2 (DEFAULT_TABLE table=default.Table_c253b5f6f93744b0990aecf5a52bb10d [id=2358cd5d19d24c88803e7861bcfec22c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.541982 10370 tablet_bootstrap.cc:492] T d15bcf97364046daa97f7461f4f6bc98 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:49.542230 10375 ts_tablet_manager.cc:1929] T 5d4717c6fed24cbfab3f64fcc2c47153 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:49.543059 10375 log.cc:1199] T 5d4717c6fed24cbfab3f64fcc2c47153 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/5d4717c6fed24cbfab3f64fcc2c47153
I20260810 19:47:49.543373 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd632a01fe424a3a956d445ce01e31d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.543672 10375 ts_tablet_manager.cc:1950] T 5d4717c6fed24cbfab3f64fcc2c47153 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:49.542471 10125 tablet_service.cc:1511] Processing CreateTablet for tablet f8e4de89977b4caf91b2c0a49d147d17 (DEFAULT_TABLE table=default.Table_7b186c06f7bd4a98937d92630880d907 [id=aaa80fee4a8b4bed8ca573347cd60268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.546695 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e4de89977b4caf91b2c0a49d147d17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.543852 10370 ts_tablet_manager.cc:1403] T d15bcf97364046daa97f7461f4f6bc98 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.050s user 0.000s sys 0.005s
I20260810 19:47:49.547827 10370 raft_consensus.cc:359] T d15bcf97364046daa97f7461f4f6bc98 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.548055 10370 raft_consensus.cc:385] T d15bcf97364046daa97f7461f4f6bc98 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.548163 10370 raft_consensus.cc:740] T d15bcf97364046daa97f7461f4f6bc98 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.548555 10370 consensus_queue.cc:260] T d15bcf97364046daa97f7461f4f6bc98 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.550984 10370 ts_tablet_manager.cc:1434] T d15bcf97364046daa97f7461f4f6bc98 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:47:49.551280 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 5d4717c6fed24cbfab3f64fcc2c47153 (table default.Table_83926431e06b4b8fb2cb2024ed370a13 [id=11015256d39042599eae0f05e96dca2d]) successfully deleted
I20260810 19:47:49.551327 10370 tablet_bootstrap.cc:492] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:47:49.554466 9395 catalog_manager.cc:5017] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 6ae2df18a03a4e4ea8f0c2302866999c because the tablet was not found. No further retry: Not found: Tablet not found: 6ae2df18a03a4e4ea8f0c2302866999c
W20260810 19:47:49.557766 9831 leader_election.cc:343] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:49.558856 9831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 85540.7us
I20260810 19:47:49.559841 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668b3514d9f64d44a8747647194e50be" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:49.560117 10370 tablet_bootstrap.cc:654] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.559955 9946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668b3514d9f64d44a8747647194e50be" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:49.560209 9945 raft_consensus.cc:3060] T 668b3514d9f64d44a8747647194e50be P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:49.564815 10589 leader_election.cc:290] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:49.566438 10377 log.cc:1199] T 6ae2df18a03a4e4ea8f0c2302866999c P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/6ae2df18a03a4e4ea8f0c2302866999c
I20260810 19:47:49.564608 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "204ef31f396a43a5bf06205560f987c9" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:47:49.568645 10067 leader_election.cc:343] T 204ef31f396a43a5bf06205560f987c9 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:49.568820 10067 leader_election.cc:304] T 204ef31f396a43a5bf06205560f987c9 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:49.569276 10621 raft_consensus.cc:2749] T 204ef31f396a43a5bf06205560f987c9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:47:49.569718 9830 leader_election.cc:343] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:49.573043 9945 raft_consensus.cc:2468] T 668b3514d9f64d44a8747647194e50be P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:49.575587 10370 tablet_bootstrap.cc:492] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:49.575803 10370 ts_tablet_manager.cc:1403] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.003s
I20260810 19:47:49.576259 9830 leader_election.cc:304] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:49.576596 10589 raft_consensus.cc:2749] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:49.577051 10366 tablet_bootstrap.cc:492] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:49.577318 10366 ts_tablet_manager.cc:1403] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.228s user 0.024s sys 0.056s
W20260810 19:47:49.577490 9830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.195:43797, user_credentials={real_user=slave}} blocked reactor thread for 83093.2us
I20260810 19:47:49.579756 9904 tablet_service.cc:1511] Processing CreateTablet for tablet c7235af514fa47d899d7e38ee5662f6c (DEFAULT_TABLE table=default.Table_9417c867265449d5b1be02c69d183657 [id=7c6a3df13ef44571a127a5ef2e73683a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.580273 9911 tablet_service.cc:1511] Processing CreateTablet for tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d (DEFAULT_TABLE table=default.Table_5e6891ff4aa040be8b327aafa596bc7e [id=fd840f00bdc5477aaad0b7fa114870dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.578594 10366 raft_consensus.cc:359] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.580724 9896 tablet_service.cc:1511] Processing CreateTablet for tablet e959898b2c4c4173aea107d3f090ca07 (DEFAULT_TABLE table=default.Table_e2e810e459f24d0b9d348d428782a761 [id=3babf53bc29e4d4f9be8b2c19be6e2bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.580883 10366 raft_consensus.cc:385] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.581004 10366 raft_consensus.cc:740] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.580395 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7235af514fa47d899d7e38ee5662f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.581276 10366 consensus_queue.cc:260] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.581879 10366 ts_tablet_manager.cc:1434] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260810 19:47:49.582935 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.585620 10366 tablet_bootstrap.cc:492] T a71e3516f97c46f397de42f5c7089eeb P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:49.587110 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e959898b2c4c4173aea107d3f090ca07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.588173 10370 raft_consensus.cc:359] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.588418 10370 raft_consensus.cc:385] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.588490 10370 raft_consensus.cc:740] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.588776 10370 consensus_queue.cc:260] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.589370 10370 ts_tablet_manager.cc:1434] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260810 19:47:49.590615 10377 ts_tablet_manager.cc:1950] T 6ae2df18a03a4e4ea8f0c2302866999c P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:49.591156 10377 tablet_replica.cc:333] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:49.591434 10377 raft_consensus.cc:2243] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:49.591732 10377 pending_rounds.cc:70] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691: Trying to abort 1 pending ops.
I20260810 19:47:49.591831 10377 pending_rounds.cc:77] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058637212844032 op_type: NO_OP noop_request { }
I20260810 19:47:49.591969 10377 raft_consensus.cc:2889] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:49.592105 10377 raft_consensus.cc:2272] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:49.592684 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 6ae2df18a03a4e4ea8f0c2302866999c (table default.Table_d3d4ff6a369249fea07d925aa5bfcd23 [id=cb4a2b1054cc4067ba59466503c77f8f]) successfully deleted
I20260810 19:47:49.593327 10366 tablet_bootstrap.cc:654] T a71e3516f97c46f397de42f5c7089eeb P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.593850 10367 raft_consensus.cc:385] T 389ed7d4651446869d404fb389d6ce9d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.593966 10367 raft_consensus.cc:740] T 389ed7d4651446869d404fb389d6ce9d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.595152 10370 tablet_bootstrap.cc:492] T 2ddeefaa826b4033b2e79eff7240887f P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:49.596578 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 34fdc03b114b405da9e3a17ef1ad87c4
I20260810 19:47:49.597043 10370 tablet_bootstrap.cc:654] T 2ddeefaa826b4033b2e79eff7240887f P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.597150 9413 catalog_manager.cc:6807] ReplaceTablet: tablet 34fdc03b114b405da9e3a17ef1ad87c4 deleted and replaced by tablet 9e8a23221e8447bd83592c05c9d1149c
I20260810 19:47:49.597038 10367 consensus_queue.cc:260] T 389ed7d4651446869d404fb389d6ce9d P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.553193 10371 ts_tablet_manager.cc:1929] T 994c70f8843e4b0ab744775d357c49c2 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:49.598059 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 5b2ee8ebe11e4e5cb6a91592170c6c3d
I20260810 19:47:49.562407 10639 tablet.cc:1724] T 043f418de5ee493eb2bc43f3bc61e7fa P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:47:49.598209 10371 log.cc:1199] T 994c70f8843e4b0ab744775d357c49c2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/994c70f8843e4b0ab744775d357c49c2
I20260810 19:47:49.590065 10596 raft_consensus.cc:493] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:49.600966 10596 raft_consensus.cc:515] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.601735 10596 leader_election.cc:290] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:49.602043 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 34fdc03b114b405da9e3a17ef1ad87c4 with delete_type TABLET_DATA_DELETED (replaced by tablet 9e8a23221e8447bd83592c05c9d1149c) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.602106 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec0aa595d3c4e388eb7f07717ac4349" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:49.602378 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b2ee8ebe11e4e5cb6a91592170c6c3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.602445 10168 raft_consensus.cc:2468] T 4ec0aa595d3c4e388eb7f07717ac4349 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:49.602948 9611 leader_election.cc:304] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:49.603744 10596 raft_consensus.cc:2804] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260810 19:47:49.603829 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 34fdc03b114b405da9e3a17ef1ad87c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34fdc03b114b405da9e3a17ef1ad87c4 already in progress: creating tablet
I20260810 19:47:49.603883 10596 raft_consensus.cc:493] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:49.603988 10596 raft_consensus.cc:3060] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:47:49.604172 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 5b2ee8ebe11e4e5cb6a91592170c6c3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b2ee8ebe11e4e5cb6a91592170c6c3d already in progress: creating tablet
I20260810 19:47:49.607097 10596 raft_consensus.cc:515] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.608515 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec0aa595d3c4e388eb7f07717ac4349" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:49.608731 10168 raft_consensus.cc:3060] T 4ec0aa595d3c4e388eb7f07717ac4349 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:49.611188 9677 tablet_service.cc:1558] Processing DeleteTablet for tablet 34fdc03b114b405da9e3a17ef1ad87c4 with delete_type TABLET_DATA_DELETED (replaced by tablet 9e8a23221e8447bd83592c05c9d1149c) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:49.611518 9673 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b2ee8ebe11e4e5cb6a91592170c6c3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:49.612005 10168 raft_consensus.cc:2468] T 4ec0aa595d3c4e388eb7f07717ac4349 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:49.612805 9611 leader_election.cc:304] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:49.613790 10585 raft_consensus.cc:2804] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:49.613965 10585 raft_consensus.cc:697] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:49.614259 10585 consensus_queue.cc:237] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.614583 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_da2146aa6d244f3f892e8cf1c68bda8f" } modify_external_catalogs: true
I20260810 19:47:49.614753 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_da2146aa6d244f3f892e8cf1c68bda8f" } modify_external_catalogs: true
I20260810 19:47:49.615624 10367 ts_tablet_manager.cc:1434] T 389ed7d4651446869d404fb389d6ce9d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.077s user 0.000s sys 0.002s
I20260810 19:47:49.616011 10367 tablet_bootstrap.cc:492] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:49.614180 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6e4259d122294c46bd79d8abbb79c520" } modify_external_catalogs: true
I20260810 19:47:49.618072 10367 tablet_bootstrap.cc:654] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.617956 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6e4259d122294c46bd79d8abbb79c520" } modify_external_catalogs: true
I20260810 19:47:49.618947 10378 consensus_queue.cc:1048] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:49.621027 10371 ts_tablet_manager.cc:1950] T 994c70f8843e4b0ab744775d357c49c2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:49.621443 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_feeb41d918e24137a0d1da856cfd8e8d" } modify_external_catalogs: true
I20260810 19:47:49.621666 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_feeb41d918e24137a0d1da856cfd8e8d" } modify_external_catalogs: true
I20260810 19:47:49.622638 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_250f18957ff84ad58246dfec016f0abf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:49.623308 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_250f18957ff84ad58246dfec016f0abf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:49.625200 10371 tablet_replica.cc:333] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:49.625316 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 994c70f8843e4b0ab744775d357c49c2 (table default.Table_4b9c0a9770784e0d850b9fd5481270e0 [id=88952654dedd4f77870e7f82cac12431]) successfully deleted
I20260810 19:47:49.625427 10371 raft_consensus.cc:2243] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:49.625871 10371 pending_rounds.cc:70] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4: Trying to abort 1 pending ops.
I20260810 19:47:49.626062 10371 pending_rounds.cc:77] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058639327891456 op_type: NO_OP noop_request { }
I20260810 19:47:49.626240 10371 raft_consensus.cc:2889] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:49.626398 10371 raft_consensus.cc:2272] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:49.627768 10371 ts_tablet_manager.cc:1916] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:49.632833 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 043f418de5ee493eb2bc43f3bc61e7fa
I20260810 19:47:49.633423 9415 catalog_manager.cc:6807] ReplaceTablet: tablet 043f418de5ee493eb2bc43f3bc61e7fa deleted and replaced by tablet d8b928b6aa724998b96aef5a4223c8f0
I20260810 19:47:49.635394 10371 ts_tablet_manager.cc:1929] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:49.635861 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet 043f418de5ee493eb2bc43f3bc61e7fa with delete_type TABLET_DATA_DELETED (replaced by tablet d8b928b6aa724998b96aef5a4223c8f0) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.636183 10375 tablet_replica.cc:333] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:49.636409 10375 raft_consensus.cc:2243] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:49.636656 10375 raft_consensus.cc:2272] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:49.637048 10370 tablet_bootstrap.cc:492] T 2ddeefaa826b4033b2e79eff7240887f P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:49.637228 10370 ts_tablet_manager.cc:1403] T 2ddeefaa826b4033b2e79eff7240887f P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.002s
I20260810 19:47:49.637718 10375 ts_tablet_manager.cc:1916] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:49.638159 10370 raft_consensus.cc:359] T 2ddeefaa826b4033b2e79eff7240887f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.638413 10370 raft_consensus.cc:385] T 2ddeefaa826b4033b2e79eff7240887f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.638518 10370 raft_consensus.cc:740] T 2ddeefaa826b4033b2e79eff7240887f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.638774 10370 consensus_queue.cc:260] T 2ddeefaa826b4033b2e79eff7240887f P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.639665 10370 ts_tablet_manager.cc:1434] T 2ddeefaa826b4033b2e79eff7240887f P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:47:49.640087 10370 tablet_bootstrap.cc:492] T 5f0d4ce494b4459eb05716d6e62d7a09 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:49.644766 10370 tablet_bootstrap.cc:654] T 5f0d4ce494b4459eb05716d6e62d7a09 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.645720 10375 ts_tablet_manager.cc:1929] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:47:49.646463 10375 log.cc:1199] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/043f418de5ee493eb2bc43f3bc61e7fa
I20260810 19:47:49.646536 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec0aa595d3c4e388eb7f07717ac4349" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:49.647091 10375 ts_tablet_manager.cc:1950] T 043f418de5ee493eb2bc43f3bc61e7fa P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:49.647147 9945 raft_consensus.cc:2468] T 4ec0aa595d3c4e388eb7f07717ac4349 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:49.648816 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 043f418de5ee493eb2bc43f3bc61e7fa (table default.Table_3d204c57a3154b73b51379fd4fe89ad7 [id=d0343c1dbf284737b5183387c8ef1483]) successfully deleted
I20260810 19:47:49.645696 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 043f418de5ee493eb2bc43f3bc61e7fa with delete_type TABLET_DATA_DELETED (replaced by tablet d8b928b6aa724998b96aef5a4223c8f0) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:49.646287 9611 leader_election.cc:304] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:49.652285 10371 log.cc:1199] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/f495efb5bc9e47f4a353b497b9ae78a8
I20260810 19:47:49.652804 10371 ts_tablet_manager.cc:1950] T f495efb5bc9e47f4a353b497b9ae78a8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:49.653249 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec0aa595d3c4e388eb7f07717ac4349" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:49.653616 10378 raft_consensus.cc:2749] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:49.647452 10596 leader_election.cc:290] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:49.653963 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet f495efb5bc9e47f4a353b497b9ae78a8 (table default.Table_f1f332ce5d104c2b889c1faf78a0510f [id=a5becac787b84d398e96784d005d21f6]) successfully deleted
I20260810 19:47:49.655282 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2a994cac12d24a589728d6edb766c2af" } modify_external_catalogs: true
I20260810 19:47:49.655496 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2a994cac12d24a589728d6edb766c2af" } modify_external_catalogs: true
I20260810 19:47:49.656118 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_dd3680521a084b7e9b0d94c1e8b1e7b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:49.656697 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd3680521a084b7e9b0d94c1e8b1e7b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:49.659580 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 34fdc03b114b405da9e3a17ef1ad87c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34fdc03b114b405da9e3a17ef1ad87c4 already in progress: creating tablet
W20260810 19:47:49.662222 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 5b2ee8ebe11e4e5cb6a91592170c6c3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b2ee8ebe11e4e5cb6a91592170c6c3d already in progress: creating tablet
I20260810 19:47:49.662900 10371 tablet_replica.cc:333] T 043f418de5ee493eb2bc43f3bc61e7fa P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:49.663141 10371 raft_consensus.cc:2243] T 043f418de5ee493eb2bc43f3bc61e7fa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:49.664985 10377 ts_tablet_manager.cc:1916] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:49.664990 10371 raft_consensus.cc:2272] T 043f418de5ee493eb2bc43f3bc61e7fa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:49.667189 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 34fdc03b114b405da9e3a17ef1ad87c4 with delete_type TABLET_DATA_DELETED (replaced by tablet 9e8a23221e8447bd83592c05c9d1149c) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.667613 9911 tablet_service.cc:1558] Processing DeleteTablet for tablet 043f418de5ee493eb2bc43f3bc61e7fa with delete_type TABLET_DATA_DELETED (replaced by tablet d8b928b6aa724998b96aef5a4223c8f0) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.667845 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b2ee8ebe11e4e5cb6a91592170c6c3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.668023 9945 raft_consensus.cc:3060] T 4ec0aa595d3c4e388eb7f07717ac4349 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:49.671204 9945 raft_consensus.cc:2468] T 4ec0aa595d3c4e388eb7f07717ac4349 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:49.671891 9416 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 668b3514d9f64d44a8747647194e50be (table default.Table_ac3c40912d96436d8ff55c48873a0057 [id=f96d1bbf37954740825d721e6259ce3c]). Expected version 2 got 0
I20260810 19:47:49.673835 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f1a090bd6e0042b58f8b6f478fc4fb11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:49.676180 10370 tablet_bootstrap.cc:492] T 5f0d4ce494b4459eb05716d6e62d7a09 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:49.676365 10370 ts_tablet_manager.cc:1403] T 5f0d4ce494b4459eb05716d6e62d7a09 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.010s
I20260810 19:47:49.676605 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_50b96f2fdacb49cdbbce6a9e02ad2132" } new_table_name: "default.Table_a1645668cf79415ca029a01169fbf874" modify_external_catalogs: true
I20260810 19:47:49.677230 10370 raft_consensus.cc:359] T 5f0d4ce494b4459eb05716d6e62d7a09 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.677443 10370 raft_consensus.cc:385] T 5f0d4ce494b4459eb05716d6e62d7a09 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.677515 10370 raft_consensus.cc:740] T 5f0d4ce494b4459eb05716d6e62d7a09 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.677783 10370 consensus_queue.cc:260] T 5f0d4ce494b4459eb05716d6e62d7a09 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.678246 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_6c826966f2e544f7b354551cd1aa632e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:49.678580 10370 ts_tablet_manager.cc:1434] T 5f0d4ce494b4459eb05716d6e62d7a09 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260810 19:47:49.678839 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c826966f2e544f7b354551cd1aa632e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:49.680886 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet 043f418de5ee493eb2bc43f3bc61e7fa with delete_type TABLET_DATA_DELETED (replaced by tablet d8b928b6aa724998b96aef5a4223c8f0) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.681120 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ec0aa595d3c4e388eb7f07717ac4349 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.681277 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet 9680053712644b4ca33c33031b1ad8bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.681421 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet 389ed7d4651446869d404fb389d6ce9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.683921 10370 tablet_bootstrap.cc:492] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:47:49.685257 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1a090bd6e0042b58f8b6f478fc4fb11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:49.685938 10370 tablet_bootstrap.cc:654] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.688581 9418 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 668b3514d9f64d44a8747647194e50be (table default.Table_ac3c40912d96436d8ff55c48873a0057 [id=f96d1bbf37954740825d721e6259ce3c]). Expected version 2 got 0
I20260810 19:47:49.691386 9413 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 668b3514d9f64d44a8747647194e50be (table default.Table_ac3c40912d96436d8ff55c48873a0057 [id=f96d1bbf37954740825d721e6259ce3c]). Expected version 2 got 0
I20260810 19:47:49.696393 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet 248e8954c46e4328a696f9799604e67f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.697053 10135 tablet_service.cc:1511] Processing CreateTablet for tablet bc753970b2464e38b03e377551276343 (DEFAULT_TABLE table=default.Table_0689244b1b034fd58974b1979666463f [id=fd9deda7275b423b9f9c85aa22dde728]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.697496 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc753970b2464e38b03e377551276343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.704223 9904 tablet_service.cc:1511] Processing CreateTablet for tablet bc753970b2464e38b03e377551276343 (DEFAULT_TABLE table=default.Table_0689244b1b034fd58974b1979666463f [id=fd9deda7275b423b9f9c85aa22dde728]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.704756 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc753970b2464e38b03e377551276343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.705513 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2e7c9e56b8194281bbde511afe54b03f" } new_table_name: "default.Table_949bcc619f4b45189db61b24b5598e66" modify_external_catalogs: true
I20260810 19:47:49.707932 9911 tablet_service.cc:1558] Processing DeleteTablet for tablet f495efb5bc9e47f4a353b497b9ae78a8 with delete_type TABLET_DATA_DELETED (replaced by tablet f2931130e9354f16a238712234c19217) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.708395 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ec0aa595d3c4e388eb7f07717ac4349 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.708600 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d4387725a1843a7a7344d10e956c712 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.708665 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 389ed7d4651446869d404fb389d6ce9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.708920 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a7bb5fcac0a4207b4ee997099777b5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.709297 9911 tablet_service.cc:1558] Processing DeleteTablet for tablet 9680053712644b4ca33c33031b1ad8bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.709867 10124 tablet_service.cc:1511] Processing CreateTablet for tablet e247ae3828e84092b836f3dd07b44bc6 (DEFAULT_TABLE table=default.Table_745ec8d1fd994242990bec7acd5bd9cd [id=435f41d3a7ba4f03a738cdb2272f759e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.710346 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e247ae3828e84092b836f3dd07b44bc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.720182 10370 tablet_bootstrap.cc:492] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
W20260810 19:47:49.722445 9395 catalog_manager.cc:5017] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 043f418de5ee493eb2bc43f3bc61e7fa because the tablet was not found. No further retry: Not found: Tablet not found: 043f418de5ee493eb2bc43f3bc61e7fa
I20260810 19:47:49.723899 9904 tablet_service.cc:1511] Processing CreateTablet for tablet e247ae3828e84092b836f3dd07b44bc6 (DEFAULT_TABLE table=default.Table_745ec8d1fd994242990bec7acd5bd9cd [id=435f41d3a7ba4f03a738cdb2272f759e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.724509 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e247ae3828e84092b836f3dd07b44bc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.725003 9911 tablet_service.cc:1511] Processing CreateTablet for tablet c8602b7360b747a3af756b139635d95c (DEFAULT_TABLE table=default.Table_e2c3250ad65342b6b93438349218f41a [id=043b4921c17c438db20e082f44e88787]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.725454 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8602b7360b747a3af756b139635d95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.726521 10370 ts_tablet_manager.cc:1403] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.043s user 0.023s sys 0.008s
I20260810 19:47:49.727473 10370 raft_consensus.cc:359] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.727676 10370 raft_consensus.cc:385] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.727773 10370 raft_consensus.cc:740] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.728039 10370 consensus_queue.cc:260] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.728834 10370 ts_tablet_manager.cc:1434] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:47:49.732942 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 28c9eecacc6540ac82ac7faabceec788
I20260810 19:47:49.738183 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 46005eead530459eb2b636ae0a6767ad
I20260810 19:47:49.738572 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 2ddeefaa826b4033b2e79eff7240887f
I20260810 19:47:49.739064 9412 catalog_manager.cc:6807] ReplaceTablet: tablet 2ddeefaa826b4033b2e79eff7240887f deleted and replaced by tablet 00fe7d9a548a487d965d92b53cdf9250
W20260810 19:47:49.739706 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a01d3ec3c8914fe495f7a0f3c7c312f8 consensus state has no leader
I20260810 19:47:49.740933 9413 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 00dabf43505f4fc89be39ee8fb41c7ee (table default.Table_257ddf6dffe443b7bb3a6d5e7f1e93a2 [id=6b30bf93c566421593a182e1768c0482]). Expected version 1 got 0
I20260810 19:47:49.745798 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 28c9eecacc6540ac82ac7faabceec788 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.746246 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet 46005eead530459eb2b636ae0a6767ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.746507 10120 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ddeefaa826b4033b2e79eff7240887f with delete_type TABLET_DATA_DELETED (replaced by tablet 00fe7d9a548a487d965d92b53cdf9250) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.746631 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a7bb5fcac0a4207b4ee997099777b5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.746687 10136 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f0d4ce494b4459eb05716d6e62d7a09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.746835 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet a71e3516f97c46f397de42f5c7089eeb with delete_type TABLET_DATA_DELETED (replaced by tablet 4d654dada92a4939914d26ab72a5f5e8) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.747059 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 248e8954c46e4328a696f9799604e67f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.747442 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 28c9eecacc6540ac82ac7faabceec788 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.747743 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 46005eead530459eb2b636ae0a6767ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.747977 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ddeefaa826b4033b2e79eff7240887f with delete_type TABLET_DATA_DELETED (replaced by tablet 00fe7d9a548a487d965d92b53cdf9250) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.750202 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet 176d4e72b8e44e4b88bdf89d06f2f79a from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:49.722098 10375 tablet_replica.cc:333] T 4ec0aa595d3c4e388eb7f07717ac4349 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:49.755539 10370 tablet_bootstrap.cc:492] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:49.757715 10370 tablet_bootstrap.cc:654] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.758575 10375 raft_consensus.cc:2243] T 4ec0aa595d3c4e388eb7f07717ac4349 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:49.770929 10375 raft_consensus.cc:2272] T 4ec0aa595d3c4e388eb7f07717ac4349 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:49.772050 10375 ts_tablet_manager.cc:1916] T 4ec0aa595d3c4e388eb7f07717ac4349 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:49.777275 10370 tablet_bootstrap.cc:492] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:49.777522 10370 ts_tablet_manager.cc:1403] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.009s
I20260810 19:47:49.778393 10370 raft_consensus.cc:359] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.778635 10370 raft_consensus.cc:385] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.778717 10370 raft_consensus.cc:740] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.779028 10370 consensus_queue.cc:260] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.779676 10370 ts_tablet_manager.cc:1434] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:47:49.780041 10370 tablet_bootstrap.cc:492] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:49.781778 10370 tablet_bootstrap.cc:654] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.786481 10135 tablet_service.cc:1511] Processing CreateTablet for tablet c8602b7360b747a3af756b139635d95c (DEFAULT_TABLE table=default.Table_e2c3250ad65342b6b93438349218f41a [id=043b4921c17c438db20e082f44e88787]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.789422 9416 master_service.cc:960] ReplaceTablet: received request to replace tablet c7235af514fa47d899d7e38ee5662f6c from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:49.791025 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 7d3395886420455d9bdaf816c19ebae2
I20260810 19:47:49.791968 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_aa1552151467479ba8b4a8d5b1f70122"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:49.792714 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa1552151467479ba8b4a8d5b1f70122 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:49.796020 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d3395886420455d9bdaf816c19ebae2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.796622 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_259904d1cb8e432d88e40cbdac93d13d" } new_table_name: "default.Table_8b81e3e69f0f4859aa14ca8f923fd4b8" modify_external_catalogs: true
I20260810 19:47:49.797529 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e60e43b61eba457e8a4e7cd6543b7cc6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:49.798291 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e60e43b61eba457e8a4e7cd6543b7cc6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:49.799083 10621 raft_consensus.cc:493] T 2ddeefaa826b4033b2e79eff7240887f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:49.799293 10621 raft_consensus.cc:515] T 2ddeefaa826b4033b2e79eff7240887f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.800177 10621 leader_election.cc:290] T 2ddeefaa826b4033b2e79eff7240887f P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:49.800993 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ddeefaa826b4033b2e79eff7240887f" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:47:49.801729 10067 leader_election.cc:343] T 2ddeefaa826b4033b2e79eff7240887f P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:49.802016 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 8851f5c0c2fd4600bb99793ddd151daa
I20260810 19:47:49.803891 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 8851f5c0c2fd4600bb99793ddd151daa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.804308 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet 8851f5c0c2fd4600bb99793ddd151daa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.804811 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ffaf5621f8c4416bb378fcfee21da737"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:49.805454 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ffaf5621f8c4416bb378fcfee21da737 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:49.807471 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_83926431e06b4b8fb2cb2024ed370a13" } new_table_name: "default.Table_70688a60aaaa4439a3fccf1b2a8f768d" modify_external_catalogs: true
I20260810 19:47:49.809423 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_217debaa83504cc9bc150924d212f9b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:49.810024 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_217debaa83504cc9bc150924d212f9b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:49.812186 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d3395886420455d9bdaf816c19ebae2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.812695 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0689244b1b034fd58974b1979666463f" } new_table_name: "default.Table_11f1003720914accbb076692dc9e5d17" modify_external_catalogs: true
W20260810 19:47:49.815279 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 06af03c8a87141febef768bd56c72c39 consensus state has no leader
W20260810 19:47:49.815526 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0d79ef93c5bf4ac9895e594198edb251 consensus state has no leader
I20260810 19:47:49.815738 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c2a3c3f509104c5cbeb2f53726021955"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:49.815955 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3d204c57a3154b73b51379fd4fe89ad7" } modify_external_catalogs: true
I20260810 19:47:49.816133 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3d204c57a3154b73b51379fd4fe89ad7" } modify_external_catalogs: true
W20260810 19:47:49.816403 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2a3c3f509104c5cbeb2f53726021955 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:49.818851 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet c7235af514fa47d899d7e38ee5662f6c
I20260810 19:47:49.819438 9416 catalog_manager.cc:6807] ReplaceTablet: tablet c7235af514fa47d899d7e38ee5662f6c deleted and replaced by tablet 0bddaf5b5fc1404e83b079ffa97e7321
I20260810 19:47:49.819689 9416 master_service.cc:960] ReplaceTablet: received request to replace tablet 3badc88d94a34ff7a053ed312f0dd646 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:49.820396 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet c7235af514fa47d899d7e38ee5662f6c with delete_type TABLET_DATA_DELETED (replaced by tablet 0bddaf5b5fc1404e83b079ffa97e7321) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.822801 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 176d4e72b8e44e4b88bdf89d06f2f79a with delete_type TABLET_DATA_DELETED (replaced by tablet 0c0a1e360ac648eeb0c734215bc200f6) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.824365 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet c7235af514fa47d899d7e38ee5662f6c with delete_type TABLET_DATA_DELETED (replaced by tablet 0bddaf5b5fc1404e83b079ffa97e7321) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.832394 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 6af6dd8913f44e7f966ed2a128ae4fbf (DEFAULT_TABLE table=default.Table_ae6b06e8ae0c4fd19fe26b1b08db672a [id=5354f5d091794b14806dd9bc872da0ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.832998 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6af6dd8913f44e7f966ed2a128ae4fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.840209 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 6af6dd8913f44e7f966ed2a128ae4fbf (DEFAULT_TABLE table=default.Table_ae6b06e8ae0c4fd19fe26b1b08db672a [id=5354f5d091794b14806dd9bc872da0ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.840811 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6af6dd8913f44e7f966ed2a128ae4fbf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:49.842883 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a9e42e13617c4457ba88ae0e0269ec93 consensus state has no leader
I20260810 19:47:49.848381 9421 master_service.cc:960] ReplaceTablet: received request to replace tablet dad16ea0f82942de8587dd7c98c0d2df from {username='slave'} at 127.0.0.1:56048
W20260810 19:47:49.851336 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc753970b2464e38b03e377551276343 consensus state has no leader
I20260810 19:47:49.852576 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_cc3aacf41a5e424687efa546af746ffa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:49.853492 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc3aacf41a5e424687efa546af746ffa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:49.857278 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8602b7360b747a3af756b139635d95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.866503 10371 ts_tablet_manager.cc:1916] T 043f418de5ee493eb2bc43f3bc61e7fa P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:49.866972 10621 raft_consensus.cc:493] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:49.867213 10621 raft_consensus.cc:515] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.867985 10621 leader_election.cc:290] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:49.868849 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389ed7d4651446869d404fb389d6ce9d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:49.869132 9945 raft_consensus.cc:2468] T 389ed7d4651446869d404fb389d6ce9d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:47:49.869719 10067 leader_election.cc:304] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:49.871356 10585 raft_consensus.cc:493] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:49.873679 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet f495efb5bc9e47f4a353b497b9ae78a8 with delete_type TABLET_DATA_DELETED (replaced by tablet f2931130e9354f16a238712234c19217) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:49.875262 10378 consensus_queue.cc:1048] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:49.883474 10585 raft_consensus.cc:515] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.884362 9677 tablet_service.cc:1558] Processing DeleteTablet for tablet 9680053712644b4ca33c33031b1ad8bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:46 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:49.884526 9418 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet d8b928b6aa724998b96aef5a4223c8f0
I20260810 19:47:49.884568 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d4717c6fed24cbfab3f64fcc2c47153 with delete_type TABLET_DATA_DELETED (replaced by tablet a9e42e13617c4457ba88ae0e0269ec93) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:49.884689 9673 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ec0aa595d3c4e388eb7f07717ac4349 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:49.885666 10621 raft_consensus.cc:2804] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:49.885800 10621 raft_consensus.cc:493] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:49.885797 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 3badc88d94a34ff7a053ed312f0dd646
I20260810 19:47:49.885748 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7bb5fcac0a4207b4ee997099777b5b" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:49.885907 10621 raft_consensus.cc:3060] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:49.886039 9951 raft_consensus.cc:2468] T 3a7bb5fcac0a4207b4ee997099777b5b P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:49.886619 9416 catalog_manager.cc:6807] ReplaceTablet: tablet 3badc88d94a34ff7a053ed312f0dd646 deleted and replaced by tablet b16108d31ced4e02b2d7d0ab1f581a2c
I20260810 19:47:49.887068 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a7bb5fcac0a4207b4ee997099777b5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:49.887264 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d4387725a1843a7a7344d10e956c712 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:49.887724 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ddeefaa826b4033b2e79eff7240887f" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:49.888681 9673 tablet_service.cc:1511] Processing CreateTablet for tablet bc753970b2464e38b03e377551276343 (DEFAULT_TABLE table=default.Table_0689244b1b034fd58974b1979666463f [id=fd9deda7275b423b9f9c85aa22dde728]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.888939 10621 raft_consensus.cc:515] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.889212 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc753970b2464e38b03e377551276343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.890636 10585 leader_election.cc:290] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:49.891032 9611 leader_election.cc:304] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:49.891770 9675 tablet_service.cc:1511] Processing CreateTablet for tablet e247ae3828e84092b836f3dd07b44bc6 (DEFAULT_TABLE table=default.Table_745ec8d1fd994242990bec7acd5bd9cd [id=435f41d3a7ba4f03a738cdb2272f759e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.893955 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e247ae3828e84092b836f3dd07b44bc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.897305 9408 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 00dabf43505f4fc89be39ee8fb41c7ee (table default.Table_257ddf6dffe443b7bb3a6d5e7f1e93a2 [id=6b30bf93c566421593a182e1768c0482]). Expected version 1 got 0
I20260810 19:47:49.900063 10585 raft_consensus.cc:2804] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:49.900593 10585 raft_consensus.cc:493] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:49.900715 10585 raft_consensus.cc:3060] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:49.901213 9408 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 00dabf43505f4fc89be39ee8fb41c7ee (table default.Table_257ddf6dffe443b7bb3a6d5e7f1e93a2 [id=6b30bf93c566421593a182e1768c0482]). Expected version 1 got 0
I20260810 19:47:49.904379 10585 raft_consensus.cc:515] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.915069 9416 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 00dabf43505f4fc89be39ee8fb41c7ee (table default.Table_257ddf6dffe443b7bb3a6d5e7f1e93a2 [id=6b30bf93c566421593a182e1768c0482]). Expected version 1 got 0
I20260810 19:47:49.916846 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_7418b98ddb584a2888e186a1b7d50810"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:49.917608 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7418b98ddb584a2888e186a1b7d50810 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:49.920051 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_39a71ac764f44ae1bb2168baeea4cb85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:49.920774 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39a71ac764f44ae1bb2168baeea4cb85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:49.929227 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet dad16ea0f82942de8587dd7c98c0d2df
I20260810 19:47:49.930228 9421 catalog_manager.cc:6807] ReplaceTablet: tablet dad16ea0f82942de8587dd7c98c0d2df deleted and replaced by tablet 4f90707dba6e4a3ab7d4c6c197326411
I20260810 19:47:49.892903 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7bb5fcac0a4207b4ee997099777b5b" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:49.932682 10168 raft_consensus.cc:2468] T 3a7bb5fcac0a4207b4ee997099777b5b P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
W20260810 19:47:49.910857 10068 leader_election.cc:343] T 2ddeefaa826b4033b2e79eff7240887f P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:49.934360 10068 leader_election.cc:304] T 2ddeefaa826b4033b2e79eff7240887f P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:49.922645 10759 raft_consensus.cc:493] T 5f0d4ce494b4459eb05716d6e62d7a09 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:49.934633 9408 catalog_manager.cc:5719] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193). New cstate: current_term: 1 leader_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: HEALTHY } } }
I20260810 19:47:49.934832 10759 raft_consensus.cc:515] T 5f0d4ce494b4459eb05716d6e62d7a09 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.935134 9408 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 668b3514d9f64d44a8747647194e50be (table default.Table_ac3c40912d96436d8ff55c48873a0057 [id=f96d1bbf37954740825d721e6259ce3c]). Expected version 2 got 0
I20260810 19:47:49.935474 9408 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 00dabf43505f4fc89be39ee8fb41c7ee (table default.Table_257ddf6dffe443b7bb3a6d5e7f1e93a2 [id=6b30bf93c566421593a182e1768c0482]). Expected version 1 got 0
I20260810 19:47:49.935813 10759 leader_election.cc:290] T 5f0d4ce494b4459eb05716d6e62d7a09 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:49.936043 10759 raft_consensus.cc:2749] T 2ddeefaa826b4033b2e79eff7240887f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:49.931280 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet dad16ea0f82942de8587dd7c98c0d2df with delete_type TABLET_DATA_DELETED (replaced by tablet 4f90707dba6e4a3ab7d4c6c197326411) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.937716 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0d4ce494b4459eb05716d6e62d7a09" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:47:49.938482 10067 leader_election.cc:343] T 5f0d4ce494b4459eb05716d6e62d7a09 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:49.940199 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b8c16d5ca4ee41fbaf84f9e6e6fbb3bd" } modify_external_catalogs: true
I20260810 19:47:49.941425 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b8c16d5ca4ee41fbaf84f9e6e6fbb3bd" } modify_external_catalogs: true
I20260810 19:47:49.944892 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389ed7d4651446869d404fb389d6ce9d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:49.945143 9945 raft_consensus.cc:3060] T 389ed7d4651446869d404fb389d6ce9d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:49.948853 9945 raft_consensus.cc:2468] T 389ed7d4651446869d404fb389d6ce9d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:47:49.941924 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_949bcc619f4b45189db61b24b5598e66" } modify_external_catalogs: true
I20260810 19:47:49.949750 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_949bcc619f4b45189db61b24b5598e66" } modify_external_catalogs: true
I20260810 19:47:49.906626 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 6af6dd8913f44e7f966ed2a128ae4fbf (DEFAULT_TABLE table=default.Table_ae6b06e8ae0c4fd19fe26b1b08db672a [id=5354f5d091794b14806dd9bc872da0ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.950804 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6af6dd8913f44e7f966ed2a128ae4fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.953397 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c253b5f6f93744b0990aecf5a52bb10d" } new_table_name: "default.Table_8398701ecb954c5c833b81f075d2c23a" modify_external_catalogs: true
I20260810 19:47:49.906929 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d3395886420455d9bdaf816c19ebae2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:49.907085 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet 8851f5c0c2fd4600bb99793ddd151daa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:49.907223 9685 tablet_service.cc:1558] Processing DeleteTablet for tablet c7235af514fa47d899d7e38ee5662f6c with delete_type TABLET_DATA_DELETED (replaced by tablet 0bddaf5b5fc1404e83b079ffa97e7321) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:49.907363 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet 3badc88d94a34ff7a053ed312f0dd646 with delete_type TABLET_DATA_DELETED (replaced by tablet b16108d31ced4e02b2d7d0ab1f581a2c) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:49.908921 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet 28c9eecacc6540ac82ac7faabceec788 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:49.909111 9677 tablet_service.cc:1558] Processing DeleteTablet for tablet 46005eead530459eb2b636ae0a6767ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:49.909756 9669 tablet_service.cc:1511] Processing CreateTablet for tablet c8602b7360b747a3af756b139635d95c (DEFAULT_TABLE table=default.Table_e2c3250ad65342b6b93438349218f41a [id=043b4921c17c438db20e082f44e88787]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.955137 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8602b7360b747a3af756b139635d95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.955466 10621 leader_election.cc:290] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:49.910017 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ddeefaa826b4033b2e79eff7240887f with delete_type TABLET_DATA_DELETED (replaced by tablet 00fe7d9a548a487d965d92b53cdf9250) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:49.910274 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389ed7d4651446869d404fb389d6ce9d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:49.956885 9911 tablet_service.cc:1558] Processing DeleteTablet for tablet dad16ea0f82942de8587dd7c98c0d2df with delete_type TABLET_DATA_DELETED (replaced by tablet 4f90707dba6e4a3ab7d4c6c197326411) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:49.960301 10067 leader_election.cc:304] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:49.960671 10621 raft_consensus.cc:2804] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:49.961408 10621 raft_consensus.cc:697] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:47:49.961756 10621 consensus_queue.cc:237] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.912758 10378 raft_consensus.cc:493] T 389ed7d4651446869d404fb389d6ce9d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:49.965310 10378 raft_consensus.cc:515] T 389ed7d4651446869d404fb389d6ce9d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:49.965786 9413 master_service.cc:960] ReplaceTablet: received request to replace tablet 5f560ed7ea0c4075bad1375d86738861 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:49.966096 10378 leader_election.cc:290] T 389ed7d4651446869d404fb389d6ce9d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:49.932085 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet dad16ea0f82942de8587dd7c98c0d2df with delete_type TABLET_DATA_DELETED (replaced by tablet 4f90707dba6e4a3ab7d4c6c197326411) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:49.966432 9715 raft_consensus.cc:2468] T 389ed7d4651446869d404fb389d6ce9d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:47:49.969281 10367 tablet_bootstrap.cc:492] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:49.969480 10367 ts_tablet_manager.cc:1403] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.354s user 0.018s sys 0.065s
I20260810 19:47:49.980934 10145 tablet_service.cc:1511] Processing CreateTablet for tablet b737b216646a4c5baecb88d59bcce4df (DEFAULT_TABLE table=default.Table_98357f787dbf48958872d3de9003c202 [id=549322ede70c4efc91018201075b1a29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:49.980942 10367 raft_consensus.cc:359] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.981176 10367 raft_consensus.cc:385] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:49.981290 10367 raft_consensus.cc:740] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:49.981529 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b737b216646a4c5baecb88d59bcce4df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:49.982793 10367 consensus_queue.cc:260] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:49.983479 10367 ts_tablet_manager.cc:1434] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260810 19:47:49.984901 10585 leader_election.cc:290] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:49.987660 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 0d79ef93c5bf4ac9895e594198edb251
W20260810 19:47:49.988283 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dd632a01fe424a3a956d445ce01e31d2 consensus state has no leader
I20260810 19:47:49.989318 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d79ef93c5bf4ac9895e594198edb251 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:49.991773 10367 tablet_bootstrap.cc:492] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:49.993847 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d79ef93c5bf4ac9895e594198edb251 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:49.996670 10367 tablet_bootstrap.cc:654] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:49.997205 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 11272d47d96f443187d63c184049871f
I20260810 19:47:49.998212 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 11272d47d96f443187d63c184049871f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:50.003095 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 389ed7d4651446869d404fb389d6ce9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:50.004869 10371 ts_tablet_manager.cc:1929] T 043f418de5ee493eb2bc43f3bc61e7fa P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:47:50.005115 10371 log.cc:1199] T 043f418de5ee493eb2bc43f3bc61e7fa P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/043f418de5ee493eb2bc43f3bc61e7fa
I20260810 19:47:50.005893 10371 ts_tablet_manager.cc:1950] T 043f418de5ee493eb2bc43f3bc61e7fa P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:50.006737 9681 tablet_service.cc:1511] Processing CreateTablet for tablet b737b216646a4c5baecb88d59bcce4df (DEFAULT_TABLE table=default.Table_98357f787dbf48958872d3de9003c202 [id=549322ede70c4efc91018201075b1a29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.011314 10367 tablet_bootstrap.cc:492] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:50.011529 10367 ts_tablet_manager.cc:1403] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.002s
I20260810 19:47:50.012538 10367 raft_consensus.cc:359] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.012809 10367 raft_consensus.cc:385] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:50.012904 10367 raft_consensus.cc:740] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:50.013195 10367 consensus_queue.cc:260] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.013684 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b737b216646a4c5baecb88d59bcce4df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.015784 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e9ea44b27cff400ba61de42acb18908c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.016680 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9ea44b27cff400ba61de42acb18908c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.019145 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_aa9a8825478043949020967cf580deca" } modify_external_catalogs: true
I20260810 19:47:50.019387 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_aa9a8825478043949020967cf580deca" } modify_external_catalogs: true
I20260810 19:47:50.021375 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_47c121b1c8cf4d999324cc090246288b" } modify_external_catalogs: true
I20260810 19:47:50.021665 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_47c121b1c8cf4d999324cc090246288b" } modify_external_catalogs: true
I20260810 19:47:50.013819 10367 ts_tablet_manager.cc:1434] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:47:50.023402 10367 tablet_bootstrap.cc:492] T a71e3516f97c46f397de42f5c7089eeb P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:50.024115 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0166430906c04e7fbf172ff0c3ede71f" } new_table_name: "default.Table_b8bd05c31450458cb9d2bdb337397fde" modify_external_catalogs: true
I20260810 19:47:50.025657 10367 tablet_bootstrap.cc:654] T a71e3516f97c46f397de42f5c7089eeb P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:50.027443 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 11272d47d96f443187d63c184049871f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:50.028251 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1fbfe698e86d4003a8da30f7988b9501" } new_table_name: "default.Table_81bfaffed3704bd5b2fd7c1dc23bf3fa" modify_external_catalogs: true
I20260810 19:47:50.028710 10371 tablet_replica.cc:333] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:50.028967 10371 raft_consensus.cc:2243] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:50.029369 10371 pending_rounds.cc:70] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4: Trying to abort 1 pending ops.
I20260810 19:47:50.029479 10371 pending_rounds.cc:77] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058638998822912 op_type: NO_OP noop_request { }
I20260810 19:47:50.029616 10371 raft_consensus.cc:2889] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:50.029775 10371 raft_consensus.cc:2272] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 19:47:50.030773 9397 catalog_manager.cc:5017] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet f495efb5bc9e47f4a353b497b9ae78a8 because the tablet was not found. No further retry: Not found: Tablet not found: f495efb5bc9e47f4a353b497b9ae78a8
I20260810 19:47:50.031231 10371 ts_tablet_manager.cc:1916] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:50.031798 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1958ec28228543e19a55ae3083097318"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.032582 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1958ec28228543e19a55ae3083097318 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.021806 10585 raft_consensus.cc:493] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:50.034818 10585 raft_consensus.cc:515] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.035568 10585 leader_election.cc:290] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:49.984843 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7bb5fcac0a4207b4ee997099777b5b" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:50.041778 9951 raft_consensus.cc:3060] T 3a7bb5fcac0a4207b4ee997099777b5b P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:49.998764 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 11272d47d96f443187d63c184049871f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:50.045296 9951 raft_consensus.cc:2468] T 3a7bb5fcac0a4207b4ee997099777b5b P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:50.045923 9611 leader_election.cc:304] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:49.998870 9911 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d79ef93c5bf4ac9895e594198edb251 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:50.046545 10585 raft_consensus.cc:2804] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:50.046769 10585 raft_consensus.cc:697] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:49.976508 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet 3badc88d94a34ff7a053ed312f0dd646 with delete_type TABLET_DATA_DELETED (replaced by tablet b16108d31ced4e02b2d7d0ab1f581a2c) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:50.047047 10585 consensus_queue.cc:237] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } }
I20260810 19:47:50.032984 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 5f560ed7ea0c4075bad1375d86738861
I20260810 19:47:50.033983 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a4e75ffc215f4ff2a55eeb4e515a8c4f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:50.041008 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_d5338ea409454e78919788fa347f72b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.049263 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5338ea409454e78919788fa347f72b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.007578 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389ed7d4651446869d404fb389d6ce9d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:50.050134 9945 raft_consensus.cc:2393] T 389ed7d4651446869d404fb389d6ce9d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcd31b1bbb0340cbacfce652b4ad8da4 in current term 1: Already voted for candidate eadde59fd6504d679e47f03a60c64bb0 in this term.
I20260810 19:47:50.042655 9418 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet b16108d31ced4e02b2d7d0ab1f581a2c
I20260810 19:47:50.036509 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15bcf97364046daa97f7461f4f6bc98" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:50.050765 9948 raft_consensus.cc:2468] T d15bcf97364046daa97f7461f4f6bc98 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:50.051438 9611 leader_election.cc:304] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:50.051836 10378 raft_consensus.cc:2804] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:50.051944 10378 raft_consensus.cc:493] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:50.052048 10378 raft_consensus.cc:3060] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:47:50.052043 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4e75ffc215f4ff2a55eeb4e515a8c4f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.054982 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f560ed7ea0c4075bad1375d86738861 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b2b20dc77954af7a203f357c746be29) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:50.055433 9413 catalog_manager.cc:6807] ReplaceTablet: tablet 5f560ed7ea0c4075bad1375d86738861 deleted and replaced by tablet 2b2b20dc77954af7a203f357c746be29
I20260810 19:47:50.055558 10378 raft_consensus.cc:515] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.056361 10378 leader_election.cc:290] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:50.056813 10371 ts_tablet_manager.cc:1929] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:50.057034 10371 log.cc:1199] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/9680053712644b4ca33c33031b1ad8bc
I20260810 19:47:50.057030 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f560ed7ea0c4075bad1375d86738861 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b2b20dc77954af7a203f357c746be29) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:50.057531 10371 ts_tablet_manager.cc:1950] T 9680053712644b4ca33c33031b1ad8bc P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:50.059614 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15bcf97364046daa97f7461f4f6bc98" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:50.059916 9945 raft_consensus.cc:3060] T d15bcf97364046daa97f7461f4f6bc98 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:50.062543 9904 tablet_service.cc:1511] Processing CreateTablet for tablet b737b216646a4c5baecb88d59bcce4df (DEFAULT_TABLE table=default.Table_98357f787dbf48958872d3de9003c202 [id=549322ede70c4efc91018201075b1a29]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:50.064630 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 204ef31f396a43a5bf06205560f987c9 consensus state has no leader
W20260810 19:47:50.065315 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee65b2c9980d4c77af8c68bf2f5c5f92 consensus state has no leader
I20260810 19:47:50.065778 10371 tablet_replica.cc:333] T 5d4717c6fed24cbfab3f64fcc2c47153 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:50.065747 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 9680053712644b4ca33c33031b1ad8bc (table default.Table_ec142e3fcbce461e80ff2fb17a1e690b [id=e6635cbcc8bc40d9b28fcae1ff0c2bef]) successfully deleted
I20260810 19:47:50.066047 10371 raft_consensus.cc:2243] T 5d4717c6fed24cbfab3f64fcc2c47153 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:50.066259 10371 raft_consensus.cc:2272] T 5d4717c6fed24cbfab3f64fcc2c47153 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:50.066640 9408 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 00dabf43505f4fc89be39ee8fb41c7ee (table default.Table_257ddf6dffe443b7bb3a6d5e7f1e93a2 [id=6b30bf93c566421593a182e1768c0482]). Expected version 1 got 0
I20260810 19:47:50.066933 10371 ts_tablet_manager.cc:1916] T 5d4717c6fed24cbfab3f64fcc2c47153 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:50.067363 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet d15bcf97364046daa97f7461f4f6bc98
I20260810 19:47:50.068176 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet d15bcf97364046daa97f7461f4f6bc98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:50.070855 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet d15bcf97364046daa97f7461f4f6bc98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:50.071674 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b8b85596130046dda3da6f7626b21127"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.072616 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8b85596130046dda3da6f7626b21127 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.059674 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_43a169cacafa4fb7a011cbe861de63c6" } new_table_name: "default.Table_9899065101ba46e9adf4fac4aa095bc0" modify_external_catalogs: true
I20260810 19:47:50.076021 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_fda8b43621384fe1b1891232334742f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.077046 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fda8b43621384fe1b1891232334742f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.078622 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet 3badc88d94a34ff7a053ed312f0dd646 with delete_type TABLET_DATA_DELETED (replaced by tablet b16108d31ced4e02b2d7d0ab1f581a2c) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:50.080106 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ffaf5621f8c4416bb378fcfee21da737" } new_table_name: "default.Table_1b1b59cdf6ef477b856b825bb519bd47" modify_external_catalogs: true
I20260810 19:47:50.083666 9675 tablet_service.cc:1511] Processing CreateTablet for tablet ee65b2c9980d4c77af8c68bf2f5c5f92 (DEFAULT_TABLE table=default.Table_81bfaffed3704bd5b2fd7c1dc23bf3fa [id=77e412a6dedf44a3a69b72b6a9d017aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.084175 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee65b2c9980d4c77af8c68bf2f5c5f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.084884 9420 master_service.cc:960] ReplaceTablet: received request to replace tablet 6af6dd8913f44e7f966ed2a128ae4fbf from {username='slave'} at 127.0.0.1:56048
W20260810 19:47:50.088995 9398 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet a01d3ec3c8914fe495f7a0f3c7c312f8 (table default.Table_a1645668cf79415ca029a01169fbf874 [id=aec405416e584af6bfb8194b357d6dbc], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet a01d3ec3c8914fe495f7a0f3c7c312f8 consensus state has no leader
I20260810 19:47:50.089982 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b737b216646a4c5baecb88d59bcce4df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.076416 10366 tablet_bootstrap.cc:492] T a71e3516f97c46f397de42f5c7089eeb P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:50.090417 10366 ts_tablet_manager.cc:1403] T a71e3516f97c46f397de42f5c7089eeb P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.508s user 0.046s sys 0.063s
W20260810 19:47:50.079705 10068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 168864us
I20260810 19:47:50.091491 10366 raft_consensus.cc:359] T a71e3516f97c46f397de42f5c7089eeb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.091768 10366 raft_consensus.cc:385] T a71e3516f97c46f397de42f5c7089eeb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:50.091869 10366 raft_consensus.cc:740] T a71e3516f97c46f397de42f5c7089eeb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:50.092120 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0d4ce494b4459eb05716d6e62d7a09" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:50.092231 10366 consensus_queue.cc:260] T a71e3516f97c46f397de42f5c7089eeb P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.093019 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389ed7d4651446869d404fb389d6ce9d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:50.093271 9715 raft_consensus.cc:3060] T 389ed7d4651446869d404fb389d6ce9d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:50.093619 10366 ts_tablet_manager.cc:1434] T a71e3516f97c46f397de42f5c7089eeb P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:47:50.094043 10366 tablet_bootstrap.cc:492] T 3cda6eb6d4b847edb2624a267bc3522d P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:50.070541 9911 tablet_service.cc:1558] Processing DeleteTablet for tablet d15bcf97364046daa97f7461f4f6bc98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:50.095780 9945 raft_consensus.cc:2468] T d15bcf97364046daa97f7461f4f6bc98 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:50.096182 9715 raft_consensus.cc:2468] T 389ed7d4651446869d404fb389d6ce9d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:47:50.096344 9611 leader_election.cc:304] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:50.097759 10366 tablet_bootstrap.cc:654] T 3cda6eb6d4b847edb2624a267bc3522d P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:50.099284 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389ed7d4651446869d404fb389d6ce9d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:50.100394 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7bb5fcac0a4207b4ee997099777b5b" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:50.100601 10168 raft_consensus.cc:3060] T 3a7bb5fcac0a4207b4ee997099777b5b P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:50.103654 10168 raft_consensus.cc:2468] T 3a7bb5fcac0a4207b4ee997099777b5b P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:50.105053 10378 raft_consensus.cc:2804] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:50.107432 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f560ed7ea0c4075bad1375d86738861 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b2b20dc77954af7a203f357c746be29) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:50.109309 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15bcf97364046daa97f7461f4f6bc98" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:50.109573 10168 raft_consensus.cc:2468] T d15bcf97364046daa97f7461f4f6bc98 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:50.110070 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15bcf97364046daa97f7461f4f6bc98" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:50.110575 10168 raft_consensus.cc:3060] T d15bcf97364046daa97f7461f4f6bc98 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:50.112473 10371 ts_tablet_manager.cc:1929] T 5d4717c6fed24cbfab3f64fcc2c47153 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:50.112643 10371 log.cc:1199] T 5d4717c6fed24cbfab3f64fcc2c47153 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/5d4717c6fed24cbfab3f64fcc2c47153
I20260810 19:47:50.113091 10371 ts_tablet_manager.cc:1950] T 5d4717c6fed24cbfab3f64fcc2c47153 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:50.113544 10378 raft_consensus.cc:697] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:50.113920 10378 consensus_queue.cc:237] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.114392 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 5d4717c6fed24cbfab3f64fcc2c47153 (table default.Table_70688a60aaaa4439a3fccf1b2a8f768d [id=11015256d39042599eae0f05e96dca2d]) successfully deleted
I20260810 19:47:50.116454 10168 raft_consensus.cc:2468] T d15bcf97364046daa97f7461f4f6bc98 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:50.116882 10621 raft_consensus.cc:493] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:50.117085 10621 raft_consensus.cc:515] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.121259 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 248e8954c46e4328a696f9799604e67f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:50.121615 10621 leader_election.cc:290] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:50.122049 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176d4e72b8e44e4b88bdf89d06f2f79a" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:50.125746 9911 tablet_service.cc:1558] Processing DeleteTablet for tablet a71e3516f97c46f397de42f5c7089eeb with delete_type TABLET_DATA_DELETED (replaced by tablet 4d654dada92a4939914d26ab72a5f5e8) from {username='slave'} at 127.0.0.1:38276
W20260810 19:47:50.122907 10067 leader_election.cc:343] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:50.127511 10068 leader_election.cc:343] T 5f0d4ce494b4459eb05716d6e62d7a09 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:50.128455 10068 leader_election.cc:304] T 5f0d4ce494b4459eb05716d6e62d7a09 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:50.129719 9611 leader_election.cc:304] T 389ed7d4651446869d404fb389d6ce9d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:50.130285 10585 raft_consensus.cc:2749] T 389ed7d4651446869d404fb389d6ce9d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:50.084369 10145 tablet_service.cc:1511] Processing CreateTablet for tablet ee65b2c9980d4c77af8c68bf2f5c5f92 (DEFAULT_TABLE table=default.Table_81bfaffed3704bd5b2fd7c1dc23bf3fa [id=77e412a6dedf44a3a69b72b6a9d017aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.131790 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee65b2c9980d4c77af8c68bf2f5c5f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.132320 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176d4e72b8e44e4b88bdf89d06f2f79a" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:50.141096 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 6af6dd8913f44e7f966ed2a128ae4fbf
I20260810 19:47:50.141631 9420 catalog_manager.cc:6807] ReplaceTablet: tablet 6af6dd8913f44e7f966ed2a128ae4fbf deleted and replaced by tablet 320e42f6de6c4452adb7bbb379a156e6
W20260810 19:47:50.142740 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 476e762e46c04ae6bfef5e14df2d16e2 has no consensus state
I20260810 19:47:50.142917 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 6af6dd8913f44e7f966ed2a128ae4fbf with delete_type TABLET_DATA_DELETED (replaced by tablet 320e42f6de6c4452adb7bbb379a156e6) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:50.142948 10621 raft_consensus.cc:2749] T 5f0d4ce494b4459eb05716d6e62d7a09 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:50.144294 9911 tablet_service.cc:1558] Processing DeleteTablet for tablet 6af6dd8913f44e7f966ed2a128ae4fbf with delete_type TABLET_DATA_DELETED (replaced by tablet 320e42f6de6c4452adb7bbb379a156e6) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:50.144414 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet 6af6dd8913f44e7f966ed2a128ae4fbf with delete_type TABLET_DATA_DELETED (replaced by tablet 320e42f6de6c4452adb7bbb379a156e6) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:50.127928 10763 raft_consensus.cc:493] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:50.150518 10763 raft_consensus.cc:515] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.152940 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71e3516f97c46f397de42f5c7089eeb" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:50.153335 9945 raft_consensus.cc:2468] T a71e3516f97c46f397de42f5c7089eeb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:47:50.153945 10067 leader_election.cc:304] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:50.157929 10377 ts_tablet_manager.cc:1929] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:50.158291 10621 raft_consensus.cc:2804] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:50.158514 10621 raft_consensus.cc:493] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:50.158700 10621 raft_consensus.cc:3060] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:47:50.159765 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4f2d7c165d2c465d9080b927d54807f7 consensus state has no leader
I20260810 19:47:50.161950 10621 raft_consensus.cc:515] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.169482 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 3f18c24b01384299a4f941d7fb840032 (DEFAULT_TABLE table=default.Table_5fec01b720074528bb967b379211864f [id=6287581e5dad45b4b7fd481e9ae5eae3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.170084 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f18c24b01384299a4f941d7fb840032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.114149 10371 tablet_replica.cc:333] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:50.178399 10371 raft_consensus.cc:2243] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:50.178819 10371 pending_rounds.cc:70] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4: Trying to abort 1 pending ops.
I20260810 19:47:50.178900 10371 pending_rounds.cc:77] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058640343040000 op_type: NO_OP noop_request { }
I20260810 19:47:50.184824 9413 master_service.cc:960] ReplaceTablet: received request to replace tablet a9e42e13617c4457ba88ae0e0269ec93 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:50.185235 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_20489495f6794646b9eda0458ee58d91"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.185999 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20489495f6794646b9eda0458ee58d91 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.187780 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_998c14b0e9e14df48d3d4367f7c3b941"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.188434 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_998c14b0e9e14df48d3d4367f7c3b941 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.190217 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_20332cc0e9df49adb98c82a60784c4bb" } modify_external_catalogs: true
I20260810 19:47:50.190470 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_20332cc0e9df49adb98c82a60784c4bb" } modify_external_catalogs: true
I20260810 19:47:50.195982 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet a9e42e13617c4457ba88ae0e0269ec93
I20260810 19:47:50.196470 9413 catalog_manager.cc:6807] ReplaceTablet: tablet a9e42e13617c4457ba88ae0e0269ec93 deleted and replaced by tablet 0dd49d6fa79e4677b753b6cf9117b02d
I20260810 19:47:50.167207 9911 tablet_service.cc:1511] Processing CreateTablet for tablet ee65b2c9980d4c77af8c68bf2f5c5f92 (DEFAULT_TABLE table=default.Table_81bfaffed3704bd5b2fd7c1dc23bf3fa [id=77e412a6dedf44a3a69b72b6a9d017aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.198433 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee65b2c9980d4c77af8c68bf2f5c5f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.194845 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 3f18c24b01384299a4f941d7fb840032 (DEFAULT_TABLE table=default.Table_5fec01b720074528bb967b379211864f [id=6287581e5dad45b4b7fd481e9ae5eae3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.202692 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f18c24b01384299a4f941d7fb840032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.196009 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 28c9eecacc6540ac82ac7faabceec788 (DEFAULT_TABLE table=default.Table_6e4259d122294c46bd79d8abbb79c520 [id=2d19b64ee46e460e807325299f942e18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.206702 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c9eecacc6540ac82ac7faabceec788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.197364 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet a9e42e13617c4457ba88ae0e0269ec93 with delete_type TABLET_DATA_DELETED (replaced by tablet 0dd49d6fa79e4677b753b6cf9117b02d) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:50.211020 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 6355c14e38b3446493f7bd5e2a717341
I20260810 19:47:50.212680 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 6355c14e38b3446493f7bd5e2a717341 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:50.235781 10377 log.cc:1199] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/5d4717c6fed24cbfab3f64fcc2c47153
I20260810 19:47:50.236517 10377 ts_tablet_manager.cc:1950] T 5d4717c6fed24cbfab3f64fcc2c47153 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:50.238014 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 5d4717c6fed24cbfab3f64fcc2c47153 (table default.Table_70688a60aaaa4439a3fccf1b2a8f768d [id=11015256d39042599eae0f05e96dca2d]) successfully deleted
W20260810 19:47:50.239720 9395 catalog_manager.cc:5017] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 994c70f8843e4b0ab744775d357c49c2 because the tablet was not found. No further retry: Not found: Tablet not found: 994c70f8843e4b0ab744775d357c49c2
W20260810 19:47:50.240658 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 34fdc03b114b405da9e3a17ef1ad87c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34fdc03b114b405da9e3a17ef1ad87c4 already in progress: creating tablet
I20260810 19:47:50.241080 10377 tablet_replica.cc:333] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:50.241385 10377 raft_consensus.cc:2243] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:50.241801 10377 raft_consensus.cc:2272] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:50.242290 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_18277a006ecd4ec08e1ac6a597417bd1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.243112 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18277a006ecd4ec08e1ac6a597417bd1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.244771 9421 master_service.cc:960] ReplaceTablet: received request to replace tablet 3cda6eb6d4b847edb2624a267bc3522d from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:50.245705 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3dcb85babc4642ca90ab01191504bc0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.246239 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3dcb85babc4642ca90ab01191504bc0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.247704 9420 master_service.cc:960] ReplaceTablet: received request to replace tablet 3a7bb5fcac0a4207b4ee997099777b5b from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:50.248521 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b0123864189f4f8bbe188d35a6e10013" } modify_external_catalogs: true
I20260810 19:47:50.248724 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b0123864189f4f8bbe188d35a6e10013" } modify_external_catalogs: true
I20260810 19:47:50.250502 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e9ea44b27cff400ba61de42acb18908c" } modify_external_catalogs: true
I20260810 19:47:50.250602 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_70688a60aaaa4439a3fccf1b2a8f768d" } new_table_name: "default.Table_ebe965457d0c46a39803fb5155a0bc0c" modify_external_catalogs: true
I20260810 19:47:50.250726 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e9ea44b27cff400ba61de42acb18908c" } modify_external_catalogs: true
I20260810 19:47:50.252703 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c6d29088153747e5aac8ca0d5904f69d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.253573 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6d29088153747e5aac8ca0d5904f69d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.269250 10621 leader_election.cc:290] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:50.269296 9416 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 77e85931de814ceba1ab419c93e70368
I20260810 19:47:50.165254 10375 ts_tablet_manager.cc:1929] T 4ec0aa595d3c4e388eb7f07717ac4349 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:50.269726 10375 log.cc:1199] T 4ec0aa595d3c4e388eb7f07717ac4349 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/4ec0aa595d3c4e388eb7f07717ac4349
I20260810 19:47:50.270212 10375 ts_tablet_manager.cc:1950] T 4ec0aa595d3c4e388eb7f07717ac4349 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:50.271545 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 4ec0aa595d3c4e388eb7f07717ac4349 (table default.Table_b0ed4458615243bebb70678601959f25 [id=18a231579184474c909db279bbba5751]) successfully deleted
W20260810 19:47:50.181806 10068 leader_election.cc:343] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:50.271986 10068 leader_election.cc:304] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:47:50.272409 10068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 90642.2us
I20260810 19:47:50.272554 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 74dddd12f2314d6ab5a6717025b13a51
I20260810 19:47:50.182013 10763 leader_election.cc:290] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:50.196364 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 3f18c24b01384299a4f941d7fb840032 (DEFAULT_TABLE table=default.Table_5fec01b720074528bb967b379211864f [id=6287581e5dad45b4b7fd481e9ae5eae3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.273736 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f18c24b01384299a4f941d7fb840032. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:50.274202 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0dd49d6fa79e4677b753b6cf9117b02d has no consensus state
I20260810 19:47:50.275110 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet 74dddd12f2314d6ab5a6717025b13a51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:50.196923 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet a9e42e13617c4457ba88ae0e0269ec93 with delete_type TABLET_DATA_DELETED (replaced by tablet 0dd49d6fa79e4677b753b6cf9117b02d) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:50.279089 10763 raft_consensus.cc:2749] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:50.197773 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 28c9eecacc6540ac82ac7faabceec788 (DEFAULT_TABLE table=default.Table_6e4259d122294c46bd79d8abbb79c520 [id=2d19b64ee46e460e807325299f942e18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.207840 10370 tablet_bootstrap.cc:492] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:50.212309 10136 tablet_service.cc:1558] Processing DeleteTablet for tablet 6355c14e38b3446493f7bd5e2a717341 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:50.252010 10759 raft_consensus.cc:493] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:50.259840 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 6355c14e38b3446493f7bd5e2a717341 (DEFAULT_TABLE table=default.Table_20332cc0e9df49adb98c82a60784c4bb [id=ba8ef3f482364fc081f8e796fdbdb076]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.282850 10370 ts_tablet_manager.cc:1403] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.503s user 0.075s sys 0.124s
I20260810 19:47:50.283301 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6355c14e38b3446493f7bd5e2a717341. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.283941 10370 raft_consensus.cc:359] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:50.284165 10370 raft_consensus.cc:385] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:50.284260 10370 raft_consensus.cc:740] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:50.284536 10370 consensus_queue.cc:260] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:50.285181 10370 ts_tablet_manager.cc:1434] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:47:50.285594 10370 tablet_bootstrap.cc:492] T 9e09483838f0459da3041ee4fe5d55cc P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:50.264108 10120 tablet_service.cc:1511] Processing CreateTablet for tablet 08e29e23d54f47968a06be98b313918d (DEFAULT_TABLE table=default.Table_d533329b9e424fa0abce94bd85345b36 [id=7112ce97719c47919a3d24d1af7d07cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.282867 10759 raft_consensus.cc:515] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.265111 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 0d79ef93c5bf4ac9895e594198edb251 (DEFAULT_TABLE table=default.Table_949bcc619f4b45189db61b24b5598e66 [id=ed1551c0accc41eead911b83ee4c0a6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.290376 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e29e23d54f47968a06be98b313918d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.292799 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d79ef93c5bf4ac9895e594198edb251. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.293234 10759 leader_election.cc:290] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:50.295658 10370 tablet_bootstrap.cc:654] T 9e09483838f0459da3041ee4fe5d55cc P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:50.298417 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c9eecacc6540ac82ac7faabceec788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.328719 10585 raft_consensus.cc:493] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:50.333920 10375 tablet_replica.cc:333] T 9680053712644b4ca33c33031b1ad8bc P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:50.335194 10375 raft_consensus.cc:2243] T 9680053712644b4ca33c33031b1ad8bc P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:50.339746 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 6355c14e38b3446493f7bd5e2a717341 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:50.339747 10585 raft_consensus.cc:515] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.339226 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71e3516f97c46f397de42f5c7089eeb" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:50.340553 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet a9e42e13617c4457ba88ae0e0269ec93 with delete_type TABLET_DATA_DELETED (replaced by tablet 0dd49d6fa79e4677b753b6cf9117b02d) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:50.341275 10585 leader_election.cc:290] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:50.341518 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 0d79ef93c5bf4ac9895e594198edb251 (DEFAULT_TABLE table=default.Table_949bcc619f4b45189db61b24b5598e66 [id=ed1551c0accc41eead911b83ee4c0a6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.341883 9716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71e3516f97c46f397de42f5c7089eeb" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:50.341575 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 74dddd12f2314d6ab5a6717025b13a51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:50.342293 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 28c9eecacc6540ac82ac7faabceec788 (DEFAULT_TABLE table=default.Table_6e4259d122294c46bd79d8abbb79c520 [id=2d19b64ee46e460e807325299f942e18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.343779 10371 raft_consensus.cc:2889] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:50.343811 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 08e29e23d54f47968a06be98b313918d (DEFAULT_TABLE table=default.Table_d533329b9e424fa0abce94bd85345b36 [id=7112ce97719c47919a3d24d1af7d07cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.344044 10371 raft_consensus.cc:2272] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:50.344264 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 0c0a1e360ac648eeb0c734215bc200f6 (DEFAULT_TABLE table=default.Table_03fbd70a4ed44530a3fab8f17c0769db [id=09fa54104d0f46dbb3f19138bfa2313d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.346143 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 6355c14e38b3446493f7bd5e2a717341 (DEFAULT_TABLE table=default.Table_20332cc0e9df49adb98c82a60784c4bb [id=ba8ef3f482364fc081f8e796fdbdb076]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.346426 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d79ef93c5bf4ac9895e594198edb251. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.346684 10367 tablet_bootstrap.cc:492] T a71e3516f97c46f397de42f5c7089eeb P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:50.346938 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "248e8954c46e4328a696f9799604e67f" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:50.347180 9715 raft_consensus.cc:2468] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:47:50.348062 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6355c14e38b3446493f7bd5e2a717341. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.349418 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c0a1e360ac648eeb0c734215bc200f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.350046 10371 ts_tablet_manager.cc:1916] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:50.343029 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "248e8954c46e4328a696f9799604e67f" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:50.350457 10168 raft_consensus.cc:2468] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
W20260810 19:47:50.343513 10068 leader_election.cc:343] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:50.351084 10068 leader_election.cc:343] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:50.351353 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e29e23d54f47968a06be98b313918d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.351608 10068 leader_election.cc:304] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:50.352188 9611 leader_election.cc:304] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:50.352799 10375 raft_consensus.cc:2272] T 9680053712644b4ca33c33031b1ad8bc P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:50.352998 10621 raft_consensus.cc:2804] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:50.353152 10621 raft_consensus.cc:493] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:50.353294 10621 raft_consensus.cc:3060] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:50.355640 10375 ts_tablet_manager.cc:1916] T 9680053712644b4ca33c33031b1ad8bc P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:50.359175 10621 raft_consensus.cc:515] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.366071 10378 raft_consensus.cc:2804] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:50.366219 10378 raft_consensus.cc:493] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:50.366057 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_252bc6d370744d24bcfdfab17c4a3d17"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:50.366367 10378 raft_consensus.cc:3060] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:50.366654 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_59b5d4d82ac044e0a101d8f598a44e43" } modify_external_catalogs: true
W20260810 19:47:50.366816 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_252bc6d370744d24bcfdfab17c4a3d17 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.366807 10621 leader_election.cc:290] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:50.366873 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_59b5d4d82ac044e0a101d8f598a44e43" } modify_external_catalogs: true
I20260810 19:47:50.367360 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c9eecacc6540ac82ac7faabceec788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.367388 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "248e8954c46e4328a696f9799604e67f" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:50.262382 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 08e29e23d54f47968a06be98b313918d (DEFAULT_TABLE table=default.Table_d533329b9e424fa0abce94bd85345b36 [id=7112ce97719c47919a3d24d1af7d07cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.370450 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_81bfaffed3704bd5b2fd7c1dc23bf3fa" } new_table_name: "default.Table_2784ff35cf7944ada0cefff31407d65d" modify_external_catalogs: true
I20260810 19:47:50.370842 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e29e23d54f47968a06be98b313918d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.372089 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2080a27caba94bd8a8ab66b012cb20e4" } modify_external_catalogs: true
I20260810 19:47:50.372288 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2080a27caba94bd8a8ab66b012cb20e4" } modify_external_catalogs: true
I20260810 19:47:50.374039 10375 ts_tablet_manager.cc:1929] T 9680053712644b4ca33c33031b1ad8bc P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:50.374176 10375 log.cc:1199] T 9680053712644b4ca33c33031b1ad8bc P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/9680053712644b4ca33c33031b1ad8bc
I20260810 19:47:50.262809 9911 tablet_service.cc:1511] Processing CreateTablet for tablet 6355c14e38b3446493f7bd5e2a717341 (DEFAULT_TABLE table=default.Table_20332cc0e9df49adb98c82a60784c4bb [id=ba8ef3f482364fc081f8e796fdbdb076]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.374725 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6355c14e38b3446493f7bd5e2a717341. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.374951 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_217debaa83504cc9bc150924d212f9b8" } new_table_name: "default.Table_2bdff833e300406db760c7c64d88e546" modify_external_catalogs: true
I20260810 19:47:50.266244 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 0d79ef93c5bf4ac9895e594198edb251 (DEFAULT_TABLE table=default.Table_949bcc619f4b45189db61b24b5598e66 [id=ed1551c0accc41eead911b83ee4c0a6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.267683 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 0c0a1e360ac648eeb0c734215bc200f6 (DEFAULT_TABLE table=default.Table_03fbd70a4ed44530a3fab8f17c0769db [id=09fa54104d0f46dbb3f19138bfa2313d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.378811 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c0a1e360ac648eeb0c734215bc200f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.381331 10378 raft_consensus.cc:515] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.381776 9715 raft_consensus.cc:2393] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eadde59fd6504d679e47f03a60c64bb0 in current term 1: Already voted for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in this term.
I20260810 19:47:50.382222 10378 leader_election.cc:290] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:50.269021 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71e3516f97c46f397de42f5c7089eeb" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:50.382416 10367 ts_tablet_manager.cc:1403] T a71e3516f97c46f397de42f5c7089eeb P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.324s user 0.023s sys 0.054s
I20260810 19:47:50.275720 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet 74dddd12f2314d6ab5a6717025b13a51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:50.382546 9945 raft_consensus.cc:3060] T a71e3516f97c46f397de42f5c7089eeb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:50.280800 10488 raft_consensus.cc:493] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:50.382773 10488 raft_consensus.cc:515] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.383651 10488 leader_election.cc:290] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:50.383872 10488 consensus_queue.cc:1048] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:50.384198 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "248e8954c46e4328a696f9799604e67f" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:50.384466 10168 raft_consensus.cc:2393] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fcd31b1bbb0340cbacfce652b4ad8da4 in current term 1: Already voted for candidate eadde59fd6504d679e47f03a60c64bb0 in this term.
I20260810 19:47:50.384572 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "248e8954c46e4328a696f9799604e67f" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:50.384838 9944 raft_consensus.cc:3060] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:50.385561 10375 ts_tablet_manager.cc:1950] T 9680053712644b4ca33c33031b1ad8bc P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:50.385562 9945 raft_consensus.cc:2468] T a71e3516f97c46f397de42f5c7089eeb P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:47:50.291654 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "248e8954c46e4328a696f9799604e67f" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:50.330937 10366 tablet_bootstrap.cc:492] T 3cda6eb6d4b847edb2624a267bc3522d P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:50.385984 10366 ts_tablet_manager.cc:1403] T 3cda6eb6d4b847edb2624a267bc3522d P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.292s user 0.020s sys 0.035s
I20260810 19:47:50.386119 10367 raft_consensus.cc:359] T a71e3516f97c46f397de42f5c7089eeb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.386343 10367 raft_consensus.cc:385] T a71e3516f97c46f397de42f5c7089eeb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:50.386435 10367 raft_consensus.cc:740] T a71e3516f97c46f397de42f5c7089eeb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:50.386675 10367 consensus_queue.cc:260] T a71e3516f97c46f397de42f5c7089eeb P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.386896 10366 raft_consensus.cc:359] T 3cda6eb6d4b847edb2624a267bc3522d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:50.387082 10366 raft_consensus.cc:385] T 3cda6eb6d4b847edb2624a267bc3522d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:50.387188 10366 raft_consensus.cc:740] T 3cda6eb6d4b847edb2624a267bc3522d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:50.387231 10367 ts_tablet_manager.cc:1434] T a71e3516f97c46f397de42f5c7089eeb P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20260810 19:47:50.387522 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d79ef93c5bf4ac9895e594198edb251. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.368809 9946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "248e8954c46e4328a696f9799604e67f" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:50.387610 10367 tablet_bootstrap.cc:492] T 204ef31f396a43a5bf06205560f987c9 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:50.389875 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "204ef31f396a43a5bf06205560f987c9" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:50.390004 10367 tablet_bootstrap.cc:654] T 204ef31f396a43a5bf06205560f987c9 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:50.390116 10168 raft_consensus.cc:2468] T 204ef31f396a43a5bf06205560f987c9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:50.387408 10366 consensus_queue.cc:260] T 3cda6eb6d4b847edb2624a267bc3522d P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:50.342186 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "248e8954c46e4328a696f9799604e67f" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:50.390854 10366 ts_tablet_manager.cc:1434] T 3cda6eb6d4b847edb2624a267bc3522d P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260810 19:47:50.390867 9830 leader_election.cc:304] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:50.390973 9944 raft_consensus.cc:2468] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:50.391584 10488 raft_consensus.cc:2804] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:50.391698 10488 raft_consensus.cc:493] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:50.391777 10488 raft_consensus.cc:3060] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:50.395198 10366 tablet_bootstrap.cc:492] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:50.395272 10375 tablet_replica.cc:333] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:50.396283 9611 leader_election.cc:304] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:50.396513 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "204ef31f396a43a5bf06205560f987c9" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:50.397100 10366 tablet_bootstrap.cc:654] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:50.397782 10585 raft_consensus.cc:2804] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:50.397943 10585 raft_consensus.cc:697] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:50.398262 10585 consensus_queue.cc:237] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
W20260810 19:47:50.399712 9831 leader_election.cc:343] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:50.402856 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet a71e3516f97c46f397de42f5c7089eeb with delete_type TABLET_DATA_DELETED (replaced by tablet 4d654dada92a4939914d26ab72a5f5e8) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:50.403699 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 9680053712644b4ca33c33031b1ad8bc (table default.Table_ec142e3fcbce461e80ff2fb17a1e690b [id=e6635cbcc8bc40d9b28fcae1ff0c2bef]) successfully deleted
I20260810 19:47:50.412958 10488 raft_consensus.cc:515] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.414441 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "204ef31f396a43a5bf06205560f987c9" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:50.414640 10067 leader_election.cc:304] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:47:50.415231 9831 leader_election.cc:343] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:50.415616 10621 raft_consensus.cc:2804] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:50.415692 10067 leader_election.cc:304] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:50.415849 10621 raft_consensus.cc:697] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:47:50.416183 10759 raft_consensus.cc:2749] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 19:47:50.418159 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "204ef31f396a43a5bf06205560f987c9" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:50.418397 10168 raft_consensus.cc:3060] T 204ef31f396a43a5bf06205560f987c9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:50.421669 10168 raft_consensus.cc:2468] T 204ef31f396a43a5bf06205560f987c9 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:50.422441 9830 leader_election.cc:304] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:50.422842 10488 leader_election.cc:290] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:50.423234 10488 raft_consensus.cc:2804] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:50.423409 10488 raft_consensus.cc:697] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:47:50.423779 10488 consensus_queue.cc:237] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.416180 10621 consensus_queue.cc:237] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.425563 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet ba8c4420f5e345eeac30c805d673b5e9
I20260810 19:47:50.426926 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet ba8c4420f5e345eeac30c805d673b5e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:50.427564 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee65b2c9980d4c77af8c68bf2f5c5f92 consensus state has no leader
I20260810 19:47:50.429567 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cda6eb6d4b847edb2624a267bc3522d with delete_type TABLET_DATA_DELETED (replaced by tablet 3e8d34d723134d9289d96e633fed3fde) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:50.429852 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet ba8c4420f5e345eeac30c805d673b5e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:50.430094 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet ba8c4420f5e345eeac30c805d673b5e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:50.430505 10375 raft_consensus.cc:2243] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:50.433279 10375 pending_rounds.cc:70] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:47:50.434094 10375 pending_rounds.cc:77] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058641792458752 op_type: NO_OP noop_request { }
I20260810 19:47:50.434639 10375 raft_consensus.cc:2889] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:50.435127 10375 raft_consensus.cc:2272] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:50.437077 10367 tablet_bootstrap.cc:492] T 204ef31f396a43a5bf06205560f987c9 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:50.437299 10367 ts_tablet_manager.cc:1403] T 204ef31f396a43a5bf06205560f987c9 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.050s user 0.009s sys 0.013s
I20260810 19:47:50.438238 10375 ts_tablet_manager.cc:1916] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:50.440099 10367 raft_consensus.cc:359] T 204ef31f396a43a5bf06205560f987c9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.440359 10367 raft_consensus.cc:385] T 204ef31f396a43a5bf06205560f987c9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:50.440456 10367 raft_consensus.cc:740] T 204ef31f396a43a5bf06205560f987c9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:50.440739 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cda6eb6d4b847edb2624a267bc3522d with delete_type TABLET_DATA_DELETED (replaced by tablet 3e8d34d723134d9289d96e633fed3fde) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:50.440766 10367 consensus_queue.cc:260] T 204ef31f396a43a5bf06205560f987c9 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
W20260810 19:47:50.441076 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 971e9abee86444a7a9e923b0962ae751 has no consensus state
I20260810 19:47:50.441365 10367 ts_tablet_manager.cc:1434] T 204ef31f396a43a5bf06205560f987c9 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 19:47:50.441749 10367 tablet_bootstrap.cc:492] T 5f0d4ce494b4459eb05716d6e62d7a09 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:50.441764 10377 ts_tablet_manager.cc:1916] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:50.445011 9413 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 4f90707dba6e4a3ab7d4c6c197326411
I20260810 19:47:50.447631 10367 tablet_bootstrap.cc:654] T 5f0d4ce494b4459eb05716d6e62d7a09 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:50.451138 10367 tablet_bootstrap.cc:492] T 5f0d4ce494b4459eb05716d6e62d7a09 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:50.451319 10367 ts_tablet_manager.cc:1403] T 5f0d4ce494b4459eb05716d6e62d7a09 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260810 19:47:50.452123 10367 raft_consensus.cc:359] T 5f0d4ce494b4459eb05716d6e62d7a09 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.452301 10367 raft_consensus.cc:385] T 5f0d4ce494b4459eb05716d6e62d7a09 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:50.452412 10367 raft_consensus.cc:740] T 5f0d4ce494b4459eb05716d6e62d7a09 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:50.452689 10367 consensus_queue.cc:260] T 5f0d4ce494b4459eb05716d6e62d7a09 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.453322 10367 ts_tablet_manager.cc:1434] T 5f0d4ce494b4459eb05716d6e62d7a09 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:47:50.457489 10367 tablet_bootstrap.cc:492] T c5625c6f78f14d629bcd7f8c9522c4ba P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:50.459414 10367 tablet_bootstrap.cc:654] T c5625c6f78f14d629bcd7f8c9522c4ba P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:50.460510 10375 ts_tablet_manager.cc:1929] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:50.463665 10375 log.cc:1199] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/389ed7d4651446869d404fb389d6ce9d
I20260810 19:47:50.463624 10367 tablet_bootstrap.cc:492] T c5625c6f78f14d629bcd7f8c9522c4ba P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:50.464111 10367 ts_tablet_manager.cc:1403] T c5625c6f78f14d629bcd7f8c9522c4ba P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260810 19:47:50.465092 10375 ts_tablet_manager.cc:1950] T 389ed7d4651446869d404fb389d6ce9d P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:50.465415 10367 raft_consensus.cc:359] T c5625c6f78f14d629bcd7f8c9522c4ba P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.465729 10367 raft_consensus.cc:385] T c5625c6f78f14d629bcd7f8c9522c4ba P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:50.465819 10367 raft_consensus.cc:740] T c5625c6f78f14d629bcd7f8c9522c4ba P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:50.466527 10367 consensus_queue.cc:260] T c5625c6f78f14d629bcd7f8c9522c4ba P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.468309 10585 consensus_queue.cc:1048] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:50.469847 10367 ts_tablet_manager.cc:1434] T c5625c6f78f14d629bcd7f8c9522c4ba P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 19:47:50.470484 10367 tablet_bootstrap.cc:492] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:50.475703 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 0c0a1e360ac648eeb0c734215bc200f6 (DEFAULT_TABLE table=default.Table_03fbd70a4ed44530a3fab8f17c0769db [id=09fa54104d0f46dbb3f19138bfa2313d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.476344 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 389ed7d4651446869d404fb389d6ce9d (table default.Table_730d817e803a49e180281cc558c18e52 [id=1af6d2ea63b143dbab0acae33421936b]) successfully deleted
I20260810 19:47:50.477291 10367 tablet_bootstrap.cc:654] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:50.478252 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c0a1e360ac648eeb0c734215bc200f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.478489 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_511b7773a9034830ad84841ad4c71063"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.479306 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_511b7773a9034830ad84841ad4c71063 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.479887 10375 tablet_replica.cc:333] T 2ddeefaa826b4033b2e79eff7240887f P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
W20260810 19:47:50.480103 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 28c9eecacc6540ac82ac7faabceec788 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28c9eecacc6540ac82ac7faabceec788 already in progress: creating tablet
I20260810 19:47:50.480155 10375 raft_consensus.cc:2243] T 2ddeefaa826b4033b2e79eff7240887f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260810 19:47:50.480464 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 46005eead530459eb2b636ae0a6767ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46005eead530459eb2b636ae0a6767ad already in progress: creating tablet
I20260810 19:47:50.482167 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_9ae3537027a04f86aa62a86f5668fe12"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:50.482797 10375 raft_consensus.cc:2272] T 2ddeefaa826b4033b2e79eff7240887f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:47:50.482864 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ae3537027a04f86aa62a86f5668fe12 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.483585 10375 ts_tablet_manager.cc:1916] T 2ddeefaa826b4033b2e79eff7240887f P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:50.484285 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2b214fd57f394b5bae33becc3b1439b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.484870 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b214fd57f394b5bae33becc3b1439b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.486225 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_7127a1cfb63b4490ac7b827da3350206"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.486840 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7127a1cfb63b4490ac7b827da3350206 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.488180 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9899065101ba46e9adf4fac4aa095bc0" } new_table_name: "default.Table_35ada13f5f5a41b0a93a57276b7756d9" modify_external_catalogs: true
I20260810 19:47:50.489568 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3d6b5606c1454e6297b993e3eaf7f084" } new_table_name: "default.Table_5f6b1710e7cc447dbf34e05882706750" modify_external_catalogs: true
I20260810 19:47:50.492722 10366 tablet_bootstrap.cc:492] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:50.492961 10366 ts_tablet_manager.cc:1403] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.098s user 0.005s sys 0.004s
I20260810 19:47:50.494005 10366 raft_consensus.cc:359] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.494307 10366 raft_consensus.cc:385] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:50.494448 10366 raft_consensus.cc:740] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:50.494849 10366 consensus_queue.cc:260] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.482197 9408 master_service.cc:960] ReplaceTablet: received request to replace tablet 4f2d7c165d2c465d9080b927d54807f7 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:50.512547 10371 ts_tablet_manager.cc:1929] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260810 19:47:50.519333 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet aa5702d7b3bd421eb7b8a4e0f181d2d4 consensus state has no leader
I20260810 19:47:50.519764 10621 raft_consensus.cc:493] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 19:47:50.519913 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4f2d7c165d2c465d9080b927d54807f7 consensus state has no leader
I20260810 19:47:50.520159 10621 raft_consensus.cc:515] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:50.523106 10621 leader_election.cc:290] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:50.524806 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 4f2d7c165d2c465d9080b927d54807f7
I20260810 19:47:50.525359 9408 catalog_manager.cc:6807] ReplaceTablet: tablet 4f2d7c165d2c465d9080b927d54807f7 deleted and replaced by tablet 639c824ba4834734a4ebfd558181bebe
W20260810 19:47:50.526445 9830 consensus_peers.cc:597] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6d4387725a1843a7a7344d10e956c712. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:50.528096 10370 tablet_bootstrap.cc:492] T 9e09483838f0459da3041ee4fe5d55cc P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:50.528415 10370 ts_tablet_manager.cc:1403] T 9e09483838f0459da3041ee4fe5d55cc P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.243s user 0.042s sys 0.060s
I20260810 19:47:50.529706 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet b9e761e94dbf4baba5e44a89b6c6a81c from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:50.529632 10370 raft_consensus.cc:359] T 9e09483838f0459da3041ee4fe5d55cc P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.529875 10370 raft_consensus.cc:385] T 9e09483838f0459da3041ee4fe5d55cc P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:50.529950 10370 raft_consensus.cc:740] T 9e09483838f0459da3041ee4fe5d55cc P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:50.530292 10370 consensus_queue.cc:260] T 9e09483838f0459da3041ee4fe5d55cc P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.530959 10370 ts_tablet_manager.cc:1434] T 9e09483838f0459da3041ee4fe5d55cc P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 19:47:50.539026 10375 ts_tablet_manager.cc:1929] T 2ddeefaa826b4033b2e79eff7240887f P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:50.539224 10375 log.cc:1199] T 2ddeefaa826b4033b2e79eff7240887f P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/2ddeefaa826b4033b2e79eff7240887f
I20260810 19:47:50.539594 10375 ts_tablet_manager.cc:1950] T 2ddeefaa826b4033b2e79eff7240887f P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:50.539930 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet b9e761e94dbf4baba5e44a89b6c6a81c
I20260810 19:47:50.540076 10366 ts_tablet_manager.cc:1434] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.047s user 0.003s sys 0.000s
I20260810 19:47:50.540609 9410 catalog_manager.cc:6807] ReplaceTablet: tablet b9e761e94dbf4baba5e44a89b6c6a81c deleted and replaced by tablet a78960e1f2164c848297411b9273ac64
I20260810 19:47:50.541358 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet b9e761e94dbf4baba5e44a89b6c6a81c with delete_type TABLET_DATA_DELETED (replaced by tablet a78960e1f2164c848297411b9273ac64) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:50.541953 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f2d7c165d2c465d9080b927d54807f7 with delete_type TABLET_DATA_DELETED (replaced by tablet 639c824ba4834734a4ebfd558181bebe) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:50.542344 9911 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f2d7c165d2c465d9080b927d54807f7 with delete_type TABLET_DATA_DELETED (replaced by tablet 639c824ba4834734a4ebfd558181bebe) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:50.521819 9716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cda6eb6d4b847edb2624a267bc3522d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:50.543416 10371 log.cc:1199] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/4ec0aa595d3c4e388eb7f07717ac4349
W20260810 19:47:50.543895 10068 leader_election.cc:343] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:50.543972 10371 ts_tablet_manager.cc:1950] T 4ec0aa595d3c4e388eb7f07717ac4349 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:50.544442 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet b9e761e94dbf4baba5e44a89b6c6a81c with delete_type TABLET_DATA_DELETED (replaced by tablet a78960e1f2164c848297411b9273ac64) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:50.545378 10371 tablet_replica.cc:333] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:50.545645 10371 raft_consensus.cc:2243] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:50.545964 10371 pending_rounds.cc:70] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4: Trying to abort 1 pending ops.
I20260810 19:47:50.546041 10371 pending_rounds.cc:77] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058642116247552 op_type: NO_OP noop_request { }
I20260810 19:47:50.546205 10371 raft_consensus.cc:2889] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:50.546216 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cda6eb6d4b847edb2624a267bc3522d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:50.546386 10371 raft_consensus.cc:2272] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:50.546550 9951 raft_consensus.cc:2468] T 3cda6eb6d4b847edb2624a267bc3522d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:47:50.547087 10067 leader_election.cc:304] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:50.547916 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a02900865d894a1dbfdb42b50ca8ebbf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:50.547796 10377 ts_tablet_manager.cc:1929] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:47:50.548403 10377 log.cc:1199] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/043f418de5ee493eb2bc43f3bc61e7fa
W20260810 19:47:50.548629 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a02900865d894a1dbfdb42b50ca8ebbf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.548895 10377 ts_tablet_manager.cc:1950] T 043f418de5ee493eb2bc43f3bc61e7fa P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:50.554083 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2784ff35cf7944ada0cefff31407d65d" } modify_external_catalogs: true
I20260810 19:47:50.554284 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2784ff35cf7944ada0cefff31407d65d" } modify_external_catalogs: true
I20260810 19:47:50.555732 10370 tablet_bootstrap.cc:492] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:50.556397 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0445d007d0d8477dbd940cd0d2d99fe0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.557047 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0445d007d0d8477dbd940cd0d2d99fe0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.558056 10370 tablet_bootstrap.cc:654] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:50.560307 10375 tablet_replica.cc:333] T 3a7bb5fcac0a4207b4ee997099777b5b P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:50.560551 10375 raft_consensus.cc:2243] T 3a7bb5fcac0a4207b4ee997099777b5b P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:50.560791 10375 raft_consensus.cc:2272] T 3a7bb5fcac0a4207b4ee997099777b5b P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:50.560782 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 2ddeefaa826b4033b2e79eff7240887f (table default.Table_2adfdcdb33f543d49ea6f361bf8a55c4 [id=cfd27e7efc8f4c529e7dace21742b656]) successfully deleted
I20260810 19:47:50.561362 10375 ts_tablet_manager.cc:1916] T 3a7bb5fcac0a4207b4ee997099777b5b P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:50.566417 10585 consensus_queue.cc:1048] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260810 19:47:50.569553 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet ee65b2c9980d4c77af8c68bf2f5c5f92
W20260810 19:47:50.571527 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 5b2ee8ebe11e4e5cb6a91592170c6c3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b2ee8ebe11e4e5cb6a91592170c6c3d already in progress: creating tablet
I20260810 19:47:50.571587 10377 tablet_replica.cc:333] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:50.571838 10377 raft_consensus.cc:2243] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:50.572118 10377 raft_consensus.cc:2272] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:50.572208 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet ee65b2c9980d4c77af8c68bf2f5c5f92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:50.572736 10377 ts_tablet_manager.cc:1916] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:50.575620 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b42d252a590144aeb51d07c6d59bb5d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.576495 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b42d252a590144aeb51d07c6d59bb5d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.576990 10370 tablet_bootstrap.cc:492] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:50.577181 10370 ts_tablet_manager.cc:1403] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20260810 19:47:50.578141 10370 raft_consensus.cc:359] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.578380 10370 raft_consensus.cc:385] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:50.578469 10370 raft_consensus.cc:740] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:50.578778 10370 consensus_queue.cc:260] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.579123 10763 raft_consensus.cc:2804] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:50.579206 10763 raft_consensus.cc:493] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:50.579298 10763 raft_consensus.cc:3060] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:50.582355 10759 raft_consensus.cc:493] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:50.582445 10763 raft_consensus.cc:515] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:50.582578 10759 raft_consensus.cc:515] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.583266 10759 leader_election.cc:290] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:50.583863 9716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cda6eb6d4b847edb2624a267bc3522d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:50.584002 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8851f5c0c2fd4600bb99793ddd151daa" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:50.583994 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8851f5c0c2fd4600bb99793ddd151daa" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:47:50.584602 10068 leader_election.cc:343] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:50.584647 10067 leader_election.cc:343] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:50.584851 10068 leader_election.cc:343] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:50.584981 10068 leader_election.cc:304] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:50.585289 10759 raft_consensus.cc:2749] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:50.585769 10763 leader_election.cc:290] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:50.586058 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f2d7c165d2c465d9080b927d54807f7 with delete_type TABLET_DATA_DELETED (replaced by tablet 639c824ba4834734a4ebfd558181bebe) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:50.586189 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet b9e761e94dbf4baba5e44a89b6c6a81c with delete_type TABLET_DATA_DELETED (replaced by tablet a78960e1f2164c848297411b9273ac64) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:50.586297 10370 ts_tablet_manager.cc:1434] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260810 19:47:50.586478 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cda6eb6d4b847edb2624a267bc3522d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:50.586704 9951 raft_consensus.cc:3060] T 3cda6eb6d4b847edb2624a267bc3522d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:50.586741 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet ee65b2c9980d4c77af8c68bf2f5c5f92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:50.587029 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 4ec0aa595d3c4e388eb7f07717ac4349 (table default.Table_b0ed4458615243bebb70678601959f25 [id=18a231579184474c909db279bbba5751]) successfully deleted
I20260810 19:47:50.587814 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_35f61a45f4824b3eb463bf86f3f9f4cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.588462 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_35f61a45f4824b3eb463bf86f3f9f4cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.589628 9951 raft_consensus.cc:2468] T 3cda6eb6d4b847edb2624a267bc3522d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:47:50.590276 10067 leader_election.cc:304] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:50.591423 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_798bf26932ec4547b2ed311ccba8467b" } modify_external_catalogs: true
I20260810 19:47:50.591729 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_798bf26932ec4547b2ed311ccba8467b" } modify_external_catalogs: true
I20260810 19:47:50.591814 10763 raft_consensus.cc:2804] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:50.593497 10371 ts_tablet_manager.cc:1916] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:50.592087 10763 raft_consensus.cc:697] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:47:50.595721 10763 consensus_queue.cc:237] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:50.596284 10370 tablet_bootstrap.cc:492] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:50.599004 10370 tablet_bootstrap.cc:654] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:50.598960 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4ba52e1a6c3b42688033e6fd1cdcd7ae" } modify_external_catalogs: true
I20260810 19:47:50.599182 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4ba52e1a6c3b42688033e6fd1cdcd7ae" } modify_external_catalogs: true
I20260810 19:47:50.600142 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8b81e3e69f0f4859aa14ca8f923fd4b8" } new_table_name: "default.Table_3517015cddb644a28150bb4f6f7c3187" modify_external_catalogs: true
I20260810 19:47:50.602430 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2aba782a81094d01b32e6d51bd0a3a5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.603112 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2aba782a81094d01b32e6d51bd0a3a5f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.604511 10377 ts_tablet_manager.cc:1929] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:50.602541 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet ee65b2c9980d4c77af8c68bf2f5c5f92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:50.610512 9421 master_service.cc:960] ReplaceTablet: received request to replace tablet e247ae3828e84092b836f3dd07b44bc6 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:50.612308 9412 master_service.cc:960] ReplaceTablet: received request to replace tablet 3f18c24b01384299a4f941d7fb840032 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:50.616652 10370 tablet_bootstrap.cc:492] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:50.617345 10370 ts_tablet_manager.cc:1403] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.001s
I20260810 19:47:50.620235 10370 raft_consensus.cc:359] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.611014 10366 tablet_bootstrap.cc:492] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:50.628773 10366 tablet_bootstrap.cc:654] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:50.630822 10826 raft_consensus.cc:493] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:50.631008 10826 raft_consensus.cc:515] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.631224 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet e247ae3828e84092b836f3dd07b44bc6
I20260810 19:47:50.631906 10826 leader_election.cc:290] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:50.632484 9421 catalog_manager.cc:6807] ReplaceTablet: tablet e247ae3828e84092b836f3dd07b44bc6 deleted and replaced by tablet 839dcdb448d14a8f8e452145ccf41263
I20260810 19:47:50.633671 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet e247ae3828e84092b836f3dd07b44bc6 with delete_type TABLET_DATA_DELETED (replaced by tablet 839dcdb448d14a8f8e452145ccf41263) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:50.634943 9716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e09483838f0459da3041ee4fe5d55cc" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
W20260810 19:47:50.636207 9831 leader_election.cc:343] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:50.643159 10366 tablet_bootstrap.cc:492] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:50.643469 10366 ts_tablet_manager.cc:1403] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.005s
W20260810 19:47:50.643476 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 06af03c8a87141febef768bd56c72c39 consensus state has no leader
I20260810 19:47:50.644517 10366 raft_consensus.cc:359] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.644899 10366 raft_consensus.cc:385] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:50.645046 10366 raft_consensus.cc:740] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:50.645449 10366 consensus_queue.cc:260] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.645588 10367 tablet_bootstrap.cc:492] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:50.645764 10367 ts_tablet_manager.cc:1403] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.176s user 0.004s sys 0.000s
I20260810 19:47:50.646189 10366 ts_tablet_manager.cc:1434] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 19:47:50.646680 10367 raft_consensus.cc:359] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.646888 10367 raft_consensus.cc:385] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:50.646989 10367 raft_consensus.cc:740] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:50.647007 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet e959898b2c4c4173aea107d3f090ca07 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:50.647265 10367 consensus_queue.cc:260] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.647861 10367 ts_tablet_manager.cc:1434] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 19:47:50.648223 10367 tablet_bootstrap.cc:492] T 9e09483838f0459da3041ee4fe5d55cc P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:50.650511 10367 tablet_bootstrap.cc:654] T 9e09483838f0459da3041ee4fe5d55cc P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:50.651913 9397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.254:33891, user_credentials={real_user=slave}} blocked reactor thread for 50015.4us
I20260810 19:47:50.652021 10366 tablet_bootstrap.cc:492] T 09ab62f482b14cd4b86115e9a0423e7c P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:50.652842 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet e247ae3828e84092b836f3dd07b44bc6 with delete_type TABLET_DATA_DELETED (replaced by tablet 839dcdb448d14a8f8e452145ccf41263) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:50.656059 10371 ts_tablet_manager.cc:1929] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:50.656286 10371 log.cc:1199] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/3a7bb5fcac0a4207b4ee997099777b5b
I20260810 19:47:50.656800 10366 tablet_bootstrap.cc:654] T 09ab62f482b14cd4b86115e9a0423e7c P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:50.656831 10371 ts_tablet_manager.cc:1950] T 3a7bb5fcac0a4207b4ee997099777b5b P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:50.633158 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e09483838f0459da3041ee4fe5d55cc" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:50.635906 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet e247ae3828e84092b836f3dd07b44bc6 with delete_type TABLET_DATA_DELETED (replaced by tablet 839dcdb448d14a8f8e452145ccf41263) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:50.657140 10171 raft_consensus.cc:2468] T 9e09483838f0459da3041ee4fe5d55cc P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:50.658138 10370 raft_consensus.cc:385] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:50.658329 10370 raft_consensus.cc:740] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:50.658339 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 3a7bb5fcac0a4207b4ee997099777b5b (table default.Table_ee1e8ddb1a5441d6a4386715abbf552a [id=95ba52709d804e93859d24bde3444696]) successfully deleted
I20260810 19:47:50.658816 10371 tablet_replica.cc:333] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:50.658738 10370 consensus_queue.cc:260] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.619180 10375 ts_tablet_manager.cc:1929] T 3a7bb5fcac0a4207b4ee997099777b5b P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:50.659126 10375 log.cc:1199] T 3a7bb5fcac0a4207b4ee997099777b5b P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/3a7bb5fcac0a4207b4ee997099777b5b
I20260810 19:47:50.659162 10371 raft_consensus.cc:2243] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:50.659447 10371 raft_consensus.cc:2272] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:50.659593 10375 ts_tablet_manager.cc:1950] T 3a7bb5fcac0a4207b4ee997099777b5b P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:50.660907 10371 ts_tablet_manager.cc:1916] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:50.663765 10370 ts_tablet_manager.cc:1434] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.044s user 0.000s sys 0.002s
I20260810 19:47:50.665228 10367 tablet_bootstrap.cc:492] T 9e09483838f0459da3041ee4fe5d55cc P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:50.665518 10367 ts_tablet_manager.cc:1403] T 9e09483838f0459da3041ee4fe5d55cc P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.007s
I20260810 19:47:50.666450 10370 tablet_bootstrap.cc:492] T 0efa6f35ed284933b9fc53c1cb32da82 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:50.666450 10367 raft_consensus.cc:359] T 9e09483838f0459da3041ee4fe5d55cc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.666657 10367 raft_consensus.cc:385] T 9e09483838f0459da3041ee4fe5d55cc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:50.654861 10377 log.cc:1199] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/248e8954c46e4328a696f9799604e67f
I20260810 19:47:50.666739 10367 raft_consensus.cc:740] T 9e09483838f0459da3041ee4fe5d55cc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:50.657840 9830 leader_election.cc:304] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:50.666988 10367 consensus_queue.cc:260] T 9e09483838f0459da3041ee4fe5d55cc P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.667541 10367 ts_tablet_manager.cc:1434] T 9e09483838f0459da3041ee4fe5d55cc P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:47:50.667591 10488 raft_consensus.cc:2804] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:50.667881 10367 tablet_bootstrap.cc:492] T 2ddeefaa826b4033b2e79eff7240887f P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:50.668216 10488 raft_consensus.cc:493] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:50.668524 10488 raft_consensus.cc:3060] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:50.669812 10367 tablet_bootstrap.cc:654] T 2ddeefaa826b4033b2e79eff7240887f P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:50.673944 10488 raft_consensus.cc:515] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.677469 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1b1b59cdf6ef477b856b825bb519bd47" } modify_external_catalogs: true
I20260810 19:47:50.677736 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1b1b59cdf6ef477b856b825bb519bd47" } modify_external_catalogs: true
I20260810 19:47:50.679116 9421 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 668b3514d9f64d44a8747647194e50be (table default.Table_ac3c40912d96436d8ff55c48873a0057 [id=f96d1bbf37954740825d721e6259ce3c]). Expected version 2 got 0
I20260810 19:47:50.679817 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d5338ea409454e78919788fa347f72b4" } new_table_name: "default.Table_fc65a045265c494998007900c7ac9e01" modify_external_catalogs: true
I20260810 19:47:50.680401 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_fbd39ba8232d4e87817232b88300650a" } new_table_name: "default.Table_b46992ec81974f6caad1ea769640dcf1" modify_external_catalogs: true
I20260810 19:47:50.664839 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 3a7bb5fcac0a4207b4ee997099777b5b (table default.Table_ee1e8ddb1a5441d6a4386715abbf552a [id=95ba52709d804e93859d24bde3444696]) successfully deleted
I20260810 19:47:50.681490 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_4ba3897e392f4245946e90391193a319"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.682123 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ba3897e392f4245946e90391193a319 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.686815 10375 tablet_replica.cc:333] T 5f0d4ce494b4459eb05716d6e62d7a09 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:50.687069 10375 raft_consensus.cc:2243] T 5f0d4ce494b4459eb05716d6e62d7a09 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:50.687239 10375 raft_consensus.cc:2272] T 5f0d4ce494b4459eb05716d6e62d7a09 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:50.688030 10375 ts_tablet_manager.cc:1916] T 5f0d4ce494b4459eb05716d6e62d7a09 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:50.689054 10371 ts_tablet_manager.cc:1929] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:50.689203 10371 log.cc:1199] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/6d4387725a1843a7a7344d10e956c712
I20260810 19:47:50.689719 10371 ts_tablet_manager.cc:1950] T 6d4387725a1843a7a7344d10e956c712 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:50.691912 10370 tablet_bootstrap.cc:654] T 0efa6f35ed284933b9fc53c1cb32da82 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:50.693791 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 6d4387725a1843a7a7344d10e956c712 (table default.Table_8d6a1f9bb09e4de7807970d6c9479ac5 [id=7e8f45dba2404ef3b48b021b4d08bd3d]) successfully deleted
W20260810 19:47:50.694101 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 7d3395886420455d9bdaf816c19ebae2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d3395886420455d9bdaf816c19ebae2 already in progress: creating tablet
W20260810 19:47:50.694391 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 8851f5c0c2fd4600bb99793ddd151daa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8851f5c0c2fd4600bb99793ddd151daa already in progress: creating tablet
I20260810 19:47:50.694468 10371 tablet_replica.cc:333] T 389ed7d4651446869d404fb389d6ce9d P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
W20260810 19:47:50.694622 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet c7235af514fa47d899d7e38ee5662f6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7235af514fa47d899d7e38ee5662f6c already in progress: creating tablet
I20260810 19:47:50.694715 10371 raft_consensus.cc:2243] T 389ed7d4651446869d404fb389d6ce9d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 19:47:50.694881 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 28c9eecacc6540ac82ac7faabceec788 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28c9eecacc6540ac82ac7faabceec788 already in progress: creating tablet
I20260810 19:47:50.694895 10371 raft_consensus.cc:2272] T 389ed7d4651446869d404fb389d6ce9d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 19:47:50.695061 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 46005eead530459eb2b636ae0a6767ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46005eead530459eb2b636ae0a6767ad already in progress: creating tablet
W20260810 19:47:50.695237 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 2ddeefaa826b4033b2e79eff7240887f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ddeefaa826b4033b2e79eff7240887f already in progress: creating tablet
W20260810 19:47:50.695458 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 0d79ef93c5bf4ac9895e594198edb251 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d79ef93c5bf4ac9895e594198edb251 already in progress: creating tablet
I20260810 19:47:50.695505 10371 ts_tablet_manager.cc:1916] T 389ed7d4651446869d404fb389d6ce9d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:47:50.695684 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 11272d47d96f443187d63c184049871f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11272d47d96f443187d63c184049871f already in progress: creating tablet
W20260810 19:47:50.696161 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5 consensus state has no leader
W20260810 19:47:50.698207 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 21208dd824fe432fa307cbb88d37aaa2 has no consensus state
I20260810 19:47:50.702831 10377 ts_tablet_manager.cc:1950] T 248e8954c46e4328a696f9799604e67f P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:50.703214 10371 ts_tablet_manager.cc:1929] T 389ed7d4651446869d404fb389d6ce9d P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:50.703397 10371 log.cc:1199] T 389ed7d4651446869d404fb389d6ce9d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/389ed7d4651446869d404fb389d6ce9d
I20260810 19:47:50.703790 10371 ts_tablet_manager.cc:1950] T 389ed7d4651446869d404fb389d6ce9d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:50.704231 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 174) took 1009 ms. Trace:
I20260810 19:47:50.704844 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 389ed7d4651446869d404fb389d6ce9d (table default.Table_730d817e803a49e180281cc558c18e52 [id=1af6d2ea63b143dbab0acae33421936b]) successfully deleted
I20260810 19:47:50.704953 10367 tablet_bootstrap.cc:492] T 2ddeefaa826b4033b2e79eff7240887f P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:50.705112 10367 ts_tablet_manager.cc:1403] T 2ddeefaa826b4033b2e79eff7240887f P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.003s
I20260810 19:47:50.704586 10377 rpcz_store.cc:276] 0810 19:47:49.694705 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.696215 (+ 1510us) service_pool.cc:224] Handling call
0810 19:47:50.571478 (+875263us) ts_tablet_manager.cc:1151] Deleting tablet 248e8954c46e4328a696f9799604e67f
0810 19:47:50.571488 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:50.600571 (+ 29083us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:50.604386 (+ 3815us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:50.704182 (+ 99796us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":874917}
I20260810 19:47:50.706000 10367 raft_consensus.cc:359] T 2ddeefaa826b4033b2e79eff7240887f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.706205 10367 raft_consensus.cc:385] T 2ddeefaa826b4033b2e79eff7240887f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:50.706388 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 248e8954c46e4328a696f9799604e67f (table default.Table_e57c84cd8eb94daf9711603419d86cd2 [id=558424139ffe43aebb7011b7805574a9]) successfully deleted
I20260810 19:47:50.706473 10367 raft_consensus.cc:740] T 2ddeefaa826b4033b2e79eff7240887f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:50.706768 10367 consensus_queue.cc:260] T 2ddeefaa826b4033b2e79eff7240887f P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
W20260810 19:47:50.707176 9395 catalog_manager.cc:5017] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet f495efb5bc9e47f4a353b497b9ae78a8 because the tablet was not found. No further retry: Not found: Tablet not found: f495efb5bc9e47f4a353b497b9ae78a8
I20260810 19:47:50.707530 10377 tablet_replica.cc:333] T 4ec0aa595d3c4e388eb7f07717ac4349 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:50.707770 10377 raft_consensus.cc:2243] T 4ec0aa595d3c4e388eb7f07717ac4349 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:50.707983 10377 raft_consensus.cc:2272] T 4ec0aa595d3c4e388eb7f07717ac4349 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:50.708650 10377 ts_tablet_manager.cc:1916] T 4ec0aa595d3c4e388eb7f07717ac4349 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:50.709175 10371 tablet_replica.cc:333] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:50.709694 10371 raft_consensus.cc:2243] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:50.710260 10371 pending_rounds.cc:70] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4: Trying to abort 1 pending ops.
I20260810 19:47:50.710721 10367 ts_tablet_manager.cc:1434] T 2ddeefaa826b4033b2e79eff7240887f P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20260810 19:47:50.710711 10371 pending_rounds.cc:77] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058642397315072 op_type: NO_OP noop_request { }
I20260810 19:47:50.711658 10371 raft_consensus.cc:2889] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:50.711982 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e09483838f0459da3041ee4fe5d55cc" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:50.712159 10371 raft_consensus.cc:2272] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:50.712340 10168 raft_consensus.cc:3060] T 9e09483838f0459da3041ee4fe5d55cc P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:50.712925 9716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e09483838f0459da3041ee4fe5d55cc" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:50.713150 9716 raft_consensus.cc:3060] T 9e09483838f0459da3041ee4fe5d55cc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:50.713523 10371 ts_tablet_manager.cc:1916] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:50.714253 10367 tablet_bootstrap.cc:492] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:50.715699 10168 raft_consensus.cc:2468] T 9e09483838f0459da3041ee4fe5d55cc P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:50.716267 9716 raft_consensus.cc:2468] T 9e09483838f0459da3041ee4fe5d55cc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:50.716313 10367 tablet_bootstrap.cc:654] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:50.716877 9831 leader_election.cc:304] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:50.717219 10826 raft_consensus.cc:2804] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:50.717377 10826 raft_consensus.cc:697] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:47:50.717638 10826 consensus_queue.cc:237] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.721180 9418 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 668b3514d9f64d44a8747647194e50be (table default.Table_ac3c40912d96436d8ff55c48873a0057 [id=f96d1bbf37954740825d721e6259ce3c]). Expected version 2 got 0
I20260810 19:47:50.722827 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7127a1cfb63b4490ac7b827da3350206" } modify_external_catalogs: true
I20260810 19:47:50.723091 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7127a1cfb63b4490ac7b827da3350206" } modify_external_catalogs: true
I20260810 19:47:50.725186 10367 tablet_bootstrap.cc:492] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:50.725185 10488 leader_election.cc:290] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:50.725404 10367 ts_tablet_manager.cc:1403] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
I20260810 19:47:50.726060 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 651a1f5011de4db495dbbab2d19ff096 with delete_type TABLET_DATA_DELETED (replaced by tablet 02cd41da21364a868f5b6c980765d0cd) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:50.726346 10367 raft_consensus.cc:359] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:50.726569 10367 raft_consensus.cc:385] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:50.726739 10370 tablet_bootstrap.cc:492] T 0efa6f35ed284933b9fc53c1cb32da82 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:50.726804 10367 raft_consensus.cc:740] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:50.726908 10370 ts_tablet_manager.cc:1403] T 0efa6f35ed284933b9fc53c1cb32da82 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.061s user 0.000s sys 0.004s
I20260810 19:47:50.727093 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet c5625c6f78f14d629bcd7f8c9522c4ba with delete_type TABLET_DATA_DELETED (replaced by tablet 9e9603994555425289db23bd5c38cc99) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:50.727114 10367 consensus_queue.cc:260] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:50.728159 10367 ts_tablet_manager.cc:1434] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 19:47:50.729287 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_382f973da2a84b2d8c0e721e21ebf9e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:50.729311 10370 raft_consensus.cc:359] T 0efa6f35ed284933b9fc53c1cb32da82 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.729498 10370 raft_consensus.cc:385] T 0efa6f35ed284933b9fc53c1cb32da82 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:50.729570 10370 raft_consensus.cc:740] T 0efa6f35ed284933b9fc53c1cb32da82 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:50.729830 10370 consensus_queue.cc:260] T 0efa6f35ed284933b9fc53c1cb32da82 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
W20260810 19:47:50.730042 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_382f973da2a84b2d8c0e721e21ebf9e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.732043 10370 ts_tablet_manager.cc:1434] T 0efa6f35ed284933b9fc53c1cb32da82 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260810 19:47:50.731959 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_443b8f3510e5405f933993a05ab4bd8e" } new_table_name: "default.Table_9374c1b5d0ce4ebc9ca6f086b49f9778" modify_external_catalogs: true
I20260810 19:47:50.732403 10370 tablet_bootstrap.cc:492] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:50.736119 10370 tablet_bootstrap.cc:654] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:50.739488 10371 ts_tablet_manager.cc:1929] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:50.741310 10371 log.cc:1199] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/d15bcf97364046daa97f7461f4f6bc98
I20260810 19:47:50.742432 10371 ts_tablet_manager.cc:1950] T d15bcf97364046daa97f7461f4f6bc98 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:50.746465 9413 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 204ef31f396a43a5bf06205560f987c9 (table default.Table_b8bd05c31450458cb9d2bdb337397fde [id=4ed93ad00edc4b06ba6b845cfd726631]). Expected version 1 got 0
I20260810 19:47:50.747308 10366 tablet_bootstrap.cc:492] T 09ab62f482b14cd4b86115e9a0423e7c P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:50.747506 10366 ts_tablet_manager.cc:1403] T 09ab62f482b14cd4b86115e9a0423e7c P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.096s user 0.004s sys 0.000s
I20260810 19:47:50.748124 10367 tablet_bootstrap.cc:492] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:50.750746 10367 tablet_bootstrap.cc:654] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:50.750880 10366 raft_consensus.cc:359] T 09ab62f482b14cd4b86115e9a0423e7c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.751118 10366 raft_consensus.cc:385] T 09ab62f482b14cd4b86115e9a0423e7c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:50.751191 10366 raft_consensus.cc:740] T 09ab62f482b14cd4b86115e9a0423e7c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:50.751845 9408 catalog_manager.cc:5719] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } }
I20260810 19:47:50.752279 9408 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 204ef31f396a43a5bf06205560f987c9 (table default.Table_b8bd05c31450458cb9d2bdb337397fde [id=4ed93ad00edc4b06ba6b845cfd726631]). Expected version 1 got 0
I20260810 19:47:50.753080 10371 tablet_replica.cc:333] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:50.753290 10371 raft_consensus.cc:2243] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:50.753592 10371 pending_rounds.cc:70] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4: Trying to abort 1 pending ops.
I20260810 19:47:50.753513 10366 consensus_queue.cc:260] T 09ab62f482b14cd4b86115e9a0423e7c P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.753741 10371 pending_rounds.cc:77] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058643554185216 op_type: NO_OP noop_request { }
I20260810 19:47:50.754051 10371 raft_consensus.cc:2889] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:50.754230 10371 raft_consensus.cc:2272] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:50.754487 10366 ts_tablet_manager.cc:1434] T 09ab62f482b14cd4b86115e9a0423e7c P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260810 19:47:50.757879 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 3b6187dbe1ca42f79bf3eddd5475b929 (DEFAULT_TABLE table=default.Table_18277a006ecd4ec08e1ac6a597417bd1 [id=ecadc549b3444735b6972f914f5b4e2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.758481 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b6187dbe1ca42f79bf3eddd5475b929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.759274 10371 ts_tablet_manager.cc:1916] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:50.762759 10125 tablet_service.cc:1511] Processing CreateTablet for tablet a5625dc6303d44c6be28abd6278ce034 (DEFAULT_TABLE table=default.Table_20489495f6794646b9eda0458ee58d91 [id=16ed3d0d9475472283f6d95c69c60f8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.763312 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5625dc6303d44c6be28abd6278ce034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.763437 10366 tablet_bootstrap.cc:492] T 0efa6f35ed284933b9fc53c1cb32da82 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:50.765571 10366 tablet_bootstrap.cc:654] T 0efa6f35ed284933b9fc53c1cb32da82 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:50.766709 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 4b2b0f2fc93647f3bc1d79b4132c3703 (DEFAULT_TABLE table=default.Table_3dcb85babc4642ca90ab01191504bc0f [id=64e1f507ae574ea6b7fa1627b8e7f4c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.767198 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b2b0f2fc93647f3bc1d79b4132c3703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.767271 10371 ts_tablet_manager.cc:1929] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:50.767422 10371 log.cc:1199] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/248e8954c46e4328a696f9799604e67f
I20260810 19:47:50.769176 10367 tablet_bootstrap.cc:492] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:50.769332 10367 ts_tablet_manager.cc:1403] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.001s
I20260810 19:47:50.770015 10375 ts_tablet_manager.cc:1929] T 5f0d4ce494b4459eb05716d6e62d7a09 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:50.770166 10375 log.cc:1199] T 5f0d4ce494b4459eb05716d6e62d7a09 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/5f0d4ce494b4459eb05716d6e62d7a09
I20260810 19:47:50.770282 10367 raft_consensus.cc:359] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.770524 10367 raft_consensus.cc:385] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:50.770622 10367 raft_consensus.cc:740] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:50.770941 10367 consensus_queue.cc:260] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.771448 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 3b6187dbe1ca42f79bf3eddd5475b929 (DEFAULT_TABLE table=default.Table_18277a006ecd4ec08e1ac6a597417bd1 [id=ecadc549b3444735b6972f914f5b4e2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.771989 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b6187dbe1ca42f79bf3eddd5475b929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.772827 10367 ts_tablet_manager.cc:1434] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 19:47:50.773181 10367 tablet_bootstrap.cc:492] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:50.774816 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 4b2b0f2fc93647f3bc1d79b4132c3703 (DEFAULT_TABLE table=default.Table_3dcb85babc4642ca90ab01191504bc0f [id=64e1f507ae574ea6b7fa1627b8e7f4c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.775173 10367 tablet_bootstrap.cc:654] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:50.775308 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b2b0f2fc93647f3bc1d79b4132c3703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.776649 10371 ts_tablet_manager.cc:1950] T 248e8954c46e4328a696f9799604e67f P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:50.771473 9911 tablet_service.cc:1511] Processing CreateTablet for tablet a5625dc6303d44c6be28abd6278ce034 (DEFAULT_TABLE table=default.Table_20489495f6794646b9eda0458ee58d91 [id=16ed3d0d9475472283f6d95c69c60f8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.779618 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5625dc6303d44c6be28abd6278ce034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.783190 10375 ts_tablet_manager.cc:1950] T 5f0d4ce494b4459eb05716d6e62d7a09 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:50.783903 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet d15bcf97364046daa97f7461f4f6bc98 (table default.Table_47c121b1c8cf4d999324cc090246288b [id=e107df18522446d3bcf7bd46e78eb626]) successfully deleted
W20260810 19:47:50.784209 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 5f560ed7ea0c4075bad1375d86738861 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f560ed7ea0c4075bad1375d86738861 already in progress: creating tablet
I20260810 19:47:50.784425 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 248e8954c46e4328a696f9799604e67f (table default.Table_e57c84cd8eb94daf9711603419d86cd2 [id=558424139ffe43aebb7011b7805574a9]) successfully deleted
W20260810 19:47:50.784646 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 6af6dd8913f44e7f966ed2a128ae4fbf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6af6dd8913f44e7f966ed2a128ae4fbf already in progress: creating tablet
I20260810 19:47:50.785632 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 181) took 1039 ms. Trace:
I20260810 19:47:50.787775 10366 tablet_bootstrap.cc:492] T 0efa6f35ed284933b9fc53c1cb32da82 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:50.788184 10366 ts_tablet_manager.cc:1403] T 0efa6f35ed284933b9fc53c1cb32da82 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.000s
I20260810 19:47:50.789209 10366 raft_consensus.cc:359] T 0efa6f35ed284933b9fc53c1cb32da82 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.789562 10366 raft_consensus.cc:385] T 0efa6f35ed284933b9fc53c1cb32da82 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:50.789525 9904 tablet_service.cc:1511] Processing CreateTablet for tablet d77785d9bde843bc8366fe15d1b4fa18 (DEFAULT_TABLE table=default.Table_b8b85596130046dda3da6f7626b21127 [id=1af2d06c44b643e28d28bb080cd5eef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.789695 10366 raft_consensus.cc:740] T 0efa6f35ed284933b9fc53c1cb32da82 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:50.790019 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d77785d9bde843bc8366fe15d1b4fa18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.789960 10366 consensus_queue.cc:260] T 0efa6f35ed284933b9fc53c1cb32da82 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.790735 10585 raft_consensus.cc:493] T 5f0d4ce494b4459eb05716d6e62d7a09 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:50.790979 10585 raft_consensus.cc:515] T 5f0d4ce494b4459eb05716d6e62d7a09 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.787781 10377 ts_tablet_manager.cc:1929] T 4ec0aa595d3c4e388eb7f07717ac4349 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:50.791450 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 3b6187dbe1ca42f79bf3eddd5475b929 (DEFAULT_TABLE table=default.Table_18277a006ecd4ec08e1ac6a597417bd1 [id=ecadc549b3444735b6972f914f5b4e2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.791752 10585 leader_election.cc:290] T 5f0d4ce494b4459eb05716d6e62d7a09 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:50.791949 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b6187dbe1ca42f79bf3eddd5475b929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.792003 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet c5625c6f78f14d629bcd7f8c9522c4ba with delete_type TABLET_DATA_DELETED (replaced by tablet 9e9603994555425289db23bd5c38cc99) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:50.789934 10375 rpcz_store.cc:276] 0810 19:47:49.745855 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.746630 (+ 775us) service_pool.cc:224] Handling call
0810 19:47:50.686707 (+940077us) ts_tablet_manager.cc:1151] Deleting tablet 5f0d4ce494b4459eb05716d6e62d7a09
0810 19:47:50.686721 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:50.727554 (+ 40833us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:50.769922 (+ 42368us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:50.785557 (+ 15635us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38,"tablet-delete.queue_time_us":939932}
I20260810 19:47:50.792153 9675 tablet_service.cc:1511] Processing CreateTablet for tablet a5625dc6303d44c6be28abd6278ce034 (DEFAULT_TABLE table=default.Table_20489495f6794646b9eda0458ee58d91 [id=16ed3d0d9475472283f6d95c69c60f8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.792541 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5625dc6303d44c6be28abd6278ce034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.792758 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 5f0d4ce494b4459eb05716d6e62d7a09 (table default.Table_00c06a91c9354d248755681fa27cf4fe [id=6e28810aef52474fbe2a51e601877ab6]) successfully deleted
I20260810 19:47:50.793165 10375 tablet_replica.cc:333] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
W20260810 19:47:50.793570 9611 leader_election.cc:343] T 5f0d4ce494b4459eb05716d6e62d7a09 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Not found: Tablet not found: 5f0d4ce494b4459eb05716d6e62d7a09
I20260810 19:47:50.794384 10375 raft_consensus.cc:2243] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:50.794677 10370 tablet_bootstrap.cc:492] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:50.794865 10370 ts_tablet_manager.cc:1403] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.063s user 0.004s sys 0.019s
I20260810 19:47:50.795051 10375 pending_rounds.cc:70] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:47:50.795171 10375 pending_rounds.cc:77] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058643666182144 op_type: NO_OP noop_request { }
I20260810 19:47:50.795642 10375 raft_consensus.cc:2889] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:50.795789 10375 raft_consensus.cc:2272] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:50.795737 10370 raft_consensus.cc:359] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.795935 10370 raft_consensus.cc:385] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:50.796016 10370 raft_consensus.cc:740] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:50.798697 10370 consensus_queue.cc:260] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.799269 9684 tablet_service.cc:1511] Processing CreateTablet for tablet d77785d9bde843bc8366fe15d1b4fa18 (DEFAULT_TABLE table=default.Table_b8b85596130046dda3da6f7626b21127 [id=1af2d06c44b643e28d28bb080cd5eef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.799743 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d77785d9bde843bc8366fe15d1b4fa18. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:50.799878 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 6355c14e38b3446493f7bd5e2a717341 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6355c14e38b3446493f7bd5e2a717341 already in progress: creating tablet
I20260810 19:47:50.800678 10375 ts_tablet_manager.cc:1916] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:50.802498 10370 ts_tablet_manager.cc:1434] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260810 19:47:50.807610 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 21208dd824fe432fa307cbb88d37aaa2 (DEFAULT_TABLE table=default.Table_fc65a045265c494998007900c7ac9e01 [id=190f70ae5e5f44c294a4c0250fc7b08a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.808177 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21208dd824fe432fa307cbb88d37aaa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.808481 10120 tablet_service.cc:1511] Processing CreateTablet for tablet 63b649cbc1d141d8bb438105b8e8537c (DEFAULT_TABLE table=default.Table_39a71ac764f44ae1bb2168baeea4cb85 [id=9eaa5e14e854425e8971160c64ee97cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.809063 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63b649cbc1d141d8bb438105b8e8537c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.809566 10370 tablet_bootstrap.cc:492] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:50.810065 10136 tablet_service.cc:1511] Processing CreateTablet for tablet fb7b722c43ee4b8698b19b2b6c1b401d (DEFAULT_TABLE table=default.Table_7418b98ddb584a2888e186a1b7d50810 [id=374cf9ed870c448fbbdad7050d0d11f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.810141 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 4b2b0f2fc93647f3bc1d79b4132c3703 (DEFAULT_TABLE table=default.Table_3dcb85babc4642ca90ab01191504bc0f [id=64e1f507ae574ea6b7fa1627b8e7f4c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.810550 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7b722c43ee4b8698b19b2b6c1b401d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.811234 10130 tablet_service.cc:1511] Processing CreateTablet for tablet d77785d9bde843bc8366fe15d1b4fa18 (DEFAULT_TABLE table=default.Table_b8b85596130046dda3da6f7626b21127 [id=1af2d06c44b643e28d28bb080cd5eef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.811600 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d77785d9bde843bc8366fe15d1b4fa18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.814136 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e09483838f0459da3041ee4fe5d55cc with delete_type TABLET_DATA_DELETED (replaced by tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:50.817626 9673 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f0d4ce494b4459eb05716d6e62d7a09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:50.821285 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0d4ce494b4459eb05716d6e62d7a09" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:50.822095 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 971e9abee86444a7a9e923b0962ae751 (DEFAULT_TABLE table=default.Table_2bdff833e300406db760c7c64d88e546 [id=f3f4d6ebcacf43489369bd8f742a0631]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.822716 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 971e9abee86444a7a9e923b0962ae751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.824930 10124 tablet_service.cc:1511] Processing CreateTablet for tablet d2c77a8ac1614bb286e4e168bcf999f3 (DEFAULT_TABLE table=default.Table_c2a3c3f509104c5cbeb2f53726021955 [id=8fddaf13b1664006ac4b4fc2dcd2e90c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.825412 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2c77a8ac1614bb286e4e168bcf999f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.827380 10370 tablet_bootstrap.cc:654] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:50.837438 9421 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 9fed1bfec6694ba992de696e858b460c
I20260810 19:47:50.839538 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 21208dd824fe432fa307cbb88d37aaa2 (DEFAULT_TABLE table=default.Table_fc65a045265c494998007900c7ac9e01 [id=190f70ae5e5f44c294a4c0250fc7b08a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.840744 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b15ce9ec2404408f8f8e74743a8cce0d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.841401 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b15ce9ec2404408f8f8e74743a8cce0d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.842118 9413 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 668b3514d9f64d44a8747647194e50be (table default.Table_ac3c40912d96436d8ff55c48873a0057 [id=f96d1bbf37954740825d721e6259ce3c]). Expected version 2 got 0
I20260810 19:47:50.844604 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b8b85596130046dda3da6f7626b21127" } new_table_name: "default.Table_149d216201e949b4b44a3449c2f444e1" modify_external_catalogs: true
I20260810 19:47:50.847469 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 971e9abee86444a7a9e923b0962ae751 (DEFAULT_TABLE table=default.Table_2bdff833e300406db760c7c64d88e546 [id=f3f4d6ebcacf43489369bd8f742a0631]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.852298 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 3f18c24b01384299a4f941d7fb840032
I20260810 19:47:50.852850 9412 catalog_manager.cc:6807] ReplaceTablet: tablet 3f18c24b01384299a4f941d7fb840032 deleted and replaced by tablet 0e967384768b4ec7956f1b508e8ab2af
I20260810 19:47:50.853176 9899 tablet_service.cc:1511] Processing CreateTablet for tablet 3c828ae089774fb9b0582141f4b99313 (DEFAULT_TABLE table=default.Table_cc3aacf41a5e424687efa546af746ffa [id=56c4ed6bce3c4b88b8f47f0313355de1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.853310 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a88275c6d33a4c2fbdb5f03ab3a78bbe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.853896 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a88275c6d33a4c2fbdb5f03ab3a78bbe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.853838 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 476e762e46c04ae6bfef5e14df2d16e2 (DEFAULT_TABLE table=default.Table_1b1b59cdf6ef477b856b825bb519bd47 [id=f601112ceee249d49b43a2437b9731ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.854588 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 5d3598b5743244e39efd12703ec15aea
I20260810 19:47:50.854848 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 4e80e2327c394612bffc51f38798dac3 (DEFAULT_TABLE table=default.Table_6c826966f2e544f7b354551cd1aa632e [id=bd544994cecc42b2adc881ebfe318d7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.855216 9407 master_service.cc:960] ReplaceTablet: received request to replace tablet 74dddd12f2314d6ab5a6717025b13a51 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:50.855824 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_fbf29712bafa4a6390afd942219d24fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.856350 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fbf29712bafa4a6390afd942219d24fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.856534 10377 log.cc:1199] T 4ec0aa595d3c4e388eb7f07717ac4349 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/4ec0aa595d3c4e388eb7f07717ac4349
I20260810 19:47:50.857064 10377 ts_tablet_manager.cc:1950] T 4ec0aa595d3c4e388eb7f07717ac4349 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:50.857429 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 177) took 1149 ms. Trace:
I20260810 19:47:50.857517 10377 rpcz_store.cc:276] 0810 19:47:49.707862 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.708259 (+ 397us) service_pool.cc:224] Handling call
0810 19:47:50.707456 (+999197us) ts_tablet_manager.cc:1151] Deleting tablet 4ec0aa595d3c4e388eb7f07717ac4349
0810 19:47:50.707466 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:50.743972 (+ 36506us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:50.787682 (+ 43710us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:50.857376 (+ 69694us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":998933}
I20260810 19:47:50.857918 10377 tablet_replica.cc:333] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:50.858135 10377 raft_consensus.cc:2243] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:50.857208 9677 tablet_service.cc:1511] Processing CreateTablet for tablet 21208dd824fe432fa307cbb88d37aaa2 (DEFAULT_TABLE table=default.Table_fc65a045265c494998007900c7ac9e01 [id=190f70ae5e5f44c294a4c0250fc7b08a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.858553 10377 raft_consensus.cc:2272] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:50.858769 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21208dd824fe432fa307cbb88d37aaa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.859375 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 476e762e46c04ae6bfef5e14df2d16e2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:50.860710 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6992e7ef8e794ddc879ae04f9f78b8bd consensus state has no leader
I20260810 19:47:50.861189 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c2a3c3f509104c5cbeb2f53726021955" } modify_external_catalogs: true
I20260810 19:47:50.861378 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c2a3c3f509104c5cbeb2f53726021955" } modify_external_catalogs: true
I20260810 19:47:50.862418 9898 tablet_service.cc:1511] Processing CreateTablet for tablet d2c77a8ac1614bb286e4e168bcf999f3 (DEFAULT_TABLE table=default.Table_c2a3c3f509104c5cbeb2f53726021955 [id=8fddaf13b1664006ac4b4fc2dcd2e90c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.862596 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 9a13b0f5b6b14bb9b72740a8521e4ea5 (DEFAULT_TABLE table=default.Table_a4e75ffc215f4ff2a55eeb4e515a8c4f [id=4830b444314a4bb6a605cb73432e772f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.863015 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2c77a8ac1614bb286e4e168bcf999f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.863070 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 9fb544dff4eb4642b7e282657ae15d19 (DEFAULT_TABLE table=default.Table_e60e43b61eba457e8a4e7cd6543b7cc6 [id=d81c8e61cae4492fbd2681ab1ecdfe4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.863435 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fb544dff4eb4642b7e282657ae15d19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.865605 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 971e9abee86444a7a9e923b0962ae751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.866679 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e80e2327c394612bffc51f38798dac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.870855 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a13b0f5b6b14bb9b72740a8521e4ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.872251 9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c828ae089774fb9b0582141f4b99313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.873117 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 476e762e46c04ae6bfef5e14df2d16e2
W20260810 19:47:50.873454 9611 leader_election.cc:343] T 5f0d4ce494b4459eb05716d6e62d7a09 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:50.873617 9611 leader_election.cc:304] T 5f0d4ce494b4459eb05716d6e62d7a09 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:50.877305 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_d9f4c05ddfed4c938ab02d9f8507e119"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.877992 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9f4c05ddfed4c938ab02d9f8507e119 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:50.879266 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet a9e42e13617c4457ba88ae0e0269ec93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9e42e13617c4457ba88ae0e0269ec93 already in progress: creating tablet
I20260810 19:47:50.883595 10367 tablet_bootstrap.cc:492] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:50.883975 9688 tablet_service.cc:1511] Processing CreateTablet for tablet d2c77a8ac1614bb286e4e168bcf999f3 (DEFAULT_TABLE table=default.Table_c2a3c3f509104c5cbeb2f53726021955 [id=8fddaf13b1664006ac4b4fc2dcd2e90c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.884446 10585 raft_consensus.cc:2749] T 5f0d4ce494b4459eb05716d6e62d7a09 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:50.885695 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 965395b5072e4d47adac504e22a8d484
I20260810 19:47:50.887617 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b2b0f2fc93647f3bc1d79b4132c3703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.889065 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_074b525586d74c169b286124d5849cd2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.889698 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_074b525586d74c169b286124d5849cd2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.892582 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 63b649cbc1d141d8bb438105b8e8537c (DEFAULT_TABLE table=default.Table_39a71ac764f44ae1bb2168baeea4cb85 [id=9eaa5e14e854425e8971160c64ee97cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.893347 9685 tablet_service.cc:1511] Processing CreateTablet for tablet 3c828ae089774fb9b0582141f4b99313 (DEFAULT_TABLE table=default.Table_cc3aacf41a5e424687efa546af746ffa [id=56c4ed6bce3c4b88b8f47f0313355de1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.892220 9673 tablet_service.cc:1511] Processing CreateTablet for tablet fb7b722c43ee4b8698b19b2b6c1b401d (DEFAULT_TABLE table=default.Table_7418b98ddb584a2888e186a1b7d50810 [id=374cf9ed870c448fbbdad7050d0d11f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.894460 9668 tablet_service.cc:1511] Processing CreateTablet for tablet 476e762e46c04ae6bfef5e14df2d16e2 (DEFAULT_TABLE table=default.Table_1b1b59cdf6ef477b856b825bb519bd47 [id=f601112ceee249d49b43a2437b9731ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.895220 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 9a13b0f5b6b14bb9b72740a8521e4ea5 (DEFAULT_TABLE table=default.Table_a4e75ffc215f4ff2a55eeb4e515a8c4f [id=4830b444314a4bb6a605cb73432e772f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.895696 9665 tablet_service.cc:1511] Processing CreateTablet for tablet 9fb544dff4eb4642b7e282657ae15d19 (DEFAULT_TABLE table=default.Table_e60e43b61eba457e8a4e7cd6543b7cc6 [id=d81c8e61cae4492fbd2681ab1ecdfe4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.896188 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e09483838f0459da3041ee4fe5d55cc with delete_type TABLET_DATA_DELETED (replaced by tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:50.896545 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d3598b5743244e39efd12703ec15aea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:50.896767 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet 476e762e46c04ae6bfef5e14df2d16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:50.896952 9663 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cda6eb6d4b847edb2624a267bc3522d with delete_type TABLET_DATA_DELETED (replaced by tablet 3e8d34d723134d9289d96e633fed3fde) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:50.897148 9660 tablet_service.cc:1558] Processing DeleteTablet for tablet 176d4e72b8e44e4b88bdf89d06f2f79a with delete_type TABLET_DATA_DELETED (replaced by tablet 0c0a1e360ac648eeb0c734215bc200f6) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:50.897346 9659 tablet_service.cc:1511] Processing CreateTablet for tablet 4e80e2327c394612bffc51f38798dac3 (DEFAULT_TABLE table=default.Table_6c826966f2e544f7b354551cd1aa632e [id=bd544994cecc42b2adc881ebfe318d7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.897806 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ddeefaa826b4033b2e79eff7240887f with delete_type TABLET_DATA_DELETED (replaced by tablet 00fe7d9a548a487d965d92b53cdf9250) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:50.897933 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet e959898b2c4c4173aea107d3f090ca07
I20260810 19:47:50.898084 9655 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f18c24b01384299a4f941d7fb840032 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e967384768b4ec7956f1b508e8ab2af) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:50.898272 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 971e9abee86444a7a9e923b0962ae751 (DEFAULT_TABLE table=default.Table_2bdff833e300406db760c7c64d88e546 [id=f3f4d6ebcacf43489369bd8f742a0631]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.898727 10367 ts_tablet_manager.cc:1403] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.111s user 0.004s sys 0.000s
I20260810 19:47:50.898977 9410 catalog_manager.cc:6807] ReplaceTablet: tablet e959898b2c4c4173aea107d3f090ca07 deleted and replaced by tablet e68916e2568f4527a181342cdc728001
I20260810 19:47:50.899699 10367 raft_consensus.cc:359] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.899940 10367 raft_consensus.cc:385] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:50.900025 10367 raft_consensus.cc:740] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:50.900286 10367 consensus_queue.cc:260] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.900851 10367 ts_tablet_manager.cc:1434] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:47:50.901223 10367 tablet_bootstrap.cc:492] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:50.901724 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e104dc1ca7624bcaad9a86a8854217e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.902361 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e104dc1ca7624bcaad9a86a8854217e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.902813 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21208dd824fe432fa307cbb88d37aaa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.904151 10763 raft_consensus.cc:493] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:50.904357 10763 raft_consensus.cc:515] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.905318 10366 ts_tablet_manager.cc:1434] T 0efa6f35ed284933b9fc53c1cb32da82 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:47:50.907397 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ab62f482b14cd4b86115e9a0423e7c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:50.907629 9944 raft_consensus.cc:2468] T 09ab62f482b14cd4b86115e9a0423e7c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:47:50.908715 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 971e9abee86444a7a9e923b0962ae751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.914476 9685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c828ae089774fb9b0582141f4b99313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.914841 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 9fb544dff4eb4642b7e282657ae15d19 (DEFAULT_TABLE table=default.Table_e60e43b61eba457e8a4e7cd6543b7cc6 [id=d81c8e61cae4492fbd2681ab1ecdfe4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.917001 10763 leader_election.cc:290] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:50.918012 10366 tablet_bootstrap.cc:492] T c1777a713b1d4a58919b5f6abe779ab8 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:50.918438 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a13b0f5b6b14bb9b72740a8521e4ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.919003 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63b649cbc1d141d8bb438105b8e8537c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.920288 10366 tablet_bootstrap.cc:654] T c1777a713b1d4a58919b5f6abe779ab8 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:50.923889 10377 ts_tablet_manager.cc:1916] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:50.924136 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet 0efa6f35ed284933b9fc53c1cb32da82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:50.924170 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 9a13b0f5b6b14bb9b72740a8521e4ea5 (DEFAULT_TABLE table=default.Table_a4e75ffc215f4ff2a55eeb4e515a8c4f [id=4830b444314a4bb6a605cb73432e772f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.926491 9659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e80e2327c394612bffc51f38798dac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.926702 10371 tablet_replica.cc:333] T a71e3516f97c46f397de42f5c7089eeb P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:50.926911 10371 raft_consensus.cc:2243] T a71e3516f97c46f397de42f5c7089eeb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:50.927136 10371 raft_consensus.cc:2272] T a71e3516f97c46f397de42f5c7089eeb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:50.927764 10371 ts_tablet_manager.cc:1916] T a71e3516f97c46f397de42f5c7089eeb P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:50.930476 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 476e762e46c04ae6bfef5e14df2d16e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.934492 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fb544dff4eb4642b7e282657ae15d19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.936806 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2c77a8ac1614bb286e4e168bcf999f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.943634 10585 raft_consensus.cc:493] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:50.943837 10585 raft_consensus.cc:515] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.944612 10585 leader_election.cc:290] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:50.945660 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8851f5c0c2fd4600bb99793ddd151daa" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:50.947599 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7b722c43ee4b8698b19b2b6c1b401d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.952747 10367 tablet_bootstrap.cc:654] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:50.953434 9611 leader_election.cc:343] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:50.955052 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 74dddd12f2314d6ab5a6717025b13a51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74dddd12f2314d6ab5a6717025b13a51 already in progress: creating tablet
W20260810 19:47:50.956501 9397 consensus_peers.cc:597] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a -> Peer 5268e710af3c43ddab70eb7dd1aaa575 (127.8.235.254:33891): Couldn't send request to peer 5268e710af3c43ddab70eb7dd1aaa575. Status: Network error: Client connection negotiation failed: client connection to 127.8.235.254:33891: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260810 19:47:50.958899 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fb544dff4eb4642b7e282657ae15d19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.959846 10067 leader_election.cc:304] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:50.960320 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 3c828ae089774fb9b0582141f4b99313 (DEFAULT_TABLE table=default.Table_cc3aacf41a5e424687efa546af746ffa [id=56c4ed6bce3c4b88b8f47f0313355de1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.960904 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 476e762e46c04ae6bfef5e14df2d16e2 (DEFAULT_TABLE table=default.Table_1b1b59cdf6ef477b856b825bb519bd47 [id=f601112ceee249d49b43a2437b9731ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.961241 10763 raft_consensus.cc:2804] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:50.962075 10763 raft_consensus.cc:493] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:50.962216 10763 raft_consensus.cc:3060] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:50.962898 10375 ts_tablet_manager.cc:1929] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:50.962996 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a13b0f5b6b14bb9b72740a8521e4ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.963057 10375 log.cc:1199] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/a71e3516f97c46f397de42f5c7089eeb
I20260810 19:47:50.963578 10375 ts_tablet_manager.cc:1950] T a71e3516f97c46f397de42f5c7089eeb P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:50.963677 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 476e762e46c04ae6bfef5e14df2d16e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.967072 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 476e762e46c04ae6bfef5e14df2d16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:50.967273 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 4ec0aa595d3c4e388eb7f07717ac4349 (table default.Table_b0ed4458615243bebb70678601959f25 [id=18a231579184474c909db279bbba5751]) successfully deleted
I20260810 19:47:50.969123 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 7d93fd6556b146ca8933a6dc0a2357e8 (DEFAULT_TABLE table=default.Table_1958ec28228543e19a55ae3083097318 [id=de4d62ebb8c440a1a71ed57ac4f3c530]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.969691 9899 tablet_service.cc:1558] Processing DeleteTablet for tablet e959898b2c4c4173aea107d3f090ca07 with delete_type TABLET_DATA_DELETED (replaced by tablet e68916e2568f4527a181342cdc728001) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:50.970188 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 5576e9087855441498904bc59685a442 (DEFAULT_TABLE table=default.Table_dd3680521a084b7e9b0d94c1e8b1e7b6 [id=51d5f38a702e4bbd932ae4a181eb367d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.971979 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f18c24b01384299a4f941d7fb840032 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e967384768b4ec7956f1b508e8ab2af) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:50.972478 10585 raft_consensus.cc:493] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:50.972652 10585 raft_consensus.cc:515] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:50.973400 9904 tablet_service.cc:1511] Processing CreateTablet for tablet fb7b722c43ee4b8698b19b2b6c1b401d (DEFAULT_TABLE table=default.Table_7418b98ddb584a2888e186a1b7d50810 [id=374cf9ed870c448fbbdad7050d0d11f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.973889 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d3598b5743244e39efd12703ec15aea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:50.974093 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 965395b5072e4d47adac504e22a8d484 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:50.974273 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d93fd6556b146ca8933a6dc0a2357e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.974452 10585 leader_election.cc:290] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:50.974937 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efa6f35ed284933b9fc53c1cb32da82" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:50.975169 9944 raft_consensus.cc:2468] T 0efa6f35ed284933b9fc53c1cb32da82 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:50.975788 9611 leader_election.cc:304] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:50.976143 10585 raft_consensus.cc:2804] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:50.978659 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7b722c43ee4b8698b19b2b6c1b401d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.980579 9716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ab62f482b14cd4b86115e9a0423e7c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:50.980665 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 7d93fd6556b146ca8933a6dc0a2357e8 (DEFAULT_TABLE table=default.Table_1958ec28228543e19a55ae3083097318 [id=de4d62ebb8c440a1a71ed57ac4f3c530]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.981630 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d93fd6556b146ca8933a6dc0a2357e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.982488 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5576e9087855441498904bc59685a442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:50.983174 9655 tablet_service.cc:1558] Processing DeleteTablet for tablet e959898b2c4c4173aea107d3f090ca07 with delete_type TABLET_DATA_DELETED (replaced by tablet e68916e2568f4527a181342cdc728001) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:50.983392 10585 raft_consensus.cc:493] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:50.984329 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f18c24b01384299a4f941d7fb840032 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e967384768b4ec7956f1b508e8ab2af) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:50.986765 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 476e762e46c04ae6bfef5e14df2d16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:50.987074 10142 tablet_service.cc:1558] Processing DeleteTablet for tablet e959898b2c4c4173aea107d3f090ca07 with delete_type TABLET_DATA_DELETED (replaced by tablet e68916e2568f4527a181342cdc728001) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:50.990432 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet 965395b5072e4d47adac504e22a8d484 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:47:50.990932 10068 leader_election.cc:343] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:50.992920 10585 raft_consensus.cc:3060] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:50.993289 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 5576e9087855441498904bc59685a442 (DEFAULT_TABLE table=default.Table_dd3680521a084b7e9b0d94c1e8b1e7b6 [id=51d5f38a702e4bbd932ae4a181eb367d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:50.994412 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2502bd78450e4b1b940e7f64a514dc85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:50.995060 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2502bd78450e4b1b940e7f64a514dc85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:50.997444 9413 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 204ef31f396a43a5bf06205560f987c9 (table default.Table_b8bd05c31450458cb9d2bdb337397fde [id=4ed93ad00edc4b06ba6b845cfd726631]). Expected version 1 got 0
I20260810 19:47:50.997741 9413 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 668b3514d9f64d44a8747647194e50be (table default.Table_ac3c40912d96436d8ff55c48873a0057 [id=f96d1bbf37954740825d721e6259ce3c]). Expected version 2 got 0
I20260810 19:47:50.999603 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5fec01b720074528bb967b379211864f" } new_table_name: "default.Table_5043edeafbb047c6a7619f91323879c2" modify_external_catalogs: true
I20260810 19:47:51.001820 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 965395b5072e4d47adac504e22a8d484 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:51.002415 10596 raft_consensus.cc:493] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:51.002597 10596 raft_consensus.cc:515] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.003830 9911 tablet_service.cc:1511] Processing CreateTablet for tablet 63b649cbc1d141d8bb438105b8e8537c (DEFAULT_TABLE table=default.Table_39a71ac764f44ae1bb2168baeea4cb85 [id=9eaa5e14e854425e8971160c64ee97cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.004153 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176d4e72b8e44e4b88bdf89d06f2f79a" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:51.004663 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63b649cbc1d141d8bb438105b8e8537c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.004577 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8851f5c0c2fd4600bb99793ddd151daa" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:51.004750 10067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 52015.8us
I20260810 19:47:51.004835 10168 raft_consensus.cc:2468] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:51.005084 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 182) took 1218 ms. Trace:
I20260810 19:47:51.005221 10375 rpcz_store.cc:276] 0810 19:47:49.745944 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.746777 (+ 833us) service_pool.cc:224] Handling call
0810 19:47:50.793065 (+1046288us) ts_tablet_manager.cc:1151] Deleting tablet a71e3516f97c46f397de42f5c7089eeb
0810 19:47:50.793077 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:50.804826 (+ 11749us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:50.962803 (+157977us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:50.964548 (+ 1745us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1046142}
I20260810 19:47:51.007140 10596 leader_election.cc:290] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:47:51.007439 9611 leader_election.cc:343] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:51.008510 9611 leader_election.cc:304] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691
I20260810 19:47:51.009002 10596 raft_consensus.cc:2804] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:51.009131 10596 raft_consensus.cc:493] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:51.009238 10596 raft_consensus.cc:3060] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:51.009446 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5576e9087855441498904bc59685a442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.012456 10596 raft_consensus.cc:515] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.013226 10596 leader_election.cc:290] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:51.014405 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8851f5c0c2fd4600bb99793ddd151daa" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
W20260810 19:47:51.015164 9611 leader_election.cc:343] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:51.016489 9687 tablet_service.cc:1511] Processing CreateTablet for tablet dfea147ef3904ab49375def065c6f328 (DEFAULT_TABLE table=default.Table_55f86d7f1c8e47b18267b6f427c46aca [id=c6c90cd5058a4eb9985fc7df3ef5c79a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.024381 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfea147ef3904ab49375def065c6f328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.020666 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 965395b5072e4d47adac504e22a8d484 (DEFAULT_TABLE table=default.Table_4ba52e1a6c3b42688033e6fd1cdcd7ae [id=a88614b26dcb4c16bd100a55431569c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.025663 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 965395b5072e4d47adac504e22a8d484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.027053 10371 ts_tablet_manager.cc:1929] T a71e3516f97c46f397de42f5c7089eeb P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:51.027275 10371 log.cc:1199] T a71e3516f97c46f397de42f5c7089eeb P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/a71e3516f97c46f397de42f5c7089eeb
I20260810 19:47:51.027451 10377 ts_tablet_manager.cc:1929] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:51.027797 10371 ts_tablet_manager.cc:1950] T a71e3516f97c46f397de42f5c7089eeb P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:51.026428 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0c2f99b1c8cb452b973d5ea06626ac1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:51.030822 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c2f99b1c8cb452b973d5ea06626ac1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:51.028949 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet a71e3516f97c46f397de42f5c7089eeb (table default.Table_dcf48c67df284776aca6205b880fbbc5 [id=a8bdf6ea608f4279971af4c9eff71db6]) successfully deleted
I20260810 19:47:51.029223 10377 log.cc:1199] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/6d4387725a1843a7a7344d10e956c712
I20260810 19:47:51.034300 10377 ts_tablet_manager.cc:1950] T 6d4387725a1843a7a7344d10e956c712 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:51.039356 10585 raft_consensus.cc:515] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.041278 10585 leader_election.cc:290] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:47:51.045881 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d77785d9bde843bc8366fe15d1b4fa18 consensus state has no leader
I20260810 19:47:51.051585 9415 master_service.cc:960] ReplaceTablet: received request to replace tablet 3a7bb5fcac0a4207b4ee997099777b5b from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:51.052430 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_5ae50e2c32d5407aae2976de4f6ce97b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:51.053637 10890 tablet.cc:1724] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 19:47:51.053946 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ae50e2c32d5407aae2976de4f6ce97b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:51.054613 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 7d93fd6556b146ca8933a6dc0a2357e8 (DEFAULT_TABLE table=default.Table_1958ec28228543e19a55ae3083097318 [id=de4d62ebb8c440a1a71ed57ac4f3c530]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.055060 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d3598b5743244e39efd12703ec15aea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:51.055311 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 5576e9087855441498904bc59685a442 (DEFAULT_TABLE table=default.Table_dd3680521a084b7e9b0d94c1e8b1e7b6 [id=51d5f38a702e4bbd932ae4a181eb367d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.055994 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 4e80e2327c394612bffc51f38798dac3 (DEFAULT_TABLE table=default.Table_6c826966f2e544f7b354551cd1aa632e [id=bd544994cecc42b2adc881ebfe318d7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.056038 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efa6f35ed284933b9fc53c1cb32da82" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:51.056299 10171 raft_consensus.cc:2468] T 0efa6f35ed284933b9fc53c1cb32da82 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:51.057307 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c828ae089774fb9b0582141f4b99313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.057634 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e80e2327c394612bffc51f38798dac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.058468 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5576e9087855441498904bc59685a442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.059235 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176d4e72b8e44e4b88bdf89d06f2f79a" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:51.059473 10168 raft_consensus.cc:2468] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:51.059963 10375 tablet_replica.cc:333] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:51.060298 9611 leader_election.cc:304] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691
I20260810 19:47:51.061088 10378 raft_consensus.cc:2804] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:51.061383 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 8851f5c0c2fd4600bb99793ddd151daa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:51.061635 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet 09ab62f482b14cd4b86115e9a0423e7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:51.061898 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d93fd6556b146ca8933a6dc0a2357e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.061920 10378 raft_consensus.cc:493] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:51.062044 10378 raft_consensus.cc:3060] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:51.062732 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8851f5c0c2fd4600bb99793ddd151daa" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:51.065186 10167 raft_consensus.cc:3060] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:51.067062 9673 tablet_service.cc:1558] Processing DeleteTablet for tablet 0efa6f35ed284933b9fc53c1cb32da82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:51.067201 10375 raft_consensus.cc:2243] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:51.067680 10370 tablet_bootstrap.cc:492] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:51.067906 10370 ts_tablet_manager.cc:1403] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.262s user 0.026s sys 0.042s
I20260810 19:47:51.066978 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet a71e3516f97c46f397de42f5c7089eeb (table default.Table_dcf48c67df284776aca6205b880fbbc5 [id=a8bdf6ea608f4279971af4c9eff71db6]) successfully deleted
I20260810 19:47:51.068209 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efa6f35ed284933b9fc53c1cb32da82" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:51.068864 10165 raft_consensus.cc:3060] T 0efa6f35ed284933b9fc53c1cb32da82 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:51.069998 10378 raft_consensus.cc:515] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.070401 10140 tablet_service.cc:1511] Processing CreateTablet for tablet dfea147ef3904ab49375def065c6f328 (DEFAULT_TABLE table=default.Table_55f86d7f1c8e47b18267b6f427c46aca [id=c6c90cd5058a4eb9985fc7df3ef5c79a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.071538 10621 raft_consensus.cc:493] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:51.071712 10621 raft_consensus.cc:515] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.072535 10370 raft_consensus.cc:359] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.072715 10370 raft_consensus.cc:385] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:51.072311 10763 raft_consensus.cc:515] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.078301 10375 raft_consensus.cc:2272] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:51.078922 10621 leader_election.cc:290] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:51.079044 10375 ts_tablet_manager.cc:1916] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:51.079214 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfea147ef3904ab49375def065c6f328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.074158 9716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651a1f5011de4db495dbbab2d19ff096" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:51.078799 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ab62f482b14cd4b86115e9a0423e7c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
W20260810 19:47:51.080199 10068 leader_election.cc:343] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:51.080570 10068 leader_election.cc:343] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:51.079380 10371 tablet_replica.cc:333] T ba8c4420f5e345eeac30c805d673b5e9 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:51.080905 10371 raft_consensus.cc:2243] T ba8c4420f5e345eeac30c805d673b5e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:51.081154 10371 raft_consensus.cc:2272] T ba8c4420f5e345eeac30c805d673b5e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:51.081776 10371 ts_tablet_manager.cc:1916] T ba8c4420f5e345eeac30c805d673b5e9 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:51.083209 10164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176d4e72b8e44e4b88bdf89d06f2f79a" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:51.083424 10164 raft_consensus.cc:3060] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:51.088541 10378 leader_election.cc:290] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:51.042784 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efa6f35ed284933b9fc53c1cb32da82" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:51.090034 9951 raft_consensus.cc:3060] T 0efa6f35ed284933b9fc53c1cb32da82 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:51.090345 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 181) took 1381 ms. Trace:
I20260810 19:47:51.090488 10377 rpcz_store.cc:276] 0810 19:47:49.708433 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.708492 (+ 59us) service_pool.cc:224] Handling call
0810 19:47:50.857837 (+1149345us) ts_tablet_manager.cc:1151] Deleting tablet 6d4387725a1843a7a7344d10e956c712
0810 19:47:50.857847 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:50.969414 (+111567us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:51.027312 (+ 57898us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:51.090280 (+ 62968us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1149115}
I20260810 19:47:51.091097 10377 tablet_replica.cc:333] T 389ed7d4651446869d404fb389d6ce9d P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:51.091329 10377 raft_consensus.cc:2243] T 389ed7d4651446869d404fb389d6ce9d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:51.091625 10377 raft_consensus.cc:2272] T 389ed7d4651446869d404fb389d6ce9d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:51.092259 10377 ts_tablet_manager.cc:1916] T 389ed7d4651446869d404fb389d6ce9d P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:51.092497 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 6d4387725a1843a7a7344d10e956c712 (table default.Table_8d6a1f9bb09e4de7807970d6c9479ac5 [id=7e8f45dba2404ef3b48b021b4d08bd3d]) successfully deleted
I20260810 19:47:51.093245 9951 raft_consensus.cc:2468] T 0efa6f35ed284933b9fc53c1cb32da82 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
W20260810 19:47:51.093825 9400 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 31c8699875b54be888b3128df1b673aa (table default.Table_c35c3a44fcc44bba8a8c334292245b49 [id=5abc1f7beec444a4a988fbfcb8b45623], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 31c8699875b54be888b3128df1b673aa consensus state has no leader
I20260810 19:47:51.094266 9611 leader_election.cc:304] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:51.095304 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 72b39babf851404c89adb317033015ec (DEFAULT_TABLE table=default.Table_c6d29088153747e5aac8ca0d5904f69d [id=c681008d2b5f43a9b7b6ed2d72653b1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.095328 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 72b39babf851404c89adb317033015ec (DEFAULT_TABLE table=default.Table_c6d29088153747e5aac8ca0d5904f69d [id=c681008d2b5f43a9b7b6ed2d72653b1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.096174 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b39babf851404c89adb317033015ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.055045 10894 tablet.cc:1724] T 00dabf43505f4fc89be39ee8fb41c7ee P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:47:51.061832 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 09ab62f482b14cd4b86115e9a0423e7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:51.063062 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet 0efa6f35ed284933b9fc53c1cb32da82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:51.063890 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet c5625c6f78f14d629bcd7f8c9522c4ba with delete_type TABLET_DATA_DELETED (replaced by tablet 9e9603994555425289db23bd5c38cc99) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:51.066414 9898 tablet_service.cc:1511] Processing CreateTablet for tablet dfea147ef3904ab49375def065c6f328 (DEFAULT_TABLE table=default.Table_55f86d7f1c8e47b18267b6f427c46aca [id=c6c90cd5058a4eb9985fc7df3ef5c79a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.097370 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfea147ef3904ab49375def065c6f328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.097919 10890 tablet.cc:1724] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:47:51.070497 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 965395b5072e4d47adac504e22a8d484 (DEFAULT_TABLE table=default.Table_4ba52e1a6c3b42688033e6fd1cdcd7ae [id=a88614b26dcb4c16bd100a55431569c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.074486 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651a1f5011de4db495dbbab2d19ff096" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:51.078640 9946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ab62f482b14cd4b86115e9a0423e7c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:51.102523 9946 raft_consensus.cc:3060] T 09ab62f482b14cd4b86115e9a0423e7c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:51.102727 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 965395b5072e4d47adac504e22a8d484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.103971 10378 raft_consensus.cc:2804] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:51.105815 9946 raft_consensus.cc:2468] T 09ab62f482b14cd4b86115e9a0423e7c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:47:51.106650 10370 raft_consensus.cc:740] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:51.082363 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e09483838f0459da3041ee4fe5d55cc with delete_type TABLET_DATA_DELETED (replaced by tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:51.085248 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176d4e72b8e44e4b88bdf89d06f2f79a" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
W20260810 19:47:51.107443 9611 leader_election.cc:343] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:51.107705 10378 raft_consensus.cc:697] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:51.108052 10378 consensus_queue.cc:237] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.112675 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b39babf851404c89adb317033015ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.106568 10763 leader_election.cc:290] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:51.124825 10367 tablet_bootstrap.cc:492] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:51.125041 10367 ts_tablet_manager.cc:1403] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.224s user 0.004s sys 0.004s
I20260810 19:47:51.125965 10367 raft_consensus.cc:359] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:51.126163 10367 raft_consensus.cc:385] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:51.126263 10367 raft_consensus.cc:740] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:51.126807 10367 consensus_queue.cc:260] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:51.127806 10367 ts_tablet_manager.cc:1434] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 19:47:51.126456 10370 consensus_queue.cc:260] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.129252 10367 tablet_bootstrap.cc:492] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:51.133064 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet d2c77a8ac1614bb286e4e168bcf999f3
I20260810 19:47:51.134130 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet d2c77a8ac1614bb286e4e168bcf999f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:51.134974 10367 tablet_bootstrap.cc:654] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:51.135546 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet d2c77a8ac1614bb286e4e168bcf999f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:51.131999 10067 leader_election.cc:304] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:51.137653 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8ae48a2fb548358176abefe1ee3baa (DEFAULT_TABLE table=default.Table_8d68cddeb5f84601ab82e52cbc26b10f [id=12db110e89e04d40bdb05ec61fd5e3b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.138147 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8ae48a2fb548358176abefe1ee3baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.138196 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8ae48a2fb548358176abefe1ee3baa (DEFAULT_TABLE table=default.Table_8d68cddeb5f84601ab82e52cbc26b10f [id=12db110e89e04d40bdb05ec61fd5e3b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.139029 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 320e42f6de6c4452adb7bbb379a156e6 (DEFAULT_TABLE table=default.Table_ae6b06e8ae0c4fd19fe26b1b08db672a [id=5354f5d091794b14806dd9bc872da0ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.139451 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 320e42f6de6c4452adb7bbb379a156e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.139897 9684 tablet_service.cc:1511] Processing CreateTablet for tablet ebf33d82af9e494a8e85be8cba55d2c9 (DEFAULT_TABLE table=default.Table_998c14b0e9e14df48d3d4367f7c3b941 [id=19618281529d4843b4e58733646f0e08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.140329 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebf33d82af9e494a8e85be8cba55d2c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.140882 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ac3c40912d96436d8ff55c48873a0057" } new_table_name: "default.Table_a3d5e18125a047349dec5a6f6f3bde4d" modify_external_catalogs: true
I20260810 19:47:51.146379 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 320e42f6de6c4452adb7bbb379a156e6 (DEFAULT_TABLE table=default.Table_ae6b06e8ae0c4fd19fe26b1b08db672a [id=5354f5d091794b14806dd9bc872da0ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.146827 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 320e42f6de6c4452adb7bbb379a156e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.150020 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8ae48a2fb548358176abefe1ee3baa (DEFAULT_TABLE table=default.Table_8d68cddeb5f84601ab82e52cbc26b10f [id=12db110e89e04d40bdb05ec61fd5e3b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.150632 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8ae48a2fb548358176abefe1ee3baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.153373 10366 tablet_bootstrap.cc:492] T c1777a713b1d4a58919b5f6abe779ab8 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:51.153560 10366 ts_tablet_manager.cc:1403] T c1777a713b1d4a58919b5f6abe779ab8 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.236s user 0.024s sys 0.014s
I20260810 19:47:51.154445 10366 raft_consensus.cc:359] T c1777a713b1d4a58919b5f6abe779ab8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.154675 10366 raft_consensus.cc:385] T c1777a713b1d4a58919b5f6abe779ab8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:51.154743 10366 raft_consensus.cc:740] T c1777a713b1d4a58919b5f6abe779ab8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:51.155263 10366 consensus_queue.cc:260] T c1777a713b1d4a58919b5f6abe779ab8 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.155961 10366 ts_tablet_manager.cc:1434] T c1777a713b1d4a58919b5f6abe779ab8 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:47:51.157310 10371 ts_tablet_manager.cc:1929] T ba8c4420f5e345eeac30c805d673b5e9 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260810 19:47:51.157488 10371 log.cc:1199] T ba8c4420f5e345eeac30c805d673b5e9 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/ba8c4420f5e345eeac30c805d673b5e9
I20260810 19:47:51.158015 10371 ts_tablet_manager.cc:1950] T ba8c4420f5e345eeac30c805d673b5e9 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:51.159194 9412 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet c1777a713b1d4a58919b5f6abe779ab8 (table default.Table_2819131cbbda496d8acccf4b8e83c322 [id=59935ce778c84929aa6ae71a1e33c63f]). Expected version 1 got 0
I20260810 19:47:51.160104 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_382f973da2a84b2d8c0e721e21ebf9e9" } new_table_name: "default.Table_25921125d38844c9aa2816c5a6c395d1" modify_external_catalogs: true
I20260810 19:47:51.160447 10371 tablet_replica.cc:333] T c5625c6f78f14d629bcd7f8c9522c4ba P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:51.160672 10371 raft_consensus.cc:2243] T c5625c6f78f14d629bcd7f8c9522c4ba P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:51.160866 10371 raft_consensus.cc:2272] T c5625c6f78f14d629bcd7f8c9522c4ba P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:51.161441 10371 ts_tablet_manager.cc:1916] T c5625c6f78f14d629bcd7f8c9522c4ba P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:51.161696 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet ba8c4420f5e345eeac30c805d673b5e9 (table default.Table_2080a27caba94bd8a8ab66b012cb20e4 [id=c421996810c34ce69ca7c00ed984dc54]) successfully deleted
W20260810 19:47:51.162029 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 4f2d7c165d2c465d9080b927d54807f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f2d7c165d2c465d9080b927d54807f7 already in progress: creating tablet
W20260810 19:47:51.162365 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet b9e761e94dbf4baba5e44a89b6c6a81c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9e761e94dbf4baba5e44a89b6c6a81c already in progress: creating tablet
W20260810 19:47:51.162688 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet ee65b2c9980d4c77af8c68bf2f5c5f92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee65b2c9980d4c77af8c68bf2f5c5f92 already in progress: creating tablet
W20260810 19:47:51.162978 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet e247ae3828e84092b836f3dd07b44bc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e247ae3828e84092b836f3dd07b44bc6 already in progress: creating tablet
I20260810 19:47:51.167852 10366 tablet_bootstrap.cc:492] T a78f955a3ca946189de7ea96baee35f6 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:51.170285 10366 tablet_bootstrap.cc:654] T a78f955a3ca946189de7ea96baee35f6 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:51.172209 10894 tablet.cc:1724] T 668b3514d9f64d44a8747647194e50be P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:47:51.177894 10366 tablet_bootstrap.cc:492] T a78f955a3ca946189de7ea96baee35f6 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:51.178103 10366 ts_tablet_manager.cc:1403] T a78f955a3ca946189de7ea96baee35f6 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.004s
I20260810 19:47:51.179019 9420 master_service.cc:960] ReplaceTablet: received request to replace tablet 176d4e72b8e44e4b88bdf89d06f2f79a from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:51.179337 10366 raft_consensus.cc:359] T a78f955a3ca946189de7ea96baee35f6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.179556 10366 raft_consensus.cc:385] T a78f955a3ca946189de7ea96baee35f6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:51.179648 10366 raft_consensus.cc:740] T a78f955a3ca946189de7ea96baee35f6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:51.179970 10366 consensus_queue.cc:260] T a78f955a3ca946189de7ea96baee35f6 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.183669 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_cc3aacf41a5e424687efa546af746ffa" } modify_external_catalogs: true
I20260810 19:47:51.183903 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_cc3aacf41a5e424687efa546af746ffa" } modify_external_catalogs: true
I20260810 19:47:51.186558 9895 tablet_service.cc:1511] Processing CreateTablet for tablet ebf33d82af9e494a8e85be8cba55d2c9 (DEFAULT_TABLE table=default.Table_998c14b0e9e14df48d3d4367f7c3b941 [id=19618281529d4843b4e58733646f0e08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.187038 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebf33d82af9e494a8e85be8cba55d2c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.193563 10377 ts_tablet_manager.cc:1929] T 389ed7d4651446869d404fb389d6ce9d P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:51.194176 9681 tablet_service.cc:1511] Processing CreateTablet for tablet db2b8038ee9747109b42510bba02faa9 (DEFAULT_TABLE table=default.Table_fda8b43621384fe1b1891232334742f7 [id=452b19ee68bc463086780f6f72603483]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.194830 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db2b8038ee9747109b42510bba02faa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.205761 10140 tablet_service.cc:1511] Processing CreateTablet for tablet db2b8038ee9747109b42510bba02faa9 (DEFAULT_TABLE table=default.Table_fda8b43621384fe1b1891232334742f7 [id=452b19ee68bc463086780f6f72603483]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.207969 9416 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet c1777a713b1d4a58919b5f6abe779ab8 (table default.Table_2819131cbbda496d8acccf4b8e83c322 [id=59935ce778c84929aa6ae71a1e33c63f]). Expected version 1 got 0
I20260810 19:47:51.199659 10371 ts_tablet_manager.cc:1929] T c5625c6f78f14d629bcd7f8c9522c4ba P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:51.209890 10371 log.cc:1199] T c5625c6f78f14d629bcd7f8c9522c4ba P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/c5625c6f78f14d629bcd7f8c9522c4ba
I20260810 19:47:51.210469 10371 ts_tablet_manager.cc:1950] T c5625c6f78f14d629bcd7f8c9522c4ba P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:51.211596 10370 ts_tablet_manager.cc:1434] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.065s user 0.001s sys 0.001s
I20260810 19:47:51.211553 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 965395b5072e4d47adac504e22a8d484 (DEFAULT_TABLE table=default.Table_4ba52e1a6c3b42688033e6fd1cdcd7ae [id=a88614b26dcb4c16bd100a55431569c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.200091 9687 tablet_service.cc:1511] Processing CreateTablet for tablet da3d8ade850c4d36bd2756c36706195d (DEFAULT_TABLE table=default.Table_aa1552151467479ba8b4a8d5b1f70122 [id=51fc4051f8ac425e9b6b5f86acf32827]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.212087 10370 tablet_bootstrap.cc:492] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:51.212450 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da3d8ade850c4d36bd2756c36706195d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.216117 10167 raft_consensus.cc:2468] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:51.216557 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 72b39babf851404c89adb317033015ec (DEFAULT_TABLE table=default.Table_c6d29088153747e5aac8ca0d5904f69d [id=c681008d2b5f43a9b7b6ed2d72653b1b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:51.217067 10067 leader_election.cc:343] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:51.217222 10067 leader_election.cc:304] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:47:51.217638 10067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 79972.8us
I20260810 19:47:51.218127 10621 raft_consensus.cc:2749] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:51.218501 10621 raft_consensus.cc:493] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:51.218650 10621 raft_consensus.cc:515] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.219408 10621 leader_election.cc:290] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:51.219707 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8ae48a2fb548358176abefe1ee3baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.220186 10763 raft_consensus.cc:2804] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:51.220343 10763 raft_consensus.cc:697] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:47:51.220652 10763 consensus_queue.cc:237] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.223441 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5625c6f78f14d629bcd7f8c9522c4ba" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:51.224291 9611 leader_election.cc:304] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691
I20260810 19:47:51.225164 10165 raft_consensus.cc:2468] T 0efa6f35ed284933b9fc53c1cb32da82 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
W20260810 19:47:51.226174 10068 leader_election.cc:343] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: Tablet not RUNNING: STOPPED
I20260810 19:47:51.228235 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 320e42f6de6c4452adb7bbb379a156e6 (DEFAULT_TABLE table=default.Table_ae6b06e8ae0c4fd19fe26b1b08db672a [id=5354f5d091794b14806dd9bc872da0ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.236789 9669 tablet_service.cc:1511] Processing CreateTablet for tablet b5f30148b5c84f7cbdfabd0186611cc4 (DEFAULT_TABLE table=default.Table_6d2e6ad78a7841e891fae5f687a3c392 [id=ff056c9a5dc14ebdac724d8e39e6c7bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.237037 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ea5137ed2ce8460fa70bb7a104f5604e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:51.237713 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea5137ed2ce8460fa70bb7a104f5604e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:51.237936 10898 tablet.cc:1724] T 00dabf43505f4fc89be39ee8fb41c7ee P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:47:51.238900 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2aba782a81094d01b32e6d51bd0a3a5f" } modify_external_catalogs: true
I20260810 19:47:51.239084 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2aba782a81094d01b32e6d51bd0a3a5f" } modify_external_catalogs: true
I20260810 19:47:51.239084 10137 tablet_service.cc:1511] Processing CreateTablet for tablet da3d8ade850c4d36bd2756c36706195d (DEFAULT_TABLE table=default.Table_aa1552151467479ba8b4a8d5b1f70122 [id=51fc4051f8ac425e9b6b5f86acf32827]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.245762 10136 tablet_service.cc:1511] Processing CreateTablet for tablet b5f30148b5c84f7cbdfabd0186611cc4 (DEFAULT_TABLE table=default.Table_6d2e6ad78a7841e891fae5f687a3c392 [id=ff056c9a5dc14ebdac724d8e39e6c7bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.247184 9715 raft_consensus.cc:3060] T 204ef31f396a43a5bf06205560f987c9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:51.255033 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_11f1003720914accbb076692dc9e5d17" } new_table_name: "default.Table_87ca145e91d149a68ef630e3a29795b4" modify_external_catalogs: true
I20260810 19:47:51.254822 10139 tablet_service.cc:1511] Processing CreateTablet for tablet ebf33d82af9e494a8e85be8cba55d2c9 (DEFAULT_TABLE table=default.Table_998c14b0e9e14df48d3d4367f7c3b941 [id=19618281529d4843b4e58733646f0e08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.258522 10897 tablet.cc:1724] T 668b3514d9f64d44a8747647194e50be P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:47:51.206743 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet d2c77a8ac1614bb286e4e168bcf999f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:51.265478 10887 raft_consensus.cc:2804] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:51.266731 10887 raft_consensus.cc:697] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:51.263664 10165 raft_consensus.cc:1275] T 204ef31f396a43a5bf06205560f987c9 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Refusing update from remote peer 6986ed920dcb4af29a5eeeda6f671691: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 19:47:51.195533 10366 ts_tablet_manager.cc:1434] T a78f955a3ca946189de7ea96baee35f6 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260810 19:47:51.280834 10377 log.cc:1199] T 389ed7d4651446869d404fb389d6ce9d P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/389ed7d4651446869d404fb389d6ce9d
I20260810 19:47:51.280884 10488 consensus_queue.cc:1048] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:51.281105 10366 tablet_bootstrap.cc:492] T 2ddeefaa826b4033b2e79eff7240887f P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:51.281344 10377 ts_tablet_manager.cc:1950] T 389ed7d4651446869d404fb389d6ce9d P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
W20260810 19:47:51.282905 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e967384768b4ec7956f1b508e8ab2af has no consensus state
I20260810 19:47:51.283109 10366 tablet_bootstrap.cc:654] T 2ddeefaa826b4033b2e79eff7240887f P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:51.200310 9895 tablet_service.cc:1511] Processing CreateTablet for tablet db2b8038ee9747109b42510bba02faa9 (DEFAULT_TABLE table=default.Table_fda8b43621384fe1b1891232334742f7 [id=452b19ee68bc463086780f6f72603483]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.284415 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db2b8038ee9747109b42510bba02faa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.285570 9415 master_service.cc:960] ReplaceTablet: received request to replace tablet 7737acd216204209ba0327e26e85cfe6 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:51.287497 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8398701ecb954c5c833b81f075d2c23a" } modify_external_catalogs: true
I20260810 19:47:51.287701 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8398701ecb954c5c833b81f075d2c23a" } modify_external_catalogs: true
I20260810 19:47:51.264180 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db2b8038ee9747109b42510bba02faa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.291945 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 410855f236004ad4b78839eb1c0c2f1f (DEFAULT_TABLE table=default.Table_252bc6d370744d24bcfdfab17c4a3d17 [id=1d363ce63686462f9f4c15669773ee22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.292382 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 410855f236004ad4b78839eb1c0c2f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.292433 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b39babf851404c89adb317033015ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.297315 9407 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_257ddf6dffe443b7bb3a6d5e7f1e93a2 [id=6b30bf93c566421593a182e1768c0482] alter complete (version 1)
I20260810 19:47:51.298017 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 965395b5072e4d47adac504e22a8d484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.298502 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 320e42f6de6c4452adb7bbb379a156e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.298498 9416 master_service.cc:960] ReplaceTablet: received request to replace tablet e4a92eb8626f465caf563b72598a685f from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:51.299062 10370 tablet_bootstrap.cc:654] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:51.218019 9902 tablet_service.cc:1511] Processing CreateTablet for tablet da3d8ade850c4d36bd2756c36706195d (DEFAULT_TABLE table=default.Table_aa1552151467479ba8b4a8d5b1f70122 [id=51fc4051f8ac425e9b6b5f86acf32827]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.244885 9898 tablet_service.cc:1511] Processing CreateTablet for tablet b5f30148b5c84f7cbdfabd0186611cc4 (DEFAULT_TABLE table=default.Table_6d2e6ad78a7841e891fae5f687a3c392 [id=ff056c9a5dc14ebdac724d8e39e6c7bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.269840 9911 tablet_service.cc:1511] Processing CreateTablet for tablet 9e8a23221e8447bd83592c05c9d1149c (DEFAULT_TABLE table=default.Table_60869a2a939f4cc8813040573f05bd41 [id=5cf32f9df60d4b04a704522da9f7973d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.271409 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 9e8a23221e8447bd83592c05c9d1149c (DEFAULT_TABLE table=default.Table_60869a2a939f4cc8813040573f05bd41 [id=5cf32f9df60d4b04a704522da9f7973d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.309576 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5f30148b5c84f7cbdfabd0186611cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.314776 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da3d8ade850c4d36bd2756c36706195d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.316299 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5f30148b5c84f7cbdfabd0186611cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.319036 10621 raft_consensus.cc:493] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:51.319638 10621 raft_consensus.cc:515] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.320967 10621 leader_election.cc:290] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:51.321441 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8a23221e8447bd83592c05c9d1149c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.321700 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8a23221e8447bd83592c05c9d1149c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.327428 10370 tablet_bootstrap.cc:492] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:51.327736 10370 ts_tablet_manager.cc:1403] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.116s user 0.010s sys 0.008s
I20260810 19:47:51.328879 10370 raft_consensus.cc:359] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.329265 10370 raft_consensus.cc:385] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:51.329420 10370 raft_consensus.cc:740] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:51.329768 10370 consensus_queue.cc:260] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.331866 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet c5625c6f78f14d629bcd7f8c9522c4ba (table default.Table_0dafd75d95394cdda8062e308591219d [id=3ec1bdaeba584422a569a6f070344b6a]) successfully deleted
I20260810 19:47:51.334928 10370 ts_tablet_manager.cc:1434] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260810 19:47:51.330217 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da3d8ade850c4d36bd2756c36706195d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.341357 10488 consensus_queue.cc:1048] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:51.339100 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebf33d82af9e494a8e85be8cba55d2c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.343976 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 178) took 1631 ms. Trace:
I20260810 19:47:51.344129 10377 rpcz_store.cc:276] 0810 19:47:49.707995 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.708567 (+ 572us) service_pool.cc:224] Handling call
0810 19:47:51.091010 (+1382443us) ts_tablet_manager.cc:1151] Deleting tablet 389ed7d4651446869d404fb389d6ce9d
0810 19:47:51.091022 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:51.189827 (+ 98805us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:51.193460 (+ 3633us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:51.339185 (+145725us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1382194}
I20260810 19:47:51.344705 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 389ed7d4651446869d404fb389d6ce9d (table default.Table_730d817e803a49e180281cc558c18e52 [id=1af6d2ea63b143dbab0acae33421936b]) successfully deleted
I20260810 19:47:51.345608 10377 tablet_replica.cc:333] T 3a7bb5fcac0a4207b4ee997099777b5b P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:51.350557 10377 raft_consensus.cc:2243] T 3a7bb5fcac0a4207b4ee997099777b5b P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:51.351279 10377 raft_consensus.cc:2272] T 3a7bb5fcac0a4207b4ee997099777b5b P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:51.352429 10377 ts_tablet_manager.cc:1916] T 3a7bb5fcac0a4207b4ee997099777b5b P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:51.358194 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4ba3897e392f4245946e90391193a319" } modify_external_catalogs: true
I20260810 19:47:51.358436 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4ba3897e392f4245946e90391193a319" } modify_external_catalogs: true
I20260810 19:47:51.363294 10366 tablet_bootstrap.cc:492] T 2ddeefaa826b4033b2e79eff7240887f P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:51.363600 10366 ts_tablet_manager.cc:1403] T 2ddeefaa826b4033b2e79eff7240887f P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.083s user 0.002s sys 0.006s
I20260810 19:47:51.364593 10366 raft_consensus.cc:359] T 2ddeefaa826b4033b2e79eff7240887f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.364899 10366 raft_consensus.cc:385] T 2ddeefaa826b4033b2e79eff7240887f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:51.365017 10366 raft_consensus.cc:740] T 2ddeefaa826b4033b2e79eff7240887f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:51.340709 10370 tablet_bootstrap.cc:492] T a9e42e13617c4457ba88ae0e0269ec93 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:51.365414 10366 consensus_queue.cc:260] T 2ddeefaa826b4033b2e79eff7240887f P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.341569 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 410855f236004ad4b78839eb1c0c2f1f (DEFAULT_TABLE table=default.Table_252bc6d370744d24bcfdfab17c4a3d17 [id=1d363ce63686462f9f4c15669773ee22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.268630 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5f30148b5c84f7cbdfabd0186611cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.270565 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 410855f236004ad4b78839eb1c0c2f1f (DEFAULT_TABLE table=default.Table_252bc6d370744d24bcfdfab17c4a3d17 [id=1d363ce63686462f9f4c15669773ee22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.293824 9665 tablet_service.cc:1511] Processing CreateTablet for tablet 0bddaf5b5fc1404e83b079ffa97e7321 (DEFAULT_TABLE table=default.Table_9417c867265449d5b1be02c69d183657 [id=7c6a3df13ef44571a127a5ef2e73683a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.368180 10366 ts_tablet_manager.cc:1434] T 2ddeefaa826b4033b2e79eff7240887f P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260810 19:47:51.321974 9716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1777a713b1d4a58919b5f6abe779ab8" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:51.331481 10371 tablet_replica.cc:333] T 5f0d4ce494b4459eb05716d6e62d7a09 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:51.368631 10371 raft_consensus.cc:2243] T 5f0d4ce494b4459eb05716d6e62d7a09 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:51.368778 10366 tablet_bootstrap.cc:492] T 8851f5c0c2fd4600bb99793ddd151daa P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:51.368834 10371 raft_consensus.cc:2272] T 5f0d4ce494b4459eb05716d6e62d7a09 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:51.272627 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 9e8a23221e8447bd83592c05c9d1149c (DEFAULT_TABLE table=default.Table_60869a2a939f4cc8813040573f05bd41 [id=5cf32f9df60d4b04a704522da9f7973d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.369504 10371 ts_tablet_manager.cc:1916] T 5f0d4ce494b4459eb05716d6e62d7a09 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:51.370949 10366 tablet_bootstrap.cc:654] T 8851f5c0c2fd4600bb99793ddd151daa P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:51.373695 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 410855f236004ad4b78839eb1c0c2f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.374513 10377 ts_tablet_manager.cc:1929] T 3a7bb5fcac0a4207b4ee997099777b5b P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:51.374641 10377 log.cc:1199] T 3a7bb5fcac0a4207b4ee997099777b5b P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/3a7bb5fcac0a4207b4ee997099777b5b
I20260810 19:47:51.374748 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bddaf5b5fc1404e83b079ffa97e7321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.375005 10377 ts_tablet_manager.cc:1950] T 3a7bb5fcac0a4207b4ee997099777b5b P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:51.375907 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 180) took 1667 ms. Trace:
I20260810 19:47:51.376031 10377 rpcz_store.cc:276] 0810 19:47:49.708279 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.708829 (+ 550us) service_pool.cc:224] Handling call
0810 19:47:51.345496 (+1636667us) ts_tablet_manager.cc:1151] Deleting tablet 3a7bb5fcac0a4207b4ee997099777b5b
0810 19:47:51.345510 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:51.356829 (+ 11319us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:51.374408 (+ 17579us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:51.375863 (+ 1455us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1636469}
I20260810 19:47:51.382117 10366 tablet_bootstrap.cc:492] T 8851f5c0c2fd4600bb99793ddd151daa P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:51.382429 10366 ts_tablet_manager.cc:1403] T 8851f5c0c2fd4600bb99793ddd151daa P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260810 19:47:51.383373 10366 raft_consensus.cc:359] T 8851f5c0c2fd4600bb99793ddd151daa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.383690 10366 raft_consensus.cc:385] T 8851f5c0c2fd4600bb99793ddd151daa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:51.383821 10366 raft_consensus.cc:740] T 8851f5c0c2fd4600bb99793ddd151daa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:51.384123 10366 consensus_queue.cc:260] T 8851f5c0c2fd4600bb99793ddd151daa P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.384871 10366 ts_tablet_manager.cc:1434] T 8851f5c0c2fd4600bb99793ddd151daa P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:47:51.385263 10366 tablet_bootstrap.cc:492] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:51.387303 10366 tablet_bootstrap.cc:654] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:51.388520 10377 tablet_replica.cc:333] T 9680053712644b4ca33c33031b1ad8bc P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:51.388813 10377 raft_consensus.cc:2243] T 9680053712644b4ca33c33031b1ad8bc P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:51.389048 10377 raft_consensus.cc:2272] T 9680053712644b4ca33c33031b1ad8bc P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:51.389082 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 410855f236004ad4b78839eb1c0c2f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.389753 10377 ts_tablet_manager.cc:1916] T 9680053712644b4ca33c33031b1ad8bc P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:51.393514 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 0dd49d6fa79e4677b753b6cf9117b02d (DEFAULT_TABLE table=default.Table_ebe965457d0c46a39803fb5155a0bc0c [id=11015256d39042599eae0f05e96dca2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.394106 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dd49d6fa79e4677b753b6cf9117b02d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.398141 10164 raft_consensus.cc:2468] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:51.400066 9611 leader_election.cc:304] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691
I20260810 19:47:51.400285 10370 tablet_bootstrap.cc:654] T a9e42e13617c4457ba88ae0e0269ec93 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:51.400907 10068 leader_election.cc:343] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:51.401057 10366 tablet_bootstrap.cc:492] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:51.401340 10366 ts_tablet_manager.cc:1403] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
I20260810 19:47:51.402287 10366 raft_consensus.cc:359] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.402629 10366 raft_consensus.cc:385] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:51.402755 10366 raft_consensus.cc:740] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:51.403154 10366 consensus_queue.cc:260] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.403561 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 00fe7d9a548a487d965d92b53cdf9250 (DEFAULT_TABLE table=default.Table_2adfdcdb33f543d49ea6f361bf8a55c4 [id=cfd27e7efc8f4c529e7dace21742b656]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.404137 10366 ts_tablet_manager.cc:1434] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:47:51.404604 10366 tablet_bootstrap.cc:492] T a9e42e13617c4457ba88ae0e0269ec93 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:51.406148 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00fe7d9a548a487d965d92b53cdf9250. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.406723 10366 tablet_bootstrap.cc:654] T a9e42e13617c4457ba88ae0e0269ec93 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:51.413283 10371 ts_tablet_manager.cc:1929] T 5f0d4ce494b4459eb05716d6e62d7a09 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:51.413583 10371 log.cc:1199] T 5f0d4ce494b4459eb05716d6e62d7a09 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/5f0d4ce494b4459eb05716d6e62d7a09
I20260810 19:47:51.414095 10371 ts_tablet_manager.cc:1950] T 5f0d4ce494b4459eb05716d6e62d7a09 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:51.415127 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 0bddaf5b5fc1404e83b079ffa97e7321 (DEFAULT_TABLE table=default.Table_9417c867265449d5b1be02c69d183657 [id=7c6a3df13ef44571a127a5ef2e73683a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.415671 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bddaf5b5fc1404e83b079ffa97e7321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.417143 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 0dd49d6fa79e4677b753b6cf9117b02d (DEFAULT_TABLE table=default.Table_ebe965457d0c46a39803fb5155a0bc0c [id=11015256d39042599eae0f05e96dca2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.417716 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dd49d6fa79e4677b753b6cf9117b02d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.418648 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 0bddaf5b5fc1404e83b079ffa97e7321 (DEFAULT_TABLE table=default.Table_9417c867265449d5b1be02c69d183657 [id=7c6a3df13ef44571a127a5ef2e73683a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.418706 9911 tablet_service.cc:1511] Processing CreateTablet for tablet 00fe7d9a548a487d965d92b53cdf9250 (DEFAULT_TABLE table=default.Table_2adfdcdb33f543d49ea6f361bf8a55c4 [id=cfd27e7efc8f4c529e7dace21742b656]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.419052 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bddaf5b5fc1404e83b079ffa97e7321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.419127 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00fe7d9a548a487d965d92b53cdf9250. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.422706 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 0dd49d6fa79e4677b753b6cf9117b02d (DEFAULT_TABLE table=default.Table_ebe965457d0c46a39803fb5155a0bc0c [id=11015256d39042599eae0f05e96dca2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.422744 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 00fe7d9a548a487d965d92b53cdf9250 (DEFAULT_TABLE table=default.Table_2adfdcdb33f543d49ea6f361bf8a55c4 [id=cfd27e7efc8f4c529e7dace21742b656]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.423133 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dd49d6fa79e4677b753b6cf9117b02d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.423344 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00fe7d9a548a487d965d92b53cdf9250. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.429623 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 3a7bb5fcac0a4207b4ee997099777b5b (table default.Table_ee1e8ddb1a5441d6a4386715abbf552a [id=95ba52709d804e93859d24bde3444696]) successfully deleted
I20260810 19:47:51.430955 9898 tablet_service.cc:1511] Processing CreateTablet for tablet ae3e151180ae4d258d18365770acaaad (DEFAULT_TABLE table=default.Table_250f18957ff84ad58246dfec016f0abf [id=197d5993ea8643288fe8814a51e4bfd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.431324 10137 tablet_service.cc:1511] Processing CreateTablet for tablet ae3e151180ae4d258d18365770acaaad (DEFAULT_TABLE table=default.Table_250f18957ff84ad58246dfec016f0abf [id=197d5993ea8643288fe8814a51e4bfd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.431457 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae3e151180ae4d258d18365770acaaad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.431753 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae3e151180ae4d258d18365770acaaad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.439324 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 8455cb11388340beb6daa13fee06177a (DEFAULT_TABLE table=default.Table_700bae09815f40a1a543173e1188670f [id=2a56448ab2544b8ca7a6a49841520fc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.439936 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8455cb11388340beb6daa13fee06177a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.442358 10370 tablet_bootstrap.cc:492] T a9e42e13617c4457ba88ae0e0269ec93 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:51.442541 10370 ts_tablet_manager.cc:1403] T a9e42e13617c4457ba88ae0e0269ec93 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.103s user 0.004s sys 0.001s
I20260810 19:47:51.443572 10370 raft_consensus.cc:359] T a9e42e13617c4457ba88ae0e0269ec93 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:51.443790 10370 raft_consensus.cc:385] T a9e42e13617c4457ba88ae0e0269ec93 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:51.443882 10370 raft_consensus.cc:740] T a9e42e13617c4457ba88ae0e0269ec93 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:51.444195 10370 consensus_queue.cc:260] T a9e42e13617c4457ba88ae0e0269ec93 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:51.445235 10370 ts_tablet_manager.cc:1434] T a9e42e13617c4457ba88ae0e0269ec93 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 19:47:51.445577 10370 tablet_bootstrap.cc:492] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:51.413393 10377 ts_tablet_manager.cc:1929] T 9680053712644b4ca33c33031b1ad8bc P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:51.448902 10377 log.cc:1199] T 9680053712644b4ca33c33031b1ad8bc P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/9680053712644b4ca33c33031b1ad8bc
I20260810 19:47:51.450870 10377 ts_tablet_manager.cc:1950] T 9680053712644b4ca33c33031b1ad8bc P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:51.451479 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 179) took 1743 ms. Trace:
I20260810 19:47:51.451664 10377 rpcz_store.cc:276] 0810 19:47:49.708118 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.709208 (+ 1090us) service_pool.cc:224] Handling call
0810 19:47:51.388448 (+1679240us) ts_tablet_manager.cc:1151] Deleting tablet 9680053712644b4ca33c33031b1ad8bc
0810 19:47:51.388458 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:51.393531 (+ 5073us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:51.413286 (+ 19755us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:51.451412 (+ 38126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1678996}
I20260810 19:47:51.454829 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 184) took 1707 ms. Trace:
I20260810 19:47:51.455022 10377 rpcz_store.cc:276] 0810 19:47:49.747049 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.747327 (+ 278us) service_pool.cc:224] Handling call
0810 19:47:51.454628 (+1707301us) ts_tablet_manager.cc:1151] Deleting tablet 28c9eecacc6540ac82ac7faabceec788
0810 19:47:51.454640 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:51.454769 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1707030}
I20260810 19:47:51.455590 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 8455cb11388340beb6daa13fee06177a (DEFAULT_TABLE table=default.Table_700bae09815f40a1a543173e1188670f [id=2a56448ab2544b8ca7a6a49841520fc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.455811 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 185) took 1708 ms. Trace:
I20260810 19:47:51.456382 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8455cb11388340beb6daa13fee06177a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.456321 10377 rpcz_store.cc:276] 0810 19:47:49.747163 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.747640 (+ 477us) service_pool.cc:224] Handling call
0810 19:47:51.455630 (+1707990us) ts_tablet_manager.cc:1151] Deleting tablet 46005eead530459eb2b636ae0a6767ad
0810 19:47:51.455641 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:51.455753 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1707777}
I20260810 19:47:51.457036 10377 tablet_replica.cc:333] T 2ddeefaa826b4033b2e79eff7240887f P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
W20260810 19:47:51.457067 10068 consensus_peers.cc:597] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba8c4420f5e345eeac30c805d673b5e9. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:51.457595 10377 raft_consensus.cc:2243] T 2ddeefaa826b4033b2e79eff7240887f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:51.458144 10377 raft_consensus.cc:2272] T 2ddeefaa826b4033b2e79eff7240887f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:51.459432 10377 ts_tablet_manager.cc:1916] T 2ddeefaa826b4033b2e79eff7240887f P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:51.417958 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 63486cc3f8774a11827b1cc5f1c16332 (DEFAULT_TABLE table=default.Table_f1a090bd6e0042b58f8b6f478fc4fb11 [id=2e90b67006f344688d2b021965d8abdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.421984 10596 raft_consensus.cc:2804] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:51.459962 10596 raft_consensus.cc:697] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:51.460304 10596 consensus_queue.cc:237] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.462044 10366 tablet_bootstrap.cc:492] T a9e42e13617c4457ba88ae0e0269ec93 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:51.466584 10366 ts_tablet_manager.cc:1403] T a9e42e13617c4457ba88ae0e0269ec93 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.062s user 0.006s sys 0.000s
I20260810 19:47:51.467559 10366 raft_consensus.cc:359] T a9e42e13617c4457ba88ae0e0269ec93 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:51.426491 9665 tablet_service.cc:1511] Processing CreateTablet for tablet 8455cb11388340beb6daa13fee06177a (DEFAULT_TABLE table=default.Table_700bae09815f40a1a543173e1188670f [id=2a56448ab2544b8ca7a6a49841520fc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.467876 10366 raft_consensus.cc:385] T a9e42e13617c4457ba88ae0e0269ec93 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:51.468017 10366 raft_consensus.cc:740] T a9e42e13617c4457ba88ae0e0269ec93 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:51.468474 10366 consensus_queue.cc:260] T a9e42e13617c4457ba88ae0e0269ec93 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:51.468720 10488 raft_consensus.cc:493] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:51.468902 10488 raft_consensus.cc:515] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.469619 10488 leader_election.cc:290] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:51.471246 10164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5625c6f78f14d629bcd7f8c9522c4ba" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:51.471444 9831 leader_election.cc:343] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: c5625c6f78f14d629bcd7f8c9522c4ba
I20260810 19:47:51.471676 10164 raft_consensus.cc:2468] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:51.472239 9830 leader_election.cc:304] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:51.472766 10488 raft_consensus.cc:2804] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:51.472903 10488 raft_consensus.cc:493] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:51.472992 10488 raft_consensus.cc:3060] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:51.429150 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8a23221e8447bd83592c05c9d1149c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.476188 10488 raft_consensus.cc:515] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.477397 10488 leader_election.cc:290] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:51.477712 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63486cc3f8774a11827b1cc5f1c16332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.479014 10164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5625c6f78f14d629bcd7f8c9522c4ba" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:51.479326 10164 raft_consensus.cc:3060] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:51.481827 10377 ts_tablet_manager.cc:1929] T 2ddeefaa826b4033b2e79eff7240887f P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:51.482491 9668 tablet_service.cc:1511] Processing CreateTablet for tablet 2b2b20dc77954af7a203f357c746be29 (DEFAULT_TABLE table=default.Table_0de524b66ecf4dea8ab5e6b87c4f6261 [id=4de43e2ae0424104aa75c5d872b72d3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.482906 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8455cb11388340beb6daa13fee06177a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.483258 10377 log.cc:1199] T 2ddeefaa826b4033b2e79eff7240887f P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/2ddeefaa826b4033b2e79eff7240887f
I20260810 19:47:51.483085 10366 ts_tablet_manager.cc:1434] T a9e42e13617c4457ba88ae0e0269ec93 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.016s user 0.004s sys 0.000s
I20260810 19:47:51.483584 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b2b20dc77954af7a203f357c746be29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.483935 10366 tablet_bootstrap.cc:492] T 176d4e72b8e44e4b88bdf89d06f2f79a P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:51.486052 10366 tablet_bootstrap.cc:654] T 176d4e72b8e44e4b88bdf89d06f2f79a P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:51.431116 10378 raft_consensus.cc:493] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:51.483224 10585 raft_consensus.cc:493] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 19:47:51.482684 9831 leader_election.cc:343] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: c5625c6f78f14d629bcd7f8c9522c4ba
I20260810 19:47:51.486968 10585 raft_consensus.cc:515] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:51.487720 10585 leader_election.cc:290] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:51.488379 10378 raft_consensus.cc:515] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:51.489053 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e42e13617c4457ba88ae0e0269ec93" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:51.489302 10167 raft_consensus.cc:2468] T a9e42e13617c4457ba88ae0e0269ec93 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:51.489645 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e42e13617c4457ba88ae0e0269ec93" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:51.489876 10377 ts_tablet_manager.cc:1950] T 2ddeefaa826b4033b2e79eff7240887f P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:51.489883 9948 raft_consensus.cc:2468] T a9e42e13617c4457ba88ae0e0269ec93 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:51.490229 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 186) took 1742 ms. Trace:
I20260810 19:47:51.489846 9611 leader_election.cc:304] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:51.491667 10585 raft_consensus.cc:2804] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:51.491792 10585 raft_consensus.cc:493] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:51.491881 10585 raft_consensus.cc:3060] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:51.492182 10377 rpcz_store.cc:276] 0810 19:47:49.747273 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.747892 (+ 619us) service_pool.cc:224] Handling call
0810 19:47:51.456940 (+1709048us) ts_tablet_manager.cc:1151] Deleting tablet 2ddeefaa826b4033b2e79eff7240887f
0810 19:47:51.456951 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:51.465934 (+ 8983us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:51.481713 (+ 15779us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:51.490197 (+ 8484us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1708873}
I20260810 19:47:51.492693 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 187) took 1697 ms. Trace:
I20260810 19:47:51.495311 10585 raft_consensus.cc:515] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:51.496172 10585 leader_election.cc:290] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:51.497414 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e42e13617c4457ba88ae0e0269ec93" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:51.497676 10167 raft_consensus.cc:3060] T a9e42e13617c4457ba88ae0e0269ec93 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:51.268178 10887 consensus_queue.cc:237] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.492797 10377 rpcz_store.cc:276] 0810 19:47:49.795039 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.795887 (+ 848us) service_pool.cc:224] Handling call
0810 19:47:51.492521 (+1696634us) ts_tablet_manager.cc:1151] Deleting tablet 7d3395886420455d9bdaf816c19ebae2
0810 19:47:51.492533 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:51.492659 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1696320}
I20260810 19:47:51.499884 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cda6eb6d4b847edb2624a267bc3522d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:51.500085 10377 tablet_replica.cc:333] T 8851f5c0c2fd4600bb99793ddd151daa P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:51.500200 9944 raft_consensus.cc:2393] T 3cda6eb6d4b847edb2624a267bc3522d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcd31b1bbb0340cbacfce652b4ad8da4 in current term 1: Already voted for candidate eadde59fd6504d679e47f03a60c64bb0 in this term.
I20260810 19:47:51.500311 10377 raft_consensus.cc:2243] T 8851f5c0c2fd4600bb99793ddd151daa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:51.500511 10377 raft_consensus.cc:2272] T 8851f5c0c2fd4600bb99793ddd151daa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:51.500577 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e42e13617c4457ba88ae0e0269ec93" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:51.500761 9948 raft_consensus.cc:3060] T a9e42e13617c4457ba88ae0e0269ec93 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:51.501530 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cda6eb6d4b847edb2624a267bc3522d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:51.502108 10377 ts_tablet_manager.cc:1916] T 8851f5c0c2fd4600bb99793ddd151daa P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:51.503692 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 5f0d4ce494b4459eb05716d6e62d7a09 (table default.Table_00c06a91c9354d248755681fa27cf4fe [id=6e28810aef52474fbe2a51e601877ab6]) successfully deleted
I20260810 19:47:51.503926 9948 raft_consensus.cc:2468] T a9e42e13617c4457ba88ae0e0269ec93 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:51.504783 9611 leader_election.cc:304] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:51.505119 10585 raft_consensus.cc:2804] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:51.508543 10366 tablet_bootstrap.cc:492] T 176d4e72b8e44e4b88bdf89d06f2f79a P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:51.508813 10366 ts_tablet_manager.cc:1403] T 176d4e72b8e44e4b88bdf89d06f2f79a P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.005s
I20260810 19:47:51.509724 10366 raft_consensus.cc:359] T 176d4e72b8e44e4b88bdf89d06f2f79a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.510023 10366 raft_consensus.cc:385] T 176d4e72b8e44e4b88bdf89d06f2f79a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:51.510154 10366 raft_consensus.cc:740] T 176d4e72b8e44e4b88bdf89d06f2f79a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:51.510547 10366 consensus_queue.cc:260] T 176d4e72b8e44e4b88bdf89d06f2f79a P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.511601 10366 ts_tablet_manager.cc:1434] T 176d4e72b8e44e4b88bdf89d06f2f79a P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:47:51.511659 9611 leader_election.cc:304] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:51.511988 10366 tablet_bootstrap.cc:492] T 5f0d4ce494b4459eb05716d6e62d7a09 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:51.514345 10366 tablet_bootstrap.cc:654] T 5f0d4ce494b4459eb05716d6e62d7a09 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:51.519268 10937 raft_consensus.cc:3060] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:51.525637 10937 raft_consensus.cc:2749] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:51.526041 10377 ts_tablet_manager.cc:1929] T 8851f5c0c2fd4600bb99793ddd151daa P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:51.526503 10377 log.cc:1199] T 8851f5c0c2fd4600bb99793ddd151daa P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/8851f5c0c2fd4600bb99793ddd151daa
I20260810 19:47:51.527194 10377 ts_tablet_manager.cc:1950] T 8851f5c0c2fd4600bb99793ddd151daa P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:51.527971 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 188) took 1723 ms. Trace:
I20260810 19:47:51.528191 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 63486cc3f8774a11827b1cc5f1c16332 (DEFAULT_TABLE table=default.Table_f1a090bd6e0042b58f8b6f478fc4fb11 [id=2e90b67006f344688d2b021965d8abdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.528532 10377 rpcz_store.cc:276] 0810 19:47:49.804062 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.804172 (+ 110us) service_pool.cc:224] Handling call
0810 19:47:51.499779 (+1695607us) ts_tablet_manager.cc:1151] Deleting tablet 8851f5c0c2fd4600bb99793ddd151daa
0810 19:47:51.500014 (+ 235us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:51.505633 (+ 5619us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:51.525941 (+ 20308us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:51.527912 (+ 1971us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8576,"tablet-delete.queue_time_us":1695295}
I20260810 19:47:51.528909 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63486cc3f8774a11827b1cc5f1c16332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.530092 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 189) took 1710 ms. Trace:
I20260810 19:47:51.530206 10377 rpcz_store.cc:276] 0810 19:47:49.819855 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.820266 (+ 411us) service_pool.cc:224] Handling call
0810 19:47:51.529881 (+1709615us) ts_tablet_manager.cc:1151] Deleting tablet c7235af514fa47d899d7e38ee5662f6c
0810 19:47:51.529890 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:51.530021 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1709317}
I20260810 19:47:51.531548 10366 tablet_bootstrap.cc:492] T 5f0d4ce494b4459eb05716d6e62d7a09 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:51.531708 10366 ts_tablet_manager.cc:1403] T 5f0d4ce494b4459eb05716d6e62d7a09 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.003s
I20260810 19:47:51.532392 10370 tablet_bootstrap.cc:654] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:51.532666 10366 raft_consensus.cc:359] T 5f0d4ce494b4459eb05716d6e62d7a09 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.532867 10366 raft_consensus.cc:385] T 5f0d4ce494b4459eb05716d6e62d7a09 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:51.532971 10366 raft_consensus.cc:740] T 5f0d4ce494b4459eb05716d6e62d7a09 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:51.533334 10366 consensus_queue.cc:260] T 5f0d4ce494b4459eb05716d6e62d7a09 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.543471 9418 master_service.cc:960] ReplaceTablet: received request to replace tablet 08e29e23d54f47968a06be98b313918d from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:51.543902 10366 ts_tablet_manager.cc:1434] T 5f0d4ce494b4459eb05716d6e62d7a09 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260810 19:47:51.544481 10366 tablet_bootstrap.cc:492] T 4d654dada92a4939914d26ab72a5f5e8 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
W20260810 19:47:51.545737 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3582ed23ffdf4ff089952e29083e5425 has no consensus state
I20260810 19:47:51.546401 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 63486cc3f8774a11827b1cc5f1c16332 (DEFAULT_TABLE table=default.Table_f1a090bd6e0042b58f8b6f478fc4fb11 [id=2e90b67006f344688d2b021965d8abdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.546908 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63486cc3f8774a11827b1cc5f1c16332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.548017 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 3c828ae089774fb9b0582141f4b99313
I20260810 19:47:51.550305 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_7924d8dbb4ea4a7c8809db86c7b3fbef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:51.551087 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7924d8dbb4ea4a7c8809db86c7b3fbef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:51.552760 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c6d29088153747e5aac8ca0d5904f69d" } new_table_name: "default.Table_2d7f246476ac4544a3fa089ec3c52657" modify_external_catalogs: true
I20260810 19:47:51.555724 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0504de5b8bb5437498dc4408394be292"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:51.555998 10932 raft_consensus.cc:493] T 176d4e72b8e44e4b88bdf89d06f2f79a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 19:47:51.557133 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0504de5b8bb5437498dc4408394be292 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:51.556200 10932 raft_consensus.cc:515] T 176d4e72b8e44e4b88bdf89d06f2f79a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.560577 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176d4e72b8e44e4b88bdf89d06f2f79a" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:51.560931 10166 raft_consensus.cc:2393] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6986ed920dcb4af29a5eeeda6f671691 in current term 1: Already voted for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in this term.
I20260810 19:47:51.564216 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 192) took 1624 ms. Trace:
I20260810 19:47:51.564375 10377 rpcz_store.cc:276] 0810 19:47:49.931676 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.956728 (+ 25052us) service_pool.cc:224] Handling call
0810 19:47:51.534287 (+1577559us) ts_tablet_manager.cc:1151] Deleting tablet dad16ea0f82942de8587dd7c98c0d2df
0810 19:47:51.534298 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:51.556389 (+ 22091us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1574544}
I20260810 19:47:51.567101 10932 leader_election.cc:290] T 176d4e72b8e44e4b88bdf89d06f2f79a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:51.569300 10366 tablet_bootstrap.cc:654] T 4d654dada92a4939914d26ab72a5f5e8 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:51.569658 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 195) took 1566 ms. Trace:
I20260810 19:47:51.573351 10375 ts_tablet_manager.cc:1929] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:51.573534 10375 log.cc:1199] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/248e8954c46e4328a696f9799604e67f
I20260810 19:47:51.574024 10375 ts_tablet_manager.cc:1950] T 248e8954c46e4328a696f9799604e67f P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:51.582901 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 2b2b20dc77954af7a203f357c746be29 (DEFAULT_TABLE table=default.Table_0de524b66ecf4dea8ab5e6b87c4f6261 [id=4de43e2ae0424104aa75c5d872b72d3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.583459 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b2b20dc77954af7a203f357c746be29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.583432 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 9680053712644b4ca33c33031b1ad8bc (table default.Table_ec142e3fcbce461e80ff2fb17a1e690b [id=e6635cbcc8bc40d9b28fcae1ff0c2bef]) successfully deleted
I20260810 19:47:51.583549 10897 tablet.cc:1724] T 204ef31f396a43a5bf06205560f987c9 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 19:47:51.583760 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 28c9eecacc6540ac82ac7faabceec788 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28c9eecacc6540ac82ac7faabceec788 already in progress: creating tablet
W20260810 19:47:51.584043 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 46005eead530459eb2b636ae0a6767ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46005eead530459eb2b636ae0a6767ad already in progress: creating tablet
I20260810 19:47:51.584270 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 2ddeefaa826b4033b2e79eff7240887f (table default.Table_2adfdcdb33f543d49ea6f361bf8a55c4 [id=cfd27e7efc8f4c529e7dace21742b656]) successfully deleted
W20260810 19:47:51.584527 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 7d3395886420455d9bdaf816c19ebae2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d3395886420455d9bdaf816c19ebae2 already in progress: creating tablet
I20260810 19:47:51.584754 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 8851f5c0c2fd4600bb99793ddd151daa (table default.Table_feeb41d918e24137a0d1da856cfd8e8d [id=503738899b2347aaae2c2645ce8a930d]) successfully deleted
W20260810 19:47:51.584997 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet c7235af514fa47d899d7e38ee5662f6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7235af514fa47d899d7e38ee5662f6c already in progress: creating tablet
I20260810 19:47:51.585815 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c828ae089774fb9b0582141f4b99313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:47:51.587890 9397 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.235.254:33891: connect: Connection refused (error 111) [suppressed 10 similar messages]
I20260810 19:47:51.590797 10894 tablet.cc:1724] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:47:51.591895 9911 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c828ae089774fb9b0582141f4b99313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:51.592998 10370 tablet_bootstrap.cc:492] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:51.593302 10370 ts_tablet_manager.cc:1403] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.148s user 0.000s sys 0.004s
I20260810 19:47:51.594352 10370 raft_consensus.cc:359] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.594636 10370 raft_consensus.cc:385] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:51.594754 10370 raft_consensus.cc:740] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:51.595137 10370 consensus_queue.cc:260] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.602660 10830 mvcc.cc:204] Tried to move back new op lower bound from 7317058647089537024 to 7317058643659210752. Current Snapshot: MvccSnapshot[applied={T|T < 7317058647089537024}]
I20260810 19:47:51.591475 10377 rpcz_store.cc:276] 0810 19:47:49.998599 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.998669 (+ 70us) service_pool.cc:224] Handling call
0810 19:47:51.564958 (+1566289us) ts_tablet_manager.cc:1151] Deleting tablet 11272d47d96f443187d63c184049871f
0810 19:47:51.564973 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:51.565108 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1522397}
I20260810 19:47:51.604154 10371 tablet_replica.cc:333] T 9e09483838f0459da3041ee4fe5d55cc P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:51.604513 10371 raft_consensus.cc:2243] T 9e09483838f0459da3041ee4fe5d55cc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:51.604835 10371 raft_consensus.cc:2272] T 9e09483838f0459da3041ee4fe5d55cc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:51.605142 10164 raft_consensus.cc:2468] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:51.605660 10371 ts_tablet_manager.cc:1916] T 9e09483838f0459da3041ee4fe5d55cc P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:51.607421 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c828ae089774fb9b0582141f4b99313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:51.608119 10167 raft_consensus.cc:2468] T a9e42e13617c4457ba88ae0e0269ec93 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:51.613196 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5625c6f78f14d629bcd7f8c9522c4ba" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:51.613644 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1777a713b1d4a58919b5f6abe779ab8" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:51.621255 9408 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 15e36552fe9b456482f5aacb382f2e68
W20260810 19:47:51.622335 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc753970b2464e38b03e377551276343 consensus state has no leader
I20260810 19:47:51.631654 10370 ts_tablet_manager.cc:1434] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.038s user 0.000s sys 0.003s
I20260810 19:47:51.633255 10370 tablet_bootstrap.cc:492] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:51.634011 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 194) took 1617 ms. Trace:
I20260810 19:47:51.634150 10377 rpcz_store.cc:276] 0810 19:47:49.994349 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.998817 (+ 4468us) service_pool.cc:224] Handling call
0810 19:47:51.603282 (+1604465us) ts_tablet_manager.cc:1151] Deleting tablet 0d79ef93c5bf4ac9895e594198edb251
0810 19:47:51.603298 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:51.611806 (+ 8508us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1556600}
I20260810 19:47:51.634836 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 191) took 1743 ms. Trace:
I20260810 19:47:51.634940 10377 rpcz_store.cc:276] 0810 19:47:49.891302 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.976368 (+ 85066us) service_pool.cc:224] Handling call
0810 19:47:51.634628 (+1658260us) ts_tablet_manager.cc:1151] Deleting tablet 3badc88d94a34ff7a053ed312f0dd646
0810 19:47:51.634644 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:51.634777 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1587449}
I20260810 19:47:51.635354 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 196) took 1581 ms. Trace:
I20260810 19:47:51.635479 10377 rpcz_store.cc:276] 0810 19:47:50.054061 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.055625 (+ 1564us) service_pool.cc:224] Handling call
0810 19:47:51.635181 (+1579556us) ts_tablet_manager.cc:1151] Deleting tablet 5f560ed7ea0c4075bad1375d86738861
0810 19:47:51.635190 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:51.635301 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1577599}
I20260810 19:47:51.635891 10377 tablet_replica.cc:333] T d15bcf97364046daa97f7461f4f6bc98 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:51.636106 10377 raft_consensus.cc:2243] T d15bcf97364046daa97f7461f4f6bc98 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:51.636317 10377 raft_consensus.cc:2272] T d15bcf97364046daa97f7461f4f6bc98 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:51.636940 10377 ts_tablet_manager.cc:1916] T d15bcf97364046daa97f7461f4f6bc98 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:51.638612 9830 leader_election.cc:304] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:51.639748 9948 raft_consensus.cc:2393] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eadde59fd6504d679e47f03a60c64bb0 in current term 1: Already voted for candidate 6986ed920dcb4af29a5eeeda6f671691 in this term.
I20260810 19:47:51.640108 9944 raft_consensus.cc:2468] T c1777a713b1d4a58919b5f6abe779ab8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:47:51.643977 10488 raft_consensus.cc:2804] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:51.644166 10488 raft_consensus.cc:697] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:47:51.644493 10488 consensus_queue.cc:237] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.647297 10067 leader_election.cc:304] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:51.652841 10067 leader_election.cc:304] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:51.653621 10763 raft_consensus.cc:2749] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:51.653851 10763 raft_consensus.cc:2804] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:51.653939 10763 raft_consensus.cc:493] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:51.654047 10763 raft_consensus.cc:3060] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:51.656900 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 2b2b20dc77954af7a203f357c746be29 (DEFAULT_TABLE table=default.Table_0de524b66ecf4dea8ab5e6b87c4f6261 [id=4de43e2ae0424104aa75c5d872b72d3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.658032 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b2b20dc77954af7a203f357c746be29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:51.660318 10378 leader_election.cc:290] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:51.660557 10911 raft_consensus.cc:493] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:51.660804 10449 rpc_server.cc:307] RPC server started. Bound to: 127.8.235.254:33891
I20260810 19:47:51.660971 10911 raft_consensus.cc:515] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.662493 10944 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.235.254:33891 every 8 connection(s)
I20260810 19:47:51.663251 9716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176d4e72b8e44e4b88bdf89d06f2f79a" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:51.664145 10911 leader_election.cc:290] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:51.666697 10449 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-0/data/info.pb
I20260810 19:47:51.667974 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78f955a3ca946189de7ea96baee35f6" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:51.669875 9135 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu as pid 10449
I20260810 19:47:51.671258 10370 tablet_bootstrap.cc:654] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:51.683929 10960 sys_catalog.cc:263] Verifying existing consensus state
I20260810 19:47:51.678015 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 183) took 1931 ms. Trace:
I20260810 19:47:51.691601 10375 rpcz_store.cc:276] 0810 19:47:49.746023 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.746999 (+ 976us) service_pool.cc:224] Handling call
0810 19:47:51.005716 (+1258717us) ts_tablet_manager.cc:1151] Deleting tablet 248e8954c46e4328a696f9799604e67f
0810 19:47:51.005733 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:51.187391 (+181658us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:51.573220 (+385829us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:51.677939 (+104719us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3409,"tablet-delete.queue_time_us":1258547}
W20260810 19:47:51.678570 10068 leader_election.cc:343] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:51.690719 10763 raft_consensus.cc:515] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.692844 10763 leader_election.cc:290] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:51.692728 10936 raft_consensus.cc:493] T 2ddeefaa826b4033b2e79eff7240887f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:51.696018 10375 tablet_replica.cc:333] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:51.696316 10375 raft_consensus.cc:2243] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:51.696547 10375 raft_consensus.cc:2272] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:51.697196 10375 ts_tablet_manager.cc:1916] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:51.665117 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78f955a3ca946189de7ea96baee35f6" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:51.697659 9944 raft_consensus.cc:2468] T a78f955a3ca946189de7ea96baee35f6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:47:51.697721 9716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1777a713b1d4a58919b5f6abe779ab8" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:51.693063 10936 raft_consensus.cc:515] T 2ddeefaa826b4033b2e79eff7240887f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.665947 9831 leader_election.cc:304] T 176d4e72b8e44e4b88bdf89d06f2f79a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:51.698633 10067 leader_election.cc:304] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:51.698786 10932 raft_consensus.cc:3060] T 176d4e72b8e44e4b88bdf89d06f2f79a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:51.699342 10763 raft_consensus.cc:2804] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:51.699505 10763 raft_consensus.cc:493] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:51.699631 10763 raft_consensus.cc:3060] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:51.701011 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet a78f955a3ca946189de7ea96baee35f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:51.702080 10932 raft_consensus.cc:2749] T 176d4e72b8e44e4b88bdf89d06f2f79a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:47:51.704012 9831 consensus_peers.cc:597] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:51.704851 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 7737acd216204209ba0327e26e85cfe6
I20260810 19:47:51.666983 10366 tablet_bootstrap.cc:492] T 4d654dada92a4939914d26ab72a5f5e8 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:51.705217 10366 ts_tablet_manager.cc:1403] T 4d654dada92a4939914d26ab72a5f5e8 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.161s user 0.005s sys 0.007s
I20260810 19:47:51.705487 9415 catalog_manager.cc:6807] ReplaceTablet: tablet 7737acd216204209ba0327e26e85cfe6 deleted and replaced by tablet 5654c48929564a96a55ed0444c9e1a04
I20260810 19:47:51.705811 9415 master_service.cc:960] ReplaceTablet: received request to replace tablet 6f0150de0d60425b807be532ce0ba6c3 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:51.706094 10366 raft_consensus.cc:359] T 4d654dada92a4939914d26ab72a5f5e8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:51.706362 10366 raft_consensus.cc:385] T 4d654dada92a4939914d26ab72a5f5e8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:51.706470 10366 raft_consensus.cc:740] T 4d654dada92a4939914d26ab72a5f5e8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:51.702477 10763 raft_consensus.cc:515] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.706734 10366 consensus_queue.cc:260] T 4d654dada92a4939914d26ab72a5f5e8 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:51.708770 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 7737acd216204209ba0327e26e85cfe6 with delete_type TABLET_DATA_DELETED (replaced by tablet 5654c48929564a96a55ed0444c9e1a04) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:51.709012 10897 tablet.cc:1724] T 668b3514d9f64d44a8747647194e50be P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260810 19:47:51.709533 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 11272d47d96f443187d63c184049871f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11272d47d96f443187d63c184049871f already in progress: creating tablet
W20260810 19:47:51.710007 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 0d79ef93c5bf4ac9895e594198edb251 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d79ef93c5bf4ac9895e594198edb251 already in progress: creating tablet
W20260810 19:47:51.710484 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 5f560ed7ea0c4075bad1375d86738861 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f560ed7ea0c4075bad1375d86738861 already in progress: creating tablet
I20260810 19:47:51.711539 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 248e8954c46e4328a696f9799604e67f (table default.Table_e57c84cd8eb94daf9711603419d86cd2 [id=558424139ffe43aebb7011b7805574a9]) successfully deleted
I20260810 19:47:51.711772 10890 tablet.cc:1724] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 19:47:51.712652 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_88790a0f0d5c47079b55c152d71d4a1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:51.712761 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e2c3250ad65342b6b93438349218f41a" } modify_external_catalogs: true
I20260810 19:47:51.712984 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e2c3250ad65342b6b93438349218f41a" } modify_external_catalogs: true
W20260810 19:47:51.713330 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88790a0f0d5c47079b55c152d71d4a1c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:51.714715 10894 tablet.cc:1724] T 668b3514d9f64d44a8747647194e50be P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 19:47:51.715117 9657 tablet_service.cc:1511] Processing CreateTablet for tablet ae3e151180ae4d258d18365770acaaad (DEFAULT_TABLE table=default.Table_250f18957ff84ad58246dfec016f0abf [id=197d5993ea8643288fe8814a51e4bfd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:51.715864 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet dd632a01fe424a3a956d445ce01e31d2
I20260810 19:47:51.716902 9407 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 132e801176614d8a9a7713f623ddc8f7
I20260810 19:47:51.721063 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae3e151180ae4d258d18365770acaaad. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:51.722412 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 72b39babf851404c89adb317033015ec consensus state has no leader
I20260810 19:47:51.725939 10585 raft_consensus.cc:697] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:51.726722 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_6a1034f157434db3b707bb21cddbe36b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:51.727677 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_070cfe9bb949439ca652e166a5c0f63e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:51.726238 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f77071b80f324808b6401b4f8d20d2cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:51.733131 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_398b6d4ebbf742b99fad6aff42d2802b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:51.734663 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f77071b80f324808b6401b4f8d20d2cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:51.735723 10960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575: Bootstrap starting.
W20260810 19:47:51.736060 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_070cfe9bb949439ca652e166a5c0f63e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:51.735674 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0a16454a2da548e3a7130a52dbd5143a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:51.737318 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a1034f157434db3b707bb21cddbe36b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:51.740485 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a16454a2da548e3a7130a52dbd5143a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:51.740736 10366 ts_tablet_manager.cc:1434] T 4d654dada92a4939914d26ab72a5f5e8 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.035s user 0.004s sys 0.000s
W20260810 19:47:51.741333 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_398b6d4ebbf742b99fad6aff42d2802b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:51.746937 9611 leader_election.cc:343] T 2ddeefaa826b4033b2e79eff7240887f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 2ddeefaa826b4033b2e79eff7240887f
I20260810 19:47:51.748122 10366 tablet_bootstrap.cc:492] T 58b33df59ffe49a9b07606b6dc9279eb P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:51.749835 10370 tablet_bootstrap.cc:492] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:51.750020 10370 ts_tablet_manager.cc:1403] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.117s user 0.004s sys 0.001s
W20260810 19:47:51.750969 10367 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.584s user 0.058s sys 0.152s
I20260810 19:47:51.751807 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet dd632a01fe424a3a956d445ce01e31d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:51.752825 10366 tablet_bootstrap.cc:654] T 58b33df59ffe49a9b07606b6dc9279eb P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:51.753876 10370 raft_consensus.cc:359] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:51.754477 10879 mvcc.cc:204] Tried to move back new op lower bound from 7317058647089537024 to 7317058643659210752. Current Snapshot: MvccSnapshot[applied={T|T < 7317058647089537024}]
I20260810 19:47:51.755190 9673 tablet_service.cc:1558] Processing DeleteTablet for tablet 7737acd216204209ba0327e26e85cfe6 with delete_type TABLET_DATA_DELETED (replaced by tablet 5654c48929564a96a55ed0444c9e1a04) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:51.754925 10936 leader_election.cc:290] T 2ddeefaa826b4033b2e79eff7240887f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:51.755848 10890 tablet.cc:1724] T 204ef31f396a43a5bf06205560f987c9 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:47:51.756912 10370 raft_consensus.cc:385] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:51.757112 10370 raft_consensus.cc:740] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:51.757424 10585 consensus_queue.cc:237] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:51.757553 10370 consensus_queue.cc:260] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:51.761484 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet c8602b7360b747a3af756b139635d95c
W20260810 19:47:51.761705 10367 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.615s user 0.058s sys 0.152s
I20260810 19:47:51.761811 9421 master_service.cc:960] ReplaceTablet: received request to replace tablet a01d3ec3c8914fe495f7a0f3c7c312f8 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:51.762308 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c541f938fadd4f3f977d218a6c0dca8c" } new_table_name: "default.Table_4502b22ebf5b47e5a0c8e0c3027e3251" modify_external_catalogs: true
I20260810 19:47:51.762696 10367 tablet_bootstrap.cc:492] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:51.762866 10367 ts_tablet_manager.cc:1403] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.635s user 0.059s sys 0.154s
I20260810 19:47:51.763907 10367 raft_consensus.cc:359] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.764173 10367 raft_consensus.cc:385] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:51.764312 10367 raft_consensus.cc:740] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:51.764655 10367 consensus_queue.cc:260] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.765383 10367 ts_tablet_manager.cc:1434] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:47:51.765774 10367 tablet_bootstrap.cc:492] T a78f955a3ca946189de7ea96baee35f6 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:51.772171 10366 tablet_bootstrap.cc:492] T 58b33df59ffe49a9b07606b6dc9279eb P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:51.693717 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1777a713b1d4a58919b5f6abe779ab8" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:51.766283 10370 ts_tablet_manager.cc:1434] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.016s user 0.003s sys 0.000s
I20260810 19:47:51.772691 9948 raft_consensus.cc:3060] T c1777a713b1d4a58919b5f6abe779ab8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:51.772990 10370 tablet_bootstrap.cc:492] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:51.775601 9948 raft_consensus.cc:2468] T c1777a713b1d4a58919b5f6abe779ab8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:47:51.771116 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet 7737acd216204209ba0327e26e85cfe6 with delete_type TABLET_DATA_DELETED (replaced by tablet 5654c48929564a96a55ed0444c9e1a04) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:51.772644 10139 tablet_service.cc:1558] Processing DeleteTablet for tablet c8602b7360b747a3af756b139635d95c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:51.776047 10067 leader_election.cc:304] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:51.772466 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet dd632a01fe424a3a956d445ce01e31d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:51.776355 10911 raft_consensus.cc:2804] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:51.776436 10366 ts_tablet_manager.cc:1403] T 58b33df59ffe49a9b07606b6dc9279eb P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.002s
I20260810 19:47:51.776520 10911 raft_consensus.cc:697] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:47:51.776815 10911 consensus_queue.cc:237] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.777326 10366 raft_consensus.cc:359] T 58b33df59ffe49a9b07606b6dc9279eb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.777578 10366 raft_consensus.cc:385] T 58b33df59ffe49a9b07606b6dc9279eb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:51.777791 10366 raft_consensus.cc:740] T 58b33df59ffe49a9b07606b6dc9279eb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:51.778105 10366 consensus_queue.cc:260] T 58b33df59ffe49a9b07606b6dc9279eb P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.781945 10367 tablet_bootstrap.cc:654] T a78f955a3ca946189de7ea96baee35f6 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:51.772150 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet dd632a01fe424a3a956d445ce01e31d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:47:51.786834 10068 leader_election.cc:343] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:51.786831 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet c8602b7360b747a3af756b139635d95c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:51.789927 10621 consensus_queue.cc:1048] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:51.768369 9673 tablet_service.cc:1558] Processing DeleteTablet for tablet c8602b7360b747a3af756b139635d95c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:51.787847 9716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78f955a3ca946189de7ea96baee35f6" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
W20260810 19:47:51.791134 10068 leader_election.cc:343] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:51.791523 10763 leader_election.cc:290] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:51.686856 10377 ts_tablet_manager.cc:1929] T d15bcf97364046daa97f7461f4f6bc98 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:51.791793 10377 log.cc:1199] T d15bcf97364046daa97f7461f4f6bc98 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/d15bcf97364046daa97f7461f4f6bc98
I20260810 19:47:51.792263 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78f955a3ca946189de7ea96baee35f6" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:51.792475 9948 raft_consensus.cc:3060] T a78f955a3ca946189de7ea96baee35f6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:51.792577 10377 ts_tablet_manager.cc:1950] T d15bcf97364046daa97f7461f4f6bc98 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:51.793090 10763 consensus_queue.cc:1048] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:51.795935 9948 raft_consensus.cc:2468] T a78f955a3ca946189de7ea96baee35f6 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:47:51.797096 10067 leader_election.cc:304] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:51.788249 10371 ts_tablet_manager.cc:1929] T 9e09483838f0459da3041ee4fe5d55cc P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 19:47:51.789474 9611 leader_election.cc:343] T 2ddeefaa826b4033b2e79eff7240887f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Not found: Tablet not found: 2ddeefaa826b4033b2e79eff7240887f
I20260810 19:47:51.801534 9611 leader_election.cc:304] T 2ddeefaa826b4033b2e79eff7240887f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:51.802132 10585 raft_consensus.cc:2749] T 2ddeefaa826b4033b2e79eff7240887f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:51.806401 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 198) took 1736 ms. Trace:
I20260810 19:47:51.806942 10371 log.cc:1199] T 9e09483838f0459da3041ee4fe5d55cc P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/9e09483838f0459da3041ee4fe5d55cc
I20260810 19:47:51.807817 10371 ts_tablet_manager.cc:1950] T 9e09483838f0459da3041ee4fe5d55cc P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:51.807889 10377 rpcz_store.cc:276] 0810 19:47:50.070343 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.070412 (+ 69us) service_pool.cc:224] Handling call
0810 19:47:51.635713 (+1565301us) ts_tablet_manager.cc:1151] Deleting tablet d15bcf97364046daa97f7461f4f6bc98
0810 19:47:51.635722 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:51.645614 (+ 9892us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:51.686735 (+ 41121us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:51.806335 (+119600us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4509,"tablet-delete.queue_time_us":1541497}
I20260810 19:47:51.809134 10377 tablet_replica.cc:333] T a71e3516f97c46f397de42f5c7089eeb P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:51.810226 10377 raft_consensus.cc:2243] T a71e3516f97c46f397de42f5c7089eeb P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:51.811203 10377 raft_consensus.cc:2272] T a71e3516f97c46f397de42f5c7089eeb P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:51.811424 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet d15bcf97364046daa97f7461f4f6bc98 (table default.Table_47c121b1c8cf4d999324cc090246288b [id=e107df18522446d3bcf7bd46e78eb626]) successfully deleted
I20260810 19:47:51.811786 10370 tablet_bootstrap.cc:654] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:51.812367 10377 ts_tablet_manager.cc:1916] T a71e3516f97c46f397de42f5c7089eeb P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:51.814942 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 9e09483838f0459da3041ee4fe5d55cc (table default.Table_5e6891ff4aa040be8b327aafa596bc7e [id=fd840f00bdc5477aaad0b7fa114870dd]) successfully deleted
I20260810 19:47:51.815048 9407 master_service.cc:960] ReplaceTablet: received request to replace tablet 3916a976efef43428942135e777edcec from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:51.828316 10371 tablet_replica.cc:333] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
W20260810 19:47:51.828279 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 5d3598b5743244e39efd12703ec15aea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d3598b5743244e39efd12703ec15aea already in progress: creating tablet
W20260810 19:47:51.828634 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 476e762e46c04ae6bfef5e14df2d16e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 476e762e46c04ae6bfef5e14df2d16e2 already in progress: creating tablet
I20260810 19:47:51.828655 10911 raft_consensus.cc:2804] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:51.828840 10371 raft_consensus.cc:2243] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:51.828999 10911 raft_consensus.cc:697] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:47:51.829082 10371 pending_rounds.cc:70] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4: Trying to abort 1 pending ops.
I20260810 19:47:51.829263 10371 pending_rounds.cc:77] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058644374175744 op_type: NO_OP noop_request { }
I20260810 19:47:51.829468 10371 raft_consensus.cc:2889] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:51.829386 10911 consensus_queue.cc:237] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.829702 10371 raft_consensus.cc:2272] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:51.830868 10371 ts_tablet_manager.cc:1916] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:51.833416 10026 heartbeater.cc:344] Connected to a master server at 127.8.235.254:33891
I20260810 19:47:51.840265 10932 consensus_queue.cc:1048] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:51.849228 10371 ts_tablet_manager.cc:1929] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:51.833379 10366 ts_tablet_manager.cc:1434] T 58b33df59ffe49a9b07606b6dc9279eb P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.057s user 0.001s sys 0.001s
W20260810 19:47:51.851552 10068 consensus_peers.cc:597] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:51.851629 10366 tablet_bootstrap.cc:492] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:51.876173 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_5e736aca6c8f40ca9bba22083b3622c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:51.876909 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e736aca6c8f40ca9bba22083b3622c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:51.877364 10370 tablet_bootstrap.cc:492] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:51.878567 10371 log.cc:1199] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/3cda6eb6d4b847edb2624a267bc3522d
I20260810 19:47:51.878621 10968 raft_consensus.cc:493] T 5f0d4ce494b4459eb05716d6e62d7a09 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:51.878827 10968 raft_consensus.cc:515] T 5f0d4ce494b4459eb05716d6e62d7a09 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.879858 10968 leader_election.cc:290] T 5f0d4ce494b4459eb05716d6e62d7a09 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:51.879679 10366 tablet_bootstrap.cc:654] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:51.879220 9789 heartbeater.cc:344] Connected to a master server at 127.8.235.254:33891
W20260810 19:47:51.881150 9831 leader_election.cc:343] T 5f0d4ce494b4459eb05716d6e62d7a09 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 5f0d4ce494b4459eb05716d6e62d7a09
I20260810 19:47:51.884198 10371 ts_tablet_manager.cc:1950] T 3cda6eb6d4b847edb2624a267bc3522d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:51.884650 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a4e75ffc215f4ff2a55eeb4e515a8c4f" } new_table_name: "default.Table_0844c946c41146f38e51790cd8baed2a" modify_external_catalogs: true
W20260810 19:47:51.887569 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 10617bdf2eed4dbd8d13ea1821443863 consensus state has no leader
I20260810 19:47:51.888053 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_55f86d7f1c8e47b18267b6f427c46aca" } new_table_name: "default.Table_44197dd0fe1e4c88b41c1e9996eaa4a2" modify_external_catalogs: true
I20260810 19:47:51.891595 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 228) took 1013 ms. Trace:
I20260810 19:47:51.893662 10960 log.cc:826] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575: Log is configured to *not* fsync() on all Append() calls
I20260810 19:47:51.893942 10377 ts_tablet_manager.cc:1929] T a71e3516f97c46f397de42f5c7089eeb P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:51.894656 10377 log.cc:1199] T a71e3516f97c46f397de42f5c7089eeb P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/a71e3516f97c46f397de42f5c7089eeb
I20260810 19:47:51.897377 10377 ts_tablet_manager.cc:1950] T a71e3516f97c46f397de42f5c7089eeb P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:51.897831 10371 rpcz_store.cc:276] 0810 19:47:50.878040 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.880509 (+ 2469us) service_pool.cc:224] Handling call
0810 19:47:51.828229 (+947720us) ts_tablet_manager.cc:1151] Deleting tablet 3cda6eb6d4b847edb2624a267bc3522d
0810 19:47:51.828241 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:51.845488 (+ 17247us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:51.849112 (+ 3624us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:51.891545 (+ 42433us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":931133}
I20260810 19:47:51.899035 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 3cda6eb6d4b847edb2624a267bc3522d (table default.Table_d9e5e24d09d44347bc472ff2f0ba20b6 [id=d537831ed0b04450bad2bed57f1d3b23]) successfully deleted
I20260810 19:47:51.899240 10371 tablet_replica.cc:333] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:51.899793 10371 raft_consensus.cc:2243] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:51.899959 10370 ts_tablet_manager.cc:1403] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.109s user 0.004s sys 0.004s
I20260810 19:47:51.900991 10371 pending_rounds.cc:70] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4: Trying to abort 1 pending ops.
I20260810 19:47:51.901094 10371 pending_rounds.cc:77] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058647904620544 op_type: NO_OP noop_request { }
I20260810 19:47:51.901224 10371 raft_consensus.cc:2889] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:51.901367 10371 raft_consensus.cc:2272] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:51.903023 10366 tablet_bootstrap.cc:492] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:51.903389 10366 ts_tablet_manager.cc:1403] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.052s user 0.006s sys 0.001s
I20260810 19:47:51.905092 10366 raft_consensus.cc:359] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:51.905643 10366 raft_consensus.cc:385] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:51.905858 10366 raft_consensus.cc:740] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:51.906643 10367 tablet_bootstrap.cc:492] T a78f955a3ca946189de7ea96baee35f6 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:51.906903 10367 ts_tablet_manager.cc:1403] T a78f955a3ca946189de7ea96baee35f6 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.141s user 0.005s sys 0.011s
I20260810 19:47:51.907783 10367 raft_consensus.cc:359] T a78f955a3ca946189de7ea96baee35f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.908059 10367 raft_consensus.cc:385] T a78f955a3ca946189de7ea96baee35f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:51.908208 10367 raft_consensus.cc:740] T a78f955a3ca946189de7ea96baee35f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
W20260810 19:47:51.908387 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9a13b0f5b6b14bb9b72740a8521e4ea5 consensus state has no leader
I20260810 19:47:51.908605 10367 consensus_queue.cc:260] T a78f955a3ca946189de7ea96baee35f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
W20260810 19:47:51.910488 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dfea147ef3904ab49375def065c6f328 consensus state has no leader
I20260810 19:47:51.910921 10367 ts_tablet_manager.cc:1434] T a78f955a3ca946189de7ea96baee35f6 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260810 19:47:51.911375 10367 tablet_bootstrap.cc:492] T 651a1f5011de4db495dbbab2d19ff096 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:51.911983 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_336441014db542c6ba0f204ef41d4747" } modify_external_catalogs: true
I20260810 19:47:51.912209 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_336441014db542c6ba0f204ef41d4747" } modify_external_catalogs: true
I20260810 19:47:51.912778 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c77252f5f6754251a8007baa5906cd60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:51.913400 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c77252f5f6754251a8007baa5906cd60 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:51.906549 10366 consensus_queue.cc:260] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:51.914777 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a02900865d894a1dbfdb42b50ca8ebbf" } modify_external_catalogs: true
I20260810 19:47:51.914986 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a02900865d894a1dbfdb42b50ca8ebbf" } modify_external_catalogs: true
I20260810 19:47:51.920593 10367 tablet_bootstrap.cc:654] T 651a1f5011de4db495dbbab2d19ff096 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:51.921332 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 199) took 1795 ms. Trace:
I20260810 19:47:51.922855 10370 raft_consensus.cc:359] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:51.924319 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_67bea23de98f4ac097b6723f617bd43f" } new_table_name: "default.Table_7b492dac7ea64246abf9488fd4dbc8b1" modify_external_catalogs: true
I20260810 19:47:51.924835 10377 rpcz_store.cc:276] 0810 19:47:50.125526 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.125612 (+ 86us) service_pool.cc:224] Handling call
0810 19:47:51.809032 (+1683420us) ts_tablet_manager.cc:1151] Deleting tablet a71e3516f97c46f397de42f5c7089eeb
0810 19:47:51.809045 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:51.876109 (+ 67064us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:51.893796 (+ 17687us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:51.921009 (+ 27213us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1683099}
I20260810 19:47:51.925690 10366 ts_tablet_manager.cc:1434] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.022s user 0.003s sys 0.000s
I20260810 19:47:51.926152 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet a71e3516f97c46f397de42f5c7089eeb (table default.Table_dcf48c67df284776aca6205b880fbbc5 [id=a8bdf6ea608f4279971af4c9eff71db6]) successfully deleted
I20260810 19:47:51.930225 10585 consensus_queue.cc:1048] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:51.929555 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 200) took 1784 ms. Trace:
I20260810 19:47:51.929812 10366 tablet_bootstrap.cc:492] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:51.931231 10377 rpcz_store.cc:276] 0810 19:47:50.144032 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.144120 (+ 88us) service_pool.cc:224] Handling call
0810 19:47:51.927760 (+1783640us) ts_tablet_manager.cc:1151] Deleting tablet 6af6dd8913f44e7f966ed2a128ae4fbf
0810 19:47:51.927775 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:51.928486 (+ 711us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1781579}
W20260810 19:47:51.932411 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d99b34f901484fad87cff4bb9ab56fc8 consensus state has no leader
I20260810 19:47:51.933111 10960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=7 ignored=0} inserts{seen=9 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 3 replicates
W20260810 19:47:51.933254 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 6af6dd8913f44e7f966ed2a128ae4fbf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6af6dd8913f44e7f966ed2a128ae4fbf already in progress: creating tablet
I20260810 19:47:51.933636 10377 tablet_replica.cc:333] T a9e42e13617c4457ba88ae0e0269ec93 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:51.934784 10377 raft_consensus.cc:2243] T a9e42e13617c4457ba88ae0e0269ec93 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:51.935660 10377 raft_consensus.cc:2272] T a9e42e13617c4457ba88ae0e0269ec93 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:51.936060 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8680fc2abacb464c8d39fae15165ea39" } modify_external_catalogs: true
I20260810 19:47:51.936331 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8680fc2abacb464c8d39fae15165ea39" } modify_external_catalogs: true
I20260810 19:47:51.937045 10370 raft_consensus.cc:385] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:51.937175 10370 raft_consensus.cc:740] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:51.938292 10370 consensus_queue.cc:260] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:51.938616 10960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575: Bootstrap complete.
W20260810 19:47:51.939472 9830 leader_election.cc:343] T 5f0d4ce494b4459eb05716d6e62d7a09 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Not found: Tablet not found: 5f0d4ce494b4459eb05716d6e62d7a09
I20260810 19:47:51.939633 9830 leader_election.cc:304] T 5f0d4ce494b4459eb05716d6e62d7a09 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:51.940294 10968 raft_consensus.cc:2749] T 5f0d4ce494b4459eb05716d6e62d7a09 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:51.946447 10371 ts_tablet_manager.cc:1916] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:51.956722 10960 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [term 1 FOLLOWER]: Replica starting. Triggering 3 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } }
I20260810 19:47:51.961004 10377 ts_tablet_manager.cc:1916] T a9e42e13617c4457ba88ae0e0269ec93 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:51.962168 10366 tablet_bootstrap.cc:654] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:51.964709 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 08e29e23d54f47968a06be98b313918d
I20260810 19:47:51.965188 9418 catalog_manager.cc:6807] ReplaceTablet: tablet 08e29e23d54f47968a06be98b313918d deleted and replaced by tablet 19e2bf7b7d254894a07c5a75bf24e742
I20260810 19:47:51.965619 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2819131cbbda496d8acccf4b8e83c322" } modify_external_catalogs: true
I20260810 19:47:51.965826 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2819131cbbda496d8acccf4b8e83c322" } modify_external_catalogs: true
I20260810 19:47:51.968636 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 08e29e23d54f47968a06be98b313918d with delete_type TABLET_DATA_DELETED (replaced by tablet 19e2bf7b7d254894a07c5a75bf24e742) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:51.951057 10367 tablet_bootstrap.cc:492] T 651a1f5011de4db495dbbab2d19ff096 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:51.969198 10367 ts_tablet_manager.cc:1403] T 651a1f5011de4db495dbbab2d19ff096 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.058s user 0.002s sys 0.003s
I20260810 19:47:51.970238 10367 raft_consensus.cc:359] T 651a1f5011de4db495dbbab2d19ff096 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.970561 10367 raft_consensus.cc:385] T 651a1f5011de4db495dbbab2d19ff096 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:51.970642 10367 raft_consensus.cc:740] T 651a1f5011de4db495dbbab2d19ff096 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:51.970978 10367 consensus_queue.cc:260] T 651a1f5011de4db495dbbab2d19ff096 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:51.971619 10367 ts_tablet_manager.cc:1434] T 651a1f5011de4db495dbbab2d19ff096 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:47:51.972023 10367 tablet_bootstrap.cc:492] T c1777a713b1d4a58919b5f6abe779ab8 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:51.967723 9673 tablet_service.cc:1558] Processing DeleteTablet for tablet 08e29e23d54f47968a06be98b313918d with delete_type TABLET_DATA_DELETED (replaced by tablet 19e2bf7b7d254894a07c5a75bf24e742) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:51.979053 10585 consensus_queue.cc:1048] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:51.981989 9408 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet c1777a713b1d4a58919b5f6abe779ab8 (table default.Table_2819131cbbda496d8acccf4b8e83c322 [id=59935ce778c84929aa6ae71a1e33c63f]). Expected version 1 got 0
I20260810 19:47:51.982249 9408 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 668b3514d9f64d44a8747647194e50be (table default.Table_a3d5e18125a047349dec5a6f6f3bde4d [id=f96d1bbf37954740825d721e6259ce3c]). Expected version 3 got 2
I20260810 19:47:51.982967 10367 tablet_bootstrap.cc:654] T c1777a713b1d4a58919b5f6abe779ab8 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:51.987082 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_97bfd454a3b34fb6bccadb843d79f141"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:51.987694 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97bfd454a3b34fb6bccadb843d79f141 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:51.989388 9673 tablet_service.cc:1558] Processing DeleteTablet for tablet a9e42e13617c4457ba88ae0e0269ec93 with delete_type TABLET_DATA_DELETED (replaced by tablet 0dd49d6fa79e4677b753b6cf9117b02d) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:51.996819 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 08e29e23d54f47968a06be98b313918d with delete_type TABLET_DATA_DELETED (replaced by tablet 19e2bf7b7d254894a07c5a75bf24e742) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:51.998085 10370 ts_tablet_manager.cc:1434] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.087s user 0.002s sys 0.001s
I20260810 19:47:51.999650 10370 tablet_bootstrap.cc:492] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:52.001662 10370 tablet_bootstrap.cc:654] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:52.002368 10366 tablet_bootstrap.cc:492] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:52.002688 10366 ts_tablet_manager.cc:1403] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.074s user 0.009s sys 0.000s
I20260810 19:47:52.004279 10366 raft_consensus.cc:359] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.006191 10366 raft_consensus.cc:385] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:52.006500 10366 raft_consensus.cc:740] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:52.007297 9673 tablet_service.cc:1511] Processing CreateTablet for tablet dcb3660108094399b36d19ea8e6b8308 (DEFAULT_TABLE table=default.Table_5ae50e2c32d5407aae2976de4f6ce97b [id=14e993ddf3b646098d6d3a3e24d01b07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.007081 10366 consensus_queue.cc:260] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.007805 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcb3660108094399b36d19ea8e6b8308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.009586 10366 ts_tablet_manager.cc:1434] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260810 19:47:52.011015 10366 tablet_bootstrap.cc:492] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:52.011224 10377 ts_tablet_manager.cc:1929] T a9e42e13617c4457ba88ae0e0269ec93 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:52.011814 10377 log.cc:1199] T a9e42e13617c4457ba88ae0e0269ec93 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/a9e42e13617c4457ba88ae0e0269ec93
I20260810 19:47:52.013511 10377 ts_tablet_manager.cc:1950] T a9e42e13617c4457ba88ae0e0269ec93 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:52.015383 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 204) took 1818 ms. Trace:
I20260810 19:47:52.016808 10377 rpcz_store.cc:276] 0810 19:47:50.197220 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.197278 (+ 58us) service_pool.cc:224] Handling call
0810 19:47:51.933261 (+1735983us) ts_tablet_manager.cc:1151] Deleting tablet a9e42e13617c4457ba88ae0e0269ec93
0810 19:47:51.933369 (+ 108us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:51.985843 (+ 52474us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.010955 (+ 25112us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.015243 (+ 4288us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1722716}
I20260810 19:47:52.018978 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet a9e42e13617c4457ba88ae0e0269ec93 (table default.Table_ebe965457d0c46a39803fb5155a0bc0c [id=11015256d39042599eae0f05e96dca2d]) successfully deleted
I20260810 19:47:52.020176 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 205) took 1807 ms. Trace:
I20260810 19:47:52.020737 10377 rpcz_store.cc:276] 0810 19:47:50.212258 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.212458 (+ 200us) service_pool.cc:224] Handling call
0810 19:47:52.019308 (+1806850us) ts_tablet_manager.cc:1151] Deleting tablet 6355c14e38b3446493f7bd5e2a717341
0810 19:47:52.019428 (+ 120us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.019854 (+ 426us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1806324}
I20260810 19:47:52.021518 10366 tablet_bootstrap.cc:654] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:52.022784 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 210) took 1747 ms. Trace:
I20260810 19:47:52.023299 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 3916a976efef43428942135e777edcec
I20260810 19:47:52.023887 9407 catalog_manager.cc:6807] ReplaceTablet: tablet 3916a976efef43428942135e777edcec deleted and replaced by tablet 988d87b2b00a459d9afc44ba0ae1961e
I20260810 19:47:52.023311 10377 rpcz_store.cc:276] 0810 19:47:50.275549 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.275619 (+ 70us) service_pool.cc:224] Handling call
0810 19:47:52.022146 (+1746527us) ts_tablet_manager.cc:1151] Deleting tablet 74dddd12f2314d6ab5a6717025b13a51
0810 19:47:52.022159 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.022657 (+ 498us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1639455}
I20260810 19:47:52.024780 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet a01d3ec3c8914fe495f7a0f3c7c312f8
I20260810 19:47:52.025249 9421 catalog_manager.cc:6807] ReplaceTablet: tablet a01d3ec3c8914fe495f7a0f3c7c312f8 deleted and replaced by tablet 18cd8adaa065425c846bc791c05fa67d
I20260810 19:47:52.026059 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 6f0150de0d60425b807be532ce0ba6c3
I20260810 19:47:52.026167 10377 tablet_replica.cc:333] T 3cda6eb6d4b847edb2624a267bc3522d P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:52.026516 9415 catalog_manager.cc:6807] ReplaceTablet: tablet 6f0150de0d60425b807be532ce0ba6c3 deleted and replaced by tablet cc1bd9211b2f4035a16c6ff91752c4fc
I20260810 19:47:52.027032 10377 raft_consensus.cc:2243] T 3cda6eb6d4b847edb2624a267bc3522d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:52.027374 10377 raft_consensus.cc:2272] T 3cda6eb6d4b847edb2624a267bc3522d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:52.028712 10246 heartbeater.cc:344] Connected to a master server at 127.8.235.254:33891
I20260810 19:47:52.029071 10377 ts_tablet_manager.cc:1916] T 3cda6eb6d4b847edb2624a267bc3522d P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:52.029233 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 3916a976efef43428942135e777edcec with delete_type TABLET_DATA_DELETED (replaced by tablet 988d87b2b00a459d9afc44ba0ae1961e) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:52.029505 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet a01d3ec3c8914fe495f7a0f3c7c312f8 with delete_type TABLET_DATA_DELETED (replaced by tablet 18cd8adaa065425c846bc791c05fa67d) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:52.029700 9665 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f0150de0d60425b807be532ce0ba6c3 with delete_type TABLET_DATA_DELETED (replaced by tablet cc1bd9211b2f4035a16c6ff91752c4fc) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:52.031407 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 6355c14e38b3446493f7bd5e2a717341 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6355c14e38b3446493f7bd5e2a717341 already in progress: creating tablet
W20260810 19:47:52.031702 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 74dddd12f2314d6ab5a6717025b13a51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74dddd12f2314d6ab5a6717025b13a51 already in progress: creating tablet
I20260810 19:47:52.032297 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 3916a976efef43428942135e777edcec with delete_type TABLET_DATA_DELETED (replaced by tablet 988d87b2b00a459d9afc44ba0ae1961e) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.032438 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet a01d3ec3c8914fe495f7a0f3c7c312f8 with delete_type TABLET_DATA_DELETED (replaced by tablet 18cd8adaa065425c846bc791c05fa67d) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.032558 9911 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f0150de0d60425b807be532ce0ba6c3 with delete_type TABLET_DATA_DELETED (replaced by tablet cc1bd9211b2f4035a16c6ff91752c4fc) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.033674 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 3916a976efef43428942135e777edcec with delete_type TABLET_DATA_DELETED (replaced by tablet 988d87b2b00a459d9afc44ba0ae1961e) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:52.033908 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f0150de0d60425b807be532ce0ba6c3 with delete_type TABLET_DATA_DELETED (replaced by tablet cc1bd9211b2f4035a16c6ff91752c4fc) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:52.034022 10139 tablet_service.cc:1558] Processing DeleteTablet for tablet a01d3ec3c8914fe495f7a0f3c7c312f8 with delete_type TABLET_DATA_DELETED (replaced by tablet 18cd8adaa065425c846bc791c05fa67d) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:52.034355 9416 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_b8bd05c31450458cb9d2bdb337397fde [id=4ed93ad00edc4b06ba6b845cfd726631] alter complete (version 1)
I20260810 19:47:52.035573 9416 master_service.cc:960] ReplaceTablet: received request to replace tablet e959898b2c4c4173aea107d3f090ca07 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:52.039285 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e9290dde7b6e467584d7cdf7b0ceae58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:52.039958 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9290dde7b6e467584d7cdf7b0ceae58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.041532 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6c826966f2e544f7b354551cd1aa632e" } new_table_name: "default.Table_5005f8f74af74cad8c19a3c67e8f9fe9" modify_external_catalogs: true
I20260810 19:47:52.044486 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3517015cddb644a28150bb4f6f7c3187" } modify_external_catalogs: true
I20260810 19:47:52.044767 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3517015cddb644a28150bb4f6f7c3187" } modify_external_catalogs: true
I20260810 19:47:52.049108 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet a9e42e13617c4457ba88ae0e0269ec93 with delete_type TABLET_DATA_DELETED (replaced by tablet 0dd49d6fa79e4677b753b6cf9117b02d) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.049223 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f0d4ce494b4459eb05716d6e62d7a09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.049412 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 176d4e72b8e44e4b88bdf89d06f2f79a with delete_type TABLET_DATA_DELETED (replaced by tablet 0c0a1e360ac648eeb0c734215bc200f6) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.050171 9911 tablet_service.cc:1558] Processing DeleteTablet for tablet 651a1f5011de4db495dbbab2d19ff096 with delete_type TABLET_DATA_DELETED (replaced by tablet 02cd41da21364a868f5b6c980765d0cd) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.053706 9911 tablet_service.cc:1511] Processing CreateTablet for tablet dcb3660108094399b36d19ea8e6b8308 (DEFAULT_TABLE table=default.Table_5ae50e2c32d5407aae2976de4f6ce97b [id=14e993ddf3b646098d6d3a3e24d01b07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.054236 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcb3660108094399b36d19ea8e6b8308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.055226 10377 ts_tablet_manager.cc:1929] T 3cda6eb6d4b847edb2624a267bc3522d P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:52.055902 10377 log.cc:1199] T 3cda6eb6d4b847edb2624a267bc3522d P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/3cda6eb6d4b847edb2624a267bc3522d
I20260810 19:47:52.057732 10377 ts_tablet_manager.cc:1950] T 3cda6eb6d4b847edb2624a267bc3522d P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:52.059480 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 211) took 1648 ms. Trace:
I20260810 19:47:52.059985 10377 rpcz_store.cc:276] 0810 19:47:50.410407 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.429449 (+ 19042us) service_pool.cc:224] Handling call
0810 19:47:52.025269 (+1595820us) ts_tablet_manager.cc:1151] Deleting tablet 3cda6eb6d4b847edb2624a267bc3522d
0810 19:47:52.025283 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.040972 (+ 15689us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.054841 (+ 13869us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.059223 (+ 4382us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1595068}
I20260810 19:47:52.061511 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 3cda6eb6d4b847edb2624a267bc3522d (table default.Table_d9e5e24d09d44347bc472ff2f0ba20b6 [id=d537831ed0b04450bad2bed57f1d3b23]) successfully deleted
I20260810 19:47:52.062770 10377 tablet_replica.cc:333] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:52.063040 10246 heartbeater.cc:344] Connected to a master server at 127.8.235.254:33891
I20260810 19:47:52.064147 10377 raft_consensus.cc:2243] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:52.065573 10377 raft_consensus.cc:2272] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:52.068074 10139 tablet_service.cc:1511] Processing CreateTablet for tablet dcb3660108094399b36d19ea8e6b8308 (DEFAULT_TABLE table=default.Table_5ae50e2c32d5407aae2976de4f6ce97b [id=14e993ddf3b646098d6d3a3e24d01b07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.068599 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcb3660108094399b36d19ea8e6b8308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.068619 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 5394eadabf184158864921dd5d394828 (DEFAULT_TABLE table=default.Table_0c2f99b1c8cb452b973d5ea06626ac1a [id=2d447d5da0e74e0885490174fc0f929d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.069079 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5394eadabf184158864921dd5d394828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.073575 9665 tablet_service.cc:1511] Processing CreateTablet for tablet 4dba7046bdfd41f1a2ad6f299a723776 (DEFAULT_TABLE table=default.Table_074b525586d74c169b286124d5849cd2 [id=4dd4fbd829aa40048810c5a338d1b741]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.074016 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dba7046bdfd41f1a2ad6f299a723776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.077508 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 5394eadabf184158864921dd5d394828 (DEFAULT_TABLE table=default.Table_0c2f99b1c8cb452b973d5ea06626ac1a [id=2d447d5da0e74e0885490174fc0f929d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.078032 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5394eadabf184158864921dd5d394828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.078687 9911 tablet_service.cc:1511] Processing CreateTablet for tablet 5394eadabf184158864921dd5d394828 (DEFAULT_TABLE table=default.Table_0c2f99b1c8cb452b973d5ea06626ac1a [id=2d447d5da0e74e0885490174fc0f929d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.079265 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5394eadabf184158864921dd5d394828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.081789 10377 ts_tablet_manager.cc:1916] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:52.082814 10375 ts_tablet_manager.cc:1929] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:52.083005 10375 log.cc:1199] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/8851f5c0c2fd4600bb99793ddd151daa
I20260810 19:47:52.083397 10375 ts_tablet_manager.cc:1950] T 8851f5c0c2fd4600bb99793ddd151daa P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:52.084343 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 186) took 2281 ms. Trace:
I20260810 19:47:52.084560 10375 rpcz_store.cc:276] 0810 19:47:49.802820 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.803747 (+ 927us) service_pool.cc:224] Handling call
0810 19:47:51.695939 (+1892192us) ts_tablet_manager.cc:1151] Deleting tablet 8851f5c0c2fd4600bb99793ddd151daa
0810 19:47:51.695950 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:51.902478 (+206528us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.038261 (+135783us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.084269 (+ 46008us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1891894}
I20260810 19:47:52.085259 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 8851f5c0c2fd4600bb99793ddd151daa (table default.Table_feeb41d918e24137a0d1da856cfd8e8d [id=503738899b2347aaae2c2645ce8a930d]) successfully deleted
I20260810 19:47:52.085327 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 185) took 2289 ms. Trace:
I20260810 19:47:52.085445 10375 rpcz_store.cc:276] 0810 19:47:49.795343 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.812036 (+ 16693us) service_pool.cc:224] Handling call
0810 19:47:52.084945 (+2272909us) ts_tablet_manager.cc:1151] Deleting tablet 7d3395886420455d9bdaf816c19ebae2
0810 19:47:52.084956 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.085183 (+ 227us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2272572}
W20260810 19:47:52.086193 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 7d3395886420455d9bdaf816c19ebae2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d3395886420455d9bdaf816c19ebae2 already in progress: creating tablet
I20260810 19:47:52.087841 10375 tablet_replica.cc:333] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:52.093642 10375 raft_consensus.cc:2243] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:52.096134 10960 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5268e710af3c43ddab70eb7dd1aaa575, State: Initialized, Role: FOLLOWER
I20260810 19:47:52.096827 10375 raft_consensus.cc:2272] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:52.098308 10370 tablet_bootstrap.cc:492] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:52.098377 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet c1777a713b1d4a58919b5f6abe779ab8
I20260810 19:47:52.098565 10370 ts_tablet_manager.cc:1403] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.100s user 0.005s sys 0.012s
W20260810 19:47:52.099929 9397 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet d99b34f901484fad87cff4bb9ab56fc8 (table default.Table_7b492dac7ea64246abf9488fd4dbc8b1 [id=8fac27396c0e45458c9f668d6349fc03], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d99b34f901484fad87cff4bb9ab56fc8 consensus state has no leader
I20260810 19:47:52.102231 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet c1777a713b1d4a58919b5f6abe779ab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:52.103410 10370 raft_consensus.cc:359] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.103631 10370 raft_consensus.cc:385] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:52.103717 10370 raft_consensus.cc:740] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:52.103996 10370 consensus_queue.cc:260] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.104990 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3102211b2b544d6bae3547d4f9af2574"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:52.105752 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3102211b2b544d6bae3547d4f9af2574 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.108651 9413 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 4d654dada92a4939914d26ab72a5f5e8 (table default.Table_dcf48c67df284776aca6205b880fbbc5 [id=a8bdf6ea608f4279971af4c9eff71db6]). Expected version 1 got 0
I20260810 19:47:52.110893 10370 ts_tablet_manager.cc:1434] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260810 19:47:52.111574 10375 ts_tablet_manager.cc:1916] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:52.112736 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet f3600d0528164850973cb296aaf6910f
I20260810 19:47:52.113624 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b2a435ba43114086a5c772c02c7ab120"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:52.114348 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2a435ba43114086a5c772c02c7ab120 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.114775 10370 tablet_bootstrap.cc:492] T b9e761e94dbf4baba5e44a89b6c6a81c P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:52.115942 10960 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } }
I20260810 19:47:52.118188 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet f3600d0528164850973cb296aaf6910f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:52.125257 10367 tablet_bootstrap.cc:492] T c1777a713b1d4a58919b5f6abe779ab8 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:52.125471 10367 ts_tablet_manager.cc:1403] T c1777a713b1d4a58919b5f6abe779ab8 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.154s user 0.004s sys 0.005s
I20260810 19:47:52.125599 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet f3600d0528164850973cb296aaf6910f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:52.125497 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet c1777a713b1d4a58919b5f6abe779ab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:52.126044 9789 heartbeater.cc:344] Connected to a master server at 127.8.235.254:33891
I20260810 19:47:52.126443 10367 raft_consensus.cc:359] T c1777a713b1d4a58919b5f6abe779ab8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:52.126642 10367 raft_consensus.cc:385] T c1777a713b1d4a58919b5f6abe779ab8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:52.126756 10367 raft_consensus.cc:740] T c1777a713b1d4a58919b5f6abe779ab8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:52.126988 10367 consensus_queue.cc:260] T c1777a713b1d4a58919b5f6abe779ab8 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:52.127564 10367 ts_tablet_manager.cc:1434] T c1777a713b1d4a58919b5f6abe779ab8 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:47:52.127858 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet ffc4466b82bd49fcaad30e4d5325c7db
I20260810 19:47:52.127892 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet c1777a713b1d4a58919b5f6abe779ab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.129315 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet f3600d0528164850973cb296aaf6910f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.129590 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet ffc4466b82bd49fcaad30e4d5325c7db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:52.129974 10370 tablet_bootstrap.cc:654] T b9e761e94dbf4baba5e44a89b6c6a81c P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:52.130280 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet ffc4466b82bd49fcaad30e4d5325c7db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:52.130499 10960 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 19:47:52.130905 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 4dba7046bdfd41f1a2ad6f299a723776 (DEFAULT_TABLE table=default.Table_074b525586d74c169b286124d5849cd2 [id=4dd4fbd829aa40048810c5a338d1b741]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:52.131153 10067 consensus_peers.cc:597] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:52.132777 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1954ac0ddba541af937bd2b421cb2f8e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:52.134454 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1954ac0ddba541af937bd2b421cb2f8e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.134832 10371 ts_tablet_manager.cc:1929] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:52.137213 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 4dba7046bdfd41f1a2ad6f299a723776 (DEFAULT_TABLE table=default.Table_074b525586d74c169b286124d5849cd2 [id=4dd4fbd829aa40048810c5a338d1b741]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.139719 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 3bf9486839474b2a8ddff3a49b4fda2a (DEFAULT_TABLE table=default.Table_d9f4c05ddfed4c938ab02d9f8507e119 [id=d628448cf7b94ebab79194e81fcaf040]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.140173 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dba7046bdfd41f1a2ad6f299a723776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.144335 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 3fd5cd2e4c104e45a81d2603c6f7d24a (DEFAULT_TABLE table=default.Table_a88275c6d33a4c2fbdb5f03ab3a78bbe [id=1c2a651f6a514c0bad4f133a844d91ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.144443 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bf9486839474b2a8ddff3a49b4fda2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.146173 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fd5cd2e4c104e45a81d2603c6f7d24a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.149783 9420 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet cc1bd9211b2f4035a16c6ff91752c4fc
I20260810 19:47:52.150255 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_31db32caf8c24fcbb27ba3ab77fe50b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:52.150991 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31db32caf8c24fcbb27ba3ab77fe50b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.156005 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 3bf9486839474b2a8ddff3a49b4fda2a (DEFAULT_TABLE table=default.Table_d9f4c05ddfed4c938ab02d9f8507e119 [id=d628448cf7b94ebab79194e81fcaf040]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.157629 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet ffc4466b82bd49fcaad30e4d5325c7db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.157955 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dba7046bdfd41f1a2ad6f299a723776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.159564 10366 tablet_bootstrap.cc:492] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:52.160423 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 3fd5cd2e4c104e45a81d2603c6f7d24a (DEFAULT_TABLE table=default.Table_a88275c6d33a4c2fbdb5f03ab3a78bbe [id=1c2a651f6a514c0bad4f133a844d91ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.160924 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bf9486839474b2a8ddff3a49b4fda2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.160946 10366 ts_tablet_manager.cc:1403] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.149s user 0.030s sys 0.014s
I20260810 19:47:52.161867 10366 raft_consensus.cc:359] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.162086 10366 raft_consensus.cc:385] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:52.162173 10366 raft_consensus.cc:740] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:52.165530 10377 ts_tablet_manager.cc:1929] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260810 19:47:52.165736 10377 log.cc:1199] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/ba8c4420f5e345eeac30c805d673b5e9
I20260810 19:47:52.166329 10377 ts_tablet_manager.cc:1950] T ba8c4420f5e345eeac30c805d673b5e9 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:52.167243 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 212) took 1737 ms. Trace:
I20260810 19:47:52.167789 10377 rpcz_store.cc:276] 0810 19:47:50.429705 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.429766 (+ 61us) service_pool.cc:224] Handling call
0810 19:47:52.062373 (+1632607us) ts_tablet_manager.cc:1151] Deleting tablet ba8c4420f5e345eeac30c805d673b5e9
0810 19:47:52.062440 (+ 67us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.157253 (+ 94813us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.165436 (+ 8183us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.167196 (+ 1760us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1632257}
I20260810 19:47:52.168264 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fd5cd2e4c104e45a81d2603c6f7d24a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.168437 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet ba8c4420f5e345eeac30c805d673b5e9 (table default.Table_2080a27caba94bd8a8ab66b012cb20e4 [id=c421996810c34ce69ca7c00ed984dc54]) successfully deleted
I20260810 19:47:52.167539 10366 consensus_queue.cc:260] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.169377 10366 ts_tablet_manager.cc:1434] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260810 19:47:52.169777 10366 tablet_bootstrap.cc:492] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:52.173424 10375 ts_tablet_manager.cc:1929] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:52.173586 10375 log.cc:1199] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/176d4e72b8e44e4b88bdf89d06f2f79a
I20260810 19:47:52.180750 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 213) took 1652 ms. Trace:
I20260810 19:47:52.181344 10377 rpcz_store.cc:276] 0810 19:47:50.527835 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.542229 (+ 14394us) service_pool.cc:224] Handling call
0810 19:47:52.170039 (+1627810us) ts_tablet_manager.cc:1151] Deleting tablet 4f2d7c165d2c465d9080b927d54807f7
0810 19:47:52.170048 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.180435 (+ 10387us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1627483}
I20260810 19:47:52.181830 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 214) took 1640 ms. Trace:
I20260810 19:47:52.136837 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 3bf9486839474b2a8ddff3a49b4fda2a (DEFAULT_TABLE table=default.Table_d9f4c05ddfed4c938ab02d9f8507e119 [id=d628448cf7b94ebab79194e81fcaf040]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.139624 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 3fd5cd2e4c104e45a81d2603c6f7d24a (DEFAULT_TABLE table=default.Table_a88275c6d33a4c2fbdb5f03ab3a78bbe [id=1c2a651f6a514c0bad4f133a844d91ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.185866 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bf9486839474b2a8ddff3a49b4fda2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.142102 10367 tablet_bootstrap.cc:492] T 58b33df59ffe49a9b07606b6dc9279eb P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:52.188294 10367 tablet_bootstrap.cc:654] T 58b33df59ffe49a9b07606b6dc9279eb P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:52.189605 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 4f2d7c165d2c465d9080b927d54807f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f2d7c165d2c465d9080b927d54807f7 already in progress: creating tablet
I20260810 19:47:52.190339 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fd5cd2e4c104e45a81d2603c6f7d24a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.191380 10375 ts_tablet_manager.cc:1950] T 176d4e72b8e44e4b88bdf89d06f2f79a P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:52.192371 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 188) took 2369 ms. Trace:
I20260810 19:47:52.192507 10375 rpcz_store.cc:276] 0810 19:47:49.822613 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.822691 (+ 78us) service_pool.cc:224] Handling call
0810 19:47:52.085718 (+2263027us) ts_tablet_manager.cc:1151] Deleting tablet 176d4e72b8e44e4b88bdf89d06f2f79a
0810 19:47:52.085728 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.131729 (+ 46001us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.173307 (+ 41578us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.192328 (+ 19021us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2262743}
I20260810 19:47:52.194339 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 187) took 2374 ms. Trace:
I20260810 19:47:52.194370 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 176d4e72b8e44e4b88bdf89d06f2f79a (table default.Table_03fbd70a4ed44530a3fab8f17c0769db [id=09fa54104d0f46dbb3f19138bfa2313d]) successfully deleted
I20260810 19:47:52.194470 10375 rpcz_store.cc:276] 0810 19:47:49.820157 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.824226 (+ 4069us) service_pool.cc:224] Handling call
0810 19:47:52.194151 (+2369925us) ts_tablet_manager.cc:1151] Deleting tablet c7235af514fa47d899d7e38ee5662f6c
0810 19:47:52.194163 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.194279 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2369620}
I20260810 19:47:52.194909 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 191) took 2263 ms. Trace:
I20260810 19:47:52.195017 10375 rpcz_store.cc:276] 0810 19:47:49.931055 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.931133 (+ 78us) service_pool.cc:224] Handling call
0810 19:47:52.194754 (+2263621us) ts_tablet_manager.cc:1151] Deleting tablet dad16ea0f82942de8587dd7c98c0d2df
0810 19:47:52.194764 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.194876 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2257903}
I20260810 19:47:52.195376 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 193) took 2201 ms. Trace:
I20260810 19:47:52.195475 10375 rpcz_store.cc:276] 0810 19:47:49.993637 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:49.993710 (+ 73us) service_pool.cc:224] Handling call
0810 19:47:52.195238 (+2201528us) ts_tablet_manager.cc:1151] Deleting tablet 0d79ef93c5bf4ac9895e594198edb251
0810 19:47:52.195247 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.195339 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2201219}
I20260810 19:47:52.195808 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 194) took 2196 ms. Trace:
I20260810 19:47:52.195922 10375 rpcz_store.cc:276] 0810 19:47:49.999499 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.027302 (+ 27803us) service_pool.cc:224] Handling call
0810 19:47:52.195689 (+2168387us) ts_tablet_manager.cc:1151] Deleting tablet 11272d47d96f443187d63c184049871f
0810 19:47:52.195698 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.195777 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2167979}
I20260810 19:47:52.196241 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 195) took 2141 ms. Trace:
I20260810 19:47:52.196332 10375 rpcz_store.cc:276] 0810 19:47:50.054764 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.054841 (+ 77us) service_pool.cc:224] Handling call
0810 19:47:52.196129 (+2141288us) ts_tablet_manager.cc:1151] Deleting tablet 5f560ed7ea0c4075bad1375d86738861
0810 19:47:52.196137 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.196212 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2140910}
I20260810 19:47:52.196610 10375 tablet_replica.cc:333] T d15bcf97364046daa97f7461f4f6bc98 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:52.196846 10375 raft_consensus.cc:2243] T d15bcf97364046daa97f7461f4f6bc98 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:52.153841 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 2798f122e0624af6971fc8317244e5ae (DEFAULT_TABLE table=default.Table_fbf29712bafa4a6390afd942219d24fa [id=83524cb8be1d482695223aeaaa578a13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.198856 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2798f122e0624af6971fc8317244e5ae. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:52.198848 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet c7235af514fa47d899d7e38ee5662f6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7235af514fa47d899d7e38ee5662f6c already in progress: creating tablet
W20260810 19:47:52.199278 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 0d79ef93c5bf4ac9895e594198edb251 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d79ef93c5bf4ac9895e594198edb251 already in progress: creating tablet
W20260810 19:47:52.199520 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 11272d47d96f443187d63c184049871f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11272d47d96f443187d63c184049871f already in progress: creating tablet
W20260810 19:47:52.199762 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 5f560ed7ea0c4075bad1375d86738861 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f560ed7ea0c4075bad1375d86738861 already in progress: creating tablet
I20260810 19:47:52.200167 9407 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_a3d5e18125a047349dec5a6f6f3bde4d [id=f96d1bbf37954740825d721e6259ce3c] alter complete (version 3)
I20260810 19:47:52.200778 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f752dd58f7fe415f85280cbb9adb306c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:52.201419 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f752dd58f7fe415f85280cbb9adb306c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.201496 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_93675b8da3114fbe80cc09ae7bf427cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:52.202015 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_93675b8da3114fbe80cc09ae7bf427cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.202787 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 06af03c8a87141febef768bd56c72c39
I20260810 19:47:52.202879 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_149d216201e949b4b44a3449c2f444e1" } new_table_name: "default.Table_3e78e13c8ecc464eb6af12a2bc3f2eba" modify_external_catalogs: true
I20260810 19:47:52.203176 10377 rpcz_store.cc:276] 0810 19:47:50.541786 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.544317 (+ 2531us) service_pool.cc:224] Handling call
0810 19:47:52.181676 (+1637359us) ts_tablet_manager.cc:1151] Deleting tablet b9e761e94dbf4baba5e44a89b6c6a81c
0810 19:47:52.181687 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.181792 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1636992}
I20260810 19:47:52.203555 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_306e2618657d4c399188ca2985977672"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:52.204047 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_306e2618657d4c399188ca2985977672 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.205600 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_35f61a45f4824b3eb463bf86f3f9f4cc" } new_table_name: "default.Table_126ec28d33ff45b2833943e70c8ed968" modify_external_catalogs: true
W20260810 19:47:52.207024 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4e80e2327c394612bffc51f38798dac3 consensus state has no leader
I20260810 19:47:52.207512 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a3d5e18125a047349dec5a6f6f3bde4d" } new_table_name: "default.Table_fcc942a53d1b4c05a1a07df15f3d9230" modify_external_catalogs: true
I20260810 19:47:52.208346 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ffc2ac7c42234d82a51b4b9b4a17e41a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:52.208887 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ffc2ac7c42234d82a51b4b9b4a17e41a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:52.210253 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet b9e761e94dbf4baba5e44a89b6c6a81c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9e761e94dbf4baba5e44a89b6c6a81c already in progress: creating tablet
I20260810 19:47:52.213088 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet a78f955a3ca946189de7ea96baee35f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:52.215241 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 215) took 1636 ms. Trace:
I20260810 19:47:52.217877 10377 rpcz_store.cc:276] 0810 19:47:50.571066 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.572110 (+ 1044us) service_pool.cc:224] Handling call
0810 19:47:52.204607 (+1632497us) ts_tablet_manager.cc:1151] Deleting tablet ee65b2c9980d4c77af8c68bf2f5c5f92
0810 19:47:52.204764 (+ 157us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.207512 (+ 2748us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1632173}
I20260810 19:47:52.218454 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 216) took 1585 ms. Trace:
I20260810 19:47:52.220319 10377 rpcz_store.cc:276] 0810 19:47:50.632703 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.633551 (+ 848us) service_pool.cc:224] Handling call
0810 19:47:52.218233 (+1584682us) ts_tablet_manager.cc:1151] Deleting tablet e247ae3828e84092b836f3dd07b44bc6
0810 19:47:52.218246 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.218403 (+ 157us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1584400}
I20260810 19:47:52.220839 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 233) took 1254 ms. Trace:
W20260810 19:47:52.221531 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet ee65b2c9980d4c77af8c68bf2f5c5f92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee65b2c9980d4c77af8c68bf2f5c5f92 already in progress: creating tablet
I20260810 19:47:52.222712 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 651a1f5011de4db495dbbab2d19ff096 with delete_type TABLET_DATA_DELETED (replaced by tablet 02cd41da21364a868f5b6c980765d0cd) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:52.222838 9665 tablet_service.cc:1558] Processing DeleteTablet for tablet 09ab62f482b14cd4b86115e9a0423e7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:47 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:52.222920 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 06af03c8a87141febef768bd56c72c39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:52.223201 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet e177140cad404e978b927c810b87ae0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.223157 10377 rpcz_store.cc:276] 0810 19:47:50.966343 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.967016 (+ 673us) service_pool.cc:224] Handling call
0810 19:47:52.220649 (+1253633us) ts_tablet_manager.cc:1151] Deleting tablet 476e762e46c04ae6bfef5e14df2d16e2
0810 19:47:52.220661 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.220799 (+ 138us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1253415}
I20260810 19:47:52.223589 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 236) took 1256 ms. Trace:
I20260810 19:47:52.223943 10366 tablet_bootstrap.cc:654] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:52.226766 10377 rpcz_store.cc:276] 0810 19:47:50.966648 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.969592 (+ 2944us) service_pool.cc:224] Handling call
0810 19:47:52.223439 (+1253847us) ts_tablet_manager.cc:1151] Deleting tablet e959898b2c4c4173aea107d3f090ca07
0810 19:47:52.223449 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.223546 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1253607}
I20260810 19:47:52.226787 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 06af03c8a87141febef768bd56c72c39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.227224 9410 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 4d654dada92a4939914d26ab72a5f5e8 (table default.Table_dcf48c67df284776aca6205b880fbbc5 [id=a8bdf6ea608f4279971af4c9eff71db6]). Expected version 1 got 0
W20260810 19:47:52.227990 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet e247ae3828e84092b836f3dd07b44bc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e247ae3828e84092b836f3dd07b44bc6 already in progress: creating tablet
W20260810 19:47:52.228495 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 476e762e46c04ae6bfef5e14df2d16e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 476e762e46c04ae6bfef5e14df2d16e2 already in progress: creating tablet
I20260810 19:47:52.228457 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d533329b9e424fa0abce94bd85345b36" } new_table_name: "default.Table_688c01e53a344393b3471974bad3b972" modify_external_catalogs: true
I20260810 19:47:52.229278 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 06af03c8a87141febef768bd56c72c39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:47:52.230674 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet e959898b2c4c4173aea107d3f090ca07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e959898b2c4c4173aea107d3f090ca07 already in progress: creating tablet
I20260810 19:47:52.232544 10370 tablet_bootstrap.cc:492] T b9e761e94dbf4baba5e44a89b6c6a81c P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:52.232749 10370 ts_tablet_manager.cc:1403] T b9e761e94dbf4baba5e44a89b6c6a81c P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.118s user 0.001s sys 0.009s
I20260810 19:47:52.233706 10370 raft_consensus.cc:359] T b9e761e94dbf4baba5e44a89b6c6a81c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.233954 10370 raft_consensus.cc:385] T b9e761e94dbf4baba5e44a89b6c6a81c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:52.234043 10370 raft_consensus.cc:740] T b9e761e94dbf4baba5e44a89b6c6a81c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
W20260810 19:47:52.234723 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d77785d9bde843bc8366fe15d1b4fa18 consensus state has no leader
I20260810 19:47:52.235548 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cda6eb6d4b847edb2624a267bc3522d with delete_type TABLET_DATA_DELETED (replaced by tablet 3e8d34d723134d9289d96e633fed3fde) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.234397 10370 consensus_queue.cc:260] T b9e761e94dbf4baba5e44a89b6c6a81c P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.236290 10370 ts_tablet_manager.cc:1434] T b9e761e94dbf4baba5e44a89b6c6a81c P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 19:47:52.236455 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 58b33df59ffe49a9b07606b6dc9279eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.236698 10370 tablet_bootstrap.cc:492] T 38ee7973736c4a0a921261d37b74f290 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:52.238773 10370 tablet_bootstrap.cc:654] T 38ee7973736c4a0a921261d37b74f290 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:52.239970 10991 raft_consensus.cc:493] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:52.240120 10991 raft_consensus.cc:515] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.240985 10991 leader_election.cc:290] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:52.197022 10375 raft_consensus.cc:2272] T d15bcf97364046daa97f7461f4f6bc98 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:52.247689 10139 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f8bf9f998ad44df98239767d17e3486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:52.248492 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 2798f122e0624af6971fc8317244e5ae (DEFAULT_TABLE table=default.Table_fbf29712bafa4a6390afd942219d24fa [id=83524cb8be1d482695223aeaaa578a13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.249320 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet 58b33df59ffe49a9b07606b6dc9279eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:52.249416 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2798f122e0624af6971fc8317244e5ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.246603 10375 ts_tablet_manager.cc:1916] T d15bcf97364046daa97f7461f4f6bc98 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:52.260039 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 3582ed23ffdf4ff089952e29083e5425 (DEFAULT_TABLE table=default.Table_25921125d38844c9aa2816c5a6c395d1 [id=c72c64a09f73486abc4b2c6a72271d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.260632 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3582ed23ffdf4ff089952e29083e5425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.263794 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 232) took 1278 ms. Trace:
I20260810 19:47:52.265614 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 3582ed23ffdf4ff089952e29083e5425 (DEFAULT_TABLE table=default.Table_25921125d38844c9aa2816c5a6c395d1 [id=c72c64a09f73486abc4b2c6a72271d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.266378 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8bf9f998ad44df98239767d17e3486" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:52.266487 10377 rpcz_store.cc:276] 0810 19:47:50.966227 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.966911 (+ 684us) service_pool.cc:224] Handling call
0810 19:47:52.235609 (+1268698us) ts_tablet_manager.cc:1151] Deleting tablet 5d3598b5743244e39efd12703ec15aea
0810 19:47:52.238832 (+ 3223us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.244555 (+ 5723us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1261583}
I20260810 19:47:52.268283 10371 log.cc:1199] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/176d4e72b8e44e4b88bdf89d06f2f79a
W20260810 19:47:52.271554 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 648ef608fa0c45cc8be4bad80c4200be consensus state has no leader
I20260810 19:47:52.271741 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet a78f955a3ca946189de7ea96baee35f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:52.271818 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 5d3598b5743244e39efd12703ec15aea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d3598b5743244e39efd12703ec15aea already in progress: creating tablet
W20260810 19:47:52.272070 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 19e2bf7b7d254894a07c5a75bf24e742 has no consensus state
I20260810 19:47:52.272380 9716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8bf9f998ad44df98239767d17e3486" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:52.272897 9669 tablet_service.cc:1511] Processing CreateTablet for tablet a45add97e0e54dce85225e175ecbb45a (DEFAULT_TABLE table=default.Table_b42d252a590144aeb51d07c6d59bb5d1 [id=c580a677dcab41d9892011258d5993d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.273391 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a45add97e0e54dce85225e175ecbb45a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.273521 9905 tablet_service.cc:1511] Processing CreateTablet for tablet a45add97e0e54dce85225e175ecbb45a (DEFAULT_TABLE table=default.Table_b42d252a590144aeb51d07c6d59bb5d1 [id=c580a677dcab41d9892011258d5993d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.276077 9913 tablet_service.cc:1511] Processing CreateTablet for tablet b33aa8be266a434cba899da7514c47e9 (DEFAULT_TABLE table=default.Table_0445d007d0d8477dbd940cd0d2d99fe0 [id=4e38b3a52c3549889893d804ab0dfb89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.277544 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 2798f122e0624af6971fc8317244e5ae (DEFAULT_TABLE table=default.Table_fbf29712bafa4a6390afd942219d24fa [id=83524cb8be1d482695223aeaaa578a13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.279206 10371 ts_tablet_manager.cc:1950] T 176d4e72b8e44e4b88bdf89d06f2f79a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:52.280229 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 229) took 1402 ms. Trace:
I20260810 19:47:52.280369 10371 rpcz_store.cc:276] 0810 19:47:50.878136 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.880630 (+ 2494us) service_pool.cc:224] Handling call
0810 19:47:51.899154 (+1018524us) ts_tablet_manager.cc:1151] Deleting tablet 176d4e72b8e44e4b88bdf89d06f2f79a
0810 19:47:51.899168 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.075254 (+176086us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.134734 (+ 59480us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.280179 (+145445us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1001862}
I20260810 19:47:52.280625 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 234) took 1314 ms. Trace:
I20260810 19:47:52.280767 10371 tablet_replica.cc:333] T 2ddeefaa826b4033b2e79eff7240887f P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:52.280987 10371 raft_consensus.cc:2243] T 2ddeefaa826b4033b2e79eff7240887f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:52.281150 10371 raft_consensus.cc:2272] T 2ddeefaa826b4033b2e79eff7240887f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:52.281726 10371 ts_tablet_manager.cc:1916] T 2ddeefaa826b4033b2e79eff7240887f P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:52.286286 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 176d4e72b8e44e4b88bdf89d06f2f79a (table default.Table_03fbd70a4ed44530a3fab8f17c0769db [id=09fa54104d0f46dbb3f19138bfa2313d]) successfully deleted
I20260810 19:47:52.286736 9675 tablet_service.cc:1511] Processing CreateTablet for tablet b33aa8be266a434cba899da7514c47e9 (DEFAULT_TABLE table=default.Table_0445d007d0d8477dbd940cd0d2d99fe0 [id=4e38b3a52c3549889893d804ab0dfb89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.287339 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 3582ed23ffdf4ff089952e29083e5425 (DEFAULT_TABLE table=default.Table_25921125d38844c9aa2816c5a6c395d1 [id=c72c64a09f73486abc4b2c6a72271d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.287809 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33aa8be266a434cba899da7514c47e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.288683 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3582ed23ffdf4ff089952e29083e5425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.291066 10377 rpcz_store.cc:276] 0810 19:47:50.966471 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.967269 (+ 798us) service_pool.cc:224] Handling call
0810 19:47:52.266798 (+1299529us) ts_tablet_manager.cc:1151] Deleting tablet 965395b5072e4d47adac504e22a8d484
0810 19:47:52.277954 (+ 11156us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.280585 (+ 2631us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1292596}
I20260810 19:47:52.291631 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 231) took 1325 ms. Trace:
W20260810 19:47:52.293380 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 965395b5072e4d47adac504e22a8d484 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 965395b5072e4d47adac504e22a8d484 already in progress: creating tablet
I20260810 19:47:52.295159 10377 rpcz_store.cc:276] 0810 19:47:50.966106 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.984199 (+ 18093us) service_pool.cc:224] Handling call
0810 19:47:52.291452 (+1307253us) ts_tablet_manager.cc:1151] Deleting tablet 3f18c24b01384299a4f941d7fb840032
0810 19:47:52.291465 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.291591 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1306967}
I20260810 19:47:52.295575 10377 tablet_replica.cc:333] T 09ab62f482b14cd4b86115e9a0423e7c P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:52.298528 9899 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ca9d34cb609413d9df495bf191cc409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.298801 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3582ed23ffdf4ff089952e29083e5425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.303025 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_4b80408d9e4d4ae483aee8594c3ff194"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:52.303849 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b80408d9e4d4ae483aee8594c3ff194 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.304140 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a45add97e0e54dce85225e175ecbb45a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.304837 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33aa8be266a434cba899da7514c47e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.307474 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2798f122e0624af6971fc8317244e5ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.315354 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5e736aca6c8f40ca9bba22083b3622c1" } modify_external_catalogs: true
I20260810 19:47:52.315641 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5e736aca6c8f40ca9bba22083b3622c1" } modify_external_catalogs: true
I20260810 19:47:52.317162 10377 raft_consensus.cc:2243] T 09ab62f482b14cd4b86115e9a0423e7c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:52.317416 10377 raft_consensus.cc:2272] T 09ab62f482b14cd4b86115e9a0423e7c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:52.318028 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_074b525586d74c169b286124d5849cd2" } modify_external_catalogs: true
I20260810 19:47:52.318118 10377 ts_tablet_manager.cc:1916] T 09ab62f482b14cd4b86115e9a0423e7c P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:52.318272 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_074b525586d74c169b286124d5849cd2" } modify_external_catalogs: true
I20260810 19:47:52.325569 10371 ts_tablet_manager.cc:1929] T 2ddeefaa826b4033b2e79eff7240887f P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:52.328759 10371 log.cc:1199] T 2ddeefaa826b4033b2e79eff7240887f P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/2ddeefaa826b4033b2e79eff7240887f
I20260810 19:47:52.330452 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 4dba7046bdfd41f1a2ad6f299a723776
I20260810 19:47:52.331233 9420 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet f56bfcd363d44ba0aecea64148d1d65f
I20260810 19:47:52.332291 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet 4dba7046bdfd41f1a2ad6f299a723776 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:52.328354 11045 tablet.cc:1724] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
W20260810 19:47:52.333635 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 3f18c24b01384299a4f941d7fb840032 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f18c24b01384299a4f941d7fb840032 already in progress: creating tablet
I20260810 19:47:52.335464 10371 ts_tablet_manager.cc:1950] T 2ddeefaa826b4033b2e79eff7240887f P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:52.336495 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 231) took 1458 ms. Trace:
I20260810 19:47:52.342387 10371 rpcz_store.cc:276] 0810 19:47:50.878353 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.881072 (+ 2719us) service_pool.cc:224] Handling call
0810 19:47:52.280700 (+1399628us) ts_tablet_manager.cc:1151] Deleting tablet 2ddeefaa826b4033b2e79eff7240887f
0810 19:47:52.280712 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.312061 (+ 31349us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.325471 (+ 13410us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.336430 (+ 10959us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1382740}
I20260810 19:47:52.330513 10367 tablet_bootstrap.cc:492] T 58b33df59ffe49a9b07606b6dc9279eb P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:52.343528 10367 ts_tablet_manager.cc:1403] T 58b33df59ffe49a9b07606b6dc9279eb P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.202s user 0.004s sys 0.015s
I20260810 19:47:52.344545 10367 raft_consensus.cc:359] T 58b33df59ffe49a9b07606b6dc9279eb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:52.344892 10367 raft_consensus.cc:385] T 58b33df59ffe49a9b07606b6dc9279eb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:52.345026 10367 raft_consensus.cc:740] T 58b33df59ffe49a9b07606b6dc9279eb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:52.345894 10367 consensus_queue.cc:260] T 58b33df59ffe49a9b07606b6dc9279eb P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:52.334972 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_745ec8d1fd994242990bec7acd5bd9cd" } modify_external_catalogs: true
I20260810 19:47:52.352783 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_745ec8d1fd994242990bec7acd5bd9cd" } modify_external_catalogs: true
I20260810 19:47:52.335575 9420 master_service.cc:960] ReplaceTablet: received request to replace tablet a5625dc6303d44c6be28abd6278ce034 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:52.354132 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_257ddf6dffe443b7bb3a6d5e7f1e93a2" } modify_external_catalogs: true
I20260810 19:47:52.345508 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 233) took 1466 ms. Trace:
I20260810 19:47:52.354399 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_257ddf6dffe443b7bb3a6d5e7f1e93a2" } modify_external_catalogs: true
I20260810 19:47:52.354547 10371 rpcz_store.cc:276] 0810 19:47:50.878544 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.881860 (+ 3316us) service_pool.cc:224] Handling call
0810 19:47:52.345298 (+1463438us) ts_tablet_manager.cc:1151] Deleting tablet 3f18c24b01384299a4f941d7fb840032
0810 19:47:52.345312 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.345449 (+ 137us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1447085}
I20260810 19:47:52.355756 10367 ts_tablet_manager.cc:1434] T 58b33df59ffe49a9b07606b6dc9279eb P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260810 19:47:52.343139 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 2ddeefaa826b4033b2e79eff7240887f (table default.Table_2adfdcdb33f543d49ea6f361bf8a55c4 [id=cfd27e7efc8f4c529e7dace21742b656]) successfully deleted
W20260810 19:47:52.358600 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 3f18c24b01384299a4f941d7fb840032 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f18c24b01384299a4f941d7fb840032 already in progress: creating tablet
I20260810 19:47:52.359388 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet 58b33df59ffe49a9b07606b6dc9279eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:52.360091 10367 tablet_bootstrap.cc:492] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:52.363866 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 239) took 1380 ms. Trace:
I20260810 19:47:52.364143 10371 rpcz_store.cc:276] 0810 19:47:50.983012 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.983063 (+ 51us) service_pool.cc:224] Handling call
0810 19:47:52.356140 (+1373077us) ts_tablet_manager.cc:1151] Deleting tablet e959898b2c4c4173aea107d3f090ca07
0810 19:47:52.360389 (+ 4249us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.363796 (+ 3407us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1372836}
W20260810 19:47:52.365473 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet e959898b2c4c4173aea107d3f090ca07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e959898b2c4c4173aea107d3f090ca07 already in progress: creating tablet
I20260810 19:47:52.367416 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 4dba7046bdfd41f1a2ad6f299a723776 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.368196 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 839dcdb448d14a8f8e452145ccf41263
I20260810 19:47:52.368745 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 237) took 1386 ms. Trace:
I20260810 19:47:52.368853 10371 rpcz_store.cc:276] 0810 19:47:50.982289 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.982670 (+ 381us) service_pool.cc:224] Handling call
0810 19:47:52.368534 (+1385864us) ts_tablet_manager.cc:1151] Deleting tablet 965395b5072e4d47adac504e22a8d484
0810 19:47:52.368548 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.368678 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1366512}
I20260810 19:47:52.370074 10371 tablet_replica.cc:333] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:52.370174 9408 master_service.cc:960] ReplaceTablet: received request to replace tablet d2c77a8ac1614bb286e4e168bcf999f3 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:52.370927 10371 raft_consensus.cc:2243] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:52.371512 10371 pending_rounds.cc:70] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4: Trying to abort 1 pending ops.
I20260810 19:47:52.372015 10371 pending_rounds.cc:77] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058648071098368 op_type: NO_OP noop_request { }
I20260810 19:47:52.372427 10371 raft_consensus.cc:2889] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:52.372830 10371 raft_consensus.cc:2272] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:52.375751 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 00dabf43505f4fc89be39ee8fb41c7ee
I20260810 19:47:52.378062 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet a5625dc6303d44c6be28abd6278ce034
I20260810 19:47:52.378130 10371 ts_tablet_manager.cc:1916] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:52.378611 9420 catalog_manager.cc:6807] ReplaceTablet: tablet a5625dc6303d44c6be28abd6278ce034 deleted and replaced by tablet 64470598ccec45a7ae3e3c77fe4b9518
I20260810 19:47:52.381796 10377 ts_tablet_manager.cc:1929] T 09ab62f482b14cd4b86115e9a0423e7c P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:52.381979 10377 log.cc:1199] T 09ab62f482b14cd4b86115e9a0423e7c P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/09ab62f482b14cd4b86115e9a0423e7c
I20260810 19:47:52.382463 10932 raft_consensus.cc:493] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:52.382661 10932 raft_consensus.cc:515] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.383392 10932 leader_election.cc:290] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:52.384145 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet 839dcdb448d14a8f8e452145ccf41263 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:52.384157 9716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2931130e9354f16a238712234c19217" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
W20260810 19:47:52.385048 9831 leader_election.cc:343] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:52.386204 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet 00dabf43505f4fc89be39ee8fb41c7ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:52.387243 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet a5625dc6303d44c6be28abd6278ce034 with delete_type TABLET_DATA_DELETED (replaced by tablet 64470598ccec45a7ae3e3c77fe4b9518) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:52.388108 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 965395b5072e4d47adac504e22a8d484 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 965395b5072e4d47adac504e22a8d484 already in progress: creating tablet
I20260810 19:47:52.390007 10367 tablet_bootstrap.cc:654] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:52.391985 10371 ts_tablet_manager.cc:1929] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:52.392880 9413 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_fcc942a53d1b4c05a1a07df15f3d9230 [id=f96d1bbf37954740825d721e6259ce3c] alter complete (version 4)
I20260810 19:47:52.394579 10371 log.cc:1199] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/8851f5c0c2fd4600bb99793ddd151daa
I20260810 19:47:52.395506 10371 ts_tablet_manager.cc:1950] T 8851f5c0c2fd4600bb99793ddd151daa P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:52.397446 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet 839dcdb448d14a8f8e452145ccf41263 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.397817 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 00dabf43505f4fc89be39ee8fb41c7ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.399955 10367 tablet_bootstrap.cc:492] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:52.400141 10367 ts_tablet_manager.cc:1403] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.040s user 0.001s sys 0.003s
I20260810 19:47:52.400261 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet a5625dc6303d44c6be28abd6278ce034 with delete_type TABLET_DATA_DELETED (replaced by tablet 64470598ccec45a7ae3e3c77fe4b9518) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.401165 10367 raft_consensus.cc:359] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.401394 10367 raft_consensus.cc:385] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:52.401504 10367 raft_consensus.cc:740] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:52.401804 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 242) took 1345 ms. Trace:
I20260810 19:47:52.401912 10371 rpcz_store.cc:276] 0810 19:47:51.055548 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:51.059356 (+ 3808us) service_pool.cc:224] Handling call
0810 19:47:52.369970 (+1310614us) ts_tablet_manager.cc:1151] Deleting tablet 8851f5c0c2fd4600bb99793ddd151daa
0810 19:47:52.369982 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.385308 (+ 15326us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.391885 (+ 6577us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.400516 (+ 8631us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":631552,"tablet-delete.queue_time_us":1308164}
I20260810 19:47:52.402379 10371 tablet_replica.cc:333] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:52.402432 9687 tablet_service.cc:1511] Processing CreateTablet for tablet f3600d0528164850973cb296aaf6910f (DEFAULT_TABLE table=default.Table_a02900865d894a1dbfdb42b50ca8ebbf [id=d772b7f40fc3470ebbfe9442d8c44185]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.402607 10371 raft_consensus.cc:2243] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:52.402753 10932 raft_consensus.cc:493] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:52.402964 10932 raft_consensus.cc:515] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
W20260810 19:47:52.403458 10067 leader_election.cc:343] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:52.403755 10932 leader_election.cc:290] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:52.404103 10366 tablet_bootstrap.cc:492] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:52.404466 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3600d0528164850973cb296aaf6910f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.404464 10366 ts_tablet_manager.cc:1403] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.235s user 0.018s sys 0.005s
I20260810 19:47:52.405361 10366 raft_consensus.cc:359] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.405560 10366 raft_consensus.cc:385] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:52.405660 10366 raft_consensus.cc:740] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:52.405750 9716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651a1f5011de4db495dbbab2d19ff096" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:52.405951 9716 raft_consensus.cc:2468] T 651a1f5011de4db495dbbab2d19ff096 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:52.405951 10366 consensus_queue.cc:260] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.406493 9831 leader_election.cc:304] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:52.407666 10026 heartbeater.cc:344] Connected to a master server at 127.8.235.254:33891
I20260810 19:47:52.408085 10366 ts_tablet_manager.cc:1434] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 19:47:52.408442 10366 tablet_bootstrap.cc:492] T a01d3ec3c8914fe495f7a0f3c7c312f8 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:52.409065 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_066ecd6fc0e0441eb69e39d946ba0b9a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:52.409256 10932 raft_consensus.cc:2804] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:52.409368 10932 raft_consensus.cc:493] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:52.409488 10932 raft_consensus.cc:3060] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:47:52.409788 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_066ecd6fc0e0441eb69e39d946ba0b9a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.410569 10366 tablet_bootstrap.cc:654] T a01d3ec3c8914fe495f7a0f3c7c312f8 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:52.411298 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ca73e90d364f4ec7af078b3d97c7cdcb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:52.411907 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca73e90d364f4ec7af078b3d97c7cdcb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.412626 10164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2931130e9354f16a238712234c19217" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:52.412897 10164 raft_consensus.cc:2468] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:52.413200 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9ae3537027a04f86aa62a86f5668fe12" } modify_external_catalogs: true
I20260810 19:47:52.413431 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9ae3537027a04f86aa62a86f5668fe12" } modify_external_catalogs: true
W20260810 19:47:52.413506 10067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 136633us
I20260810 19:47:52.417110 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0504de5b8bb5437498dc4408394be292" } new_table_name: "default.Table_096d1b86a19247f2a9d62bdeeab9cbae" modify_external_catalogs: true
I20260810 19:47:52.418006 11050 tablet.cc:1724] T 668b3514d9f64d44a8747647194e50be P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260810 19:47:52.424413 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 9b40fd0d57ea4b71aeef2d66f4958ac8 (DEFAULT_TABLE table=default.Table_2b214fd57f394b5bae33becc3b1439b3 [id=27df62a1199844dd88c52fdd4757529c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.424613 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet b9e761e94dbf4baba5e44a89b6c6a81c with delete_type TABLET_DATA_DELETED (replaced by tablet a78960e1f2164c848297411b9273ac64) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.424510 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_dca6b457fbf744e089c4a583fca06cbb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:52.424985 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 8851f5c0c2fd4600bb99793ddd151daa (table default.Table_feeb41d918e24137a0d1da856cfd8e8d [id=503738899b2347aaae2c2645ce8a930d]) successfully deleted
W20260810 19:47:52.425194 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dca6b457fbf744e089c4a583fca06cbb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.425835 10139 tablet_service.cc:1511] Processing CreateTablet for tablet a45add97e0e54dce85225e175ecbb45a (DEFAULT_TABLE table=default.Table_b42d252a590144aeb51d07c6d59bb5d1 [id=c580a677dcab41d9892011258d5993d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.426245 10932 raft_consensus.cc:515] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:52.426585 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_05b1dcc5bf9f412c87505d19c57d7025"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:52.427134 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_05b1dcc5bf9f412c87505d19c57d7025 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.428426 10991 raft_consensus.cc:493] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:52.428785 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 896b7cfdb0ca4904aaeafa13ff19365e (DEFAULT_TABLE table=default.Table_9ae3537027a04f86aa62a86f5668fe12 [id=376702dd80dd4e91b7e35a056f4ec452]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.430992 10366 tablet_bootstrap.cc:492] T a01d3ec3c8914fe495f7a0f3c7c312f8 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:52.432168 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 896b7cfdb0ca4904aaeafa13ff19365e
I20260810 19:47:52.432531 10366 ts_tablet_manager.cc:1403] T a01d3ec3c8914fe495f7a0f3c7c312f8 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.005s
I20260810 19:47:52.433621 10366 raft_consensus.cc:359] T a01d3ec3c8914fe495f7a0f3c7c312f8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:52.434928 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c40a1108d8db42fbb86c29960d1b3c25 has no consensus state
I20260810 19:47:52.427322 9908 tablet_service.cc:1511] Processing CreateTablet for tablet f3600d0528164850973cb296aaf6910f (DEFAULT_TABLE table=default.Table_a02900865d894a1dbfdb42b50ca8ebbf [id=d772b7f40fc3470ebbfe9442d8c44185]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.434119 10377 ts_tablet_manager.cc:1950] T 09ab62f482b14cd4b86115e9a0423e7c P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:52.426854 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 9b40fd0d57ea4b71aeef2d66f4958ac8 (DEFAULT_TABLE table=default.Table_2b214fd57f394b5bae33becc3b1439b3 [id=27df62a1199844dd88c52fdd4757529c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.441012 10991 raft_consensus.cc:515] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.441820 10991 leader_election.cc:290] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:52.441888 10367 consensus_queue.cc:260] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.442615 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_987f321d06054ef782d6aa76b7be0ae9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:52.443059 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c77252f5f6754251a8007baa5906cd60" } new_table_name: "default.Table_cc256890a9a1416588021bfab5b9ee71" modify_external_catalogs: true
W20260810 19:47:52.443245 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_987f321d06054ef782d6aa76b7be0ae9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.444334 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 4dba7046bdfd41f1a2ad6f299a723776 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:52.444543 10911 raft_consensus.cc:493] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 19:47:52.444727 10068 leader_election.cc:343] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:52.445091 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b642b3781fac4911b6fb2a9f00b29352"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:52.445254 10911 raft_consensus.cc:515] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
W20260810 19:47:52.445645 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b642b3781fac4911b6fb2a9f00b29352 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.445916 10911 leader_election.cc:290] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:52.446046 10140 tablet_service.cc:1511] Processing CreateTablet for tablet b33aa8be266a434cba899da7514c47e9 (DEFAULT_TABLE table=default.Table_0445d007d0d8477dbd940cd0d2d99fe0 [id=4e38b3a52c3549889893d804ab0dfb89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.446545 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 839dcdb448d14a8f8e452145ccf41263 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:52.446940 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_700bae09815f40a1a543173e1188670f" } new_table_name: "default.Table_9fc2f929c6aa4ff286e66b35f18da641" modify_external_catalogs: true
I20260810 19:47:52.447549 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_004470a924c946e2bf1d76b810f6ef8a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:52.448149 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_004470a924c946e2bf1d76b810f6ef8a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.449115 9673 tablet_service.cc:1558] Processing DeleteTablet for tablet 896b7cfdb0ca4904aaeafa13ff19365e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:52.449748 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba42032e7344423a0e86c55d613f27d (DEFAULT_TABLE table=default.Table_e104dc1ca7624bcaad9a86a8854217e5 [id=0bbc6397fe1b49cb894bb0e50af006fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.449918 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 648ef608fa0c45cc8be4bad80c4200be (DEFAULT_TABLE table=default.Table_126ec28d33ff45b2833943e70c8ed968 [id=d921f4a824ae4dd6b0b9dbb8310ff00a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.450433 9665 tablet_service.cc:1511] Processing CreateTablet for tablet 839dcdb448d14a8f8e452145ccf41263 (DEFAULT_TABLE table=default.Table_745ec8d1fd994242990bec7acd5bd9cd [id=435f41d3a7ba4f03a738cdb2272f759e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.448915 10367 ts_tablet_manager.cc:1434] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.049s user 0.003s sys 0.000s
I20260810 19:47:52.451716 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 00dabf43505f4fc89be39ee8fb41c7ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:52.451948 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 0e967384768b4ec7956f1b508e8ab2af (DEFAULT_TABLE table=default.Table_5043edeafbb047c6a7619f91323879c2 [id=6287581e5dad45b4b7fd481e9ae5eae3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.452440 10371 raft_consensus.cc:2272] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:52.453511 10371 ts_tablet_manager.cc:1916] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:52.454860 10068 leader_election.cc:304] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:52.454986 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 4c75af1e592042f5a4d442b82a539c94 (DEFAULT_TABLE table=default.Table_b15ce9ec2404408f8f8e74743a8cce0d [id=d26dfd722c9448a0a299198ccf217edc]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:52.455283 10068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 57947.8us
W20260810 19:47:52.458303 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e861473094f42dfa22b9c00145ed1fe has no consensus state
I20260810 19:47:52.458659 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651a1f5011de4db495dbbab2d19ff096" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:52.458877 10165 raft_consensus.cc:3060] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:52.461824 10165 raft_consensus.cc:2468] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:52.462360 10371 ts_tablet_manager.cc:1929] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:52.462621 10371 log.cc:1199] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/0efa6f35ed284933b9fc53c1cb32da82
I20260810 19:47:52.463016 9667 tablet_service.cc:1511] Processing CreateTablet for tablet e68916e2568f4527a181342cdc728001 (DEFAULT_TABLE table=default.Table_e2e810e459f24d0b9d348d428782a761 [id=3babf53bc29e4d4f9be8b2c19be6e2bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.463259 10371 ts_tablet_manager.cc:1950] T 0efa6f35ed284933b9fc53c1cb32da82 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:52.463995 10164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651a1f5011de4db495dbbab2d19ff096" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:52.464236 10164 raft_consensus.cc:2376] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1. Re-sending same reply.
W20260810 19:47:52.464790 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8455cb11388340beb6daa13fee06177a consensus state has no leader
I20260810 19:47:52.465773 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b33df59ffe49a9b07606b6dc9279eb" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:52.465868 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d654dada92a4939914d26ab72a5f5e8" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:52.466063 9717 raft_consensus.cc:2468] T 58b33df59ffe49a9b07606b6dc9279eb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:47:52.466217 9716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651a1f5011de4db495dbbab2d19ff096" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:52.466619 9716 raft_consensus.cc:3060] T 651a1f5011de4db495dbbab2d19ff096 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:52.468922 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b40fd0d57ea4b71aeef2d66f4958ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.469981 9716 raft_consensus.cc:2468] T 651a1f5011de4db495dbbab2d19ff096 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:52.472539 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a45add97e0e54dce85225e175ecbb45a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.472797 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet a5625dc6303d44c6be28abd6278ce034 with delete_type TABLET_DATA_DELETED (replaced by tablet 64470598ccec45a7ae3e3c77fe4b9518) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:52.475216 10366 raft_consensus.cc:385] T a01d3ec3c8914fe495f7a0f3c7c312f8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:52.475368 10366 raft_consensus.cc:740] T a01d3ec3c8914fe495f7a0f3c7c312f8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:52.475327 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ac3fc982487f4b0da46ba2d2fbf03f63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:52.476049 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac3fc982487f4b0da46ba2d2fbf03f63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.477856 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3dcb85babc4642ca90ab01191504bc0f" } new_table_name: "default.Table_a1b1eb3faa4746e7835c3e64900c3a00" modify_external_catalogs: true
I20260810 19:47:52.478756 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 648ef608fa0c45cc8be4bad80c4200be (DEFAULT_TABLE table=default.Table_126ec28d33ff45b2833943e70c8ed968 [id=d921f4a824ae4dd6b0b9dbb8310ff00a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.480634 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_82e33c23f0d84cbc9203727b5216d5b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:52.481155 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 0e967384768b4ec7956f1b508e8ab2af (DEFAULT_TABLE table=default.Table_5043edeafbb047c6a7619f91323879c2 [id=6287581e5dad45b4b7fd481e9ae5eae3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:52.481264 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82e33c23f0d84cbc9203727b5216d5b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.482395 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 4c75af1e592042f5a4d442b82a539c94 (DEFAULT_TABLE table=default.Table_b15ce9ec2404408f8f8e74743a8cce0d [id=d26dfd722c9448a0a299198ccf217edc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.483891 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ffc2ac7c42234d82a51b4b9b4a17e41a" } new_table_name: "default.Table_3169e1b140894b6cb7c9b922101b6909" modify_external_catalogs: true
I20260810 19:47:52.484325 10366 consensus_queue.cc:260] T a01d3ec3c8914fe495f7a0f3c7c312f8 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.485754 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3600d0528164850973cb296aaf6910f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.487303 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 238) took 1385 ms. Trace:
I20260810 19:47:52.487394 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b33df59ffe49a9b07606b6dc9279eb" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:52.487435 10377 rpcz_store.cc:276] 0810 19:47:51.057390 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:51.061447 (+ 4057us) service_pool.cc:224] Handling call
0810 19:47:52.295502 (+1234055us) ts_tablet_manager.cc:1151] Deleting tablet 09ab62f482b14cd4b86115e9a0423e7c
0810 19:47:52.295515 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.378499 (+ 82984us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.381692 (+ 3193us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.443026 (+ 61334us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1198640}
I20260810 19:47:52.488392 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 896b7cfdb0ca4904aaeafa13ff19365e (DEFAULT_TABLE table=default.Table_9ae3537027a04f86aa62a86f5668fe12 [id=376702dd80dd4e91b7e35a056f4ec452]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.488803 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 648ef608fa0c45cc8be4bad80c4200be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.489068 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839dcdb448d14a8f8e452145ccf41263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.489421 9948 raft_consensus.cc:2468] T 58b33df59ffe49a9b07606b6dc9279eb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:47:52.489370 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba42032e7344423a0e86c55d613f27d (DEFAULT_TABLE table=default.Table_e104dc1ca7624bcaad9a86a8854217e5 [id=0bbc6397fe1b49cb894bb0e50af006fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.489764 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet 896b7cfdb0ca4904aaeafa13ff19365e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.490609 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d654dada92a4939914d26ab72a5f5e8" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:52.490837 9944 raft_consensus.cc:2468] T 4d654dada92a4939914d26ab72a5f5e8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:47:52.491164 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 896b7cfdb0ca4904aaeafa13ff19365e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.492691 10377 tablet_replica.cc:333] T 0efa6f35ed284933b9fc53c1cb32da82 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:52.492908 10377 raft_consensus.cc:2243] T 0efa6f35ed284933b9fc53c1cb32da82 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:52.493148 10377 raft_consensus.cc:2272] T 0efa6f35ed284933b9fc53c1cb32da82 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:52.494642 9831 leader_election.cc:304] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:52.497004 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 896b7cfdb0ca4904aaeafa13ff19365e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.501034 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba42032e7344423a0e86c55d613f27d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.502424 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e967384768b4ec7956f1b508e8ab2af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.503386 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e68916e2568f4527a181342cdc728001. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.503651 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c75af1e592042f5a4d442b82a539c94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.507702 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 0e967384768b4ec7956f1b508e8ab2af (DEFAULT_TABLE table=default.Table_5043edeafbb047c6a7619f91323879c2 [id=6287581e5dad45b4b7fd481e9ae5eae3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.508440 10932 leader_election.cc:290] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:52.508807 10932 raft_consensus.cc:2804] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
W20260810 19:47:52.510170 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4b2b0f2fc93647f3bc1d79b4132c3703 consensus state has no leader
W20260810 19:47:52.510774 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 81aabb5656e7472f9223fd7acf10e43c has no consensus state
I20260810 19:47:52.512364 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba42032e7344423a0e86c55d613f27d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.512542 9911 tablet_service.cc:1511] Processing CreateTablet for tablet 839dcdb448d14a8f8e452145ccf41263 (DEFAULT_TABLE table=default.Table_745ec8d1fd994242990bec7acd5bd9cd [id=435f41d3a7ba4f03a738cdb2272f759e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.513161 10367 tablet_bootstrap.cc:492] T 4d654dada92a4939914d26ab72a5f5e8 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:52.513567 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e967384768b4ec7956f1b508e8ab2af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.515118 9830 leader_election.cc:304] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:52.516094 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 09ab62f482b14cd4b86115e9a0423e7c (table default.Table_5af45f52e4024048836c48234ef3a903 [id=4fda913821434991b62c8de128735a25]) successfully deleted
I20260810 19:47:52.517053 10936 raft_consensus.cc:493] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:52.517275 10936 raft_consensus.cc:515] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.518047 10936 leader_election.cc:290] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:52.521055 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 4c75af1e592042f5a4d442b82a539c94 (DEFAULT_TABLE table=default.Table_b15ce9ec2404408f8f8e74743a8cce0d [id=d26dfd722c9448a0a299198ccf217edc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.521606 9899 tablet_service.cc:1511] Processing CreateTablet for tablet e68916e2568f4527a181342cdc728001 (DEFAULT_TABLE table=default.Table_e2e810e459f24d0b9d348d428782a761 [id=3babf53bc29e4d4f9be8b2c19be6e2bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.522030 10932 raft_consensus.cc:697] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:47:52.522711 10932 consensus_queue.cc:237] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:52.525864 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_aa5df7d93dfb4603b493ab5638468a59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:52.526621 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa5df7d93dfb4603b493ab5638468a59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.528635 10377 ts_tablet_manager.cc:1916] T 0efa6f35ed284933b9fc53c1cb32da82 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:52.530143 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 648ef608fa0c45cc8be4bad80c4200be (DEFAULT_TABLE table=default.Table_126ec28d33ff45b2833943e70c8ed968 [id=d921f4a824ae4dd6b0b9dbb8310ff00a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.533015 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b642b3781fac4911b6fb2a9f00b29352" } modify_external_catalogs: true
I20260810 19:47:52.533233 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b642b3781fac4911b6fb2a9f00b29352" } modify_external_catalogs: true
I20260810 19:47:52.536533 11065 raft_consensus.cc:493] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:52.537436 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f1a090bd6e0042b58f8b6f478fc4fb11" } modify_external_catalogs: true
I20260810 19:47:52.537683 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f1a090bd6e0042b58f8b6f478fc4fb11" } modify_external_catalogs: true
I20260810 19:47:52.538220 10067 leader_election.cc:304] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:52.543735 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 243) took 1432 ms. Trace:
I20260810 19:47:52.544759 10371 rpcz_store.cc:276] 0810 19:47:51.056683 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:51.066956 (+ 10273us) service_pool.cc:224] Handling call
0810 19:47:52.402257 (+1335301us) ts_tablet_manager.cc:1151] Deleting tablet 0efa6f35ed284933b9fc53c1cb32da82
0810 19:47:52.402269 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.458982 (+ 56713us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.462153 (+ 3171us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.488454 (+ 26301us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1334464}
I20260810 19:47:52.544440 11065 raft_consensus.cc:515] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.545414 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 245) took 1410 ms. Trace:
I20260810 19:47:52.545938 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 0efa6f35ed284933b9fc53c1cb32da82 (table default.Table_133f8005d08641b68da5bb9faa1e2d7b [id=e8a45897ddcf4bd2a31db1b1d8f6ee12]) successfully deleted
I20260810 19:47:52.546218 11065 leader_election.cc:290] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:52.546525 11065 raft_consensus.cc:2804] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:52.546710 10371 rpcz_store.cc:276] 0810 19:47:51.134973 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:51.206614 (+ 71641us) service_pool.cc:224] Handling call
0810 19:47:52.545164 (+1338550us) ts_tablet_manager.cc:1151] Deleting tablet d2c77a8ac1614bb286e4e168bcf999f3
0810 19:47:52.545178 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.545359 (+ 181us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1281941}
I20260810 19:47:52.547140 11065 raft_consensus.cc:493] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:52.547258 11065 raft_consensus.cc:3060] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:52.548245 9420 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet b268021596554822a90bb8fc22ea03e1
W20260810 19:47:52.548552 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet d2c77a8ac1614bb286e4e168bcf999f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2c77a8ac1614bb286e4e168bcf999f3 already in progress: creating tablet
W20260810 19:47:52.548862 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 3c828ae089774fb9b0582141f4b99313 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c828ae089774fb9b0582141f4b99313 already in progress: creating tablet
I20260810 19:47:52.548991 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839dcdb448d14a8f8e452145ccf41263. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:52.549118 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet dd632a01fe424a3a956d445ce01e31d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dd632a01fe424a3a956d445ce01e31d2 already in progress: creating tablet
W20260810 19:47:52.549363 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 7737acd216204209ba0327e26e85cfe6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7737acd216204209ba0327e26e85cfe6 already in progress: creating tablet
W20260810 19:47:52.549612 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet c8602b7360b747a3af756b139635d95c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c8602b7360b747a3af756b139635d95c already in progress: creating tablet
I20260810 19:47:52.555310 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 63486cc3f8774a11827b1cc5f1c16332
I20260810 19:47:52.555699 10911 raft_consensus.cc:2749] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:47:52.556032 10068 leader_election.cc:343] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:52.556211 10068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 82781.3us
I20260810 19:47:52.557828 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b40fd0d57ea4b71aeef2d66f4958ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.558725 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33aa8be266a434cba899da7514c47e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.561386 9716 raft_consensus.cc:3060] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:47:52.561484 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 08e29e23d54f47968a06be98b313918d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08e29e23d54f47968a06be98b313918d already in progress: creating tablet
I20260810 19:47:52.567056 10371 tablet_replica.cc:333] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:52.568753 10371 raft_consensus.cc:2243] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:52.569105 10371 pending_rounds.cc:70] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4: Trying to abort 1 pending ops.
I20260810 19:47:52.571229 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_511b7773a9034830ad84841ad4c71063" } modify_external_catalogs: true
I20260810 19:47:52.571488 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_511b7773a9034830ad84841ad4c71063" } modify_external_catalogs: true
I20260810 19:47:52.572052 10371 pending_rounds.cc:77] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058649134645248 op_type: NO_OP noop_request { }
I20260810 19:47:52.572238 10371 raft_consensus.cc:2889] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:52.572697 10371 raft_consensus.cc:2272] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:52.575117 10144 tablet_service.cc:1511] Processing CreateTablet for tablet f3600d0528164850973cb296aaf6910f (DEFAULT_TABLE table=default.Table_a02900865d894a1dbfdb42b50ca8ebbf [id=d772b7f40fc3470ebbfe9442d8c44185]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.576383 10371 ts_tablet_manager.cc:1916] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:52.577132 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 896b7cfdb0ca4904aaeafa13ff19365e (DEFAULT_TABLE table=default.Table_9ae3537027a04f86aa62a86f5668fe12 [id=376702dd80dd4e91b7e35a056f4ec452]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.578158 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c75af1e592042f5a4d442b82a539c94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.578943 10370 tablet_bootstrap.cc:492] T 38ee7973736c4a0a921261d37b74f290 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:52.580466 10366 ts_tablet_manager.cc:1434] T a01d3ec3c8914fe495f7a0f3c7c312f8 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.129s user 0.002s sys 0.007s
I20260810 19:47:52.582307 9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e68916e2568f4527a181342cdc728001. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.583148 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7b492dac7ea64246abf9488fd4dbc8b1" } modify_external_catalogs: true
I20260810 19:47:52.583410 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7b492dac7ea64246abf9488fd4dbc8b1" } modify_external_catalogs: true
I20260810 19:47:52.590952 10366 tablet_bootstrap.cc:492] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:52.592819 10370 ts_tablet_manager.cc:1403] T 38ee7973736c4a0a921261d37b74f290 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.345s user 0.050s sys 0.050s
I20260810 19:47:52.592938 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba42032e7344423a0e86c55d613f27d (DEFAULT_TABLE table=default.Table_e104dc1ca7624bcaad9a86a8854217e5 [id=0bbc6397fe1b49cb894bb0e50af006fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.578056 11065 raft_consensus.cc:515] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.594947 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 9b40fd0d57ea4b71aeef2d66f4958ac8 (DEFAULT_TABLE table=default.Table_2b214fd57f394b5bae33becc3b1439b3 [id=27df62a1199844dd88c52fdd4757529c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.595448 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 839dcdb448d14a8f8e452145ccf41263 (DEFAULT_TABLE table=default.Table_745ec8d1fd994242990bec7acd5bd9cd [id=435f41d3a7ba4f03a738cdb2272f759e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.595803 9673 tablet_service.cc:1511] Processing CreateTablet for tablet a78960e1f2164c848297411b9273ac64 (DEFAULT_TABLE table=default.Table_3ffc95fe00014a0b8398de5aced22f11 [id=d277a804313e4f35a31b58d4f682efe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.595841 10135 tablet_service.cc:1511] Processing CreateTablet for tablet e68916e2568f4527a181342cdc728001 (DEFAULT_TABLE table=default.Table_e2e810e459f24d0b9d348d428782a761 [id=3babf53bc29e4d4f9be8b2c19be6e2bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.596028 10367 tablet_bootstrap.cc:654] T 4d654dada92a4939914d26ab72a5f5e8 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:52.596226 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet 896b7cfdb0ca4904aaeafa13ff19365e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:52.597875 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 15c070c23de34348ad3426c894e11022
I20260810 19:47:52.598009 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 15c070c23de34348ad3426c894e11022 (DEFAULT_TABLE table=default.Table_511b7773a9034830ad84841ad4c71063 [id=b69a88eb84db49daa3c6a51ca2c6e4d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.598562 10936 raft_consensus.cc:493] T a78f955a3ca946189de7ea96baee35f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:52.598802 10936 raft_consensus.cc:515] T a78f955a3ca946189de7ea96baee35f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:52.599539 10936 leader_election.cc:290] T a78f955a3ca946189de7ea96baee35f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:52.600247 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 63486cc3f8774a11827b1cc5f1c16332 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:52.601157 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 15c070c23de34348ad3426c894e11022 (DEFAULT_TABLE table=default.Table_511b7773a9034830ad84841ad4c71063 [id=b69a88eb84db49daa3c6a51ca2c6e4d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.601853 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 15c070c23de34348ad3426c894e11022 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.602048 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 63486cc3f8774a11827b1cc5f1c16332 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.602893 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 648ef608fa0c45cc8be4bad80c4200be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.603080 10371 ts_tablet_manager.cc:1929] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:52.603211 10371 log.cc:1199] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/a9e42e13617c4457ba88ae0e0269ec93
I20260810 19:47:52.603709 10371 ts_tablet_manager.cc:1950] T a9e42e13617c4457ba88ae0e0269ec93 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:52.604594 11065 leader_election.cc:290] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:52.605091 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet a9e42e13617c4457ba88ae0e0269ec93 (table default.Table_ebe965457d0c46a39803fb5155a0bc0c [id=11015256d39042599eae0f05e96dca2d]) successfully deleted
W20260810 19:47:52.605422 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 3916a976efef43428942135e777edcec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3916a976efef43428942135e777edcec already in progress: creating tablet
I20260810 19:47:52.605396 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78f955a3ca946189de7ea96baee35f6" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:52.605824 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 15c070c23de34348ad3426c894e11022 (DEFAULT_TABLE table=default.Table_511b7773a9034830ad84841ad4c71063 [id=b69a88eb84db49daa3c6a51ca2c6e4d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.606415 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 15c070c23de34348ad3426c894e11022 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:52.603209 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15c070c23de34348ad3426c894e11022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.607105 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78960e1f2164c848297411b9273ac64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.607537 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15c070c23de34348ad3426c894e11022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.602837 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca9d34cb609413d9df495bf191cc409" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:52.610373 10367 tablet_bootstrap.cc:492] T 4d654dada92a4939914d26ab72a5f5e8 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:52.611308 10367 ts_tablet_manager.cc:1403] T 4d654dada92a4939914d26ab72a5f5e8 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.098s user 0.004s sys 0.001s
I20260810 19:47:52.612135 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c75af1e592042f5a4d442b82a539c94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.612859 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 896b7cfdb0ca4904aaeafa13ff19365e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.612802 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 39885c3e0adb4132945d507628f4f082 (DEFAULT_TABLE table=default.Table_2502bd78450e4b1b940e7f64a514dc85 [id=76cdf98e49ae4acb8b64ca07d0e28e8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.613284 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39885c3e0adb4132945d507628f4f082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.616160 10367 raft_consensus.cc:359] T 4d654dada92a4939914d26ab72a5f5e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.617319 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e68916e2568f4527a181342cdc728001. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:52.617769 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet a01d3ec3c8914fe495f7a0f3c7c312f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a01d3ec3c8914fe495f7a0f3c7c312f8 already in progress: creating tablet
I20260810 19:47:52.618651 10911 consensus_queue.cc:1048] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260810 19:47:52.619279 10367 raft_consensus.cc:385] T 4d654dada92a4939914d26ab72a5f5e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:52.619395 10367 raft_consensus.cc:740] T 4d654dada92a4939914d26ab72a5f5e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:52.619696 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15c070c23de34348ad3426c894e11022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.619922 10367 consensus_queue.cc:260] T 4d654dada92a4939914d26ab72a5f5e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.620658 10367 ts_tablet_manager.cc:1434] T 4d654dada92a4939914d26ab72a5f5e8 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260810 19:47:52.621542 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 639c824ba4834734a4ebfd558181bebe (DEFAULT_TABLE table=default.Table_35ada13f5f5a41b0a93a57276b7756d9 [id=fa3844f34a5b4d55b6e87ec2164eb8fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.621850 10367 tablet_bootstrap.cc:492] T 38ee7973736c4a0a921261d37b74f290 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:52.622394 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2931130e9354f16a238712234c19217" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:52.622658 10167 raft_consensus.cc:2468] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:52.623682 9902 tablet_service.cc:1511] Processing CreateTablet for tablet a78960e1f2164c848297411b9273ac64 (DEFAULT_TABLE table=default.Table_3ffc95fe00014a0b8398de5aced22f11 [id=d277a804313e4f35a31b58d4f682efe6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:52.623957 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet f3600d0528164850973cb296aaf6910f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3600d0528164850973cb296aaf6910f already in progress: creating tablet
I20260810 19:47:52.624351 10991 raft_consensus.cc:2804] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:52.624969 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 63486cc3f8774a11827b1cc5f1c16332 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:52.626420 10120 tablet_service.cc:1511] Processing CreateTablet for tablet a78960e1f2164c848297411b9273ac64 (DEFAULT_TABLE table=default.Table_3ffc95fe00014a0b8398de5aced22f11 [id=d277a804313e4f35a31b58d4f682efe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.627116 10142 tablet_service.cc:1558] Processing DeleteTablet for tablet 15c070c23de34348ad3426c894e11022 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:52.627413 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839dcdb448d14a8f8e452145ccf41263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.627125 10991 raft_consensus.cc:493] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:52.630148 10067 leader_election.cc:304] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:47:52.630808 10067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 92153.2us
I20260810 19:47:52.631471 10367 tablet_bootstrap.cc:654] T 38ee7973736c4a0a921261d37b74f290 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:52.631762 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 639c824ba4834734a4ebfd558181bebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.631908 10371 tablet_replica.cc:333] T c1777a713b1d4a58919b5f6abe779ab8 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:52.634749 10911 raft_consensus.cc:2804] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:52.634866 10371 raft_consensus.cc:2243] T c1777a713b1d4a58919b5f6abe779ab8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:52.635605 10371 raft_consensus.cc:2272] T c1777a713b1d4a58919b5f6abe779ab8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:52.636003 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78960e1f2164c848297411b9273ac64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.636963 10371 ts_tablet_manager.cc:1916] T c1777a713b1d4a58919b5f6abe779ab8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:52.636032 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 39885c3e0adb4132945d507628f4f082 (DEFAULT_TABLE table=default.Table_2502bd78450e4b1b940e7f64a514dc85 [id=76cdf98e49ae4acb8b64ca07d0e28e8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.642197 10991 raft_consensus.cc:3060] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:52.643402 10911 raft_consensus.cc:493] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:52.644143 10911 raft_consensus.cc:3060] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:52.645681 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 639c824ba4834734a4ebfd558181bebe (DEFAULT_TABLE table=default.Table_35ada13f5f5a41b0a93a57276b7756d9 [id=fa3844f34a5b4d55b6e87ec2164eb8fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.645946 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39885c3e0adb4132945d507628f4f082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.648764 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 39885c3e0adb4132945d507628f4f082 (DEFAULT_TABLE table=default.Table_2502bd78450e4b1b940e7f64a514dc85 [id=76cdf98e49ae4acb8b64ca07d0e28e8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:52.650123 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba42032e7344423a0e86c55d613f27d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.651050 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78960e1f2164c848297411b9273ac64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.655344 9408 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 4d654dada92a4939914d26ab72a5f5e8 (table default.Table_dcf48c67df284776aca6205b880fbbc5 [id=a8bdf6ea608f4279971af4c9eff71db6]). Expected version 1 got 0
I20260810 19:47:52.656291 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_fd780002767d47fc96de44759973f50c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:52.656440 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_aa1552151467479ba8b4a8d5b1f70122" } new_table_name: "default.Table_07cbcdfa939f47f0a8f10f834f5ce596" modify_external_catalogs: true
W20260810 19:47:52.656948 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd780002767d47fc96de44759973f50c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.658676 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_128b093f25d14ca588d1d03d416825fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:52.659246 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ebe965457d0c46a39803fb5155a0bc0c" } modify_external_catalogs: true
I20260810 19:47:52.659436 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ebe965457d0c46a39803fb5155a0bc0c" } modify_external_catalogs: true
I20260810 19:47:52.658172 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_32e6a45ca640436c8efef8fa31883db9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:52.663812 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39885c3e0adb4132945d507628f4f082. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:52.663888 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32e6a45ca640436c8efef8fa31883db9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:52.666095 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_128b093f25d14ca588d1d03d416825fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.670370 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet d99b34f901484fad87cff4bb9ab56fc8
I20260810 19:47:52.672204 10366 tablet_bootstrap.cc:654] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:52.674098 10936 raft_consensus.cc:493] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:52.674300 10936 raft_consensus.cc:515] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:52.675099 10936 leader_election.cc:290] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:52.675642 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_415aa3ad1eca4143b9477218fbc49d30"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:52.675899 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5ae50e2c32d5407aae2976de4f6ce97b" } new_table_name: "default.Table_9d569d756be84460b1b78812a13b95ad" modify_external_catalogs: true
I20260810 19:47:52.676000 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet d99b34f901484fad87cff4bb9ab56fc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:52.676386 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_415aa3ad1eca4143b9477218fbc49d30 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.676419 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 639c824ba4834734a4ebfd558181bebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.675669 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_422e53637be84964a1cd4bb082fec236"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:52.677150 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_422e53637be84964a1cd4bb082fec236 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.680648 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_49451bd4c68e46ccaf8bf19169c14fd8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:52.681169 9408 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 4d654dada92a4939914d26ab72a5f5e8 (table default.Table_dcf48c67df284776aca6205b880fbbc5 [id=a8bdf6ea608f4279971af4c9eff71db6]). Expected version 1 got 0
W20260810 19:47:52.682889 9831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 209693us
W20260810 19:47:52.683844 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49451bd4c68e46ccaf8bf19169c14fd8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.684985 11071 tablet.cc:1724] T 668b3514d9f64d44a8747647194e50be P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260810 19:47:52.685143 10371 ts_tablet_manager.cc:1929] T c1777a713b1d4a58919b5f6abe779ab8 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:52.685313 10371 log.cc:1199] T c1777a713b1d4a58919b5f6abe779ab8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/c1777a713b1d4a58919b5f6abe779ab8
I20260810 19:47:52.685283 10375 ts_tablet_manager.cc:1929] T d15bcf97364046daa97f7461f4f6bc98 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:52.685698 10371 ts_tablet_manager.cc:1950] T c1777a713b1d4a58919b5f6abe779ab8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:52.687587 9611 leader_election.cc:304] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:52.688256 10936 raft_consensus.cc:2804] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:52.688390 10936 raft_consensus.cc:493] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:52.688436 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca9d34cb609413d9df495bf191cc409" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:52.688534 10936 raft_consensus.cc:3060] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:52.691524 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2931130e9354f16a238712234c19217" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:52.691879 10936 raft_consensus.cc:515] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.692895 9715 raft_consensus.cc:2393] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6986ed920dcb4af29a5eeeda6f671691 in current term 1: Already voted for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in this term.
I20260810 19:47:52.693578 10375 log.cc:1199] T d15bcf97364046daa97f7461f4f6bc98 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/d15bcf97364046daa97f7461f4f6bc98
W20260810 19:47:52.694425 10067 consensus_peers.cc:597] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 09ab62f482b14cd4b86115e9a0423e7c. This is attempt 1: this message will repeat every 5th retry.
W20260810 19:47:52.694591 10067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 63433.2us
I20260810 19:47:52.696028 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e967384768b4ec7956f1b508e8ab2af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.696084 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet c1777a713b1d4a58919b5f6abe779ab8 (table default.Table_2819131cbbda496d8acccf4b8e83c322 [id=59935ce778c84929aa6ae71a1e33c63f]) successfully deleted
I20260810 19:47:52.697688 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet d99b34f901484fad87cff4bb9ab56fc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.698156 10371 tablet_replica.cc:333] T 651a1f5011de4db495dbbab2d19ff096 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
W20260810 19:47:52.698156 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet ffc4466b82bd49fcaad30e4d5325c7db because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ffc4466b82bd49fcaad30e4d5325c7db already in progress: creating tablet
I20260810 19:47:52.698403 10371 raft_consensus.cc:2243] T 651a1f5011de4db495dbbab2d19ff096 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 19:47:52.698768 9830 leader_election.cc:343] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:52.699805 10371 raft_consensus.cc:2272] T 651a1f5011de4db495dbbab2d19ff096 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:52.697084 10911 raft_consensus.cc:515] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.700577 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3600d0528164850973cb296aaf6910f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.701004 10371 ts_tablet_manager.cc:1916] T 651a1f5011de4db495dbbab2d19ff096 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:52.705262 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 639c824ba4834734a4ebfd558181bebe (DEFAULT_TABLE table=default.Table_35ada13f5f5a41b0a93a57276b7756d9 [id=fa3844f34a5b4d55b6e87ec2164eb8fb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:52.705787 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da3d8ade850c4d36bd2756c36706195d consensus state has no leader
I20260810 19:47:52.707240 10375 ts_tablet_manager.cc:1950] T d15bcf97364046daa97f7461f4f6bc98 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:52.708446 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet d99b34f901484fad87cff4bb9ab56fc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:52.709054 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b40fd0d57ea4b71aeef2d66f4958ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.710335 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3102c066fa6942a28308746ce65d20e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:52.711076 10911 leader_election.cc:290] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:47:52.711510 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3102c066fa6942a28308746ce65d20e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.712205 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d654dada92a4939914d26ab72a5f5e8" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:52.712484 9715 raft_consensus.cc:3060] T 4d654dada92a4939914d26ab72a5f5e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:52.717053 10936 leader_election.cc:290] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:52.718145 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0c2f99b1c8cb452b973d5ea06626ac1a" } new_table_name: "default.Table_c5cc7d3e97ae4d02952905907354f9a3" modify_external_catalogs: true
I20260810 19:47:52.718694 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2931130e9354f16a238712234c19217" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:52.718974 9944 raft_consensus.cc:2393] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcd31b1bbb0340cbacfce652b4ad8da4 in current term 1: Already voted for candidate 6986ed920dcb4af29a5eeeda6f671691 in this term.
I20260810 19:47:52.721344 10377 ts_tablet_manager.cc:1929] T 0efa6f35ed284933b9fc53c1cb32da82 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:52.721489 10377 log.cc:1199] T 0efa6f35ed284933b9fc53c1cb32da82 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/0efa6f35ed284933b9fc53c1cb32da82
I20260810 19:47:52.721927 10377 ts_tablet_manager.cc:1950] T 0efa6f35ed284933b9fc53c1cb32da82 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:52.724875 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d654dada92a4939914d26ab72a5f5e8" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:52.729265 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78f955a3ca946189de7ea96baee35f6" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:52.729575 9944 raft_consensus.cc:2393] T a78f955a3ca946189de7ea96baee35f6 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcd31b1bbb0340cbacfce652b4ad8da4 in current term 1: Already voted for candidate eadde59fd6504d679e47f03a60c64bb0 in this term.
I20260810 19:47:52.729420 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_051685b8260741de820a8b26b13d617f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:52.730103 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_051685b8260741de820a8b26b13d617f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.730504 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 239) took 1665 ms. Trace:
I20260810 19:47:52.731305 10377 rpcz_store.cc:276] 0810 19:47:51.062361 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:51.062972 (+ 611us) service_pool.cc:224] Handling call
0810 19:47:52.487728 (+1424756us) ts_tablet_manager.cc:1151] Deleting tablet 0efa6f35ed284933b9fc53c1cb32da82
0810 19:47:52.487740 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.579584 (+ 91844us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.719894 (+140310us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.727390 (+ 7496us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1653,"tablet-delete.queue_time_us":1390783}
I20260810 19:47:52.731518 10991 raft_consensus.cc:515] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:52.731869 10377 tablet_replica.cc:333] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:52.732090 10377 raft_consensus.cc:2243] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:52.733112 9948 raft_consensus.cc:3060] T 4d654dada92a4939914d26ab72a5f5e8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:52.733871 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 0efa6f35ed284933b9fc53c1cb32da82 (table default.Table_133f8005d08641b68da5bb9faa1e2d7b [id=e8a45897ddcf4bd2a31db1b1d8f6ee12]) successfully deleted
I20260810 19:47:52.738095 10377 pending_rounds.cc:70] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691: Trying to abort 1 pending ops.
I20260810 19:47:52.740083 10377 pending_rounds.cc:77] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058648658796544 op_type: NO_OP noop_request { }
I20260810 19:47:52.740347 10377 raft_consensus.cc:2889] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:52.742748 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 0dd49d6fa79e4677b753b6cf9117b02d
I20260810 19:47:52.748435 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dd49d6fa79e4677b753b6cf9117b02d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.748842 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_621e2b21ae7f44e898cb2dfe911d60f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:52.749580 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_621e2b21ae7f44e898cb2dfe911d60f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.759028 9948 raft_consensus.cc:2468] T 4d654dada92a4939914d26ab72a5f5e8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:47:52.762292 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b07e02fd7d2e481e81bb153584c51dc2" } new_table_name: "default.Table_77e7389c3161415c96dd7dcbe6b2a829" modify_external_catalogs: true
I20260810 19:47:52.765496 10377 raft_consensus.cc:2272] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:52.766284 10377 ts_tablet_manager.cc:1916] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:52.775605 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4b80408d9e4d4ae483aee8594c3ff194" } new_table_name: "default.Table_ff8803fe033d45a79877574c5f39b756" modify_external_catalogs: true
I20260810 19:47:52.780519 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ab62f482b14cd4b86115e9a0423e7c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:52.781172 10068 consensus_peers.cc:597] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c1777a713b1d4a58919b5f6abe779ab8. This is attempt 1: this message will repeat every 5th retry.
W20260810 19:47:52.781418 10068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 70485.2us
I20260810 19:47:52.782665 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2931130e9354f16a238712234c19217" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:52.783162 10167 raft_consensus.cc:3060] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:52.784065 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 648ef608fa0c45cc8be4bad80c4200be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.793133 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e218d405fb7e4196ab4d6439b8092138"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:52.793817 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e218d405fb7e4196ab4d6439b8092138 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.795106 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 196) took 2651 ms. Trace:
I20260810 19:47:52.793371 10167 raft_consensus.cc:2468] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
W20260810 19:47:52.796772 10067 consensus_peers.cc:597] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3cda6eb6d4b847edb2624a267bc3522d. This is attempt 1: this message will repeat every 5th retry.
W20260810 19:47:52.796927 10067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 70658.2us
I20260810 19:47:52.797648 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b33df59ffe49a9b07606b6dc9279eb" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:52.797963 9948 raft_consensus.cc:3060] T 58b33df59ffe49a9b07606b6dc9279eb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:52.798161 10067 leader_election.cc:304] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:52.798539 10621 raft_consensus.cc:2804] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:52.799015 10164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2931130e9354f16a238712234c19217" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:52.802220 9412 master_service.cc:960] ReplaceTablet: received request to replace tablet ffc4466b82bd49fcaad30e4d5325c7db from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:52.802366 9948 raft_consensus.cc:2468] T 58b33df59ffe49a9b07606b6dc9279eb P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:47:52.806578 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_fc65a045265c494998007900c7ac9e01" } modify_external_catalogs: true
I20260810 19:47:52.806793 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_fc65a045265c494998007900c7ac9e01" } modify_external_catalogs: true
W20260810 19:47:52.807207 9831 leader_election.cc:343] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:52.807422 9831 leader_election.cc:304] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:52.808125 11067 raft_consensus.cc:2749] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:52.809705 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2931130e9354f16a238712234c19217" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:52.810272 9948 raft_consensus.cc:2393] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fcd31b1bbb0340cbacfce652b4ad8da4 in current term 1: Already voted for candidate 6986ed920dcb4af29a5eeeda6f671691 in this term.
I20260810 19:47:52.812796 9611 leader_election.cc:304] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:52.812315 9715 raft_consensus.cc:2468] T 4d654dada92a4939914d26ab72a5f5e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
W20260810 19:47:52.813731 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dcb3660108094399b36d19ea8e6b8308 consensus state has no leader
I20260810 19:47:52.814082 9418 master_service.cc:960] ReplaceTablet: received request to replace tablet 46005eead530459eb2b636ae0a6767ad from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:52.816504 10366 tablet_bootstrap.cc:492] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:52.816672 10366 ts_tablet_manager.cc:1403] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.236s user 0.010s sys 0.005s
I20260810 19:47:52.817500 10366 raft_consensus.cc:359] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.817951 10366 raft_consensus.cc:385] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:52.818113 10366 raft_consensus.cc:740] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:52.818578 10366 consensus_queue.cc:260] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.819470 10366 ts_tablet_manager.cc:1434] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:47:52.820065 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dd49d6fa79e4677b753b6cf9117b02d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:52.820093 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_12b12f4993a449a48336de17e0c39fc1" } modify_external_catalogs: true
I20260810 19:47:52.820315 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_12b12f4993a449a48336de17e0c39fc1" } modify_external_catalogs: true
I20260810 19:47:52.821574 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b33df59ffe49a9b07606b6dc9279eb" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:52.821656 10371 ts_tablet_manager.cc:1929] T 651a1f5011de4db495dbbab2d19ff096 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:52.821828 10371 log.cc:1199] T 651a1f5011de4db495dbbab2d19ff096 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/651a1f5011de4db495dbbab2d19ff096
I20260810 19:47:52.821839 9714 raft_consensus.cc:3060] T 58b33df59ffe49a9b07606b6dc9279eb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:52.822274 10164 raft_consensus.cc:2393] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6986ed920dcb4af29a5eeeda6f671691 in current term 1: Already voted for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in this term.
I20260810 19:47:52.822301 10371 ts_tablet_manager.cc:1950] T 651a1f5011de4db495dbbab2d19ff096 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:52.800184 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dd49d6fa79e4677b753b6cf9117b02d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:52.799513 10375 rpcz_store.cc:276] 0810 19:47:50.069897 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.070745 (+ 848us) service_pool.cc:224] Handling call
0810 19:47:52.196538 (+2125793us) ts_tablet_manager.cc:1151] Deleting tablet d15bcf97364046daa97f7461f4f6bc98
0810 19:47:52.196546 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.453903 (+257357us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.674805 (+220902us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.721785 (+ 46980us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2125465}
I20260810 19:47:52.802644 10911 consensus_queue.cc:1048] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 19:47:52.822508 9611 leader_election.cc:343] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 09ab62f482b14cd4b86115e9a0423e7c
I20260810 19:47:52.823190 9611 leader_election.cc:304] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:52.802942 10067 leader_election.cc:304] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:52.823716 9611 leader_election.cc:304] T a78f955a3ca946189de7ea96baee35f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:52.823812 10911 raft_consensus.cc:2804] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:52.823958 10911 raft_consensus.cc:697] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:47:52.824240 10911 consensus_queue.cc:237] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:52.824687 10371 tablet_replica.cc:333] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:52.824651 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 651a1f5011de4db495dbbab2d19ff096 (table default.Table_8759361d39fb4003a644f53ecd07d2d1 [id=e10b3ffceb96420494d92992411ff2ba]) successfully deleted
I20260810 19:47:52.806782 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 639c824ba4834734a4ebfd558181bebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:52.825865 10936 raft_consensus.cc:2804] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:52.825981 9714 raft_consensus.cc:2468] T 58b33df59ffe49a9b07606b6dc9279eb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:47:52.826491 11078 raft_consensus.cc:3060] T a78f955a3ca946189de7ea96baee35f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:52.806861 10991 leader_election.cc:290] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:52.831259 11078 raft_consensus.cc:2749] T a78f955a3ca946189de7ea96baee35f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:52.833267 9416 master_service.cc:960] ReplaceTablet: received request to replace tablet 38ee7973736c4a0a921261d37b74f290 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:52.835065 10371 raft_consensus.cc:2243] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:52.835224 10378 raft_consensus.cc:2706] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Received pre-election callback for term 2 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260810 19:47:52.835810 10371 pending_rounds.cc:70] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4: Trying to abort 1 pending ops.
I20260810 19:47:52.835899 10371 pending_rounds.cc:77] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058646922272768 op_type: NO_OP noop_request { }
I20260810 19:47:52.836011 10371 raft_consensus.cc:2889] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:52.836135 10371 raft_consensus.cc:2272] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:52.838632 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet d15bcf97364046daa97f7461f4f6bc98 (table default.Table_47c121b1c8cf4d999324cc090246288b [id=e107df18522446d3bcf7bd46e78eb626]) successfully deleted
I20260810 19:47:52.841570 10367 tablet_bootstrap.cc:492] T 38ee7973736c4a0a921261d37b74f290 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:52.841848 10367 ts_tablet_manager.cc:1403] T 38ee7973736c4a0a921261d37b74f290 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.221s user 0.024s sys 0.048s
I20260810 19:47:52.842779 10367 raft_consensus.cc:359] T 38ee7973736c4a0a921261d37b74f290 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.843658 10367 raft_consensus.cc:385] T 38ee7973736c4a0a921261d37b74f290 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:52.843942 10367 raft_consensus.cc:740] T 38ee7973736c4a0a921261d37b74f290 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:52.844511 10367 consensus_queue.cc:260] T 38ee7973736c4a0a921261d37b74f290 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.840607 9830 leader_election.cc:304] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:52.847337 10932 raft_consensus.cc:2749] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 19:47:52.848129 10367 ts_tablet_manager.cc:1434] T 38ee7973736c4a0a921261d37b74f290 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260810 19:47:52.848408 10366 tablet_bootstrap.cc:492] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:52.849025 10367 tablet_bootstrap.cc:492] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:52.850458 10366 tablet_bootstrap.cc:654] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:52.848246 11079 consensus_queue.cc:1175] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260810 19:47:52.851982 10936 raft_consensus.cc:697] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:52.852432 10936 consensus_queue.cc:237] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:52.853852 10068 consensus_peers.cc:597] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:52.855443 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_998c14b0e9e14df48d3d4367f7c3b941" } modify_external_catalogs: true
I20260810 19:47:52.855685 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_998c14b0e9e14df48d3d4367f7c3b941" } modify_external_catalogs: true
I20260810 19:47:52.857061 10367 tablet_bootstrap.cc:654] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:52.862165 10371 ts_tablet_manager.cc:1916] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:52.843196 10377 ts_tablet_manager.cc:1929] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:52.868880 10377 log.cc:1199] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/c5625c6f78f14d629bcd7f8c9522c4ba
I20260810 19:47:52.869546 10377 ts_tablet_manager.cc:1950] T c5625c6f78f14d629bcd7f8c9522c4ba P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:52.869524 10371 ts_tablet_manager.cc:1929] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:52.869665 10371 log.cc:1199] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/09ab62f482b14cd4b86115e9a0423e7c
I20260810 19:47:52.870023 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 240) took 1806 ms. Trace:
I20260810 19:47:52.870180 10371 ts_tablet_manager.cc:1950] T 09ab62f482b14cd4b86115e9a0423e7c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:52.870203 10377 rpcz_store.cc:276] 0810 19:47:51.063479 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:51.063671 (+ 192us) service_pool.cc:224] Handling call
0810 19:47:52.731797 (+1668126us) ts_tablet_manager.cc:1151] Deleting tablet c5625c6f78f14d629bcd7f8c9522c4ba
0810 19:47:52.731808 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.790754 (+ 58946us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.843066 (+ 52312us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.869985 (+ 26919us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1634800}
I20260810 19:47:52.870941 10377 tablet_replica.cc:333] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:52.871304 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 09ab62f482b14cd4b86115e9a0423e7c (table default.Table_5af45f52e4024048836c48234ef3a903 [id=4fda913821434991b62c8de128735a25]) successfully deleted
I20260810 19:47:52.871387 10371 tablet_replica.cc:333] T a78f955a3ca946189de7ea96baee35f6 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:52.871387 10377 raft_consensus.cc:2243] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:52.871600 10371 raft_consensus.cc:2243] T a78f955a3ca946189de7ea96baee35f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 19:47:52.871670 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 06af03c8a87141febef768bd56c72c39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06af03c8a87141febef768bd56c72c39 already in progress: creating tablet
I20260810 19:47:52.871788 10371 raft_consensus.cc:2272] T a78f955a3ca946189de7ea96baee35f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:52.871833 10377 raft_consensus.cc:2272] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:52.872449 10371 ts_tablet_manager.cc:1916] T a78f955a3ca946189de7ea96baee35f6 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:52.873889 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b2ee8ebe11e4e5cb6a91592170c6c3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.875221 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet c5625c6f78f14d629bcd7f8c9522c4ba (table default.Table_0dafd75d95394cdda8062e308591219d [id=3ec1bdaeba584422a569a6f070344b6a]) successfully deleted
I20260810 19:47:52.875696 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ea5137ed2ce8460fa70bb7a104f5604e" } modify_external_catalogs: true
I20260810 19:47:52.875941 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ea5137ed2ce8460fa70bb7a104f5604e" } modify_external_catalogs: true
I20260810 19:47:52.876009 10366 tablet_bootstrap.cc:492] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:52.875998 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 190) took 2984 ms. Trace:
I20260810 19:47:52.876185 10366 ts_tablet_manager.cc:1403] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.028s user 0.000s sys 0.003s
I20260810 19:47:52.876092 10375 rpcz_store.cc:276] 0810 19:47:49.891567 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.078471 (+186904us) service_pool.cc:224] Handling call
0810 19:47:52.822812 (+2744341us) ts_tablet_manager.cc:1151] Deleting tablet 3badc88d94a34ff7a053ed312f0dd646
0810 19:47:52.875767 (+ 52955us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.875932 (+ 165us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2732353}
W20260810 19:47:52.876546 10068 consensus_peers.cc:597] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:52.876585 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 198) took 2733 ms. Trace:
I20260810 19:47:52.876683 10375 rpcz_store.cc:276] 0810 19:47:50.143566 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.144304 (+ 738us) service_pool.cc:224] Handling call
0810 19:47:52.876392 (+2732088us) ts_tablet_manager.cc:1151] Deleting tablet 6af6dd8913f44e7f966ed2a128ae4fbf
0810 19:47:52.876403 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.876503 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2731850}
I20260810 19:47:52.877195 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 206) took 2602 ms. Trace:
I20260810 19:47:52.877345 10375 rpcz_store.cc:276] 0810 19:47:50.274935 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.275008 (+ 73us) service_pool.cc:224] Handling call
0810 19:47:52.876944 (+2601936us) ts_tablet_manager.cc:1151] Deleting tablet 74dddd12f2314d6ab5a6717025b13a51
0810 19:47:52.876955 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.877047 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2601655}
I20260810 19:47:52.877691 10375 tablet_replica.cc:333] T a9e42e13617c4457ba88ae0e0269ec93 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:52.877960 10375 raft_consensus.cc:2243] T a9e42e13617c4457ba88ae0e0269ec93 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:52.878504 10375 raft_consensus.cc:2272] T a9e42e13617c4457ba88ae0e0269ec93 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:52.879222 10375 ts_tablet_manager.cc:1916] T a9e42e13617c4457ba88ae0e0269ec93 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:52.881170 10367 tablet_bootstrap.cc:492] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:52.882493 10367 ts_tablet_manager.cc:1403] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.000s
W20260810 19:47:52.883450 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 6af6dd8913f44e7f966ed2a128ae4fbf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6af6dd8913f44e7f966ed2a128ae4fbf already in progress: creating tablet
I20260810 19:47:52.883416 10367 raft_consensus.cc:359] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:52.883857 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 74dddd12f2314d6ab5a6717025b13a51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74dddd12f2314d6ab5a6717025b13a51 already in progress: creating tablet
I20260810 19:47:52.886634 10367 raft_consensus.cc:385] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:52.887125 10367 raft_consensus.cc:740] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:52.887317 10370 raft_consensus.cc:359] T 38ee7973736c4a0a921261d37b74f290 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.887619 10370 raft_consensus.cc:385] T 38ee7973736c4a0a921261d37b74f290 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:52.887779 10370 raft_consensus.cc:740] T 38ee7973736c4a0a921261d37b74f290 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:52.884951 9789 heartbeater.cc:344] Connected to a master server at 127.8.235.254:33891
I20260810 19:47:52.888178 10370 consensus_queue.cc:260] T 38ee7973736c4a0a921261d37b74f290 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.888407 10367 consensus_queue.cc:260] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.888857 10370 ts_tablet_manager.cc:1434] T 38ee7973736c4a0a921261d37b74f290 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.296s user 0.002s sys 0.000s
I20260810 19:47:52.889380 10370 tablet_bootstrap.cc:492] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:52.889865 10367 ts_tablet_manager.cc:1434] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260810 19:47:52.891407 10370 tablet_bootstrap.cc:654] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:52.892324 10367 tablet_bootstrap.cc:492] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
W20260810 19:47:52.893318 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 45194cae6ea44d9d8cf856d256fd534f consensus state has no leader
I20260810 19:47:52.894241 10367 tablet_bootstrap.cc:654] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:52.902794 10371 ts_tablet_manager.cc:1929] T a78f955a3ca946189de7ea96baee35f6 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 19:47:52.903038 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5aa0f24443a34714a44137a77c12bbc3 has no consensus state
I20260810 19:47:52.903093 10371 log.cc:1199] T a78f955a3ca946189de7ea96baee35f6 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/a78f955a3ca946189de7ea96baee35f6
I20260810 19:47:52.903561 10371 ts_tablet_manager.cc:1950] T a78f955a3ca946189de7ea96baee35f6 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:52.908672 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet a78f955a3ca946189de7ea96baee35f6 (table default.Table_130fb9e1e90b4c679e2c0ef4cec28827 [id=3225dd83c5dc4e6c9ad6c37794312256]) successfully deleted
I20260810 19:47:52.909121 10371 tablet_replica.cc:333] T 58b33df59ffe49a9b07606b6dc9279eb P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:52.909330 10371 raft_consensus.cc:2243] T 58b33df59ffe49a9b07606b6dc9279eb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:52.909400 10932 raft_consensus.cc:493] T a01d3ec3c8914fe495f7a0f3c7c312f8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:52.909546 10371 raft_consensus.cc:2272] T 58b33df59ffe49a9b07606b6dc9279eb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:52.909602 10932 raft_consensus.cc:515] T a01d3ec3c8914fe495f7a0f3c7c312f8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:52.909691 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 4dba7046bdfd41f1a2ad6f299a723776 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4dba7046bdfd41f1a2ad6f299a723776 already in progress: creating tablet
I20260810 19:47:52.910162 10371 ts_tablet_manager.cc:1916] T 58b33df59ffe49a9b07606b6dc9279eb P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:52.910418 10932 leader_election.cc:290] T a01d3ec3c8914fe495f7a0f3c7c312f8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:52.911844 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b16a88e0061b4ab692e6ae76672eb918" } new_table_name: "default.Table_4b3474ab5fac40a28a050d69fc60bfe5" modify_external_catalogs: true
I20260810 19:47:52.912405 10366 raft_consensus.cc:359] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.913091 10367 tablet_bootstrap.cc:492] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:52.913323 10367 ts_tablet_manager.cc:1403] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.000s
I20260810 19:47:52.913676 9716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01d3ec3c8914fe495f7a0f3c7c312f8" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:52.914286 10367 raft_consensus.cc:359] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.914623 10367 raft_consensus.cc:385] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:52.914784 10366 raft_consensus.cc:385] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:52.914875 10366 raft_consensus.cc:740] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:52.914839 10367 raft_consensus.cc:740] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:52.915270 10367 consensus_queue.cc:260] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:52.914628 9831 leader_election.cc:343] T a01d3ec3c8914fe495f7a0f3c7c312f8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:52.915735 10366 consensus_queue.cc:260] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.917563 10366 ts_tablet_manager.cc:1434] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.041s user 0.001s sys 0.001s
I20260810 19:47:52.918502 10367 ts_tablet_manager.cc:1434] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260810 19:47:52.918895 10367 tablet_bootstrap.cc:492] T b9e761e94dbf4baba5e44a89b6c6a81c P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
W20260810 19:47:52.919953 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5394eadabf184158864921dd5d394828 consensus state has no leader
I20260810 19:47:52.920984 10367 tablet_bootstrap.cc:654] T b9e761e94dbf4baba5e44a89b6c6a81c P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:52.921031 10932 raft_consensus.cc:493] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:52.921185 10932 raft_consensus.cc:515] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.921957 10932 leader_election.cc:290] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:52.924551 9716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e761e94dbf4baba5e44a89b6c6a81c" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
W20260810 19:47:52.926414 9831 leader_election.cc:343] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:52.929900 10366 tablet_bootstrap.cc:492] T 74dddd12f2314d6ab5a6717025b13a51 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:52.933751 9408 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet aa5702d7b3bd421eb7b8a4e0f181d2d4 (table default.Table_5f6b1710e7cc447dbf34e05882706750 [id=a837d5f74eac4f74b2029f46d73acc93]). Expected version 2 got 0
I20260810 19:47:52.936470 10371 ts_tablet_manager.cc:1929] T 58b33df59ffe49a9b07606b6dc9279eb P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:52.934334 9407 master_service.cc:960] ReplaceTablet: received request to replace tablet 72b39babf851404c89adb317033015ec from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:52.937832 10371 log.cc:1199] T 58b33df59ffe49a9b07606b6dc9279eb P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/58b33df59ffe49a9b07606b6dc9279eb
I20260810 19:47:52.938925 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_66fcd95a5a224b4c8eb48cde1040885b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:52.939625 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66fcd95a5a224b4c8eb48cde1040885b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.941583 10621 raft_consensus.cc:697] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:47:52.941663 10366 tablet_bootstrap.cc:654] T 74dddd12f2314d6ab5a6717025b13a51 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:52.942261 10621 consensus_queue.cc:237] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.898805 10375 ts_tablet_manager.cc:1929] T a9e42e13617c4457ba88ae0e0269ec93 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:52.911383 10164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01d3ec3c8914fe495f7a0f3c7c312f8" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:52.944365 9830 leader_election.cc:343] T a01d3ec3c8914fe495f7a0f3c7c312f8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:52.944545 9830 leader_election.cc:304] T a01d3ec3c8914fe495f7a0f3c7c312f8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:52.945070 10932 raft_consensus.cc:2749] T a01d3ec3c8914fe495f7a0f3c7c312f8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:52.922902 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e761e94dbf4baba5e44a89b6c6a81c" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:52.945995 10167 raft_consensus.cc:2468] T b9e761e94dbf4baba5e44a89b6c6a81c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:52.946666 9830 leader_election.cc:304] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:52.946112 10371 ts_tablet_manager.cc:1950] T 58b33df59ffe49a9b07606b6dc9279eb P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:52.947310 10932 raft_consensus.cc:2804] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:52.947432 10932 raft_consensus.cc:493] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:52.947559 10932 raft_consensus.cc:3060] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:52.948877 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 58b33df59ffe49a9b07606b6dc9279eb (table default.Table_a289f25ff60e4733899134f73a70715c [id=356d1ec0f2784810895aecd1f2eed86a]) successfully deleted
I20260810 19:47:52.949779 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 21208dd824fe432fa307cbb88d37aaa2
W20260810 19:47:52.950402 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 839dcdb448d14a8f8e452145ccf41263 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 839dcdb448d14a8f8e452145ccf41263 already in progress: creating tablet
I20260810 19:47:52.950577 9412 master_service.cc:960] ReplaceTablet: received request to replace tablet a78f955a3ca946189de7ea96baee35f6 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:52.950551 10932 raft_consensus.cc:515] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.950656 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 21208dd824fe432fa307cbb88d37aaa2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:52.951059 10371 tablet_replica.cc:333] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:52.951337 10932 leader_election.cc:290] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:52.951370 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 21208dd824fe432fa307cbb88d37aaa2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.951683 10371 raft_consensus.cc:2243] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:52.952150 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e761e94dbf4baba5e44a89b6c6a81c" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:52.952186 10128 tablet_service.cc:1558] Processing DeleteTablet for tablet 21208dd824fe432fa307cbb88d37aaa2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:52.952397 10167 raft_consensus.cc:3060] T b9e761e94dbf4baba5e44a89b6c6a81c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:52.952697 10371 raft_consensus.cc:2272] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:52.953368 10371 ts_tablet_manager.cc:1916] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:52.954174 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e60e43b61eba457e8a4e7cd6543b7cc6" } modify_external_catalogs: true
I20260810 19:47:52.954418 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e60e43b61eba457e8a4e7cd6543b7cc6" } modify_external_catalogs: true
I20260810 19:47:52.955600 10167 raft_consensus.cc:2468] T b9e761e94dbf4baba5e44a89b6c6a81c P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:52.956307 9830 leader_election.cc:304] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:52.956651 11068 raft_consensus.cc:493] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:52.956802 11068 raft_consensus.cc:515] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.957653 11068 leader_election.cc:290] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:52.957856 11068 raft_consensus.cc:2804] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:52.958038 11068 raft_consensus.cc:697] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:47:52.958297 11068 consensus_queue.cc:237] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.959575 9415 catalog_manager.cc:5719] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193). New cstate: current_term: 1 leader_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:47:52.960759 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 38ee7973736c4a0a921261d37b74f290
I20260810 19:47:52.960717 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e177140cad404e978b927c810b87ae0c" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:52.961479 9830 leader_election.cc:343] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:52.962778 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 38ee7973736c4a0a921261d37b74f290 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:52.964221 9716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e761e94dbf4baba5e44a89b6c6a81c" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:52.964845 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e177140cad404e978b927c810b87ae0c" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
W20260810 19:47:52.965160 9831 leader_election.cc:343] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:52.965945 9831 leader_election.cc:343] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:52.966578 9831 leader_election.cc:304] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:52.966794 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c53d9c7f87054a568e99b3f08135ff87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:52.967303 10932 raft_consensus.cc:2749] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:47:52.967506 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c53d9c7f87054a568e99b3f08135ff87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.967528 10371 ts_tablet_manager.cc:1929] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:47:52.969117 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 38ee7973736c4a0a921261d37b74f290 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.969161 10375 log.cc:1199] T a9e42e13617c4457ba88ae0e0269ec93 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/a9e42e13617c4457ba88ae0e0269ec93
I20260810 19:47:52.969617 10128 tablet_service.cc:1558] Processing DeleteTablet for tablet 38ee7973736c4a0a921261d37b74f290 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:52.970692 10371 log.cc:1199] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/00dabf43505f4fc89be39ee8fb41c7ee
I20260810 19:47:52.970752 9408 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet aa5702d7b3bd421eb7b8a4e0f181d2d4 (table default.Table_5f6b1710e7cc447dbf34e05882706750 [id=a837d5f74eac4f74b2029f46d73acc93]). Expected version 2 got 0
I20260810 19:47:52.969672 10375 ts_tablet_manager.cc:1950] T a9e42e13617c4457ba88ae0e0269ec93 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:52.971520 10371 ts_tablet_manager.cc:1950] T 00dabf43505f4fc89be39ee8fb41c7ee P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:52.972421 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 201) took 2775 ms. Trace:
I20260810 19:47:52.972569 10375 rpcz_store.cc:276] 0810 19:47:50.196785 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.196841 (+ 56us) service_pool.cc:224] Handling call
0810 19:47:52.877607 (+2680766us) ts_tablet_manager.cc:1151] Deleting tablet a9e42e13617c4457ba88ae0e0269ec93
0810 19:47:52.877617 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.882821 (+ 5204us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.898692 (+ 15871us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:52.972375 (+ 73683us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2599176}
I20260810 19:47:52.973508 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 202) took 2761 ms. Trace:
I20260810 19:47:52.973614 10377 ts_tablet_manager.cc:1916] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:52.973708 10375 rpcz_store.cc:276] 0810 19:47:50.212139 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.212204 (+ 65us) service_pool.cc:224] Handling call
0810 19:47:52.973291 (+2761087us) ts_tablet_manager.cc:1151] Deleting tablet 6355c14e38b3446493f7bd5e2a717341
0810 19:47:52.973300 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:52.973465 (+ 165us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2690556}
I20260810 19:47:52.973956 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet ebf33d82af9e494a8e85be8cba55d2c9
I20260810 19:47:52.975111 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet ebf33d82af9e494a8e85be8cba55d2c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:52.973985 10370 tablet_bootstrap.cc:492] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:52.975329 10375 tablet_replica.cc:333] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:52.975536 10370 ts_tablet_manager.cc:1403] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.086s user 0.003s sys 0.001s
I20260810 19:47:52.976498 10370 raft_consensus.cc:359] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.976735 10370 raft_consensus.cc:385] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:52.976831 10370 raft_consensus.cc:740] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:52.976941 10366 tablet_bootstrap.cc:492] T 74dddd12f2314d6ab5a6717025b13a51 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:52.977109 10370 consensus_queue.cc:260] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.977401 10366 ts_tablet_manager.cc:1403] T 74dddd12f2314d6ab5a6717025b13a51 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.048s user 0.001s sys 0.003s
I20260810 19:47:52.977639 10370 ts_tablet_manager.cc:1434] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:47:52.978029 10370 tablet_bootstrap.cc:492] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:52.978729 10366 raft_consensus.cc:359] T 74dddd12f2314d6ab5a6717025b13a51 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.979023 10366 raft_consensus.cc:385] T 74dddd12f2314d6ab5a6717025b13a51 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:52.979158 10366 raft_consensus.cc:740] T 74dddd12f2314d6ab5a6717025b13a51 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:52.979557 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 00dabf43505f4fc89be39ee8fb41c7ee (table default.Table_257ddf6dffe443b7bb3a6d5e7f1e93a2 [id=6b30bf93c566421593a182e1768c0482]) successfully deleted
W20260810 19:47:52.979882 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 6355c14e38b3446493f7bd5e2a717341 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6355c14e38b3446493f7bd5e2a717341 already in progress: creating tablet
I20260810 19:47:52.979980 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet ebf33d82af9e494a8e85be8cba55d2c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:52.980392 10128 tablet_service.cc:1558] Processing DeleteTablet for tablet ebf33d82af9e494a8e85be8cba55d2c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:47:52.980587 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet a5625dc6303d44c6be28abd6278ce034 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a5625dc6303d44c6be28abd6278ce034 already in progress: creating tablet
I20260810 19:47:52.980901 10366 consensus_queue.cc:260] T 74dddd12f2314d6ab5a6717025b13a51 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:52.980985 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_928d46ef4c4b4192a572752826eb8264"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:52.977128 10375 raft_consensus.cc:2243] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
W20260810 19:47:52.981671 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_928d46ef4c4b4192a572752826eb8264 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:52.981812 10375 raft_consensus.cc:2272] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:52.982987 10366 ts_tablet_manager.cc:1434] T 74dddd12f2314d6ab5a6717025b13a51 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
W20260810 19:47:52.983188 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 896b7cfdb0ca4904aaeafa13ff19365e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 896b7cfdb0ca4904aaeafa13ff19365e already in progress: creating tablet
W20260810 19:47:52.983485 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 63486cc3f8774a11827b1cc5f1c16332 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63486cc3f8774a11827b1cc5f1c16332 already in progress: creating tablet
W20260810 19:47:52.983767 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 15c070c23de34348ad3426c894e11022 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15c070c23de34348ad3426c894e11022 already in progress: creating tablet
W20260810 19:47:52.984340 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet d99b34f901484fad87cff4bb9ab56fc8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d99b34f901484fad87cff4bb9ab56fc8 already in progress: creating tablet
W20260810 19:47:52.984935 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 0dd49d6fa79e4677b753b6cf9117b02d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0dd49d6fa79e4677b753b6cf9117b02d already in progress: creating tablet
W20260810 19:47:52.985491 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 21208dd824fe432fa307cbb88d37aaa2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21208dd824fe432fa307cbb88d37aaa2 already in progress: creating tablet
I20260810 19:47:52.985814 10371 tablet_replica.cc:333] T 38ee7973736c4a0a921261d37b74f290 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:52.986300 10371 raft_consensus.cc:2243] T 38ee7973736c4a0a921261d37b74f290 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:52.986872 10371 raft_consensus.cc:2272] T 38ee7973736c4a0a921261d37b74f290 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:52.987514 10366 tablet_bootstrap.cc:492] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:52.988929 10371 ts_tablet_manager.cc:1916] T 38ee7973736c4a0a921261d37b74f290 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:52.990528 9410 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 40f34bf8f44f4b7abbd43107d0f0548d
I20260810 19:47:52.991971 10366 tablet_bootstrap.cc:654] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:52.998862 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_acc6948ab5c0460bb57f457835e70743"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:52.999717 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_acc6948ab5c0460bb57f457835e70743 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:53.002135 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 74dddd12f2314d6ab5a6717025b13a51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:53.004561 10367 tablet_bootstrap.cc:492] T b9e761e94dbf4baba5e44a89b6c6a81c P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:53.004601 9416 catalog_manager.cc:5719] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195). New cstate: current_term: 1 leader_uuid: "eadde59fd6504d679e47f03a60c64bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: HEALTHY } } }
I20260810 19:47:53.004838 10371 ts_tablet_manager.cc:1929] T 38ee7973736c4a0a921261d37b74f290 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:53.005045 9416 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 4d654dada92a4939914d26ab72a5f5e8 (table default.Table_dcf48c67df284776aca6205b880fbbc5 [id=a8bdf6ea608f4279971af4c9eff71db6]). Expected version 1 got 0
I20260810 19:47:53.005056 10367 ts_tablet_manager.cc:1403] T b9e761e94dbf4baba5e44a89b6c6a81c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.086s user 0.014s sys 0.014s
I20260810 19:47:53.006152 10367 raft_consensus.cc:359] T b9e761e94dbf4baba5e44a89b6c6a81c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.006465 10367 raft_consensus.cc:385] T b9e761e94dbf4baba5e44a89b6c6a81c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.006585 10367 raft_consensus.cc:740] T b9e761e94dbf4baba5e44a89b6c6a81c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.006951 10367 consensus_queue.cc:260] T b9e761e94dbf4baba5e44a89b6c6a81c P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:53.009251 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 92e3d52bd5b741a4adcabb343b6770b8 consensus state has no leader
I20260810 19:47:53.009326 10367 ts_tablet_manager.cc:1434] T b9e761e94dbf4baba5e44a89b6c6a81c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260810 19:47:53.009684 10367 tablet_bootstrap.cc:492] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:53.011958 10371 log.cc:1199] T 38ee7973736c4a0a921261d37b74f290 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/38ee7973736c4a0a921261d37b74f290
I20260810 19:47:53.012463 10371 ts_tablet_manager.cc:1950] T 38ee7973736c4a0a921261d37b74f290 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:53.014814 10367 tablet_bootstrap.cc:654] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.015499 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 38ee7973736c4a0a921261d37b74f290 (table default.Table_12b12f4993a449a48336de17e0c39fc1 [id=f6c45c0da9e6448dbb64115902fef084]) successfully deleted
W20260810 19:47:53.015833 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet ebf33d82af9e494a8e85be8cba55d2c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebf33d82af9e494a8e85be8cba55d2c9 already in progress: creating tablet
I20260810 19:47:53.017922 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_4c9af5ce9ca6482d8a1aa433f970c274"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:53.018617 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c9af5ce9ca6482d8a1aa433f970c274 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:53.019510 10911 consensus_queue.cc:1048] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 19:47:53.021068 10370 tablet_bootstrap.cc:654] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.026080 10936 raft_consensus.cc:493] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:53.026279 10936 raft_consensus.cc:515] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.027089 10936 leader_election.cc:290] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:53.029276 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2ee8ebe11e4e5cb6a91592170c6c3d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:53.029548 9948 raft_consensus.cc:2468] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:53.031318 9611 leader_election.cc:304] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:53.032080 10936 raft_consensus.cc:2804] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:53.032209 10936 raft_consensus.cc:493] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:53.032140 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_252bc6d370744d24bcfdfab17c4a3d17" } new_table_name: "default.Table_44478e93cffb460aaa8df9115b799594" modify_external_catalogs: true
I20260810 19:47:53.032297 10936 raft_consensus.cc:3060] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:53.035802 10936 raft_consensus.cc:515] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.038117 10936 leader_election.cc:290] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:53.038228 10164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2ee8ebe11e4e5cb6a91592170c6c3d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
W20260810 19:47:53.038949 9611 leader_election.cc:343] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:53.039410 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2ee8ebe11e4e5cb6a91592170c6c3d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:53.039646 9948 raft_consensus.cc:3060] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:53.040274 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 72b39babf851404c89adb317033015ec
I20260810 19:47:53.040823 9407 catalog_manager.cc:6807] ReplaceTablet: tablet 72b39babf851404c89adb317033015ec deleted and replaced by tablet 676004738985441985278313d6064530
I20260810 19:47:53.041859 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 72b39babf851404c89adb317033015ec with delete_type TABLET_DATA_DELETED (replaced by tablet 676004738985441985278313d6064530) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:53.043469 9948 raft_consensus.cc:2468] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
W20260810 19:47:53.043802 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 72b39babf851404c89adb317033015ec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72b39babf851404c89adb317033015ec already in progress: creating tablet
I20260810 19:47:53.043962 9611 leader_election.cc:304] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:53.044214 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 72b39babf851404c89adb317033015ec with delete_type TABLET_DATA_DELETED (replaced by tablet 676004738985441985278313d6064530) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:53.044538 10936 raft_consensus.cc:2804] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:53.045542 10936 raft_consensus.cc:697] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:53.045480 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1afca0c2da4b421aa82e573457fe46c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:53.046115 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1afca0c2da4b421aa82e573457fe46c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:53.046017 10936 consensus_queue.cc:237] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.053049 10366 tablet_bootstrap.cc:492] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:53.052979 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2ee8ebe11e4e5cb6a91592170c6c3d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:53.053098 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 9fb544dff4eb4642b7e282657ae15d19
I20260810 19:47:53.053269 10366 ts_tablet_manager.cc:1403] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.069s user 0.002s sys 0.001s
I20260810 19:47:53.053387 10128 tablet_service.cc:1558] Processing DeleteTablet for tablet 72b39babf851404c89adb317033015ec with delete_type TABLET_DATA_DELETED (replaced by tablet 676004738985441985278313d6064530) from {username='slave'} at 127.0.0.1:41610
W20260810 19:47:53.053931 9611 leader_election.cc:343] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:53.054109 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 9fb544dff4eb4642b7e282657ae15d19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:53.054342 10375 ts_tablet_manager.cc:1916] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:53.054527 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 9fb544dff4eb4642b7e282657ae15d19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:53.054814 10128 tablet_service.cc:1558] Processing DeleteTablet for tablet 9fb544dff4eb4642b7e282657ae15d19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:47:53.056200 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 9fb544dff4eb4642b7e282657ae15d19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9fb544dff4eb4642b7e282657ae15d19 already in progress: creating tablet
I20260810 19:47:53.058262 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b3c82504d474465798c964cff5ce4371"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:53.058972 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3c82504d474465798c964cff5ce4371 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:53.059706 10366 raft_consensus.cc:359] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.059942 10366 raft_consensus.cc:385] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.060022 10366 raft_consensus.cc:740] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.064313 10377 ts_tablet_manager.cc:1929] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:53.064487 10377 log.cc:1199] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/9e09483838f0459da3041ee4fe5d55cc
I20260810 19:47:53.064962 10377 ts_tablet_manager.cc:1950] T 9e09483838f0459da3041ee4fe5d55cc P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:53.065348 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 241) took 2001 ms. Trace:
I20260810 19:47:53.065447 10377 rpcz_store.cc:276] 0810 19:47:51.064264 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:51.078296 (+ 14032us) service_pool.cc:224] Handling call
0810 19:47:52.870853 (+1792557us) ts_tablet_manager.cc:1151] Deleting tablet 9e09483838f0459da3041ee4fe5d55cc
0810 19:47:52.870865 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:53.061007 (+190142us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:53.064224 (+ 3217us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:53.065292 (+ 1068us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1763673}
I20260810 19:47:53.066012 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 9e09483838f0459da3041ee4fe5d55cc (table default.Table_5e6891ff4aa040be8b327aafa596bc7e [id=fd840f00bdc5477aaad0b7fa114870dd]) successfully deleted
I20260810 19:47:53.067642 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 38ee7973736c4a0a921261d37b74f290 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:53.068969 9397 catalog_manager.cc:5017] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 38ee7973736c4a0a921261d37b74f290 because the tablet was not found. No further retry: Not found: Tablet not found: 38ee7973736c4a0a921261d37b74f290
I20260810 19:47:53.072583 10370 tablet_bootstrap.cc:492] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:53.072767 10370 ts_tablet_manager.cc:1403] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.095s user 0.004s sys 0.000s
I20260810 19:47:53.073180 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_fe85d49e887b4fcea312afae466097e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:53.073676 10370 raft_consensus.cc:359] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:53.073840 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe85d49e887b4fcea312afae466097e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:53.073864 10370 raft_consensus.cc:385] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.073978 10370 raft_consensus.cc:740] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.074299 10370 consensus_queue.cc:260] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.074889 10370 ts_tablet_manager.cc:1434] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260810 19:47:53.075258 10370 tablet_bootstrap.cc:492] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:53.078104 10370 tablet_bootstrap.cc:654] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.078488 11068 raft_consensus.cc:493] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:53.078660 11068 raft_consensus.cc:515] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.079430 11068 leader_election.cc:290] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:53.080149 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5702d7b3bd421eb7b8a4e0f181d2d4" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:53.080382 9714 raft_consensus.cc:2468] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:53.081326 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5702d7b3bd421eb7b8a4e0f181d2d4" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:53.081483 9831 leader_election.cc:304] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
W20260810 19:47:53.082054 9830 leader_election.cc:343] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:53.082480 11068 raft_consensus.cc:2804] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:53.082607 11068 raft_consensus.cc:493] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:53.082705 11068 raft_consensus.cc:3060] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:53.085984 11068 raft_consensus.cc:515] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.087358 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5702d7b3bd421eb7b8a4e0f181d2d4" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:53.087603 9714 raft_consensus.cc:3060] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:53.088366 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 245) took 1954 ms. Trace:
I20260810 19:47:53.088856 10375 ts_tablet_manager.cc:1929] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260810 19:47:53.089041 10377 rpcz_store.cc:276] 0810 19:47:51.133960 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:51.134031 (+ 71us) service_pool.cc:224] Handling call
0810 19:47:53.088164 (+1954133us) ts_tablet_manager.cc:1151] Deleting tablet d2c77a8ac1614bb286e4e168bcf999f3
0810 19:47:53.088178 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:53.088308 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1953868}
I20260810 19:47:53.089258 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c4fa695c16634a2382811d87f8b8224b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:53.089730 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet d2c77a8ac1614bb286e4e168bcf999f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2c77a8ac1614bb286e4e168bcf999f3 already in progress: creating tablet
W20260810 19:47:53.089931 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c4fa695c16634a2382811d87f8b8224b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:53.092549 9714 raft_consensus.cc:2468] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:53.097222 9413 master_service.cc:960] ReplaceTablet: received request to replace tablet 46005eead530459eb2b636ae0a6767ad from {username='slave'} at 127.0.0.1:56048
W20260810 19:47:53.100490 9398 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 5394eadabf184158864921dd5d394828 (table default.Table_c5cc7d3e97ae4d02952905907354f9a3 [id=2d447d5da0e74e0885490174fc0f929d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 5394eadabf184158864921dd5d394828 consensus state has no leader
I20260810 19:47:53.101974 9408 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet aa5702d7b3bd421eb7b8a4e0f181d2d4 (table default.Table_5f6b1710e7cc447dbf34e05882706750 [id=a837d5f74eac4f74b2029f46d73acc93]). Expected version 2 got 0
I20260810 19:47:53.104436 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b2ee8ebe11e4e5cb6a91592170c6c3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:53.104797 10371 tablet_replica.cc:333] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:53.105026 10371 raft_consensus.cc:2243] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:53.105300 10371 pending_rounds.cc:70] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4: Trying to abort 1 pending ops.
I20260810 19:47:53.105391 10371 pending_rounds.cc:77] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058654411079680 op_type: NO_OP noop_request { }
I20260810 19:47:53.105513 10371 raft_consensus.cc:2889] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:53.105531 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9417c867265449d5b1be02c69d183657" } new_table_name: "default.Table_5bdde0f42da34c6f99e8462d17affb30" modify_external_catalogs: true
I20260810 19:47:53.105633 10371 raft_consensus.cc:2272] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:53.096973 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5702d7b3bd421eb7b8a4e0f181d2d4" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:53.106892 10246 heartbeater.cc:344] Connected to a master server at 127.8.235.254:33891
I20260810 19:47:53.107528 10371 ts_tablet_manager.cc:1916] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:53.108428 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet 6992e7ef8e794ddc879ae04f9f78b8bd from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:53.109972 10375 log.cc:1199] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/ba8c4420f5e345eeac30c805d673b5e9
I20260810 19:47:53.110512 10375 ts_tablet_manager.cc:1950] T ba8c4420f5e345eeac30c805d673b5e9 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:53.093170 9831 leader_election.cc:304] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:53.091720 11068 leader_election.cc:290] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:53.111913 11068 raft_consensus.cc:2804] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:53.112176 11068 raft_consensus.cc:697] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:47:53.113018 11068 consensus_queue.cc:237] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:53.112185 9830 leader_election.cc:343] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:53.114465 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet b9e761e94dbf4baba5e44a89b6c6a81c with delete_type TABLET_DATA_DELETED (replaced by tablet a78960e1f2164c848297411b9273ac64) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:53.114805 10371 ts_tablet_manager.cc:1929] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:53.115022 10371 log.cc:1199] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/5b2ee8ebe11e4e5cb6a91592170c6c3d
I20260810 19:47:53.115557 10371 ts_tablet_manager.cc:1950] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:53.115803 10370 tablet_bootstrap.cc:492] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:53.116014 10370 ts_tablet_manager.cc:1403] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.041s user 0.000s sys 0.003s
I20260810 19:47:53.116956 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 5b2ee8ebe11e4e5cb6a91592170c6c3d (table default.Table_bc109c4a41b649f0843393e4184b81be [id=932a3e3e563546b6b0cb7850cc4f3e1f]) successfully deleted
I20260810 19:47:53.116883 10370 raft_consensus.cc:359] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.117115 10370 raft_consensus.cc:385] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.117017 10371 tablet_replica.cc:333] T b9e761e94dbf4baba5e44a89b6c6a81c P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:53.117949 10371 raft_consensus.cc:2243] T b9e761e94dbf4baba5e44a89b6c6a81c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:53.118233 10371 raft_consensus.cc:2272] T b9e761e94dbf4baba5e44a89b6c6a81c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:53.097577 10366 consensus_queue.cc:260] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.090443 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 262) took 1499 ms. Trace:
I20260810 19:47:53.119066 10366 ts_tablet_manager.cc:1434] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.066s user 0.003s sys 0.000s
I20260810 19:47:53.119155 10377 rpcz_store.cc:276] 0810 19:47:51.591274 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:51.591337 (+ 63us) service_pool.cc:224] Handling call
0810 19:47:53.090231 (+1498894us) ts_tablet_manager.cc:1151] Deleting tablet 3c828ae089774fb9b0582141f4b99313
0810 19:47:53.090244 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:53.090378 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1498182}
I20260810 19:47:53.119501 10371 ts_tablet_manager.cc:1916] T b9e761e94dbf4baba5e44a89b6c6a81c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:53.119593 10377 tablet_replica.cc:333] T a78f955a3ca946189de7ea96baee35f6 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:53.119799 10377 raft_consensus.cc:2243] T a78f955a3ca946189de7ea96baee35f6 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 19:47:53.119825 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 3c828ae089774fb9b0582141f4b99313 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c828ae089774fb9b0582141f4b99313 already in progress: creating tablet
I20260810 19:47:53.120038 10377 raft_consensus.cc:2272] T a78f955a3ca946189de7ea96baee35f6 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:53.120179 10366 tablet_bootstrap.cc:492] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:53.117208 10370 raft_consensus.cc:740] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.122395 10366 tablet_bootstrap.cc:654] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.125259 11014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c56283079e74549afd0096f7e72046a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } } }
I20260810 19:47:53.125643 11014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 19:47:53.125839 10370 consensus_queue.cc:260] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.126098 11015 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c56283079e74549afd0096f7e72046a. Latest consensus state: current_term: 1 leader_uuid: "0c56283079e74549afd0096f7e72046a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } } }
I20260810 19:47:53.126511 11015 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 19:47:53.126772 11076 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c56283079e74549afd0096f7e72046a)
I20260810 19:47:53.127017 11076 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } }
I20260810 19:47:53.127482 10790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54376 (request call id 0) took 1308 ms. Trace:
I20260810 19:47:53.130978 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 208) took 2701 ms. Trace:
I20260810 19:47:53.133229 10377 ts_tablet_manager.cc:1916] T a78f955a3ca946189de7ea96baee35f6 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:53.134208 10375 rpcz_store.cc:276] 0810 19:47:50.429408 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.429930 (+ 522us) service_pool.cc:224] Handling call
0810 19:47:52.975262 (+2545332us) ts_tablet_manager.cc:1151] Deleting tablet ba8c4420f5e345eeac30c805d673b5e9
0810 19:47:52.975273 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:53.080012 (+104739us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:53.088757 (+ 8745us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:53.130907 (+ 42150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3966,"tablet-delete.queue_time_us":2544973}
I20260810 19:47:53.135193 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet ba8c4420f5e345eeac30c805d673b5e9 (table default.Table_2080a27caba94bd8a8ab66b012cb20e4 [id=c421996810c34ce69ca7c00ed984dc54]) successfully deleted
I20260810 19:47:53.131472 10370 ts_tablet_manager.cc:1434] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.015s user 0.003s sys 0.000s
I20260810 19:47:53.136009 10370 tablet_bootstrap.cc:492] T a01d3ec3c8914fe495f7a0f3c7c312f8 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:53.137243 9714 raft_consensus.cc:1275] T 4d654dada92a4939914d26ab72a5f5e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Refusing update from remote peer eadde59fd6504d679e47f03a60c64bb0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 19:47:53.138077 10911 consensus_queue.cc:1048] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:53.140619 11076 leader_election.cc:290] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f52c40e347e24ab4b3129e7064f4a43e (127.8.235.253:37397), 0c56283079e74549afd0096f7e72046a (127.8.235.252:43301)
I20260810 19:47:53.133332 9948 raft_consensus.cc:1275] T 4d654dada92a4939914d26ab72a5f5e8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Refusing update from remote peer eadde59fd6504d679e47f03a60c64bb0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 19:47:53.141714 10911 consensus_queue.cc:1048] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:53.143105 10375 tablet_replica.cc:333] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:53.143337 10375 raft_consensus.cc:2243] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:53.143733 10375 raft_consensus.cc:2272] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:53.144366 10375 ts_tablet_manager.cc:1916] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:53.151495 10370 tablet_bootstrap.cc:654] T a01d3ec3c8914fe495f7a0f3c7c312f8 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.160501 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8d68cddeb5f84601ab82e52cbc26b10f" } new_table_name: "default.Table_9cb0cc2a8f724781a638706ddcc2c085" modify_external_catalogs: true
I20260810 19:47:53.177013 10375 ts_tablet_manager.cc:1929] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:53.177209 10375 log.cc:1199] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/3cda6eb6d4b847edb2624a267bc3522d
I20260810 19:47:53.177672 10375 ts_tablet_manager.cc:1950] T 3cda6eb6d4b847edb2624a267bc3522d P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:53.181844 11132 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 19:47:53.182272 10377 ts_tablet_manager.cc:1929] T a78f955a3ca946189de7ea96baee35f6 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:53.182480 10377 log.cc:1199] T a78f955a3ca946189de7ea96baee35f6 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/a78f955a3ca946189de7ea96baee35f6
W20260810 19:47:53.191913 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 410855f236004ad4b78839eb1c0c2f1f consensus state has no leader
I20260810 19:47:53.194389 10377 ts_tablet_manager.cc:1950] T a78f955a3ca946189de7ea96baee35f6 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:53.194793 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 263) took 1494 ms. Trace:
I20260810 19:47:53.194967 10377 rpcz_store.cc:276] 0810 19:47:51.700840 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:51.700910 (+ 70us) service_pool.cc:224] Handling call
0810 19:47:53.119490 (+1418580us) ts_tablet_manager.cc:1151] Deleting tablet a78f955a3ca946189de7ea96baee35f6
0810 19:47:53.119501 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:53.154299 (+ 34798us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:53.182141 (+ 27842us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:53.194751 (+ 12610us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1418321}
I20260810 19:47:53.195500 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet a78f955a3ca946189de7ea96baee35f6 (table default.Table_130fb9e1e90b4c679e2c0ef4cec28827 [id=3225dd83c5dc4e6c9ad6c37794312256]) successfully deleted
I20260810 19:47:53.195602 10026 heartbeater.cc:344] Connected to a master server at 127.8.235.254:33891
I20260810 19:47:53.196419 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 264) took 1487 ms. Trace:
I20260810 19:47:53.196532 10377 rpcz_store.cc:276] 0810 19:47:51.708593 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:51.708653 (+ 60us) service_pool.cc:224] Handling call
0810 19:47:53.196261 (+1487608us) ts_tablet_manager.cc:1151] Deleting tablet 7737acd216204209ba0327e26e85cfe6
0810 19:47:53.196272 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:53.196382 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1487346}
W20260810 19:47:53.197048 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 7737acd216204209ba0327e26e85cfe6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7737acd216204209ba0327e26e85cfe6 already in progress: creating tablet
I20260810 19:47:53.200708 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6a1034f157434db3b707bb21cddbe36b" } new_table_name: "default.Table_39297078d5434aed9d01e90ff26623c8" modify_external_catalogs: true
I20260810 19:47:53.201090 10371 ts_tablet_manager.cc:1929] T b9e761e94dbf4baba5e44a89b6c6a81c P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:53.201277 10371 log.cc:1199] T b9e761e94dbf4baba5e44a89b6c6a81c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/b9e761e94dbf4baba5e44a89b6c6a81c
I20260810 19:47:53.201632 10371 ts_tablet_manager.cc:1950] T b9e761e94dbf4baba5e44a89b6c6a81c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:53.202134 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 265) took 1430 ms. Trace:
I20260810 19:47:53.202265 10377 rpcz_store.cc:276] 0810 19:47:51.771552 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:51.772355 (+ 803us) service_pool.cc:224] Handling call
0810 19:47:53.201935 (+1429580us) ts_tablet_manager.cc:1151] Deleting tablet dd632a01fe424a3a956d445ce01e31d2
0810 19:47:53.201948 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:53.202089 (+ 141us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1425644}
I20260810 19:47:53.202368 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_04f4dbba6a76450e93204861a2b94b0e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:53.202884 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet dd632a01fe424a3a956d445ce01e31d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dd632a01fe424a3a956d445ce01e31d2 already in progress: creating tablet
W20260810 19:47:53.203022 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04f4dbba6a76450e93204861a2b94b0e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:53.204636 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 207) took 2800 ms. Trace:
I20260810 19:47:53.204777 10375 rpcz_store.cc:276] 0810 19:47:50.404228 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.440608 (+ 36380us) service_pool.cc:224] Handling call
0810 19:47:53.142990 (+2702382us) ts_tablet_manager.cc:1151] Deleting tablet 3cda6eb6d4b847edb2624a267bc3522d
0810 19:47:53.143005 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:53.173515 (+ 30510us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:53.176885 (+ 3370us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:53.204559 (+ 27674us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2701984}
I20260810 19:47:53.205292 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 3cda6eb6d4b847edb2624a267bc3522d (table default.Table_d9e5e24d09d44347bc472ff2f0ba20b6 [id=d537831ed0b04450bad2bed57f1d3b23]) successfully deleted
I20260810 19:47:53.205703 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_621e2b21ae7f44e898cb2dfe911d60f2" } modify_external_catalogs: true
I20260810 19:47:53.205888 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_621e2b21ae7f44e898cb2dfe911d60f2" } modify_external_catalogs: true
I20260810 19:47:53.206574 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet b9e761e94dbf4baba5e44a89b6c6a81c (table default.Table_3ffc95fe00014a0b8398de5aced22f11 [id=d277a804313e4f35a31b58d4f682efe6]) successfully deleted
I20260810 19:47:53.207245 9435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5268e710af3c43ddab70eb7dd1aaa575" candidate_term: 2 candidate_status { last_received { term: 1 index: 354 } } ignore_live_leader: false dest_uuid: "0c56283079e74549afd0096f7e72046a" is_pre_election: true
I20260810 19:47:53.207283 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e9290dde7b6e467584d7cdf7b0ceae58" } modify_external_catalogs: true
I20260810 19:47:53.207444 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 266) took 1420 ms. Trace:
I20260810 19:47:53.207472 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e9290dde7b6e467584d7cdf7b0ceae58" } modify_external_catalogs: true
I20260810 19:47:53.207568 10377 rpcz_store.cc:276] 0810 19:47:51.786659 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:51.786731 (+ 72us) service_pool.cc:224] Handling call
0810 19:47:53.207256 (+1420525us) ts_tablet_manager.cc:1151] Deleting tablet c8602b7360b747a3af756b139635d95c
0810 19:47:53.207270 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:53.207397 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1419208}
W20260810 19:47:53.208134 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet c8602b7360b747a3af756b139635d95c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c8602b7360b747a3af756b139635d95c already in progress: creating tablet
I20260810 19:47:53.209070 9407 catalog_manager.cc:5719] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:47:53.209484 9407 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet aa5702d7b3bd421eb7b8a4e0f181d2d4 (table default.Table_5f6b1710e7cc447dbf34e05882706750 [id=a837d5f74eac4f74b2029f46d73acc93]). Expected version 2 got 0
I20260810 19:47:53.212126 10367 tablet_bootstrap.cc:492] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:53.212316 10367 ts_tablet_manager.cc:1403] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.203s user 0.018s sys 0.035s
I20260810 19:47:53.212788 10375 tablet_replica.cc:333] T b9e761e94dbf4baba5e44a89b6c6a81c P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:53.213054 10375 raft_consensus.cc:2243] T b9e761e94dbf4baba5e44a89b6c6a81c P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:53.213258 10375 raft_consensus.cc:2272] T b9e761e94dbf4baba5e44a89b6c6a81c P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:53.213213 10367 raft_consensus.cc:359] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.213424 10367 raft_consensus.cc:385] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.213518 10367 raft_consensus.cc:740] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.213771 10367 consensus_queue.cc:260] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.213912 10375 ts_tablet_manager.cc:1916] T b9e761e94dbf4baba5e44a89b6c6a81c P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:53.215093 10367 ts_tablet_manager.cc:1434] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:47:53.215445 10367 tablet_bootstrap.cc:492] T 4f8bf9f998ad44df98239767d17e3486 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:53.217362 9325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5268e710af3c43ddab70eb7dd1aaa575" candidate_term: 2 candidate_status { last_received { term: 1 index: 354 } } ignore_live_leader: false dest_uuid: "f52c40e347e24ab4b3129e7064f4a43e" is_pre_election: true
I20260810 19:47:53.218971 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 267) took 1250 ms. Trace:
I20260810 19:47:53.219117 10377 rpcz_store.cc:276] 0810 19:47:51.968426 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:51.968493 (+ 67us) service_pool.cc:224] Handling call
0810 19:47:53.218741 (+1250248us) ts_tablet_manager.cc:1151] Deleting tablet 08e29e23d54f47968a06be98b313918d
0810 19:47:53.218754 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:53.218918 (+ 164us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1249943}
W20260810 19:47:53.219684 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 08e29e23d54f47968a06be98b313918d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08e29e23d54f47968a06be98b313918d already in progress: creating tablet
I20260810 19:47:53.220892 10367 tablet_bootstrap.cc:654] T 4f8bf9f998ad44df98239767d17e3486 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.221256 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 268) took 1189 ms. Trace:
I20260810 19:47:53.221731 10377 rpcz_store.cc:276] 0810 19:47:52.032118 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.032190 (+ 72us) service_pool.cc:224] Handling call
0810 19:47:53.220943 (+1188753us) ts_tablet_manager.cc:1151] Deleting tablet 3916a976efef43428942135e777edcec
0810 19:47:53.221074 (+ 131us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:53.221188 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1188495}
W20260810 19:47:53.222669 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 3916a976efef43428942135e777edcec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3916a976efef43428942135e777edcec already in progress: creating tablet
I20260810 19:47:53.223964 11071 tablet.cc:1724] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:47:53.225515 10747 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" instance_seqno: 1786391265204214) as {username='slave'} at 127.8.235.194:47969; Asking this server to re-register.
I20260810 19:47:53.226866 10026 heartbeater.cc:461] Registering TS with master...
I20260810 19:47:53.235138 10377 tablet_replica.cc:333] T a01d3ec3c8914fe495f7a0f3c7c312f8 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:53.235432 10377 raft_consensus.cc:2243] T a01d3ec3c8914fe495f7a0f3c7c312f8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:53.235598 10747 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" instance_seqno: 1786391265751320) as {username='slave'} at 127.8.235.195:59259; Asking this server to re-register.
I20260810 19:47:53.235654 10377 raft_consensus.cc:2272] T a01d3ec3c8914fe495f7a0f3c7c312f8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:53.236793 10246 heartbeater.cc:461] Registering TS with master...
I20260810 19:47:53.239467 10747 ts_manager.cc:194] Registered new tserver with Master: 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:53.239907 10750 ts_manager.cc:194] Registered new tserver with Master: eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:53.242087 10367 tablet_bootstrap.cc:492] T 4f8bf9f998ad44df98239767d17e3486 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:53.242290 10367 ts_tablet_manager.cc:1403] T 4f8bf9f998ad44df98239767d17e3486 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.001s
I20260810 19:47:53.243847 10367 raft_consensus.cc:359] T 4f8bf9f998ad44df98239767d17e3486 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.244095 10367 raft_consensus.cc:385] T 4f8bf9f998ad44df98239767d17e3486 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.244185 10367 raft_consensus.cc:740] T 4f8bf9f998ad44df98239767d17e3486 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.244516 10367 consensus_queue.cc:260] T 4f8bf9f998ad44df98239767d17e3486 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.245198 10367 ts_tablet_manager.cc:1434] T 4f8bf9f998ad44df98239767d17e3486 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 19:47:53.245576 10367 tablet_bootstrap.cc:492] T 74dddd12f2314d6ab5a6717025b13a51 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:53.249632 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3102c066fa6942a28308746ce65d20e7" } modify_external_catalogs: true
I20260810 19:47:53.249842 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3102c066fa6942a28308746ce65d20e7" } modify_external_catalogs: true
I20260810 19:47:53.250329 11154 tablet.cc:1724] T 4d654dada92a4939914d26ab72a5f5e8 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:47:53.251037 10377 ts_tablet_manager.cc:1916] T a01d3ec3c8914fe495f7a0f3c7c312f8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:53.251747 10936 raft_consensus.cc:493] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:53.251933 10936 raft_consensus.cc:515] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.252612 10936 leader_election.cc:290] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:53.253801 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca9d34cb609413d9df495bf191cc409" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:53.253789 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca9d34cb609413d9df495bf191cc409" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:53.254056 10167 raft_consensus.cc:2468] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:53.255213 9611 leader_election.cc:304] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:53.255478 10367 tablet_bootstrap.cc:654] T 74dddd12f2314d6ab5a6717025b13a51 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.255738 10936 raft_consensus.cc:2804] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:53.255856 10936 raft_consensus.cc:493] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:53.255995 10936 raft_consensus.cc:3060] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:53.258869 10370 tablet_bootstrap.cc:492] T a01d3ec3c8914fe495f7a0f3c7c312f8 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:53.259063 10370 ts_tablet_manager.cc:1403] T a01d3ec3c8914fe495f7a0f3c7c312f8 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.123s user 0.006s sys 0.006s
I20260810 19:47:53.259302 10936 raft_consensus.cc:515] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.259925 10370 raft_consensus.cc:359] T a01d3ec3c8914fe495f7a0f3c7c312f8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.260118 10370 raft_consensus.cc:385] T a01d3ec3c8914fe495f7a0f3c7c312f8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.260236 10370 raft_consensus.cc:740] T a01d3ec3c8914fe495f7a0f3c7c312f8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.260501 10370 consensus_queue.cc:260] T a01d3ec3c8914fe495f7a0f3c7c312f8 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.261284 10936 leader_election.cc:290] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:53.261406 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca9d34cb609413d9df495bf191cc409" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:53.261632 10167 raft_consensus.cc:3060] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:47:53.261794 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0bddaf5b5fc1404e83b079ffa97e7321 consensus state has no leader
I20260810 19:47:53.262230 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_096d1b86a19247f2a9d62bdeeab9cbae" } modify_external_catalogs: true
I20260810 19:47:53.262462 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_096d1b86a19247f2a9d62bdeeab9cbae" } modify_external_catalogs: true
I20260810 19:47:53.263602 10370 ts_tablet_manager.cc:1434] T a01d3ec3c8914fe495f7a0f3c7c312f8 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260810 19:47:53.263729 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 6992e7ef8e794ddc879ae04f9f78b8bd
I20260810 19:47:53.263934 10370 tablet_bootstrap.cc:492] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:53.264249 9410 catalog_manager.cc:6807] ReplaceTablet: tablet 6992e7ef8e794ddc879ae04f9f78b8bd deleted and replaced by tablet a2fe67e8bd014acaa202c022c193cdc6
I20260810 19:47:53.264588 9944 raft_consensus.cc:2468] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:53.264578 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1afca0c2da4b421aa82e573457fe46c6" } new_table_name: "default.Table_8a225580c44c484c97bef032a300c69b" modify_external_catalogs: true
I20260810 19:47:53.264784 10167 raft_consensus.cc:2468] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:53.265534 9611 leader_election.cc:304] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:53.265868 10936 raft_consensus.cc:2804] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:53.266104 10936 raft_consensus.cc:697] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:53.266415 10936 consensus_queue.cc:237] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.267148 10370 tablet_bootstrap.cc:654] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.267892 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 6992e7ef8e794ddc879ae04f9f78b8bd with delete_type TABLET_DATA_DELETED (replaced by tablet a2fe67e8bd014acaa202c022c193cdc6) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:53.257690 10366 tablet_bootstrap.cc:492] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:53.268227 10128 tablet_service.cc:1558] Processing DeleteTablet for tablet 6992e7ef8e794ddc879ae04f9f78b8bd with delete_type TABLET_DATA_DELETED (replaced by tablet a2fe67e8bd014acaa202c022c193cdc6) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:53.268127 10696 leader_election.cc:304] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5268e710af3c43ddab70eb7dd1aaa575; no voters: 0c56283079e74549afd0096f7e72046a, f52c40e347e24ab4b3129e7064f4a43e
I20260810 19:47:53.268433 10366 ts_tablet_manager.cc:1403] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.149s user 0.000s sys 0.003s
I20260810 19:47:53.268718 11076 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 19:47:53.263218 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca9d34cb609413d9df495bf191cc409" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:53.269373 9948 raft_consensus.cc:3060] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:53.269567 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 6992e7ef8e794ddc879ae04f9f78b8bd with delete_type TABLET_DATA_DELETED (replaced by tablet a2fe67e8bd014acaa202c022c193cdc6) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:53.269797 10366 raft_consensus.cc:359] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.270041 10366 raft_consensus.cc:385] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.270162 10366 raft_consensus.cc:740] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.273411 9948 raft_consensus.cc:2468] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
W20260810 19:47:53.274485 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 6992e7ef8e794ddc879ae04f9f78b8bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6992e7ef8e794ddc879ae04f9f78b8bd already in progress: creating tablet
I20260810 19:47:53.282407 10375 ts_tablet_manager.cc:1929] T b9e761e94dbf4baba5e44a89b6c6a81c P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:53.282611 10375 log.cc:1199] T b9e761e94dbf4baba5e44a89b6c6a81c P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/b9e761e94dbf4baba5e44a89b6c6a81c
I20260810 19:47:53.283018 10375 ts_tablet_manager.cc:1950] T b9e761e94dbf4baba5e44a89b6c6a81c P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:53.285854 10377 ts_tablet_manager.cc:1929] T a01d3ec3c8914fe495f7a0f3c7c312f8 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:53.286082 10377 log.cc:1199] T a01d3ec3c8914fe495f7a0f3c7c312f8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/a01d3ec3c8914fe495f7a0f3c7c312f8
I20260810 19:47:53.286552 10377 ts_tablet_manager.cc:1950] T a01d3ec3c8914fe495f7a0f3c7c312f8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:53.286996 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 269) took 1254 ms. Trace:
I20260810 19:47:53.287110 10377 rpcz_store.cc:276] 0810 19:47:52.032263 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.032335 (+ 72us) service_pool.cc:224] Handling call
0810 19:47:53.223119 (+1190784us) ts_tablet_manager.cc:1151] Deleting tablet a01d3ec3c8914fe495f7a0f3c7c312f8
0810 19:47:53.234993 (+ 11874us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:53.258353 (+ 23360us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:53.285736 (+ 27383us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:53.286935 (+ 1199us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1190547}
I20260810 19:47:53.287715 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet a01d3ec3c8914fe495f7a0f3c7c312f8 (table default.Table_a1645668cf79415ca029a01169fbf874 [id=aec405416e584af6bfb8194b357d6dbc]) successfully deleted
I20260810 19:47:53.287994 10747 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" instance_seqno: 1786391264640285) as {username='slave'} at 127.8.235.193:50641; Asking this server to re-register.
I20260810 19:47:53.289085 9789 heartbeater.cc:461] Registering TS with master...
I20260810 19:47:53.290354 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 211) took 2749 ms. Trace:
I20260810 19:47:53.290504 10375 rpcz_store.cc:276] 0810 19:47:50.541188 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.541256 (+ 68us) service_pool.cc:224] Handling call
0810 19:47:53.212696 (+2671440us) ts_tablet_manager.cc:1151] Deleting tablet b9e761e94dbf4baba5e44a89b6c6a81c
0810 19:47:53.212712 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:53.217311 (+ 4599us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:53.282277 (+ 64966us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:53.290233 (+ 7956us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2671188}
I20260810 19:47:53.270510 10366 consensus_queue.cc:260] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.293804 10367 tablet_bootstrap.cc:492] T 74dddd12f2314d6ab5a6717025b13a51 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:53.294039 10367 ts_tablet_manager.cc:1403] T 74dddd12f2314d6ab5a6717025b13a51 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.049s user 0.000s sys 0.005s
I20260810 19:47:53.294304 9412 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet f431af7e8ba343be93f5428bd1c0bd39
I20260810 19:47:53.294696 10750 ts_manager.cc:194] Registered new tserver with Master: fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:53.295061 10367 raft_consensus.cc:359] T 74dddd12f2314d6ab5a6717025b13a51 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.295256 10367 raft_consensus.cc:385] T 74dddd12f2314d6ab5a6717025b13a51 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.295356 10367 raft_consensus.cc:740] T 74dddd12f2314d6ab5a6717025b13a51 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
W20260810 19:47:53.295408 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3e8ae48a2fb548358176abefe1ee3baa consensus state has no leader
I20260810 19:47:53.295616 11068 raft_consensus.cc:493] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:53.295734 9416 master_service.cc:960] ReplaceTablet: received request to replace tablet 4f2d7c165d2c465d9080b927d54807f7 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:53.295800 11068 raft_consensus.cc:515] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:53.296159 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 05059ef70a8e440ca2988bfeb610645d has no consensus state
I20260810 19:47:53.296062 10367 consensus_queue.cc:260] T 74dddd12f2314d6ab5a6717025b13a51 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.296509 11068 leader_election.cc:290] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:53.296754 10367 ts_tablet_manager.cc:1434] T 74dddd12f2314d6ab5a6717025b13a51 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:47:53.296921 9420 master_service.cc:960] ReplaceTablet: received request to replace tablet 6af6dd8913f44e7f966ed2a128ae4fbf from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:53.297084 10367 tablet_bootstrap.cc:492] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:53.297122 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ee7973736c4a0a921261d37b74f290" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:53.297356 10167 raft_consensus.cc:2468] T 38ee7973736c4a0a921261d37b74f290 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:53.297686 10366 ts_tablet_manager.cc:1434] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.029s user 0.001s sys 0.001s
I20260810 19:47:53.298050 10366 tablet_bootstrap.cc:492] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:53.298816 9830 leader_election.cc:304] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:53.299201 11068 raft_consensus.cc:2804] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:53.299309 11068 raft_consensus.cc:493] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:53.299432 11068 raft_consensus.cc:3060] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:47:53.299827 9831 leader_election.cc:343] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 38ee7973736c4a0a921261d37b74f290
I20260810 19:47:53.301719 10366 tablet_bootstrap.cc:654] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.303051 11068 raft_consensus.cc:515] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.305097 10367 tablet_bootstrap.cc:654] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:53.312386 9831 leader_election.cc:343] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 38ee7973736c4a0a921261d37b74f290
I20260810 19:47:53.313972 10367 tablet_bootstrap.cc:492] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:53.314234 10367 ts_tablet_manager.cc:1403] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.000s
I20260810 19:47:53.315902 10367 raft_consensus.cc:359] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.316247 10367 raft_consensus.cc:385] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.316401 10367 raft_consensus.cc:740] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.316809 10367 consensus_queue.cc:260] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.317600 10367 ts_tablet_manager.cc:1434] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:47:53.318045 10367 tablet_bootstrap.cc:492] T a01d3ec3c8914fe495f7a0f3c7c312f8 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:53.319939 10367 tablet_bootstrap.cc:654] T a01d3ec3c8914fe495f7a0f3c7c312f8 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.321832 10370 tablet_bootstrap.cc:492] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:53.322031 10370 ts_tablet_manager.cc:1403] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.058s user 0.002s sys 0.003s
I20260810 19:47:53.324038 10370 raft_consensus.cc:359] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.324306 10370 raft_consensus.cc:385] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.324393 10370 raft_consensus.cc:740] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.324713 10370 consensus_queue.cc:260] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.331054 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ee7973736c4a0a921261d37b74f290" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:53.331328 10167 raft_consensus.cc:3060] T 38ee7973736c4a0a921261d37b74f290 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:53.335242 11165 tablet.cc:1724] T 4d654dada92a4939914d26ab72a5f5e8 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:47:53.335386 10167 raft_consensus.cc:2468] T 38ee7973736c4a0a921261d37b74f290 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:53.336198 9830 leader_election.cc:304] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:53.336594 11067 raft_consensus.cc:2804] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:53.336771 11068 leader_election.cc:290] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:53.336800 11067 raft_consensus.cc:697] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:47:53.337162 11067 consensus_queue.cc:237] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.341086 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet b9e761e94dbf4baba5e44a89b6c6a81c (table default.Table_3ffc95fe00014a0b8398de5aced22f11 [id=d277a804313e4f35a31b58d4f682efe6]) successfully deleted
I20260810 19:47:53.341717 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 210) took 2814 ms. Trace:
I20260810 19:47:53.341845 10375 rpcz_store.cc:276] 0810 19:47:50.527505 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.541867 (+ 14362us) service_pool.cc:224] Handling call
0810 19:47:53.341476 (+2799609us) ts_tablet_manager.cc:1151] Deleting tablet 4f2d7c165d2c465d9080b927d54807f7
0810 19:47:53.341492 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:53.341647 (+ 155us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2799326}
W20260810 19:47:53.342585 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 4f2d7c165d2c465d9080b927d54807f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f2d7c165d2c465d9080b927d54807f7 already in progress: creating tablet
I20260810 19:47:53.351205 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 212) took 2780 ms. Trace:
I20260810 19:47:53.351400 10375 rpcz_store.cc:276] 0810 19:47:50.570830 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.602188 (+ 31358us) service_pool.cc:224] Handling call
0810 19:47:53.350963 (+2748775us) ts_tablet_manager.cc:1151] Deleting tablet ee65b2c9980d4c77af8c68bf2f5c5f92
0810 19:47:53.350978 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:53.351135 (+ 157us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2744060}
I20260810 19:47:53.352042 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 270) took 1319 ms. Trace:
W20260810 19:47:53.352679 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet ee65b2c9980d4c77af8c68bf2f5c5f92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee65b2c9980d4c77af8c68bf2f5c5f92 already in progress: creating tablet
I20260810 19:47:53.353111 10367 tablet_bootstrap.cc:492] T a01d3ec3c8914fe495f7a0f3c7c312f8 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:53.353359 10367 ts_tablet_manager.cc:1403] T a01d3ec3c8914fe495f7a0f3c7c312f8 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.035s user 0.008s sys 0.002s
I20260810 19:47:53.354050 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 213) took 2722 ms. Trace:
I20260810 19:47:53.354242 10377 rpcz_store.cc:276] 0810 19:47:52.032436 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.032488 (+ 52us) service_pool.cc:224] Handling call
0810 19:47:53.351808 (+1319320us) ts_tablet_manager.cc:1151] Deleting tablet 6f0150de0d60425b807be532ce0ba6c3
0810 19:47:53.351821 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:53.351960 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1319135}
I20260810 19:47:53.354923 10375 rpcz_store.cc:276] 0810 19:47:50.632064 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.635798 (+ 3734us) service_pool.cc:224] Handling call
0810 19:47:53.353852 (+2718054us) ts_tablet_manager.cc:1151] Deleting tablet e247ae3828e84092b836f3dd07b44bc6
0810 19:47:53.353864 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:53.353986 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2696781}
I20260810 19:47:53.355819 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 272) took 1306 ms. Trace:
I20260810 19:47:53.355887 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_398b6d4ebbf742b99fad6aff42d2802b" } modify_external_catalogs: true
I20260810 19:47:53.356098 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_398b6d4ebbf742b99fad6aff42d2802b" } modify_external_catalogs: true
I20260810 19:47:53.356619 10375 tablet_replica.cc:333] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:53.356817 10375 raft_consensus.cc:2243] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:53.356948 10377 rpcz_store.cc:276] 0810 19:47:52.048855 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.048937 (+ 82us) service_pool.cc:224] Handling call
0810 19:47:53.355674 (+1306737us) ts_tablet_manager.cc:1151] Deleting tablet a9e42e13617c4457ba88ae0e0269ec93
0810 19:47:53.355685 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:53.355763 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1306378}
I20260810 19:47:53.357402 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_11f7a8e6101542a5935af66211bd2469"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:53.357690 10377 tablet_replica.cc:333] T 5f0d4ce494b4459eb05716d6e62d7a09 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:53.357872 10377 raft_consensus.cc:2243] T 5f0d4ce494b4459eb05716d6e62d7a09 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260810 19:47:53.358048 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11f7a8e6101542a5935af66211bd2469 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:53.358178 10377 raft_consensus.cc:2272] T 5f0d4ce494b4459eb05716d6e62d7a09 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:53.358795 10377 ts_tablet_manager.cc:1916] T 5f0d4ce494b4459eb05716d6e62d7a09 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:53.360735 10367 raft_consensus.cc:359] T a01d3ec3c8914fe495f7a0f3c7c312f8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.360941 10367 raft_consensus.cc:385] T a01d3ec3c8914fe495f7a0f3c7c312f8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.361572 10367 raft_consensus.cc:740] T a01d3ec3c8914fe495f7a0f3c7c312f8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.361838 10367 consensus_queue.cc:260] T a01d3ec3c8914fe495f7a0f3c7c312f8 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.362434 10367 ts_tablet_manager.cc:1434] T a01d3ec3c8914fe495f7a0f3c7c312f8 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260810 19:47:53.362758 10367 tablet_bootstrap.cc:492] T aa457d1f5cf2445eb3d869bc6ecf60b3 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:53.364456 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_bd4c6fb49b17455592e347e1b07993b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:53.364818 10367 tablet_bootstrap.cc:654] T aa457d1f5cf2445eb3d869bc6ecf60b3 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:53.365059 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd4c6fb49b17455592e347e1b07993b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:53.365948 11067 raft_consensus.cc:493] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:53.366107 11067 raft_consensus.cc:515] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.367081 11067 leader_election.cc:290] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:53.369076 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8bf9f998ad44df98239767d17e3486" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:53.369285 10370 ts_tablet_manager.cc:1434] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.046s user 0.001s sys 0.001s
I20260810 19:47:53.369362 10167 raft_consensus.cc:2468] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:53.369642 10370 tablet_bootstrap.cc:492] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:53.370745 9830 leader_election.cc:304] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:53.371620 10370 tablet_bootstrap.cc:654] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.375113 10367 tablet_bootstrap.cc:492] T aa457d1f5cf2445eb3d869bc6ecf60b3 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:53.375309 10367 ts_tablet_manager.cc:1403] T aa457d1f5cf2445eb3d869bc6ecf60b3 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260810 19:47:53.376144 10367 raft_consensus.cc:359] T aa457d1f5cf2445eb3d869bc6ecf60b3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.376359 10367 raft_consensus.cc:385] T aa457d1f5cf2445eb3d869bc6ecf60b3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.376441 10367 raft_consensus.cc:740] T aa457d1f5cf2445eb3d869bc6ecf60b3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.376695 10367 consensus_queue.cc:260] T aa457d1f5cf2445eb3d869bc6ecf60b3 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.378665 10367 ts_tablet_manager.cc:1434] T aa457d1f5cf2445eb3d869bc6ecf60b3 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:47:53.379004 10367 tablet_bootstrap.cc:492] T 2d90d9c9f6524859a0e33e649dd80f7c P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:53.380913 10367 tablet_bootstrap.cc:654] T 2d90d9c9f6524859a0e33e649dd80f7c P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.381886 9418 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet a0ade2539ca24513b264e20291ad945d
I20260810 19:47:53.385571 9413 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet c40a1108d8db42fbb86c29960d1b3c25
I20260810 19:47:53.385854 9413 master_service.cc:960] ReplaceTablet: received request to replace tablet 896b7cfdb0ca4904aaeafa13ff19365e from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:53.390970 11067 raft_consensus.cc:2804] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:53.393133 10370 tablet_bootstrap.cc:492] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:53.393352 10370 ts_tablet_manager.cc:1403] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.000s
I20260810 19:47:53.393304 11067 raft_consensus.cc:493] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:53.393680 10375 raft_consensus.cc:2272] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:53.393883 11067 raft_consensus.cc:3060] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:53.398347 10375 ts_tablet_manager.cc:1916] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:53.400180 10366 tablet_bootstrap.cc:492] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:53.400493 10366 ts_tablet_manager.cc:1403] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.103s user 0.002s sys 0.002s
I20260810 19:47:53.401446 10366 raft_consensus.cc:359] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.401786 10366 raft_consensus.cc:385] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.401911 10366 raft_consensus.cc:740] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.402329 10366 consensus_queue.cc:260] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.403534 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8bf9f998ad44df98239767d17e3486" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:53.403801 9714 raft_consensus.cc:2468] T 4f8bf9f998ad44df98239767d17e3486 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:53.405789 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_9725c5009e6f440fa3af441d38e40217"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:53.406635 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_dc64f7c8549548b29cd6e8486da72211"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:53.410593 10366 ts_tablet_manager.cc:1434] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
I20260810 19:47:53.411144 11067 raft_consensus.cc:515] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.412278 11080 raft_consensus.cc:493] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:53.412467 11080 raft_consensus.cc:515] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.413370 11080 leader_election.cc:290] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:53.413926 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74dddd12f2314d6ab5a6717025b13a51" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:53.414202 9714 raft_consensus.cc:2468] T 74dddd12f2314d6ab5a6717025b13a51 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:47:53.414842 10068 leader_election.cc:304] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:53.414201 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74dddd12f2314d6ab5a6717025b13a51" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:53.415352 9948 raft_consensus.cc:2468] T 74dddd12f2314d6ab5a6717025b13a51 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:47:53.416960 11080 raft_consensus.cc:2804] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:53.417106 11080 raft_consensus.cc:493] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:53.417025 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8bf9f998ad44df98239767d17e3486" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:53.417189 11080 raft_consensus.cc:3060] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:53.417268 9714 raft_consensus.cc:3060] T 4f8bf9f998ad44df98239767d17e3486 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:47:53.419075 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eb3e7d34b5314bc7a7c5ed53792728ca has no consensus state
I20260810 19:47:53.419476 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet 34fdc03b114b405da9e3a17ef1ad87c4 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:53.420128 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b69402d23c6840e2955cfc41a73beb92"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:53.420455 9714 raft_consensus.cc:2468] T 4f8bf9f998ad44df98239767d17e3486 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:53.421028 9831 leader_election.cc:304] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:53.421120 11080 raft_consensus.cc:515] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.421413 10932 raft_consensus.cc:2804] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:53.421568 10932 raft_consensus.cc:697] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:47:53.421921 10932 consensus_queue.cc:237] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.423089 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74dddd12f2314d6ab5a6717025b13a51" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:53.423207 11080 leader_election.cc:290] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:53.423288 9948 raft_consensus.cc:3060] T 74dddd12f2314d6ab5a6717025b13a51 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:53.423713 10366 tablet_bootstrap.cc:492] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:53.425850 10366 tablet_bootstrap.cc:654] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.428233 9716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74dddd12f2314d6ab5a6717025b13a51" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:53.428501 9716 raft_consensus.cc:3060] T 74dddd12f2314d6ab5a6717025b13a51 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:53.432281 9716 raft_consensus.cc:2468] T 74dddd12f2314d6ab5a6717025b13a51 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:47:53.432432 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_fd780002767d47fc96de44759973f50c" } new_table_name: "default.Table_3eb29b584f754b4ab55797b02f82462d" modify_external_catalogs: true
I20260810 19:47:53.433207 10068 leader_election.cc:304] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:53.433596 11080 raft_consensus.cc:2804] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:53.433782 9948 raft_consensus.cc:2468] T 74dddd12f2314d6ab5a6717025b13a51 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:47:53.434962 11080 raft_consensus.cc:697] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:47:53.435410 11080 consensus_queue.cc:237] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.442139 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8bf9f998ad44df98239767d17e3486" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:53.442448 10167 raft_consensus.cc:3060] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:53.445703 10167 raft_consensus.cc:2468] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:53.449782 10367 tablet_bootstrap.cc:492] T 2d90d9c9f6524859a0e33e649dd80f7c P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:53.449970 10367 ts_tablet_manager.cc:1403] T 2d90d9c9f6524859a0e33e649dd80f7c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.071s user 0.015s sys 0.046s
I20260810 19:47:53.450145 11067 leader_election.cc:290] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:53.450908 10367 raft_consensus.cc:359] T 2d90d9c9f6524859a0e33e649dd80f7c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.451210 10367 raft_consensus.cc:385] T 2d90d9c9f6524859a0e33e649dd80f7c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.451314 10367 raft_consensus.cc:740] T 2d90d9c9f6524859a0e33e649dd80f7c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.451562 10367 consensus_queue.cc:260] T 2d90d9c9f6524859a0e33e649dd80f7c P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.452355 10367 ts_tablet_manager.cc:1434] T 2d90d9c9f6524859a0e33e649dd80f7c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 19:47:53.452734 10367 tablet_bootstrap.cc:492] T 9e9603994555425289db23bd5c38cc99 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
W20260810 19:47:53.454762 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc64f7c8549548b29cd6e8486da72211 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:53.456045 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9725c5009e6f440fa3af441d38e40217 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:53.456722 10366 tablet_bootstrap.cc:492] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:53.456898 10366 ts_tablet_manager.cc:1403] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.000s
W20260810 19:47:53.457149 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b69402d23c6840e2955cfc41a73beb92 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:53.457556 10367 tablet_bootstrap.cc:654] T 9e9603994555425289db23bd5c38cc99 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.457944 10366 raft_consensus.cc:359] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.458182 10366 raft_consensus.cc:385] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.458329 10366 raft_consensus.cc:740] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.458757 10366 consensus_queue.cc:260] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.460027 10366 ts_tablet_manager.cc:1434] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 19:47:53.461455 10366 tablet_bootstrap.cc:492] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:53.464777 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_4217f5ad81404f348810945248421770"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:53.465479 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4217f5ad81404f348810945248421770 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:53.489338 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7d939e3df62a45d9a964d4df01be4bfb has no consensus state
I20260810 19:47:53.497530 10375 ts_tablet_manager.cc:1929] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:53.498452 10375 log.cc:1199] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/651a1f5011de4db495dbbab2d19ff096
I20260810 19:47:53.498667 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_45a851a9919d48ad94da86574312fb58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:53.394381 10370 raft_consensus.cc:359] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.499179 10370 raft_consensus.cc:385] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.499351 10370 raft_consensus.cc:740] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
W20260810 19:47:53.499400 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45a851a9919d48ad94da86574312fb58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:53.499807 10370 consensus_queue.cc:260] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.500588 10370 ts_tablet_manager.cc:1434] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.107s user 0.000s sys 0.003s
I20260810 19:47:53.501502 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_306e2618657d4c399188ca2985977672" } new_table_name: "default.Table_e1cc6dd116324bf385dbc82e56283cf7" modify_external_catalogs: true
I20260810 19:47:53.500936 10375 ts_tablet_manager.cc:1950] T 651a1f5011de4db495dbbab2d19ff096 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:53.502982 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_53bdbd217fb14fa892a0a49daf36f7af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:53.503610 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53bdbd217fb14fa892a0a49daf36f7af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:53.504396 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 215) took 2778 ms. Trace:
I20260810 19:47:53.504964 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_717c8249c368451e88c10baf2240d27f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:53.505722 10936 raft_consensus.cc:493] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:53.505918 10936 raft_consensus.cc:515] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:53.506637 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_717c8249c368451e88c10baf2240d27f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:53.506783 10936 leader_election.cc:290] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:53.512506 10375 rpcz_store.cc:276] 0810 19:47:50.725859 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.725922 (+ 63us) service_pool.cc:224] Handling call
0810 19:47:53.356524 (+2630602us) ts_tablet_manager.cc:1151] Deleting tablet 651a1f5011de4db495dbbab2d19ff096
0810 19:47:53.356535 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:53.447018 (+ 90483us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:53.497408 (+ 50390us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:53.504344 (+ 6936us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36586,"tablet-delete.queue_time_us":2630314}
I20260810 19:47:53.518366 9420 master_service.cc:960] ReplaceTablet: received request to replace tablet f2931130e9354f16a238712234c19217 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:53.508898 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e177140cad404e978b927c810b87ae0c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:53.519433 9611 leader_election.cc:343] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:53.494966 10377 ts_tablet_manager.cc:1929] T 5f0d4ce494b4459eb05716d6e62d7a09 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:53.508371 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e177140cad404e978b927c810b87ae0c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:53.519959 9948 raft_consensus.cc:2468] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:53.520524 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f7094d91833544e996949b52a5a24386"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:53.520659 9611 leader_election.cc:304] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:53.520756 10366 tablet_bootstrap.cc:654] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:53.521121 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7094d91833544e996949b52a5a24386 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:53.521253 10936 raft_consensus.cc:2804] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:53.521376 10936 raft_consensus.cc:493] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:53.521524 10936 raft_consensus.cc:3060] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:53.524581 10936 raft_consensus.cc:515] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.525993 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e177140cad404e978b927c810b87ae0c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:53.526244 9948 raft_consensus.cc:3060] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:53.529368 9948 raft_consensus.cc:2468] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:53.530741 9611 leader_election.cc:304] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:53.531137 11087 raft_consensus.cc:2804] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
W20260810 19:47:53.533226 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3840b035b88243ecad17865d4716fcfc has no consensus state
I20260810 19:47:53.533728 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_fe85d49e887b4fcea312afae466097e7" } modify_external_catalogs: true
I20260810 19:47:53.533918 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_fe85d49e887b4fcea312afae466097e7" } modify_external_catalogs: true
I20260810 19:47:53.534621 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e177140cad404e978b927c810b87ae0c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
W20260810 19:47:53.535346 9611 leader_election.cc:343] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:53.535791 10936 leader_election.cc:290] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:53.535841 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_93675b8da3114fbe80cc09ae7bf427cc" } new_table_name: "default.Table_267ef2e8b32c47328dd2094f69e0940d" modify_external_catalogs: true
I20260810 19:47:53.538576 10377 log.cc:1199] T 5f0d4ce494b4459eb05716d6e62d7a09 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/5f0d4ce494b4459eb05716d6e62d7a09
I20260810 19:47:53.539948 10377 ts_tablet_manager.cc:1950] T 5f0d4ce494b4459eb05716d6e62d7a09 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:53.505203 10370 tablet_bootstrap.cc:492] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:53.543845 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 651a1f5011de4db495dbbab2d19ff096 (table default.Table_8759361d39fb4003a644f53ecd07d2d1 [id=e10b3ffceb96420494d92992411ff2ba]) successfully deleted
I20260810 19:47:53.544204 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 273) took 1494 ms. Trace:
I20260810 19:47:53.544606 10375 tablet_replica.cc:333] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:53.544862 10377 rpcz_store.cc:276] 0810 19:47:52.048982 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.049109 (+ 127us) service_pool.cc:224] Handling call
0810 19:47:53.357608 (+1308499us) ts_tablet_manager.cc:1151] Deleting tablet 5f0d4ce494b4459eb05716d6e62d7a09
0810 19:47:53.357618 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:53.412954 (+ 55336us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:53.494833 (+ 81879us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:53.543064 (+ 48231us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1308244}
I20260810 19:47:53.547469 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_126ec28d33ff45b2833943e70c8ed968" } new_table_name: "default.Table_524d53e58b014d8d9816c1e62b40c7d9" modify_external_catalogs: true
I20260810 19:47:53.548081 10375 raft_consensus.cc:2243] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:53.548290 10375 raft_consensus.cc:2272] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:53.549381 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 5f0d4ce494b4459eb05716d6e62d7a09 (table default.Table_00c06a91c9354d248755681fa27cf4fe [id=6e28810aef52474fbe2a51e601877ab6]) successfully deleted
I20260810 19:47:53.550243 10377 tablet_replica.cc:333] T 176d4e72b8e44e4b88bdf89d06f2f79a P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:53.550638 10377 raft_consensus.cc:2243] T 176d4e72b8e44e4b88bdf89d06f2f79a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:53.551286 10377 raft_consensus.cc:2272] T 176d4e72b8e44e4b88bdf89d06f2f79a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:53.551389 10366 tablet_bootstrap.cc:492] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:53.551852 10366 ts_tablet_manager.cc:1403] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.090s user 0.002s sys 0.002s
I20260810 19:47:53.552739 10366 raft_consensus.cc:359] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.553036 10366 raft_consensus.cc:385] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.553171 10366 raft_consensus.cc:740] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.553556 10366 consensus_queue.cc:260] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.558043 11080 raft_consensus.cc:493] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:53.558259 11080 raft_consensus.cc:515] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.559036 11080 leader_election.cc:290] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:53.560051 10128 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d90d9c9f6524859a0e33e649dd80f7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:53.560289 10139 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cda6eb6d4b847edb2624a267bc3522d with delete_type TABLET_DATA_DELETED (replaced by tablet 3e8d34d723134d9289d96e633fed3fde) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:53.560316 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ca9d34cb609413d9df495bf191cc409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:53.560890 9412 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 4d654dada92a4939914d26ab72a5f5e8 (table default.Table_dcf48c67df284776aca6205b880fbbc5 [id=a8bdf6ea608f4279971af4c9eff71db6]). Expected version 1 got 0
I20260810 19:47:53.562049 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d90d9c9f6524859a0e33e649dd80f7c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:47:53.562712 10067 leader_election.cc:343] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:53.563205 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d90d9c9f6524859a0e33e649dd80f7c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:53.563508 9714 raft_consensus.cc:2468] T 2d90d9c9f6524859a0e33e649dd80f7c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:47:53.564100 10068 leader_election.cc:304] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691
I20260810 19:47:53.564462 11080 raft_consensus.cc:2804] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:53.564561 11080 raft_consensus.cc:493] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:53.564670 11080 raft_consensus.cc:3060] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:47:53.565938 9830 consensus_peers.cc:597] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 651a1f5011de4db495dbbab2d19ff096. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:53.566471 10366 ts_tablet_manager.cc:1434] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260810 19:47:53.567763 11080 raft_consensus.cc:515] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.568506 11080 leader_election.cc:290] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:53.569526 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d90d9c9f6524859a0e33e649dd80f7c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
W20260810 19:47:53.570120 10067 leader_election.cc:343] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:53.573057 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d90d9c9f6524859a0e33e649dd80f7c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:53.573354 9714 raft_consensus.cc:3060] T 2d90d9c9f6524859a0e33e649dd80f7c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:53.574535 9667 tablet_service.cc:1511] Processing CreateTablet for tablet f85f3fa629764c79921a710739eea7ae (DEFAULT_TABLE table=default.Table_aa5df7d93dfb4603b493ab5638468a59 [id=fadd6b8bf2244dfab48fdadb0d12b6fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.574985 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85f3fa629764c79921a710739eea7ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.575467 10367 tablet_bootstrap.cc:492] T 9e9603994555425289db23bd5c38cc99 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:53.575685 10367 ts_tablet_manager.cc:1403] T 9e9603994555425289db23bd5c38cc99 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.123s user 0.035s sys 0.057s
I20260810 19:47:53.576689 9714 raft_consensus.cc:2468] T 2d90d9c9f6524859a0e33e649dd80f7c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:47:53.577169 10068 leader_election.cc:304] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691
I20260810 19:47:53.577477 11080 raft_consensus.cc:2804] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:53.577720 11080 raft_consensus.cc:697] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:47:53.578596 11080 consensus_queue.cc:237] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.583755 10366 tablet_bootstrap.cc:492] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:53.586180 10367 raft_consensus.cc:359] T 9e9603994555425289db23bd5c38cc99 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.588896 10367 raft_consensus.cc:385] T 9e9603994555425289db23bd5c38cc99 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.589251 10367 raft_consensus.cc:740] T 9e9603994555425289db23bd5c38cc99 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.589891 10367 consensus_queue.cc:260] T 9e9603994555425289db23bd5c38cc99 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.590097 10375 ts_tablet_manager.cc:1916] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:53.591059 10367 ts_tablet_manager.cc:1434] T 9e9603994555425289db23bd5c38cc99 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260810 19:47:53.591924 10367 tablet_bootstrap.cc:492] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:53.546334 10370 tablet_bootstrap.cc:654] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.594004 10367 tablet_bootstrap.cc:654] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.594507 10366 tablet_bootstrap.cc:654] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.597319 9902 tablet_service.cc:1511] Processing CreateTablet for tablet f85f3fa629764c79921a710739eea7ae (DEFAULT_TABLE table=default.Table_aa5df7d93dfb4603b493ab5638468a59 [id=fadd6b8bf2244dfab48fdadb0d12b6fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.597960 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85f3fa629764c79921a710739eea7ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.605892 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 4f21e03993e841ba901f1e9c176309b9 (DEFAULT_TABLE table=default.Table_ac3fc982487f4b0da46ba2d2fbf03f63 [id=6c0a50477acc489cb3a3895e7cda4eca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.606415 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f21e03993e841ba901f1e9c176309b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.606927 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 4f21e03993e841ba901f1e9c176309b9 (DEFAULT_TABLE table=default.Table_ac3fc982487f4b0da46ba2d2fbf03f63 [id=6c0a50477acc489cb3a3895e7cda4eca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.607501 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f21e03993e841ba901f1e9c176309b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.610466 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 82c3f619c76e40c583bfcdf2bb77fe42 (DEFAULT_TABLE table=default.Table_93675b8da3114fbe80cc09ae7bf427cc [id=0f7622612fec444b93d9454f31849cd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.610661 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 4198f46be0194875aea6a7952321bc69 (DEFAULT_TABLE table=default.Table_066ecd6fc0e0441eb69e39d946ba0b9a [id=f5ad4bd8b30e44e9b14bd6dfcc2bbb28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.610934 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82c3f619c76e40c583bfcdf2bb77fe42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.611037 9911 tablet_service.cc:1511] Processing CreateTablet for tablet 4198f46be0194875aea6a7952321bc69 (DEFAULT_TABLE table=default.Table_066ecd6fc0e0441eb69e39d946ba0b9a [id=f5ad4bd8b30e44e9b14bd6dfcc2bbb28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.611452 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4198f46be0194875aea6a7952321bc69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.612466 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4198f46be0194875aea6a7952321bc69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.615262 10367 tablet_bootstrap.cc:492] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:53.615442 10367 ts_tablet_manager.cc:1403] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.000s
I20260810 19:47:53.616338 10367 raft_consensus.cc:359] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.616559 10367 raft_consensus.cc:385] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.616647 10367 raft_consensus.cc:740] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.616927 10367 consensus_queue.cc:260] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.617103 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 82c3f619c76e40c583bfcdf2bb77fe42 (DEFAULT_TABLE table=default.Table_93675b8da3114fbe80cc09ae7bf427cc [id=0f7622612fec444b93d9454f31849cd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.617254 9408 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet aa5702d7b3bd421eb7b8a4e0f181d2d4 (table default.Table_5f6b1710e7cc447dbf34e05882706750 [id=a837d5f74eac4f74b2029f46d73acc93]). Expected version 2 got 0
I20260810 19:47:53.617462 9408 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 9e9603994555425289db23bd5c38cc99 (table default.Table_0dafd75d95394cdda8062e308591219d [id=3ec1bdaeba584422a569a6f070344b6a]). Expected version 2 got 0
I20260810 19:47:53.617530 10367 ts_tablet_manager.cc:1434] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:47:53.617604 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82c3f619c76e40c583bfcdf2bb77fe42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.617871 10367 tablet_bootstrap.cc:492] T 34fdc03b114b405da9e3a17ef1ad87c4 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:53.618139 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_20489495f6794646b9eda0458ee58d91" } modify_external_catalogs: true
I20260810 19:47:53.618366 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_20489495f6794646b9eda0458ee58d91" } modify_external_catalogs: true
I20260810 19:47:53.623242 11067 raft_consensus.cc:493] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:53.623365 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 3840b035b88243ecad17865d4716fcfc (DEFAULT_TABLE table=default.Table_e1cc6dd116324bf385dbc82e56283cf7 [id=6bf4ac94189d476d9ab5778e69d0b14f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.623478 11067 raft_consensus.cc:515] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.623847 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3840b035b88243ecad17865d4716fcfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.624251 11067 leader_election.cc:290] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:53.628419 9421 master_service.cc:960] ReplaceTablet: received request to replace tablet 9e9603994555425289db23bd5c38cc99 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:53.630718 10367 tablet_bootstrap.cc:654] T 34fdc03b114b405da9e3a17ef1ad87c4 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.635157 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b995f3c3bca4501a6c62cf9025051b2" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:53.635949 10367 tablet_bootstrap.cc:492] T 34fdc03b114b405da9e3a17ef1ad87c4 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
W20260810 19:47:53.635972 9831 leader_election.cc:343] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:53.636234 10367 ts_tablet_manager.cc:1403] T 34fdc03b114b405da9e3a17ef1ad87c4 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.001s
I20260810 19:47:53.636756 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 3840b035b88243ecad17865d4716fcfc (DEFAULT_TABLE table=default.Table_e1cc6dd116324bf385dbc82e56283cf7 [id=6bf4ac94189d476d9ab5778e69d0b14f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.637558 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3840b035b88243ecad17865d4716fcfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.637465 10367 raft_consensus.cc:359] T 34fdc03b114b405da9e3a17ef1ad87c4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.637681 10367 raft_consensus.cc:385] T 34fdc03b114b405da9e3a17ef1ad87c4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.637761 10367 raft_consensus.cc:740] T 34fdc03b114b405da9e3a17ef1ad87c4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.638032 10367 consensus_queue.cc:260] T 34fdc03b114b405da9e3a17ef1ad87c4 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.638718 10367 ts_tablet_manager.cc:1434] T 34fdc03b114b405da9e3a17ef1ad87c4 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:47:53.639067 10367 tablet_bootstrap.cc:492] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:53.642349 10377 ts_tablet_manager.cc:1916] T 176d4e72b8e44e4b88bdf89d06f2f79a P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:53.643209 10367 tablet_bootstrap.cc:654] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.643440 9410 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet e38cc064f3fd42a4ad9bc499c01595a5
I20260810 19:47:53.594254 11087 raft_consensus.cc:697] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:53.645825 11087 consensus_queue.cc:237] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.647706 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_44197dd0fe1e4c88b41c1e9996eaa4a2" } modify_external_catalogs: true
I20260810 19:47:53.647961 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_44197dd0fe1e4c88b41c1e9996eaa4a2" } modify_external_catalogs: true
I20260810 19:47:53.652901 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 18cd8adaa065425c846bc791c05fa67d (DEFAULT_TABLE table=default.Table_a1645668cf79415ca029a01169fbf874 [id=aec405416e584af6bfb8194b357d6dbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.653378 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18cd8adaa065425c846bc791c05fa67d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:53.657174 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 82c3f619c76e40c583bfcdf2bb77fe42 consensus state has no leader
I20260810 19:47:53.657506 9418 master_service.cc:960] ReplaceTablet: received request to replace tablet 965395b5072e4d47adac504e22a8d484 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:53.657352 10367 tablet_bootstrap.cc:492] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:53.658253 10367 ts_tablet_manager.cc:1403] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.002s
I20260810 19:47:53.659610 10367 raft_consensus.cc:359] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.659891 10367 raft_consensus.cc:385] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.660028 10367 raft_consensus.cc:740] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.660346 10367 consensus_queue.cc:260] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.661186 10367 ts_tablet_manager.cc:1434] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 19:47:53.661571 10367 tablet_bootstrap.cc:492] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:53.662711 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e104dc1ca7624bcaad9a86a8854217e5" } new_table_name: "default.Table_0cf27f44c96c48b6a8f46cf6bcd77713" modify_external_catalogs: true
I20260810 19:47:53.663492 10367 tablet_bootstrap.cc:654] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.667435 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 4198f46be0194875aea6a7952321bc69 (DEFAULT_TABLE table=default.Table_066ecd6fc0e0441eb69e39d946ba0b9a [id=f5ad4bd8b30e44e9b14bd6dfcc2bbb28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.667954 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4198f46be0194875aea6a7952321bc69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.668807 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 827dce05c192467589e2692fabd2a84e (DEFAULT_TABLE table=default.Table_dca6b457fbf744e089c4a583fca06cbb [id=4bce0610a04641ff86ab3af94e12e31d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.669255 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 827dce05c192467589e2692fabd2a84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.669323 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 82c3f619c76e40c583bfcdf2bb77fe42 (DEFAULT_TABLE table=default.Table_93675b8da3114fbe80cc09ae7bf427cc [id=0f7622612fec444b93d9454f31849cd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.669713 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82c3f619c76e40c583bfcdf2bb77fe42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.672158 11190 consensus_queue.cc:1048] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:53.673269 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 3840b035b88243ecad17865d4716fcfc (DEFAULT_TABLE table=default.Table_e1cc6dd116324bf385dbc82e56283cf7 [id=6bf4ac94189d476d9ab5778e69d0b14f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.673668 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3840b035b88243ecad17865d4716fcfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.675621 10367 tablet_bootstrap.cc:492] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:53.676221 10367 ts_tablet_manager.cc:1403] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.001s
W20260810 19:47:53.676520 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 648ef608fa0c45cc8be4bad80c4200be consensus state has no leader
I20260810 19:47:53.677395 10367 raft_consensus.cc:359] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.678406 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 4f21e03993e841ba901f1e9c176309b9 (DEFAULT_TABLE table=default.Table_ac3fc982487f4b0da46ba2d2fbf03f63 [id=6c0a50477acc489cb3a3895e7cda4eca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.678691 10367 raft_consensus.cc:385] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.678851 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f21e03993e841ba901f1e9c176309b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.678857 10367 raft_consensus.cc:740] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.679692 10367 consensus_queue.cc:260] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.681023 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a6baa15791834b67978359ba4d7dcc50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:53.681457 10367 ts_tablet_manager.cc:1434] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 19:47:53.681454 11080 raft_consensus.cc:493] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 19:47:53.681702 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6baa15791834b67978359ba4d7dcc50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:53.681645 11080 raft_consensus.cc:515] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.681831 10367 tablet_bootstrap.cc:492] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:53.684448 10367 tablet_bootstrap.cc:654] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.685801 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5702d7b3bd421eb7b8a4e0f181d2d4" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:53.686141 9714 raft_consensus.cc:2393] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eadde59fd6504d679e47f03a60c64bb0 in current term 1: Already voted for candidate 6986ed920dcb4af29a5eeeda6f671691 in this term.
I20260810 19:47:53.688833 9413 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_dcf48c67df284776aca6205b880fbbc5 [id=a8bdf6ea608f4279971af4c9eff71db6] alter complete (version 1)
I20260810 19:47:53.689580 9413 master_service.cc:960] ReplaceTablet: received request to replace tablet 63486cc3f8774a11827b1cc5f1c16332 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:53.691543 9408 master_service.cc:960] ReplaceTablet: received request to replace tablet 896b7cfdb0ca4904aaeafa13ff19365e from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:53.692589 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 18cd8adaa065425c846bc791c05fa67d (DEFAULT_TABLE table=default.Table_a1645668cf79415ca029a01169fbf874 [id=aec405416e584af6bfb8194b357d6dbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.693461 10367 tablet_bootstrap.cc:492] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:53.693728 10367 ts_tablet_manager.cc:1403] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.007s
I20260810 19:47:53.694861 10367 raft_consensus.cc:359] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.695179 10367 raft_consensus.cc:385] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.695346 10367 raft_consensus.cc:740] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.695758 10367 consensus_queue.cc:260] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.696612 10367 ts_tablet_manager.cc:1434] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:47:53.697019 10367 tablet_bootstrap.cc:492] T 842a5dacf9d145889e97069d3c8084b8 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:53.127606 10790 rpcz_store.cc:276] 0810 19:47:51.819908 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:51.820057 (+ 149us) service_pool.cc:224] Handling call
0810 19:47:52.131706 (+311649us) raft_consensus.cc:1471] Updating replica for 344 ops
0810 19:47:52.159049 (+ 27343us) raft_consensus.cc:1534] Early marking committed up to index 10
0810 19:47:52.180669 (+ 21620us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:47:52.180675 (+ 6us) write_op.cc:454] Released schema lock
0810 19:47:52.181019 (+ 344us) raft_consensus.cc:1539] Triggering prepare for 344 ops
0810 19:47:52.181471 (+ 452us) write_op.cc:270] Start()
0810 19:47:52.181518 (+ 47us) write_op.cc:276] Timestamp: P: 1786391265970685 usec, L: 0
0810 19:47:52.181844 (+ 326us) write_op.cc:270] Start()
0810 19:47:52.181870 (+ 26us) write_op.cc:276] Timestamp: P: 1786391265976329 usec, L: 0
0810 19:47:52.182040 (+ 170us) write_op.cc:270] Start()
0810 19:47:52.182064 (+ 24us) write_op.cc:276] Timestamp: P: 1786391265977033 usec, L: 0
0810 19:47:52.182204 (+ 140us) write_op.cc:270] Start()
0810 19:47:52.182223 (+ 19us) write_op.cc:276] Timestamp: P: 1786391265977567 usec, L: 0
0810 19:47:52.182426 (+ 203us) write_op.cc:270] Start()
0810 19:47:52.182458 (+ 32us) write_op.cc:276] Timestamp: P: 1786391265978447 usec, L: 0
0810 19:47:52.182619 (+ 161us) write_op.cc:270] Start()
0810 19:47:52.182636 (+ 17us) write_op.cc:276] Timestamp: P: 1786391265978959 usec, L: 0
0810 19:47:52.185219 (+ 2583us) write_op.cc:270] Start()
0810 19:47:52.185246 (+ 27us) write_op.cc:276] Timestamp: P: 1786391265979502 usec, L: 0
0810 19:47:52.185815 (+ 569us) write_op.cc:270] Start()
0810 19:47:52.185839 (+ 24us) write_op.cc:276] Timestamp: P: 1786391265979986 usec, L: 0
0810 19:47:52.186350 (+ 511us) write_op.cc:270] Start()
0810 19:47:52.186376 (+ 26us) write_op.cc:276] Timestamp: P: 1786391265984785 usec, L: 0
0810 19:47:52.186916 (+ 540us) write_op.cc:270] Start()
0810 19:47:52.186940 (+ 24us) write_op.cc:276] Timestamp: P: 1786391265985757 usec, L: 0
0810 19:47:52.187450 (+ 510us) write_op.cc:270] Start()
0810 19:47:52.187472 (+ 22us) write_op.cc:276] Timestamp: P: 1786391265986770 usec, L: 0
0810 19:47:52.187982 (+ 510us) write_op.cc:270] Start()
0810 19:47:52.188006 (+ 24us) write_op.cc:276] Timestamp: P: 1786391266019520 usec, L: 0
0810 19:47:52.189046 (+ 1040us) write_op.cc:270] Start()
0810 19:47:52.189071 (+ 25us) write_op.cc:276] Timestamp: P: 1786391266052017 usec, L: 0
0810 19:47:52.189214 (+ 143us) write_op.cc:270] Start()
0810 19:47:52.189233 (+ 19us) write_op.cc:276] Timestamp: P: 1786391266052852 usec, L: 0
0810 19:47:52.189367 (+ 134us) write_op.cc:270] Start()
0810 19:47:52.189384 (+ 17us) write_op.cc:276] Timestamp: P: 1786391266053517 usec, L: 0
0810 19:47:52.189502 (+ 118us) write_op.cc:270] Start()
0810 19:47:52.189518 (+ 16us) write_op.cc:276] Timestamp: P: 1786391266057194 usec, L: 0
0810 19:47:52.189631 (+ 113us) write_op.cc:270] Start()
0810 19:47:52.189656 (+ 25us) write_op.cc:276] Timestamp: P: 1786391266153133 usec, L: 0
0810 19:47:52.189801 (+ 145us) write_op.cc:270] Start()
0810 19:47:52.189818 (+ 17us) write_op.cc:276] Timestamp: P: 1786391266161659 usec, L: 0
0810 19:47:52.190272 (+ 454us) write_op.cc:270] Start()
0810 19:47:52.190305 (+ 33us) write_op.cc:276] Timestamp: P: 1786391266165190 usec, L: 0
0810 19:47:52.190536 (+ 231us) write_op.cc:270] Start()
0810 19:47:52.190558 (+ 22us) write_op.cc:276] Timestamp: P: 1786391266170261 usec, L: 0
0810 19:47:52.190676 (+ 118us) write_op.cc:270] Start()
0810 19:47:52.190693 (+ 17us) write_op.cc:276] Timestamp: P: 1786391266176102 usec, L: 0
0810 19:47:52.190816 (+ 123us) write_op.cc:270] Start()
0810 19:47:52.190833 (+ 17us) write_op.cc:276] Timestamp: P: 1786391266179541 usec, L: 0
0810 19:47:52.190995 (+ 162us) write_op.cc:270] Start()
0810 19:47:52.191043 (+ 48us) write_op.cc:276] Timestamp: P: 1786391266185053 usec, L: 0
0810 19:47:52.191155 (+ 112us) write_op.cc:270] Start()
0810 19:47:52.191172 (+ 17us) write_op.cc:276] Timestamp: P: 1786391266190363 usec, L: 0
0810 19:47:52.191299 (+ 127us) write_op.cc:270] Start()
0810 19:47:52.191327 (+ 28us) write_op.cc:276] Timestamp: P: 1786391266194402 usec, L: 0
0810 19:47:52.191453 (+ 126us) write_op.cc:270] Start()
0810 19:47:52.191475 (+ 22us) write_op.cc:276] Timestamp: P: 1786391266211582 usec, L: 0
0810 19:47:52.191617 (+ 142us) write_op.cc:270] Start()
0810 19:47:52.191639 (+ 22us) write_op.cc:276] Timestamp: P: 1786391266218173 usec, L: 0
0810 19:47:52.191785 (+ 146us) write_op.cc:270] Start()
0810 19:47:52.191806 (+ 21us) write_op.cc:276] Timestamp: P: 1786391266218810 usec, L: 0
0810 19:47:52.191939 (+ 133us) write_op.cc:270] Start()
0810 19:47:52.191958 (+ 19us) write_op.cc:276] Timestamp: P: 1786391266219428 usec, L: 0
0810 19:47:52.192074 (+ 116us) write_op.cc:270] Start()
0810 19:47:52.192092 (+ 18us) write_op.cc:276] Timestamp: P: 1786391266219942 usec, L: 0
0810 19:47:52.192254 (+ 162us) write_op.cc:270] Start()
0810 19:47:52.192273 (+ 19us) write_op.cc:276] Timestamp: P: 1786391266220525 usec, L: 0
0810 19:47:52.192443 (+ 170us) write_op.cc:270] Start()
0810 19:47:52.192464 (+ 21us) write_op.cc:276] Timestamp: P: 1786391266220974 usec, L: 0
0810 19:47:52.192669 (+ 205us) write_op.cc:270] Start()
0810 19:47:52.192692 (+ 23us) write_op.cc:276] Timestamp: P: 1786391266225276 usec, L: 0
0810 19:47:52.192839 (+ 147us) write_op.cc:270] Start()
0810 19:47:52.192857 (+ 18us) write_op.cc:276] Timestamp: P: 1786391266226359 usec, L: 0
0810 19:47:52.192971 (+ 114us) write_op.cc:270] Start()
0810 19:47:52.192988 (+ 17us) write_op.cc:276] Timestamp: P: 1786391266262937 usec, L: 0
0810 19:47:52.193101 (+ 113us) write_op.cc:270] Start()
0810 19:47:52.193117 (+ 16us) write_op.cc:276] Timestamp: P: 1786391266263806 usec, L: 0
0810 19:47:52.193235 (+ 118us) write_op.cc:270] Start()
0810 19:47:52.193269 (+ 34us) write_op.cc:276] Timestamp: P: 1786391266283768 usec, L: 0
0810 19:47:52.193409 (+ 140us) write_op.cc:270] Start()
0810 19:47:52.193426 (+ 17us) write_op.cc:276] Timestamp: P: 1786391266300696 usec, L: 0
0810 19:47:52.193546 (+ 120us) write_op.cc:270] Start()
0810 19:47:52.193565 (+ 19us) write_op.cc:276] Timestamp: P: 1786391266316526 usec, L: 0
0810 19:47:52.193678 (+ 113us) write_op.cc:270] Start()
0810 19:47:52.193695 (+ 17us) write_op.cc:276] Timestamp: P: 1786391266326918 usec, L: 0
0810 19:47:52.193819 (+ 124us) write_op.cc:270] Start()
0810 19:47:52.193837 (+ 18us) write_op.cc:276] Timestamp: P: 1786391266339582 usec, L: 0
0810 19:47:52.193976 (+ 139us) write_op.cc:270] Start()
0810 19:47:52.193995 (+ 19us) write_op.cc:276] Timestamp: P: 1786391266372716 usec, L: 0
0810 19:47:52.194149 (+ 154us) write_op.cc:270] Start()
0810 19:47:52.194169 (+ 20us) write_op.cc:276] Timestamp: P: 1786391266390721 usec, L: 0
0810 19:47:52.275300 (+ 81131us) write_op.cc:270] Start()
0810 19:47:52.275403 (+ 103us) write_op.cc:276] Timestamp: P: 1786391266395250 usec, L: 0
0810 19:47:52.275738 (+ 335us) write_op.cc:270] Start()
0810 19:47:52.275764 (+ 26us) write_op.cc:276] Timestamp: P: 1786391266410553 usec, L: 0
0810 19:47:52.275907 (+ 143us) write_op.cc:270] Start()
0810 19:47:52.277101 (+ 1194us) write_op.cc:276] Timestamp: P: 1786391266415206 usec, L: 0
0810 19:47:52.277372 (+ 271us) write_op.cc:270] Start()
0810 19:47:52.277398 (+ 26us) write_op.cc:276] Timestamp: P: 1786391266440650 usec, L: 0
0810 19:47:52.277669 (+ 271us) write_op.cc:270] Start()
0810 19:47:52.277691 (+ 22us) write_op.cc:276] Timestamp: P: 1786391266443458 usec, L: 0
0810 19:47:52.277829 (+ 138us) write_op.cc:270] Start()
0810 19:47:52.277846 (+ 17us) write_op.cc:276] Timestamp: P: 1786391266445058 usec, L: 0
0810 19:47:52.278007 (+ 161us) write_op.cc:270] Start()
0810 19:47:52.278026 (+ 19us) write_op.cc:276] Timestamp: P: 1786391266456484 usec, L: 0
0810 19:47:52.278161 (+ 135us) write_op.cc:270] Start()
0810 19:47:52.278179 (+ 18us) write_op.cc:276] Timestamp: P: 1786391266457899 usec, L: 0
0810 19:47:52.278297 (+ 118us) write_op.cc:270] Start()
0810 19:47:52.278336 (+ 39us) write_op.cc:276] Timestamp: P: 1786391266458906 usec, L: 0
0810 19:47:52.278480 (+ 144us) write_op.cc:270] Start()
0810 19:47:52.278498 (+ 18us) write_op.cc:276] Timestamp: P: 1786391266459817 usec, L: 0
0810 19:47:52.278615 (+ 117us) write_op.cc:270] Start()
0810 19:47:52.278632 (+ 17us) write_op.cc:276] Timestamp: P: 1786391266460629 usec, L: 0
0810 19:47:52.278749 (+ 117us) write_op.cc:270] Start()
0810 19:47:52.278776 (+ 27us) write_op.cc:276] Timestamp: P: 1786391266461391 usec, L: 0
0810 19:47:52.278930 (+ 154us) write_op.cc:270] Start()
0810 19:47:52.278952 (+ 22us) write_op.cc:276] Timestamp: P: 1786391266544651 usec, L: 0
0810 19:47:52.279075 (+ 123us) write_op.cc:270] Start()
0810 19:47:52.279093 (+ 18us) write_op.cc:276] Timestamp: P: 1786391266546280 usec, L: 0
0810 19:47:52.279231 (+ 138us) write_op.cc:270] Start()
0810 19:47:52.279248 (+ 17us) write_op.cc:276] Timestamp: P: 1786391266560227 usec, L: 0
0810 19:47:52.279398 (+ 150us) write_op.cc:270] Start()
0810 19:47:52.279417 (+ 19us) write_op.cc:276] Timestamp: P: 1786391266589786 usec, L: 0
0810 19:47:52.279544 (+ 127us) write_op.cc:270] Start()
0810 19:47:52.279561 (+ 17us) write_op.cc:276] Timestamp: P: 1786391266593419 usec, L: 0
0810 19:47:52.279679 (+ 118us) write_op.cc:270] Start()
0810 19:47:52.279696 (+ 17us) write_op.cc:276] Timestamp: P: 1786391266601770 usec, L: 0
0810 19:47:52.279811 (+ 115us) write_op.cc:270] Start()
0810 19:47:52.279828 (+ 17us) write_op.cc:276] Timestamp: P: 1786391266606226 usec, L: 0
0810 19:47:52.279942 (+ 114us) write_op.cc:270] Start()
0810 19:47:52.279959 (+ 17us) write_op.cc:276] Timestamp: P: 1786391266648166 usec, L: 0
0810 19:47:52.280108 (+ 149us) write_op.cc:270] Start()
0810 19:47:52.280125 (+ 17us) write_op.cc:276] Timestamp: P: 1786391266662423 usec, L: 0
0810 19:47:52.280296 (+ 171us) write_op.cc:270] Start()
0810 19:47:52.280320 (+ 24us) write_op.cc:276] Timestamp: P: 1786391266673312 usec, L: 0
0810 19:47:52.280489 (+ 169us) write_op.cc:270] Start()
0810 19:47:52.280509 (+ 20us) write_op.cc:276] Timestamp: P: 1786391266688578 usec, L: 0
0810 19:47:52.280638 (+ 129us) write_op.cc:270] Start()
0810 19:47:52.280656 (+ 18us) write_op.cc:276] Timestamp: P: 1786391266695666 usec, L: 0
0810 19:47:52.280779 (+ 123us) write_op.cc:270] Start()
0810 19:47:52.280796 (+ 17us) write_op.cc:276] Timestamp: P: 1786391266699613 usec, L: 0
0810 19:47:52.280918 (+ 122us) write_op.cc:270] Start()
0810 19:47:52.280936 (+ 18us) write_op.cc:276] Timestamp: P: 1786391266701051 usec, L: 0
0810 19:47:52.281054 (+ 118us) write_op.cc:270] Start()
0810 19:47:52.281072 (+ 18us) write_op.cc:276] Timestamp: P: 1786391266703846 usec, L: 0
0810 19:47:52.281182 (+ 110us) write_op.cc:270] Start()
0810 19:47:52.281199 (+ 17us) write_op.cc:276] Timestamp: P: 1786391266708602 usec, L: 0
0810 19:47:52.281324 (+ 125us) write_op.cc:270] Start()
0810 19:47:52.281353 (+ 29us) write_op.cc:276] Timestamp: P: 1786391266726816 usec, L: 0
0810 19:47:52.281511 (+ 158us) write_op.cc:270] Start()
0810 19:47:52.281530 (+ 19us) write_op.cc:276] Timestamp: P: 1786391266820981 usec, L: 0
0810 19:47:52.281671 (+ 141us) write_op.cc:270] Start()
0810 19:47:52.281689 (+ 18us) write_op.cc:276] Timestamp: P: 1786391266822495 usec, L: 0
0810 19:47:52.281806 (+ 117us) write_op.cc:270] Start()
0810 19:47:52.281824 (+ 18us) write_op.cc:276] Timestamp: P: 1786391266823449 usec, L: 0
0810 19:47:52.281936 (+ 112us) write_op.cc:270] Start()
0810 19:47:52.281954 (+ 18us) write_op.cc:276] Timestamp: P: 1786391266824632 usec, L: 0
0810 19:47:52.282073 (+ 119us) write_op.cc:270] Start()
0810 19:47:52.282091 (+ 18us) write_op.cc:276] Timestamp: P: 1786391266825571 usec, L: 0
0810 19:47:52.289943 (+ 7852us) write_op.cc:270] Start()
0810 19:47:52.289997 (+ 54us) write_op.cc:276] Timestamp: P: 1786391266826466 usec, L: 0
0810 19:47:52.290262 (+ 265us) write_op.cc:270] Start()
0810 19:47:52.290308 (+ 46us) write_op.cc:276] Timestamp: P: 1786391266827547 usec, L: 0
0810 19:47:52.290547 (+ 239us) write_op.cc:270] Start()
0810 19:47:52.290569 (+ 22us) write_op.cc:276] Timestamp: P: 1786391266866722 usec, L: 0
0810 19:47:52.290690 (+ 121us) write_op.cc:270] Start()
0810 19:47:52.290707 (+ 17us) write_op.cc:276] Timestamp: P: 1786391266867398 usec, L: 0
0810 19:47:52.290856 (+ 149us) write_op.cc:270] Start()
0810 19:47:52.290874 (+ 18us) write_op.cc:276] Timestamp: P: 1786391266963857 usec, L: 0
0810 19:47:52.291718 (+ 844us) write_op.cc:270] Start()
0810 19:47:52.291737 (+ 19us) write_op.cc:276] Timestamp: P: 1786391266964728 usec, L: 0
0810 19:47:52.291870 (+ 133us) write_op.cc:270] Start()
0810 19:47:52.291888 (+ 18us) write_op.cc:276] Timestamp: P: 1786391266965476 usec, L: 0
0810 19:47:52.292022 (+ 134us) write_op.cc:270] Start()
0810 19:47:52.292039 (+ 17us) write_op.cc:276] Timestamp: P: 1786391266966653 usec, L: 0
0810 19:47:52.292188 (+ 149us) write_op.cc:270] Start()
0810 19:47:52.292206 (+ 18us) write_op.cc:276] Timestamp: P: 1786391267051086 usec, L: 0
0810 19:47:52.292321 (+ 115us) write_op.cc:270] Start()
0810 19:47:52.292338 (+ 17us) write_op.cc:276] Timestamp: P: 1786391267085223 usec, L: 0
0810 19:47:52.292488 (+ 150us) write_op.cc:270] Start()
0810 19:47:52.292512 (+ 24us) write_op.cc:276] Timestamp: P: 1786391267086232 usec, L: 0
0810 19:47:52.292649 (+ 137us) write_op.cc:270] Start()
0810 19:47:52.292668 (+ 19us) write_op.cc:276] Timestamp: P: 1786391267086903 usec, L: 0
0810 19:47:52.292789 (+ 121us) write_op.cc:270] Start()
0810 19:47:52.292806 (+ 17us) write_op.cc:276] Timestamp: P: 1786391267087542 usec, L: 0
0810 19:47:52.292946 (+ 140us) write_op.cc:270] Start()
0810 19:47:52.292963 (+ 17us) write_op.cc:276] Timestamp: P: 1786391267088289 usec, L: 0
0810 19:47:52.293100 (+ 137us) write_op.cc:270] Start()
0810 19:47:52.293118 (+ 18us) write_op.cc:276] Timestamp: P: 1786391267088902 usec, L: 0
0810 19:47:52.293239 (+ 121us) write_op.cc:270] Start()
0810 19:47:52.293255 (+ 16us) write_op.cc:276] Timestamp: P: 1786391267095792 usec, L: 0
0810 19:47:52.293381 (+ 126us) write_op.cc:270] Start()
0810 19:47:52.293438 (+ 57us) write_op.cc:276] Timestamp: P: 1786391267122518 usec, L: 0
0810 19:47:52.293560 (+ 122us) write_op.cc:270] Start()
0810 19:47:52.293577 (+ 17us) write_op.cc:276] Timestamp: P: 1786391267123493 usec, L: 0
0810 19:47:52.293703 (+ 126us) write_op.cc:270] Start()
0810 19:47:52.293721 (+ 18us) write_op.cc:276] Timestamp: P: 1786391267125670 usec, L: 0
0810 19:47:52.293866 (+ 145us) write_op.cc:270] Start()
0810 19:47:52.293881 (+ 15us) write_op.cc:276] Timestamp: P: 1786391267126466 usec, L: 0
0810 19:47:52.294026 (+ 145us) write_op.cc:270] Start()
0810 19:47:52.294045 (+ 19us) write_op.cc:276] Timestamp: P: 1786391267127122 usec, L: 0
0810 19:47:52.294185 (+ 140us) write_op.cc:270] Start()
0810 19:47:52.294202 (+ 17us) write_op.cc:276] Timestamp: P: 1786391267130236 usec, L: 0
0810 19:47:52.294526 (+ 324us) write_op.cc:270] Start()
0810 19:47:52.294579 (+ 53us) write_op.cc:276] Timestamp: P: 1786391267134252 usec, L: 0
0810 19:47:52.294838 (+ 259us) write_op.cc:270] Start()
0810 19:47:52.294860 (+ 22us) write_op.cc:276] Timestamp: P: 1786391267152590 usec, L: 0
0810 19:47:52.294996 (+ 136us) write_op.cc:270] Start()
0810 19:47:52.295015 (+ 19us) write_op.cc:276] Timestamp: P: 1786391267154771 usec, L: 0
0810 19:47:52.295146 (+ 131us) write_op.cc:270] Start()
0810 19:47:52.295165 (+ 19us) write_op.cc:276] Timestamp: P: 1786391267276385 usec, L: 0
0810 19:47:52.295306 (+ 141us) write_op.cc:270] Start()
0810 19:47:52.295324 (+ 18us) write_op.cc:276] Timestamp: P: 1786391267277077 usec, L: 0
0810 19:47:52.295454 (+ 130us) write_op.cc:270] Start()
0810 19:47:52.295488 (+ 34us) write_op.cc:276] Timestamp: P: 1786391267326096 usec, L: 0
0810 19:47:52.295627 (+ 139us) write_op.cc:270] Start()
0810 19:47:52.295646 (+ 19us) write_op.cc:276] Timestamp: P: 1786391267398865 usec, L: 0
0810 19:47:52.295775 (+ 129us) write_op.cc:270] Start()
0810 19:47:52.295793 (+ 18us) write_op.cc:276] Timestamp: P: 1786391267566726 usec, L: 0
0810 19:47:52.295931 (+ 138us) write_op.cc:270] Start()
0810 19:47:52.295949 (+ 18us) write_op.cc:276] Timestamp: P: 1786391267567581 usec, L: 0
0810 19:47:52.296103 (+ 154us) write_op.cc:270] Start()
0810 19:47:52.296122 (+ 19us) write_op.cc:276] Timestamp: P: 1786391267568243 usec, L: 0
0810 19:47:52.296248 (+ 126us) write_op.cc:270] Start()
0810 19:47:52.296266 (+ 18us) write_op.cc:276] Timestamp: P: 1786391267607460 usec, L: 0
0810 19:47:52.296379 (+ 113us) write_op.cc:270] Start()
0810 19:47:52.296396 (+ 17us) write_op.cc:276] Timestamp: P: 1786391267608174 usec, L: 0
0810 19:47:52.296531 (+ 135us) write_op.cc:270] Start()
0810 19:47:52.296549 (+ 18us) write_op.cc:276] Timestamp: P: 1786391267635071 usec, L: 0
0810 19:47:52.296685 (+ 136us) write_op.cc:270] Start()
0810 19:47:52.296703 (+ 18us) write_op.cc:276] Timestamp: P: 1786391267644532 usec, L: 0
0810 19:47:52.296842 (+ 139us) write_op.cc:270] Start()
0810 19:47:52.296860 (+ 18us) write_op.cc:276] Timestamp: P: 1786391267666616 usec, L: 0
0810 19:47:52.296980 (+ 120us) write_op.cc:270] Start()
0810 19:47:52.296998 (+ 18us) write_op.cc:276] Timestamp: P: 1786391267680452 usec, L: 0
0810 19:47:52.297119 (+ 121us) write_op.cc:270] Start()
0810 19:47:52.297144 (+ 25us) write_op.cc:276] Timestamp: P: 1786391267683183 usec, L: 0
0810 19:47:52.297266 (+ 122us) write_op.cc:270] Start()
0810 19:47:52.297283 (+ 17us) write_op.cc:276] Timestamp: P: 1786391267686064 usec, L: 0
0810 19:47:52.297410 (+ 127us) write_op.cc:270] Start()
0810 19:47:52.297428 (+ 18us) write_op.cc:276] Timestamp: P: 1786391267693028 usec, L: 0
0810 19:47:52.297555 (+ 127us) write_op.cc:270] Start()
0810 19:47:52.297573 (+ 18us) write_op.cc:276] Timestamp: P: 1786391267695868 usec, L: 0
0810 19:47:52.297697 (+ 124us) write_op.cc:270] Start()
0810 19:47:52.297713 (+ 16us) write_op.cc:276] Timestamp: P: 1786391267700079 usec, L: 0
0810 19:47:52.297823 (+ 110us) write_op.cc:270] Start()
0810 19:47:52.297840 (+ 17us) write_op.cc:276] Timestamp: P: 1786391267705785 usec, L: 0
0810 19:47:52.297960 (+ 120us) write_op.cc:270] Start()
0810 19:47:52.297995 (+ 35us) write_op.cc:276] Timestamp: P: 1786391267706531 usec, L: 0
0810 19:47:52.298287 (+ 292us) write_op.cc:270] Start()
0810 19:47:52.339936 (+ 41649us) write_op.cc:276] Timestamp: P: 1786391267707204 usec, L: 0
0810 19:47:52.340764 (+ 828us) write_op.cc:270] Start()
0810 19:47:52.340814 (+ 50us) write_op.cc:276] Timestamp: P: 1786391267707861 usec, L: 0
0810 19:47:52.341023 (+ 209us) write_op.cc:270] Start()
0810 19:47:52.341046 (+ 23us) write_op.cc:276] Timestamp: P: 1786391267721566 usec, L: 0
0810 19:47:52.341179 (+ 133us) write_op.cc:270] Start()
0810 19:47:52.341198 (+ 19us) write_op.cc:276] Timestamp: P: 1786391267738519 usec, L: 0
0810 19:47:52.341319 (+ 121us) write_op.cc:270] Start()
0810 19:47:52.341337 (+ 18us) write_op.cc:276] Timestamp: P: 1786391267839715 usec, L: 0
0810 19:47:52.341516 (+ 179us) write_op.cc:270] Start()
0810 19:47:52.341547 (+ 31us) write_op.cc:276] Timestamp: P: 1786391267842032 usec, L: 0
0810 19:47:52.341745 (+ 198us) write_op.cc:270] Start()
0810 19:47:52.341765 (+ 20us) write_op.cc:276] Timestamp: P: 1786391267842906 usec, L: 0
0810 19:47:52.341923 (+ 158us) write_op.cc:270] Start()
0810 19:47:52.341942 (+ 19us) write_op.cc:276] Timestamp: P: 1786391267845323 usec, L: 0
0810 19:47:52.342073 (+ 131us) write_op.cc:270] Start()
0810 19:47:52.342094 (+ 21us) write_op.cc:276] Timestamp: P: 1786391267845950 usec, L: 0
0810 19:47:52.342245 (+ 151us) write_op.cc:270] Start()
0810 19:47:52.342264 (+ 19us) write_op.cc:276] Timestamp: P: 1786391267890349 usec, L: 0
0810 19:47:52.344227 (+ 1963us) write_op.cc:270] Start()
0810 19:47:52.344258 (+ 31us) write_op.cc:276] Timestamp: P: 1786391267891159 usec, L: 0
0810 19:47:52.344433 (+ 175us) write_op.cc:270] Start()
0810 19:47:52.344473 (+ 40us) write_op.cc:276] Timestamp: P: 1786391267894719 usec, L: 0
0810 19:47:52.344592 (+ 119us) write_op.cc:270] Start()
0810 19:47:52.344613 (+ 21us) write_op.cc:276] Timestamp: P: 1786391267895356 usec, L: 0
0810 19:47:52.344751 (+ 138us) write_op.cc:270] Start()
0810 19:47:52.344770 (+ 19us) write_op.cc:276] Timestamp: P: 1786391267908958 usec, L: 0
0810 19:47:52.344910 (+ 140us) write_op.cc:270] Start()
0810 19:47:52.344930 (+ 20us) write_op.cc:276] Timestamp: P: 1786391267919267 usec, L: 0
0810 19:47:52.345069 (+ 139us) write_op.cc:270] Start()
0810 19:47:52.345089 (+ 20us) write_op.cc:276] Timestamp: P: 1786391267926923 usec, L: 0
0810 19:47:52.345209 (+ 120us) write_op.cc:270] Start()
0810 19:47:52.345227 (+ 18us) write_op.cc:276] Timestamp: P: 1786391267927581 usec, L: 0
0810 19:47:52.345337 (+ 110us) write_op.cc:270] Start()
0810 19:47:52.345354 (+ 17us) write_op.cc:276] Timestamp: P: 1786391267929690 usec, L: 0
0810 19:47:52.345488 (+ 134us) write_op.cc:270] Start()
0810 19:47:52.345505 (+ 17us) write_op.cc:276] Timestamp: P: 1786391267938428 usec, L: 0
0810 19:47:52.345644 (+ 139us) write_op.cc:270] Start()
0810 19:47:52.345661 (+ 17us) write_op.cc:276] Timestamp: P: 1786391267942659 usec, L: 0
0810 19:47:52.345762 (+ 101us) write_op.cc:270] Start()
0810 19:47:52.345778 (+ 16us) write_op.cc:276] Timestamp: P: 1786391268026650 usec, L: 0
0810 19:47:52.345926 (+ 148us) write_op.cc:270] Start()
0810 19:47:52.345947 (+ 21us) write_op.cc:276] Timestamp: P: 1786391268028933 usec, L: 0
0810 19:47:52.349618 (+ 3671us) write_op.cc:270] Start()
0810 19:47:52.349659 (+ 41us) write_op.cc:276] Timestamp: P: 1786391268030177 usec, L: 0
0810 19:47:52.349901 (+ 242us) write_op.cc:270] Start()
0810 19:47:52.349942 (+ 41us) write_op.cc:276] Timestamp: P: 1786391268031287 usec, L: 0
0810 19:47:52.350084 (+ 142us) write_op.cc:270] Start()
0810 19:47:52.350104 (+ 20us) write_op.cc:276] Timestamp: P: 1786391268032273 usec, L: 0
0810 19:47:52.350236 (+ 132us) write_op.cc:270] Start()
0810 19:47:52.350254 (+ 18us) write_op.cc:276] Timestamp: P: 1786391268077421 usec, L: 0
0810 19:47:52.365574 (+ 15320us) write_op.cc:270] Start()
0810 19:47:52.365620 (+ 46us) write_op.cc:276] Timestamp: P: 1786391268099257 usec, L: 0
0810 19:47:52.365897 (+ 277us) write_op.cc:270] Start()
0810 19:47:52.365927 (+ 30us) write_op.cc:276] Timestamp: P: 1786391268099965 usec, L: 0
0810 19:47:52.366074 (+ 147us) write_op.cc:270] Start()
0810 19:47:52.366093 (+ 19us) write_op.cc:276] Timestamp: P: 1786391268101062 usec, L: 0
0810 19:47:52.366228 (+ 135us) write_op.cc:270] Start()
0810 19:47:52.366248 (+ 20us) write_op.cc:276] Timestamp: P: 1786391268105111 usec, L: 0
0810 19:47:52.366420 (+ 172us) write_op.cc:270] Start()
0810 19:47:52.366443 (+ 23us) write_op.cc:276] Timestamp: P: 1786391268105808 usec, L: 0
0810 19:47:52.366586 (+ 143us) write_op.cc:270] Start()
0810 19:47:52.366604 (+ 18us) write_op.cc:276] Timestamp: P: 1786391268119073 usec, L: 0
0810 19:47:52.366736 (+ 132us) write_op.cc:270] Start()
0810 19:47:52.366754 (+ 18us) write_op.cc:276] Timestamp: P: 1786391268119920 usec, L: 0
0810 19:47:52.366867 (+ 113us) write_op.cc:270] Start()
0810 19:47:52.366884 (+ 17us) write_op.cc:276] Timestamp: P: 1786391268127795 usec, L: 0
0810 19:47:52.367008 (+ 124us) write_op.cc:270] Start()
0810 19:47:52.367025 (+ 17us) write_op.cc:276] Timestamp: P: 1786391268151571 usec, L: 0
0810 19:47:52.367152 (+ 127us) write_op.cc:270] Start()
0810 19:47:52.367171 (+ 19us) write_op.cc:276] Timestamp: P: 1786391268160126 usec, L: 0
0810 19:47:52.367312 (+ 141us) write_op.cc:270] Start()
0810 19:47:52.367328 (+ 16us) write_op.cc:276] Timestamp: P: 1786391268160831 usec, L: 0
0810 19:47:52.367452 (+ 124us) write_op.cc:270] Start()
0810 19:47:52.367474 (+ 22us) write_op.cc:276] Timestamp: P: 1786391268171444 usec, L: 0
0810 19:47:52.367610 (+ 136us) write_op.cc:270] Start()
0810 19:47:52.367631 (+ 21us) write_op.cc:276] Timestamp: P: 1786391268174857 usec, L: 0
0810 19:47:52.367764 (+ 133us) write_op.cc:270] Start()
0810 19:47:52.367784 (+ 20us) write_op.cc:276] Timestamp: P: 1786391268180197 usec, L: 0
0810 19:47:52.367919 (+ 135us) write_op.cc:270] Start()
0810 19:47:52.367938 (+ 19us) write_op.cc:276] Timestamp: P: 1786391268181439 usec, L: 0
0810 19:47:52.368080 (+ 142us) write_op.cc:270] Start()
0810 19:47:52.368101 (+ 21us) write_op.cc:276] Timestamp: P: 1786391268190587 usec, L: 0
0810 19:47:52.368234 (+ 133us) write_op.cc:270] Start()
0810 19:47:52.368287 (+ 53us) write_op.cc:276] Timestamp: P: 1786391268219560 usec, L: 0
0810 19:47:52.368414 (+ 127us) write_op.cc:270] Start()
0810 19:47:52.368433 (+ 19us) write_op.cc:276] Timestamp: P: 1786391268267967 usec, L: 0
0810 19:47:52.368549 (+ 116us) write_op.cc:270] Start()
0810 19:47:52.368610 (+ 61us) write_op.cc:276] Timestamp: P: 1786391268292895 usec, L: 0
0810 19:47:52.368798 (+ 188us) write_op.cc:270] Start()
0810 19:47:52.368821 (+ 23us) write_op.cc:276] Timestamp: P: 1786391268308644 usec, L: 0
0810 19:47:52.368965 (+ 144us) write_op.cc:270] Start()
0810 19:47:52.368985 (+ 20us) write_op.cc:276] Timestamp: P: 1786391268321304 usec, L: 0
0810 19:47:52.369136 (+ 151us) write_op.cc:270] Start()
0810 19:47:52.369155 (+ 19us) write_op.cc:276] Timestamp: P: 1786391268381100 usec, L: 0
0810 19:47:52.369300 (+ 145us) write_op.cc:270] Start()
0810 19:47:52.369323 (+ 23us) write_op.cc:276] Timestamp: P: 1786391268394180 usec, L: 0
0810 19:47:52.369464 (+ 141us) write_op.cc:270] Start()
0810 19:47:52.369483 (+ 19us) write_op.cc:276] Timestamp: P: 1786391268399927 usec, L: 0
0810 19:47:52.369617 (+ 134us) write_op.cc:270] Start()
0810 19:47:52.369634 (+ 17us) write_op.cc:276] Timestamp: P: 1786391268423979 usec, L: 0
0810 19:47:52.369744 (+ 110us) write_op.cc:270] Start()
0810 19:47:52.369760 (+ 16us) write_op.cc:276] Timestamp: P: 1786391268445823 usec, L: 0
0810 19:47:52.369867 (+ 107us) write_op.cc:270] Start()
0810 19:47:52.369885 (+ 18us) write_op.cc:276] Timestamp: P: 1786391268457144 usec, L: 0
0810 19:47:52.369988 (+ 103us) write_op.cc:270] Start()
0810 19:47:52.370003 (+ 15us) write_op.cc:276] Timestamp: P: 1786391268482069 usec, L: 0
0810 19:47:52.370121 (+ 118us) write_op.cc:270] Start()
0810 19:47:52.370137 (+ 16us) write_op.cc:276] Timestamp: P: 1786391268491299 usec, L: 0
0810 19:47:52.403202 (+ 33065us) write_op.cc:270] Start()
0810 19:47:52.403250 (+ 48us) write_op.cc:276] Timestamp: P: 1786391268497350 usec, L: 0
0810 19:47:52.403576 (+ 326us) write_op.cc:270] Start()
0810 19:47:52.403607 (+ 31us) write_op.cc:276] Timestamp: P: 1786391268551888 usec, L: 0
0810 19:47:52.403774 (+ 167us) write_op.cc:270] Start()
0810 19:47:52.403796 (+ 22us) write_op.cc:276] Timestamp: P: 1786391268555878 usec, L: 0
0810 19:47:52.403955 (+ 159us) write_op.cc:270] Start()
0810 19:47:52.403979 (+ 24us) write_op.cc:276] Timestamp: P: 1786391268560833 usec, L: 0
0810 19:47:52.404138 (+ 159us) write_op.cc:270] Start()
0810 19:47:52.404159 (+ 21us) write_op.cc:276] Timestamp: P: 1786391268561872 usec, L: 0
0810 19:47:52.404302 (+ 143us) write_op.cc:270] Start()
0810 19:47:52.404321 (+ 19us) write_op.cc:276] Timestamp: P: 1786391268562936 usec, L: 0
0810 19:47:52.404445 (+ 124us) write_op.cc:270] Start()
0810 19:47:52.404475 (+ 30us) write_op.cc:276] Timestamp: P: 1786391268563841 usec, L: 0
0810 19:47:52.404599 (+ 124us) write_op.cc:270] Start()
0810 19:47:52.404613 (+ 14us) write_op.cc:276] Timestamp: P: 1786391268564787 usec, L: 0
0810 19:47:52.404697 (+ 84us) write_op.cc:270] Start()
0810 19:47:52.404709 (+ 12us) write_op.cc:276] Timestamp: P: 1786391268565744 usec, L: 0
0810 19:47:52.404790 (+ 81us) write_op.cc:270] Start()
0810 19:47:52.404802 (+ 12us) write_op.cc:276] Timestamp: P: 1786391268566630 usec, L: 0
0810 19:47:52.404888 (+ 86us) write_op.cc:270] Start()
0810 19:47:52.404899 (+ 11us) write_op.cc:276] Timestamp: P: 1786391268567770 usec, L: 0
0810 19:47:52.405035 (+ 136us) write_op.cc:270] Start()
0810 19:47:52.405055 (+ 20us) write_op.cc:276] Timestamp: P: 1786391268675593 usec, L: 0
0810 19:47:52.405157 (+ 102us) write_op.cc:270] Start()
0810 19:47:52.405170 (+ 13us) write_op.cc:276] Timestamp: P: 1786391268689663 usec, L: 0
0810 19:47:52.405255 (+ 85us) write_op.cc:270] Start()
0810 19:47:52.405266 (+ 11us) write_op.cc:276] Timestamp: P: 1786391268705681 usec, L: 0
0810 19:47:52.405364 (+ 98us) write_op.cc:270] Start()
0810 19:47:52.405377 (+ 13us) write_op.cc:276] Timestamp: P: 1786391268717227 usec, L: 0
0810 19:47:52.405514 (+ 137us) write_op.cc:270] Start()
0810 19:47:52.405534 (+ 20us) write_op.cc:276] Timestamp: P: 1786391268732010 usec, L: 0
0810 19:47:52.405662 (+ 128us) write_op.cc:270] Start()
0810 19:47:52.405678 (+ 16us) write_op.cc:276] Timestamp: P: 1786391268745284 usec, L: 0
0810 19:47:52.405774 (+ 96us) write_op.cc:270] Start()
0810 19:47:52.405788 (+ 14us) write_op.cc:276] Timestamp: P: 1786391268757672 usec, L: 0
0810 19:47:52.405925 (+ 137us) write_op.cc:270] Start()
0810 19:47:52.405941 (+ 16us) write_op.cc:276] Timestam
I20260810 19:47:53.699072 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e1bd107e98074407bc8cbc5a0644d5b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:53.699740 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1bd107e98074407bc8cbc5a0644d5b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:53.701618 10367 tablet_bootstrap.cc:654] T 842a5dacf9d145889e97069d3c8084b8 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.703989 10354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0c56283079e74549afd0096f7e72046a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } } }
I20260810 19:47:53.704197 10354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [sys.catalog]: This master's current role is: LEADER
I20260810 19:47:53.710632 10367 tablet_bootstrap.cc:492] T 842a5dacf9d145889e97069d3c8084b8 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:53.710985 10367 ts_tablet_manager.cc:1403] T 842a5dacf9d145889e97069d3c8084b8 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.001s
I20260810 19:47:53.712347 10367 raft_consensus.cc:359] T 842a5dacf9d145889e97069d3c8084b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.712754 10367 raft_consensus.cc:385] T 842a5dacf9d145889e97069d3c8084b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.712929 10367 raft_consensus.cc:740] T 842a5dacf9d145889e97069d3c8084b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.713294 10367 consensus_queue.cc:260] T 842a5dacf9d145889e97069d3c8084b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.714212 10164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b995f3c3bca4501a6c62cf9025051b2" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:53.715413 10367 ts_tablet_manager.cc:1434] T 842a5dacf9d145889e97069d3c8084b8 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260810 19:47:53.715377 10120 tablet_service.cc:1558] Processing DeleteTablet for tablet 74dddd12f2314d6ab5a6717025b13a51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:53.715754 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d90d9c9f6524859a0e33e649dd80f7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:53.715999 10367 tablet_bootstrap.cc:492] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:53.716048 10371 tablet_replica.cc:333] T 2d90d9c9f6524859a0e33e649dd80f7c P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:53.716322 10371 raft_consensus.cc:2243] T 2d90d9c9f6524859a0e33e649dd80f7c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:53.716537 10371 raft_consensus.cc:2272] T 2d90d9c9f6524859a0e33e649dd80f7c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:53.717439 10371 ts_tablet_manager.cc:1916] T 2d90d9c9f6524859a0e33e649dd80f7c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:53.717458 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 827dce05c192467589e2692fabd2a84e (DEFAULT_TABLE table=default.Table_dca6b457fbf744e089c4a583fca06cbb [id=4bce0610a04641ff86ab3af94e12e31d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.717655 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet a01d3ec3c8914fe495f7a0f3c7c312f8 with delete_type TABLET_DATA_DELETED (replaced by tablet 18cd8adaa065425c846bc791c05fa67d) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:53.717983 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 827dce05c192467589e2692fabd2a84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.719461 11080 leader_election.cc:290] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:53.722407 10140 tablet_service.cc:1511] Processing CreateTablet for tablet f85f3fa629764c79921a710739eea7ae (DEFAULT_TABLE table=default.Table_aa5df7d93dfb4603b493ab5638468a59 [id=fadd6b8bf2244dfab48fdadb0d12b6fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.722570 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet aa457d1f5cf2445eb3d869bc6ecf60b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:53.722908 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85f3fa629764c79921a710739eea7ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.723773 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet e177140cad404e978b927c810b87ae0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:53.724771 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ca9d34cb609413d9df495bf191cc409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:53.724893 10371 ts_tablet_manager.cc:1929] T 2d90d9c9f6524859a0e33e649dd80f7c P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:53.725040 10371 log.cc:1199] T 2d90d9c9f6524859a0e33e649dd80f7c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/2d90d9c9f6524859a0e33e649dd80f7c
I20260810 19:47:53.725505 10371 ts_tablet_manager.cc:1950] T 2d90d9c9f6524859a0e33e649dd80f7c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:53.725792 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 74dddd12f2314d6ab5a6717025b13a51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:53.728242 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18cd8adaa065425c846bc791c05fa67d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.729022 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 2d90d9c9f6524859a0e33e649dd80f7c (table default.Table_4d9757a90ce34541a2c047891e32a42c [id=cec00e7815514025aee218d41250d360]) successfully deleted
I20260810 19:47:53.729463 10371 tablet_replica.cc:333] T a01d3ec3c8914fe495f7a0f3c7c312f8 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:53.730222 10371 raft_consensus.cc:2243] T a01d3ec3c8914fe495f7a0f3c7c312f8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:53.730585 10371 raft_consensus.cc:2272] T a01d3ec3c8914fe495f7a0f3c7c312f8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:53.729959 10367 tablet_bootstrap.cc:654] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.731992 10371 ts_tablet_manager.cc:1916] T a01d3ec3c8914fe495f7a0f3c7c312f8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:53.731961 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_66fcd95a5a224b4c8eb48cde1040885b" } new_table_name: "default.Table_134e9e0b05db45adb8ebab5241b132b1" modify_external_catalogs: true
I20260810 19:47:53.732004 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f8bf9f998ad44df98239767d17e3486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:53.749315 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 60bd14fb8c2e40dc955352518d463ccb
I20260810 19:47:53.751180 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 60bd14fb8c2e40dc955352518d463ccb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:53 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:53.755159 9667 tablet_service.cc:1511] Processing CreateTablet for tablet ca733de7babe4343ab26dbca2c9020b2 (DEFAULT_TABLE table=default.Table_31db32caf8c24fcbb27ba3ab77fe50b0 [id=5aaa48a6a5d94fef89881115cdd023ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.755710 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca733de7babe4343ab26dbca2c9020b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.756433 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 60bd14fb8c2e40dc955352518d463ccb (DEFAULT_TABLE table=default.Table_e9290dde7b6e467584d7cdf7b0ceae58 [id=72ed9704a69b4a26a1edd95ad525650a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.756598 10371 ts_tablet_manager.cc:1929] T a01d3ec3c8914fe495f7a0f3c7c312f8 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:53.756776 10371 log.cc:1199] T a01d3ec3c8914fe495f7a0f3c7c312f8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/a01d3ec3c8914fe495f7a0f3c7c312f8
I20260810 19:47:53.756821 10120 tablet_service.cc:1511] Processing CreateTablet for tablet ca733de7babe4343ab26dbca2c9020b2 (DEFAULT_TABLE table=default.Table_31db32caf8c24fcbb27ba3ab77fe50b0 [id=5aaa48a6a5d94fef89881115cdd023ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.756902 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60bd14fb8c2e40dc955352518d463ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.757244 10371 ts_tablet_manager.cc:1950] T a01d3ec3c8914fe495f7a0f3c7c312f8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:53.757709 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca733de7babe4343ab26dbca2c9020b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.778142 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet 60bd14fb8c2e40dc955352518d463ccb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:53 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:53.783579 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet a01d3ec3c8914fe495f7a0f3c7c312f8 (table default.Table_a1645668cf79415ca029a01169fbf874 [id=aec405416e584af6bfb8194b357d6dbc]) successfully deleted
I20260810 19:47:53.785282 10140 tablet_service.cc:1511] Processing CreateTablet for tablet 60bd14fb8c2e40dc955352518d463ccb (DEFAULT_TABLE table=default.Table_e9290dde7b6e467584d7cdf7b0ceae58 [id=72ed9704a69b4a26a1edd95ad525650a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.786296 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60bd14fb8c2e40dc955352518d463ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.789634 10134 tablet_service.cc:1511] Processing CreateTablet for tablet f3e3dde1c29e4275bafb27df63b117be (DEFAULT_TABLE table=default.Table_ca73e90d364f4ec7af078b3d97c7cdcb [id=d5afb5c8b2d042e5aec4a0721e2cae1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.790452 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 8fadd6f84c75466287b318ed7018b071
I20260810 19:47:53.791360 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_35de6164baf24ff79163d6b665fc6b8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:53.791976 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_35de6164baf24ff79163d6b665fc6b8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:53.792534 10128 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fadd6f84c75466287b318ed7018b071 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:53 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:53.793166 10125 tablet_service.cc:1511] Processing CreateTablet for tablet d6f410a1659c40f08ac274e63ad01b3d (DEFAULT_TABLE table=default.Table_82e33c23f0d84cbc9203727b5216d5b9 [id=36e72d60ff074c289171c16d86625441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.793318 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet f2931130e9354f16a238712234c19217
I20260810 19:47:53.793807 9420 catalog_manager.cc:6807] ReplaceTablet: tablet f2931130e9354f16a238712234c19217 deleted and replaced by tablet deeb390ae00646089e9f1d453ddb54a1
I20260810 19:47:53.794210 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_8376743094a548beba588e486d56d283"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:53.794822 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8376743094a548beba588e486d56d283 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:53.795113 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3e3dde1c29e4275bafb27df63b117be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.802811 10128 tablet_service.cc:1558] Processing DeleteTablet for tablet f2931130e9354f16a238712234c19217 with delete_type TABLET_DATA_DELETED (replaced by tablet deeb390ae00646089e9f1d453ddb54a1) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:53.803798 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f410a1659c40f08ac274e63ad01b3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.804876 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 64470598ccec45a7ae3e3c77fe4b9518
I20260810 19:47:53.805758 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_eac904f0d8d945b3ab2e659358f3a485"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:53.806372 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eac904f0d8d945b3ab2e659358f3a485 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:53.807538 10128 tablet_service.cc:1558] Processing DeleteTablet for tablet 64470598ccec45a7ae3e3c77fe4b9518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:53 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:53.808048 10371 tablet_replica.cc:333] T aa457d1f5cf2445eb3d869bc6ecf60b3 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:53.808357 10371 raft_consensus.cc:2243] T aa457d1f5cf2445eb3d869bc6ecf60b3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:53.809473 10371 raft_consensus.cc:2272] T aa457d1f5cf2445eb3d869bc6ecf60b3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:47:53.811702 9830 leader_election.cc:343] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:53.816160 10067 consensus_peers.cc:597] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a78f955a3ca946189de7ea96baee35f6. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:53.819182 10371 ts_tablet_manager.cc:1916] T aa457d1f5cf2445eb3d869bc6ecf60b3 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:53.818737 9675 tablet_service.cc:1511] Processing CreateTablet for tablet f3e3dde1c29e4275bafb27df63b117be (DEFAULT_TABLE table=default.Table_ca73e90d364f4ec7af078b3d97c7cdcb [id=d5afb5c8b2d042e5aec4a0721e2cae1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.821295 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 9e9603994555425289db23bd5c38cc99
I20260810 19:47:53.821971 9421 catalog_manager.cc:6807] ReplaceTablet: tablet 9e9603994555425289db23bd5c38cc99 deleted and replaced by tablet 7010009b9c344fca9bc4ef804829af21
I20260810 19:47:53.822499 10932 raft_consensus.cc:493] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:53.822650 10128 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e9603994555425289db23bd5c38cc99 with delete_type TABLET_DATA_DELETED (replaced by tablet 7010009b9c344fca9bc4ef804829af21) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:53.815572 9830 leader_election.cc:304] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:47:53.823022 9831 consensus_peers.cc:597] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 651a1f5011de4db495dbbab2d19ff096. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:53.823884 10932 raft_consensus.cc:515] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.823931 9657 tablet_service.cc:1511] Processing CreateTablet for tablet d6f410a1659c40f08ac274e63ad01b3d (DEFAULT_TABLE table=default.Table_82e33c23f0d84cbc9203727b5216d5b9 [id=36e72d60ff074c289171c16d86625441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.824453 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f410a1659c40f08ac274e63ad01b3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.824642 10932 leader_election.cc:290] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:53.825932 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fdc03b114b405da9e3a17ef1ad87c4" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:53.826206 10932 raft_consensus.cc:2749] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:53.827167 9911 tablet_service.cc:1511] Processing CreateTablet for tablet 18cd8adaa065425c846bc791c05fa67d (DEFAULT_TABLE table=default.Table_a1645668cf79415ca029a01169fbf874 [id=aec405416e584af6bfb8194b357d6dbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.827661 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18cd8adaa065425c846bc791c05fa67d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.828050 9906 tablet_service.cc:1511] Processing CreateTablet for tablet ca733de7babe4343ab26dbca2c9020b2 (DEFAULT_TABLE table=default.Table_31db32caf8c24fcbb27ba3ab77fe50b0 [id=5aaa48a6a5d94fef89881115cdd023ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.828420 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca733de7babe4343ab26dbca2c9020b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.829855 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 31c2b9a4b8334e678b4632fc2f58dd0c (DEFAULT_TABLE table=default.Table_05b1dcc5bf9f412c87505d19c57d7025 [id=a6004b573d3e47feb446328fa64530f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.830451 9899 tablet_service.cc:1511] Processing CreateTablet for tablet f3e3dde1c29e4275bafb27df63b117be (DEFAULT_TABLE table=default.Table_ca73e90d364f4ec7af078b3d97c7cdcb [id=d5afb5c8b2d042e5aec4a0721e2cae1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.830873 10164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fdc03b114b405da9e3a17ef1ad87c4" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:53.830935 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fadd6f84c75466287b318ed7018b071 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:53 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:53.831387 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet 64470598ccec45a7ae3e3c77fe4b9518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:53 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:53.831759 9714 raft_consensus.cc:2468] T 34fdc03b114b405da9e3a17ef1ad87c4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:53.831979 10370 tablet_bootstrap.cc:492] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:53.832105 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3e3dde1c29e4275bafb27df63b117be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.832106 9897 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e9603994555425289db23bd5c38cc99 with delete_type TABLET_DATA_DELETED (replaced by tablet 7010009b9c344fca9bc4ef804829af21) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:53.832177 10370 ts_tablet_manager.cc:1403] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.327s user 0.002s sys 0.001s
I20260810 19:47:53.832413 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 64470598ccec45a7ae3e3c77fe4b9518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:53 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:53.832556 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet f2931130e9354f16a238712234c19217 with delete_type TABLET_DATA_DELETED (replaced by tablet deeb390ae00646089e9f1d453ddb54a1) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:53.832823 9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3e3dde1c29e4275bafb27df63b117be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.833209 10370 raft_consensus.cc:359] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.833451 10370 raft_consensus.cc:385] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.833531 10370 raft_consensus.cc:740] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.833477 9904 tablet_service.cc:1511] Processing CreateTablet for tablet d6f410a1659c40f08ac274e63ad01b3d (DEFAULT_TABLE table=default.Table_82e33c23f0d84cbc9203727b5216d5b9 [id=36e72d60ff074c289171c16d86625441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.833923 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f410a1659c40f08ac274e63ad01b3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.833896 10370 consensus_queue.cc:260] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.834249 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31c2b9a4b8334e678b4632fc2f58dd0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.834517 11087 raft_consensus.cc:493] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:53.834668 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 60bd14fb8c2e40dc955352518d463ccb (DEFAULT_TABLE table=default.Table_e9290dde7b6e467584d7cdf7b0ceae58 [id=72ed9704a69b4a26a1edd95ad525650a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.834705 11087 raft_consensus.cc:515] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.834800 9831 leader_election.cc:304] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:53.835053 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60bd14fb8c2e40dc955352518d463ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.835268 10932 raft_consensus.cc:2804] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:53.835382 10932 raft_consensus.cc:493] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:53.835466 10932 raft_consensus.cc:3060] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:53.836042 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46005eead530459eb2b636ae0a6767ad" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:53.836895 10164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46005eead530459eb2b636ae0a6767ad" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:53.837549 9611 leader_election.cc:343] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:53.837765 11087 leader_election.cc:290] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:53.838495 10370 ts_tablet_manager.cc:1434] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260810 19:47:53.838713 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 60bd14fb8c2e40dc955352518d463ccb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:53 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:53.838892 10370 tablet_bootstrap.cc:492] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:53.841094 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f8bf9f998ad44df98239767d17e3486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:53.841288 10370 tablet_bootstrap.cc:654] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:53.841518 9830 leader_election.cc:343] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:53.841984 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e9603994555425289db23bd5c38cc99 with delete_type TABLET_DATA_DELETED (replaced by tablet 7010009b9c344fca9bc4ef804829af21) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:53.842829 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fadd6f84c75466287b318ed7018b071 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:53 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:53.842821 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5702d7b3bd421eb7b8a4e0f181d2d4" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:53.843052 10375 ts_tablet_manager.cc:1929] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:53.843303 10375 log.cc:1199] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/c5625c6f78f14d629bcd7f8c9522c4ba
I20260810 19:47:53.843676 10932 raft_consensus.cc:515] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:53.843932 9611 leader_election.cc:343] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:53.844071 9611 leader_election.cc:304] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:53.844835 10932 leader_election.cc:290] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:53.845264 9665 tablet_service.cc:1558] Processing DeleteTablet for tablet f2931130e9354f16a238712234c19217 with delete_type TABLET_DATA_DELETED (replaced by tablet deeb390ae00646089e9f1d453ddb54a1) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:53.848443 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 46005eead530459eb2b636ae0a6767ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:53.848616 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet 34fdc03b114b405da9e3a17ef1ad87c4 with delete_type TABLET_DATA_DELETED (replaced by tablet 9e8a23221e8447bd83592c05c9d1149c) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:53.849992 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fdc03b114b405da9e3a17ef1ad87c4" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:53.848868 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet 860dbb6d0a004c43bdce09075272fa70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:53.851406 9659 tablet_service.cc:1558] Processing DeleteTablet for tablet 25e15a8d1e7d41e68eef25d30d668e61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:53.852036 10366 tablet_bootstrap.cc:492] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:53.852273 10366 ts_tablet_manager.cc:1403] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.269s user 0.004s sys 0.000s
I20260810 19:47:53.843672 10067 leader_election.cc:304] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:53.845599 10164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fdc03b114b405da9e3a17ef1ad87c4" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:53.852957 11080 raft_consensus.cc:3060] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:47:53.853173 9830 leader_election.cc:343] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:53.854200 10366 raft_consensus.cc:359] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.854492 10366 raft_consensus.cc:385] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.854658 10366 raft_consensus.cc:740] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.855022 10366 consensus_queue.cc:260] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.856451 10366 ts_tablet_manager.cc:1434] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 19:47:53.855599 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 827dce05c192467589e2692fabd2a84e (DEFAULT_TABLE table=default.Table_dca6b457fbf744e089c4a583fca06cbb [id=4bce0610a04641ff86ab3af94e12e31d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.856889 9714 raft_consensus.cc:3060] T 34fdc03b114b405da9e3a17ef1ad87c4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:53.858443 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 827dce05c192467589e2692fabd2a84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.858682 11080 raft_consensus.cc:2749] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:53.864629 10366 tablet_bootstrap.cc:492] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:53.866209 11190 raft_consensus.cc:493] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:53.866585 11087 raft_consensus.cc:2749] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:53.866832 11190 raft_consensus.cc:515] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.867491 10377 ts_tablet_manager.cc:1929] T 176d4e72b8e44e4b88bdf89d06f2f79a P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:53.867715 10377 log.cc:1199] T 176d4e72b8e44e4b88bdf89d06f2f79a P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/176d4e72b8e44e4b88bdf89d06f2f79a
I20260810 19:47:53.868356 10377 ts_tablet_manager.cc:1950] T 176d4e72b8e44e4b88bdf89d06f2f79a P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:53.870761 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 274) took 1821 ms. Trace:
I20260810 19:47:53.872813 10375 ts_tablet_manager.cc:1950] T c5625c6f78f14d629bcd7f8c9522c4ba P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:53.874497 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 216) took 3147 ms. Trace:
I20260810 19:47:53.874485 10377 rpcz_store.cc:276] 0810 19:47:52.049225 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.049342 (+ 117us) service_pool.cc:224] Handling call
0810 19:47:53.549861 (+1500519us) ts_tablet_manager.cc:1151] Deleting tablet 176d4e72b8e44e4b88bdf89d06f2f79a
0810 19:47:53.549876 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:53.660753 (+110877us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:53.816496 (+155743us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:53.870699 (+ 54203us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1500335}
I20260810 19:47:53.875388 10377 tablet_replica.cc:333] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:53.875550 11190 leader_election.cc:290] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:53.875836 9714 raft_consensus.cc:2468] T 34fdc03b114b405da9e3a17ef1ad87c4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:53.876052 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 176d4e72b8e44e4b88bdf89d06f2f79a (table default.Table_03fbd70a4ed44530a3fab8f17c0769db [id=09fa54104d0f46dbb3f19138bfa2313d]) successfully deleted
I20260810 19:47:53.869997 10366 tablet_bootstrap.cc:654] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.876713 9831 leader_election.cc:304] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:53.877233 11067 raft_consensus.cc:2804] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:53.877421 11067 raft_consensus.cc:697] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:47:53.876151 10377 raft_consensus.cc:2243] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:53.877868 10377 pending_rounds.cc:70] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691: Trying to abort 1 pending ops.
I20260810 19:47:53.877717 11067 consensus_queue.cc:237] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.877942 10377 pending_rounds.cc:77] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058652259110912 op_type: NO_OP noop_request { }
I20260810 19:47:53.878098 10377 raft_consensus.cc:2889] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:53.878206 10377 raft_consensus.cc:2272] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:53.879483 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e15a8d1e7d41e68eef25d30d668e61" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:53.879406 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ad03d1f368ae4d98b1c5c74343beb59e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:53.880167 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad03d1f368ae4d98b1c5c74343beb59e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:53.880384 9611 leader_election.cc:343] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:53.880831 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1d3d54acd6074609919e2db8b3c01576"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:53.881480 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d3d54acd6074609919e2db8b3c01576 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:53.881737 10366 tablet_bootstrap.cc:492] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:53.881914 10366 ts_tablet_manager.cc:1403] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20260810 19:47:53.882683 10377 ts_tablet_manager.cc:1916] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:53.883514 10371 ts_tablet_manager.cc:1929] T aa457d1f5cf2445eb3d869bc6ecf60b3 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:53.883646 10371 log.cc:1199] T aa457d1f5cf2445eb3d869bc6ecf60b3 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/aa457d1f5cf2445eb3d869bc6ecf60b3
I20260810 19:47:53.884024 10371 ts_tablet_manager.cc:1950] T aa457d1f5cf2445eb3d869bc6ecf60b3 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:53.885213 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet aa457d1f5cf2445eb3d869bc6ecf60b3 (table default.Table_9381401bf3f44ef488064afeb31098bb [id=c8a0313d7b6a4b4fa813727cf4e8e38d]) successfully deleted
I20260810 19:47:53.886720 9911 tablet_service.cc:1511] Processing CreateTablet for tablet 31c2b9a4b8334e678b4632fc2f58dd0c (DEFAULT_TABLE table=default.Table_05b1dcc5bf9f412c87505d19c57d7025 [id=a6004b573d3e47feb446328fa64530f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.890507 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31c2b9a4b8334e678b4632fc2f58dd0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.894071 9675 tablet_service.cc:1511] Processing CreateTablet for tablet ab27734e3d974260a77f1d94e5f534fe (DEFAULT_TABLE table=default.Table_1954ac0ddba541af937bd2b421cb2f8e [id=bbf1b3708f9644d486aef32d1099aede]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.894652 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab27734e3d974260a77f1d94e5f534fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.898649 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet dfea147ef3904ab49375def065c6f328
I20260810 19:47:53.892289 10366 raft_consensus.cc:359] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.899303 10366 raft_consensus.cc:385] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.899394 10366 raft_consensus.cc:740] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.900318 10366 consensus_queue.cc:260] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.900684 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet dfea147ef3904ab49375def065c6f328 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:53 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:53.901481 10366 ts_tablet_manager.cc:1434] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.019s user 0.003s sys 0.000s
I20260810 19:47:53.902308 10366 tablet_bootstrap.cc:492] T 92e3d52bd5b741a4adcabb343b6770b8 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:53.904098 10371 tablet_replica.cc:333] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:53.904412 10371 raft_consensus.cc:2243] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:53.904642 10366 tablet_bootstrap.cc:654] T 92e3d52bd5b741a4adcabb343b6770b8 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.906026 10371 pending_rounds.cc:70] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4: Trying to abort 1 pending ops.
I20260810 19:47:53.906188 10371 pending_rounds.cc:77] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058656862720000 op_type: NO_OP noop_request { }
I20260810 19:47:53.909024 10371 raft_consensus.cc:2889] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:53.909250 10371 raft_consensus.cc:2272] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:53.917225 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_415aa3ad1eca4143b9477218fbc49d30" } new_table_name: "default.Table_ae8fab9298ca4fa2bfe18cc16b490c48" modify_external_catalogs: true
I20260810 19:47:53.918615 10371 ts_tablet_manager.cc:1916] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:53.876346 10164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e15a8d1e7d41e68eef25d30d668e61" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:53.920250 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 34fdc03b114b405da9e3a17ef1ad87c4 with delete_type TABLET_DATA_DELETED (replaced by tablet 9e8a23221e8447bd83592c05c9d1149c) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:53.887277 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 31c2b9a4b8334e678b4632fc2f58dd0c (DEFAULT_TABLE table=default.Table_05b1dcc5bf9f412c87505d19c57d7025 [id=a6004b573d3e47feb446328fa64530f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.921712 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31c2b9a4b8334e678b4632fc2f58dd0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.910914 10128 tablet_service.cc:1558] Processing DeleteTablet for tablet dfea147ef3904ab49375def065c6f328 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:53 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:53.923118 9908 tablet_service.cc:1511] Processing CreateTablet for tablet ab27734e3d974260a77f1d94e5f534fe (DEFAULT_TABLE table=default.Table_1954ac0ddba541af937bd2b421cb2f8e [id=bbf1b3708f9644d486aef32d1099aede]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.923807 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab27734e3d974260a77f1d94e5f534fe. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:53.924487 9611 leader_election.cc:343] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:53.924787 9611 leader_election.cc:304] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:53.925370 11087 raft_consensus.cc:2749] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:53.926734 10375 rpcz_store.cc:276] 0810 19:47:50.726918 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.726988 (+ 70us) service_pool.cc:224] Handling call
0810 19:47:53.544517 (+2817529us) ts_tablet_manager.cc:1151] Deleting tablet c5625c6f78f14d629bcd7f8c9522c4ba
0810 19:47:53.544530 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:53.780066 (+235536us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:53.842965 (+ 62899us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:53.874425 (+ 31460us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2817286}
I20260810 19:47:53.927631 10375 tablet_replica.cc:333] T 9e09483838f0459da3041ee4fe5d55cc P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:53.928061 10375 raft_consensus.cc:2243] T 9e09483838f0459da3041ee4fe5d55cc P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:53.928947 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet c5625c6f78f14d629bcd7f8c9522c4ba (table default.Table_0dafd75d95394cdda8062e308591219d [id=3ec1bdaeba584422a569a6f070344b6a]) successfully deleted
I20260810 19:47:53.929183 10375 raft_consensus.cc:2272] T 9e09483838f0459da3041ee4fe5d55cc P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:53.908509 10377 ts_tablet_manager.cc:1929] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:53.931339 10377 log.cc:1199] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/651a1f5011de4db495dbbab2d19ff096
I20260810 19:47:53.931268 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 19e2bf7b7d254894a07c5a75bf24e742 (DEFAULT_TABLE table=default.Table_688c01e53a344393b3471974bad3b972 [id=7112ce97719c47919a3d24d1af7d07cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.931757 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19e2bf7b7d254894a07c5a75bf24e742. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.932288 10377 ts_tablet_manager.cc:1950] T 651a1f5011de4db495dbbab2d19ff096 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:53.933863 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 271) took 1885 ms. Trace:
I20260810 19:47:53.935009 10377 rpcz_store.cc:276] 0810 19:47:52.048726 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.050072 (+ 1346us) service_pool.cc:224] Handling call
0810 19:47:53.875283 (+1825211us) ts_tablet_manager.cc:1151] Deleting tablet 651a1f5011de4db495dbbab2d19ff096
0810 19:47:53.875295 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:53.905105 (+ 29810us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:53.908421 (+ 3316us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:53.933806 (+ 25385us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1824970}
I20260810 19:47:53.936559 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 651a1f5011de4db495dbbab2d19ff096 (table default.Table_8759361d39fb4003a644f53ecd07d2d1 [id=e10b3ffceb96420494d92992411ff2ba]) successfully deleted
I20260810 19:47:53.937243 10377 tablet_replica.cc:333] T c1777a713b1d4a58919b5f6abe779ab8 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:53.938100 10377 raft_consensus.cc:2243] T c1777a713b1d4a58919b5f6abe779ab8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:53.931473 10128 tablet_service.cc:1511] Processing CreateTablet for tablet ab27734e3d974260a77f1d94e5f534fe (DEFAULT_TABLE table=default.Table_1954ac0ddba541af937bd2b421cb2f8e [id=bbf1b3708f9644d486aef32d1099aede]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.938915 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab27734e3d974260a77f1d94e5f534fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.939055 10377 raft_consensus.cc:2272] T c1777a713b1d4a58919b5f6abe779ab8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:53.941018 10377 ts_tablet_manager.cc:1916] T c1777a713b1d4a58919b5f6abe779ab8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:53.950798 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 19e2bf7b7d254894a07c5a75bf24e742 (DEFAULT_TABLE table=default.Table_688c01e53a344393b3471974bad3b972 [id=7112ce97719c47919a3d24d1af7d07cd]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:53.952755 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ba42032e7344423a0e86c55d613f27d consensus state has no leader
I20260810 19:47:53.957175 10140 tablet_service.cc:1511] Processing CreateTablet for tablet 19e2bf7b7d254894a07c5a75bf24e742 (DEFAULT_TABLE table=default.Table_688c01e53a344393b3471974bad3b972 [id=7112ce97719c47919a3d24d1af7d07cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.957662 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19e2bf7b7d254894a07c5a75bf24e742. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.958161 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_70edac9409204eb0bb559d56eddecbf7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:53.958797 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70edac9409204eb0bb559d56eddecbf7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:53.958858 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 8fadd6f84c75466287b318ed7018b071 (DEFAULT_TABLE table=default.Table_398b6d4ebbf742b99fad6aff42d2802b [id=453661c1f5834b56aad5d2d647338fc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:53.959322 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fadd6f84c75466287b318ed7018b071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.961087 10377 ts_tablet_manager.cc:1929] T c1777a713b1d4a58919b5f6abe779ab8 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:53.961329 10377 log.cc:1199] T c1777a713b1d4a58919b5f6abe779ab8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/c1777a713b1d4a58919b5f6abe779ab8
I20260810 19:47:53.961879 10377 ts_tablet_manager.cc:1950] T c1777a713b1d4a58919b5f6abe779ab8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:53.962452 10911 raft_consensus.cc:493] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:53.962815 10911 raft_consensus.cc:515] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.964437 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9603994555425289db23bd5c38cc99" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:53.964653 9714 raft_consensus.cc:2468] T 9e9603994555425289db23bd5c38cc99 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:47:53.964814 10375 ts_tablet_manager.cc:1916] T 9e09483838f0459da3041ee4fe5d55cc P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:53.964944 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a015debe749f475f881da961dbe16fba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:53.965277 10068 leader_election.cc:304] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
W20260810 19:47:53.965543 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a015debe749f475f881da961dbe16fba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:53.965869 11080 raft_consensus.cc:2804] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:53.966140 11080 raft_consensus.cc:493] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:53.966282 11080 raft_consensus.cc:3060] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:53.967779 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19e2bf7b7d254894a07c5a75bf24e742. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:53.971078 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9603994555425289db23bd5c38cc99" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:47:53.971733 10067 leader_election.cc:343] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:53.972297 10911 leader_election.cc:290] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:53.972771 10911 raft_consensus.cc:493] T a01d3ec3c8914fe495f7a0f3c7c312f8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:53.974401 10366 tablet_bootstrap.cc:492] T 92e3d52bd5b741a4adcabb343b6770b8 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:53.974467 10911 raft_consensus.cc:515] T a01d3ec3c8914fe495f7a0f3c7c312f8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.977643 10366 ts_tablet_manager.cc:1403] T 92e3d52bd5b741a4adcabb343b6770b8 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.075s user 0.010s sys 0.002s
I20260810 19:47:53.978531 10367 tablet_bootstrap.cc:492] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:53.978763 10367 ts_tablet_manager.cc:1403] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.263s user 0.050s sys 0.048s
I20260810 19:47:53.979714 10367 raft_consensus.cc:359] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.979991 10367 raft_consensus.cc:385] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:53.980201 10367 raft_consensus.cc:740] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.980581 10367 consensus_queue.cc:260] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.977216 11080 raft_consensus.cc:515] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.983860 11080 leader_election.cc:290] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:53.982988 10128 tablet_service.cc:1558] Processing DeleteTablet for tablet e177140cad404e978b927c810b87ae0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:53.985493 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9603994555425289db23bd5c38cc99" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:53.985705 9714 raft_consensus.cc:3060] T 9e9603994555425289db23bd5c38cc99 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:47:53.987048 10068 leader_election.cc:343] T a01d3ec3c8914fe495f7a0f3c7c312f8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: a01d3ec3c8914fe495f7a0f3c7c312f8
I20260810 19:47:53.988121 10370 tablet_bootstrap.cc:492] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:53.989108 9714 raft_consensus.cc:2468] T 9e9603994555425289db23bd5c38cc99 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:47:53.989526 11087 consensus_queue.cc:1048] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:53.989769 10068 leader_election.cc:304] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:53.990437 11080 consensus_queue.cc:1048] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:53.994068 11080 raft_consensus.cc:2804] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:53.994724 11080 raft_consensus.cc:697] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:47:53.995105 11080 consensus_queue.cc:237] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:53.999104 10370 ts_tablet_manager.cc:1403] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.160s user 0.003s sys 0.002s
W20260810 19:47:53.999800 10067 leader_election.cc:343] T a01d3ec3c8914fe495f7a0f3c7c312f8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: a01d3ec3c8914fe495f7a0f3c7c312f8
I20260810 19:47:53.999898 10367 ts_tablet_manager.cc:1434] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20260810 19:47:53.999970 10067 leader_election.cc:304] T a01d3ec3c8914fe495f7a0f3c7c312f8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:54.000394 10370 raft_consensus.cc:359] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.000591 10370 raft_consensus.cc:385] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:54.000679 10370 raft_consensus.cc:740] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:54.000933 11215 raft_consensus.cc:2749] T a01d3ec3c8914fe495f7a0f3c7c312f8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:54.002038 10367 tablet_bootstrap.cc:492] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:54.002556 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 8fadd6f84c75466287b318ed7018b071 (DEFAULT_TABLE table=default.Table_398b6d4ebbf742b99fad6aff42d2802b [id=453661c1f5834b56aad5d2d647338fc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.004624 10366 raft_consensus.cc:359] T 92e3d52bd5b741a4adcabb343b6770b8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.007308 10366 raft_consensus.cc:385] T 92e3d52bd5b741a4adcabb343b6770b8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:54.007742 10366 raft_consensus.cc:740] T 92e3d52bd5b741a4adcabb343b6770b8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:53.981484 9911 tablet_service.cc:1558] Processing DeleteTablet for tablet e4a92eb8626f465caf563b72598a685f with delete_type TABLET_DATA_DELETED (replaced by tablet 08e29e23d54f47968a06be98b313918d) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:54.008172 10911 leader_election.cc:290] T a01d3ec3c8914fe495f7a0f3c7c312f8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:54.008319 10366 consensus_queue.cc:260] T 92e3d52bd5b741a4adcabb343b6770b8 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.007990 9413 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 92e3d52bd5b741a4adcabb343b6770b8 (table default.Table_4b3474ab5fac40a28a050d69fc60bfe5 [id=495386acd3524a388b83e38f07bf9967]). Expected version 1 got 0
I20260810 19:47:54.009284 10367 tablet_bootstrap.cc:654] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:54.011445 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_afff95e937d74160a65a9df332c769c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:53.982077 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 46005eead530459eb2b636ae0a6767ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:54.012113 10366 ts_tablet_manager.cc:1434] T 92e3d52bd5b741a4adcabb343b6770b8 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
W20260810 19:47:54.012941 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_afff95e937d74160a65a9df332c769c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:54.012964 10366 tablet_bootstrap.cc:492] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
W20260810 19:47:54.012303 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8b24b75629ec423b90e4bf287e7cfd38 has no consensus state
I20260810 19:47:53.985410 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9603994555425289db23bd5c38cc99" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:54.014506 9408 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 92e3d52bd5b741a4adcabb343b6770b8 (table default.Table_4b3474ab5fac40a28a050d69fc60bfe5 [id=495386acd3524a388b83e38f07bf9967]). Expected version 1 got 0
W20260810 19:47:54.014587 10067 leader_election.cc:343] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:53.988335 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet dfea147ef3904ab49375def065c6f328 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:53 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:53.993144 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 8fadd6f84c75466287b318ed7018b071 (DEFAULT_TABLE table=default.Table_398b6d4ebbf742b99fad6aff42d2802b [id=453661c1f5834b56aad5d2d647338fc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.015513 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fadd6f84c75466287b318ed7018b071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.015551 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_688c01e53a344393b3471974bad3b972" } modify_external_catalogs: true
I20260810 19:47:54.015726 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_688c01e53a344393b3471974bad3b972" } modify_external_catalogs: true
I20260810 19:47:54.020215 10366 tablet_bootstrap.cc:654] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:53.974826 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 278) took 1850 ms. Trace:
I20260810 19:47:54.023725 10377 rpcz_store.cc:276] 0810 19:47:52.124662 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.124904 (+ 242us) service_pool.cc:224] Handling call
0810 19:47:53.937142 (+1812238us) ts_tablet_manager.cc:1151] Deleting tablet c1777a713b1d4a58919b5f6abe779ab8
0810 19:47:53.937156 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:53.957837 (+ 20681us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:53.960987 (+ 3150us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:53.974783 (+ 13796us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1809102}
I20260810 19:47:54.024294 10371 ts_tablet_manager.cc:1929] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:54.024369 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet c1777a713b1d4a58919b5f6abe779ab8 (table default.Table_2819131cbbda496d8acccf4b8e83c322 [id=59935ce778c84929aa6ae71a1e33c63f]) successfully deleted
I20260810 19:47:54.024531 10371 log.cc:1199] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/e177140cad404e978b927c810b87ae0c
I20260810 19:47:54.025015 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 279) took 1896 ms. Trace:
I20260810 19:47:54.025182 10371 ts_tablet_manager.cc:1950] T e177140cad404e978b927c810b87ae0c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:54.025158 10377 rpcz_store.cc:276] 0810 19:47:52.128290 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.128368 (+ 78us) service_pool.cc:224] Handling call
0810 19:47:54.024834 (+1896466us) ts_tablet_manager.cc:1151] Deleting tablet f3600d0528164850973cb296aaf6910f
0810 19:47:54.024848 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.024977 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1895378}
W20260810 19:47:54.025667 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet f3600d0528164850973cb296aaf6910f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3600d0528164850973cb296aaf6910f already in progress: creating tablet
I20260810 19:47:54.026338 9684 tablet_service.cc:1511] Processing CreateTablet for tablet c285518ed49d4ed68a6039f98db3b700 (DEFAULT_TABLE table=default.Table_97bfd454a3b34fb6bccadb843d79f141 [id=4b0cbb23d570430bb2d95e9c1b27bb4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.027719 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 280) took 1896 ms. Trace:
I20260810 19:47:54.027848 10377 rpcz_store.cc:276] 0810 19:47:52.140963 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.142195 (+ 1232us) service_pool.cc:224] Handling call
0810 19:47:54.027529 (+1885334us) ts_tablet_manager.cc:1151] Deleting tablet ffc4466b82bd49fcaad30e4d5325c7db
0810 19:47:54.027541 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.027675 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1869732}
W20260810 19:47:54.028376 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet ffc4466b82bd49fcaad30e4d5325c7db because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ffc4466b82bd49fcaad30e4d5325c7db already in progress: creating tablet
I20260810 19:47:54.028803 10377 tablet_replica.cc:333] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:54.029045 10377 raft_consensus.cc:2243] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:54.029260 10377 raft_consensus.cc:2272] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:54.030491 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fadd6f84c75466287b318ed7018b071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.037957 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c285518ed49d4ed68a6039f98db3b700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.042258 9902 tablet_service.cc:1511] Processing CreateTablet for tablet c285518ed49d4ed68a6039f98db3b700 (DEFAULT_TABLE table=default.Table_97bfd454a3b34fb6bccadb843d79f141 [id=4b0cbb23d570430bb2d95e9c1b27bb4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.042824 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c285518ed49d4ed68a6039f98db3b700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.043085 10367 tablet_bootstrap.cc:492] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:54.043303 10367 ts_tablet_manager.cc:1403] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.000s
I20260810 19:47:54.045246 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet e177140cad404e978b927c810b87ae0c (table default.Table_143ff27d69cf41a79a51f8e391528ed5 [id=08a2a58f0f5646a9890870eda636e52a]) successfully deleted
I20260810 19:47:54.045746 10371 tablet_replica.cc:333] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:54.046308 10371 raft_consensus.cc:2243] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:54.046723 10370 consensus_queue.cc:260] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.047395 10370 ts_tablet_manager.cc:1434] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.048s user 0.001s sys 0.001s
I20260810 19:47:54.047765 10370 tablet_bootstrap.cc:492] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:54.048161 10377 ts_tablet_manager.cc:1916] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:54.048453 10371 pending_rounds.cc:70] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4: Trying to abort 1 pending ops.
I20260810 19:47:54.048698 10371 pending_rounds.cc:77] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058655303073792 op_type: NO_OP noop_request { }
I20260810 19:47:54.051394 10371 raft_consensus.cc:2889] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:54.051749 10371 raft_consensus.cc:2272] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:54.052841 10366 tablet_bootstrap.cc:492] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:54.051147 10367 raft_consensus.cc:359] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.053414 10367 raft_consensus.cc:385] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:54.054582 10366 ts_tablet_manager.cc:1403] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.042s user 0.004s sys 0.000s
I20260810 19:47:54.055087 10371 ts_tablet_manager.cc:1916] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:54.056309 10366 raft_consensus.cc:359] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.054111 10367 raft_consensus.cc:740] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:54.059461 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_60869a2a939f4cc8813040573f05bd41" } new_table_name: "default.Table_943801654ea043f1b8740ea0215abc35" modify_external_catalogs: true
I20260810 19:47:54.059612 10367 consensus_queue.cc:260] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.060171 10367 ts_tablet_manager.cc:1434] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260810 19:47:54.064157 10375 ts_tablet_manager.cc:1929] T 9e09483838f0459da3041ee4fe5d55cc P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:54.064316 10375 log.cc:1199] T 9e09483838f0459da3041ee4fe5d55cc P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/9e09483838f0459da3041ee4fe5d55cc
I20260810 19:47:54.064837 10375 ts_tablet_manager.cc:1950] T 9e09483838f0459da3041ee4fe5d55cc P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:54.065757 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 214) took 3340 ms. Trace:
I20260810 19:47:54.065896 10375 rpcz_store.cc:276] 0810 19:47:50.725259 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.814022 (+ 88763us) service_pool.cc:224] Handling call
0810 19:47:53.927432 (+3113410us) ts_tablet_manager.cc:1151] Deleting tablet 9e09483838f0459da3041ee4fe5d55cc
0810 19:47:53.927447 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.029943 (+102496us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.064023 (+ 34080us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.065714 (+ 1691us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3112716}
I20260810 19:47:54.066442 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 9e09483838f0459da3041ee4fe5d55cc (table default.Table_5e6891ff4aa040be8b327aafa596bc7e [id=fd840f00bdc5477aaad0b7fa114870dd]) successfully deleted
I20260810 19:47:54.067097 10140 tablet_service.cc:1511] Processing CreateTablet for tablet c285518ed49d4ed68a6039f98db3b700 (DEFAULT_TABLE table=default.Table_97bfd454a3b34fb6bccadb843d79f141 [id=4b0cbb23d570430bb2d95e9c1b27bb4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.067651 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c285518ed49d4ed68a6039f98db3b700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.072414 9675 tablet_service.cc:1511] Processing CreateTablet for tablet ee5f38d91bb349a9ae1da8ba69d2ddbc (DEFAULT_TABLE table=default.Table_0a16454a2da548e3a7130a52dbd5143a [id=b1b37ac7ddef44d7b86d2d668527a046]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.072939 10367 tablet_bootstrap.cc:492] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:54.073293 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee5f38d91bb349a9ae1da8ba69d2ddbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.073830 10366 raft_consensus.cc:385] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:54.073933 10366 raft_consensus.cc:740] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
W20260810 19:47:54.079101 10068 consensus_peers.cc:597] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58b33df59ffe49a9b07606b6dc9279eb. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:54.081178 11190 raft_consensus.cc:493] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:54.081363 11190 raft_consensus.cc:515] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.081990 11190 leader_election.cc:290] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:54.083186 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b995f3c3bca4501a6c62cf9025051b2" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:54.083438 9944 raft_consensus.cc:2468] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:54.083915 9611 leader_election.cc:304] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:54.084313 11190 raft_consensus.cc:2804] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:54.084434 11190 raft_consensus.cc:493] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:54.084594 11190 raft_consensus.cc:3060] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:54.088325 11190 raft_consensus.cc:515] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.089246 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b995f3c3bca4501a6c62cf9025051b2" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:54.090196 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b995f3c3bca4501a6c62cf9025051b2" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:54.090452 9948 raft_consensus.cc:3060] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:54.093396 9948 raft_consensus.cc:2468] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:54.094082 9611 leader_election.cc:304] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
W20260810 19:47:54.094451 9611 leader_election.cc:343] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:54.094811 11087 raft_consensus.cc:2804] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:54.094969 11087 raft_consensus.cc:697] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:54.095276 11087 consensus_queue.cc:237] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.099951 11190 leader_election.cc:290] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:54.100135 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_004470a924c946e2bf1d76b810f6ef8a" } new_table_name: "default.Table_f0bb702e0c7148519ccd7a84a5e9e574" modify_external_catalogs: true
I20260810 19:47:54.100692 10370 tablet_bootstrap.cc:654] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:54.102247 10375 tablet_replica.cc:333] T 0efa6f35ed284933b9fc53c1cb32da82 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:54.102538 9420 master_service.cc:960] ReplaceTablet: received request to replace tablet 92e3d52bd5b741a4adcabb343b6770b8 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:54.102532 10375 raft_consensus.cc:2243] T 0efa6f35ed284933b9fc53c1cb32da82 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:54.102744 10375 raft_consensus.cc:2272] T 0efa6f35ed284933b9fc53c1cb32da82 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:54.103449 10375 ts_tablet_manager.cc:1916] T 0efa6f35ed284933b9fc53c1cb32da82 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:54.107059 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d3598b5743244e39efd12703ec15aea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:54.108521 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b995f3c3bca4501a6c62cf9025051b2" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
W20260810 19:47:54.109750 9611 leader_election.cc:343] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:54.110721 10377 ts_tablet_manager.cc:1929] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:54.110895 10377 log.cc:1199] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/e177140cad404e978b927c810b87ae0c
I20260810 19:47:54.111373 10377 ts_tablet_manager.cc:1950] T e177140cad404e978b927c810b87ae0c P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:54.111795 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 284) took 1890 ms. Trace:
I20260810 19:47:54.111896 10377 rpcz_store.cc:276] 0810 19:47:52.221108 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.221383 (+ 275us) service_pool.cc:224] Handling call
0810 19:47:54.028645 (+1807262us) ts_tablet_manager.cc:1151] Deleting tablet e177140cad404e978b927c810b87ae0c
0810 19:47:54.028656 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.096119 (+ 67463us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.110624 (+ 14505us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.111740 (+ 1116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1805318}
I20260810 19:47:54.112238 11067 raft_consensus.cc:493] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:54.112453 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 283) took 1893 ms. Trace:
I20260810 19:47:54.112419 11067 raft_consensus.cc:515] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.112555 10377 rpcz_store.cc:276] 0810 19:47:52.218669 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.219134 (+ 465us) service_pool.cc:224] Handling call
0810 19:47:54.112194 (+1893060us) ts_tablet_manager.cc:1151] Deleting tablet 06af03c8a87141febef768bd56c72c39
0810 19:47:54.112205 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.112387 (+ 182us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1884955}
I20260810 19:47:54.110667 10366 consensus_queue.cc:260] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:54.113052 9395 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 06af03c8a87141febef768bd56c72c39 (table default.Table_3517015cddb644a28150bb4f6f7c3187 [id=aa329023fb1a498cb6dc964edbaccb77], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 06af03c8a87141febef768bd56c72c39 consensus state has no leader
I20260810 19:47:54.113166 11067 leader_election.cc:290] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:54.113406 10366 ts_tablet_manager.cc:1434] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.058s user 0.001s sys 0.001s
I20260810 19:47:54.113413 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet e177140cad404e978b927c810b87ae0c (table default.Table_143ff27d69cf41a79a51f8e391528ed5 [id=08a2a58f0f5646a9890870eda636e52a]) successfully deleted
W20260810 19:47:54.113677 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 06af03c8a87141febef768bd56c72c39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06af03c8a87141febef768bd56c72c39 already in progress: creating tablet
I20260810 19:47:54.113723 10366 tablet_bootstrap.cc:492] T 5d3598b5743244e39efd12703ec15aea P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:54.115530 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a92eb8626f465caf563b72598a685f" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
W20260810 19:47:54.116426 9831 leader_election.cc:343] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:54.117303 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a92eb8626f465caf563b72598a685f" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:54.119086 9830 leader_election.cc:343] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:54.119275 9830 leader_election.cc:304] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:54.119763 10932 raft_consensus.cc:2749] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:54.122644 10367 tablet_bootstrap.cc:654] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:54.125828 10370 tablet_bootstrap.cc:492] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:54.126112 10370 ts_tablet_manager.cc:1403] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.078s user 0.002s sys 0.002s
I20260810 19:47:54.126513 9908 tablet_service.cc:1511] Processing CreateTablet for tablet ee5f38d91bb349a9ae1da8ba69d2ddbc (DEFAULT_TABLE table=default.Table_0a16454a2da548e3a7130a52dbd5143a [id=b1b37ac7ddef44d7b86d2d668527a046]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.127048 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee5f38d91bb349a9ae1da8ba69d2ddbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.127101 10370 raft_consensus.cc:359] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.127306 10370 raft_consensus.cc:385] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:54.127400 10370 raft_consensus.cc:740] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:54.127709 10370 consensus_queue.cc:260] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.128260 10370 ts_tablet_manager.cc:1434] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260810 19:47:54.129890 10370 tablet_bootstrap.cc:492] T 860dbb6d0a004c43bdce09075272fa70 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:54.131805 10370 tablet_bootstrap.cc:654] T 860dbb6d0a004c43bdce09075272fa70 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:54.134603 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0dafd75d95394cdda8062e308591219d" } modify_external_catalogs: true
I20260810 19:47:54.134833 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0dafd75d95394cdda8062e308591219d" } modify_external_catalogs: true
W20260810 19:47:54.141242 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 38b0c6a017dc4afc849090cca7ee8b26 has no consensus state
I20260810 19:47:54.142827 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 285) took 1919 ms. Trace:
I20260810 19:47:54.142966 10377 rpcz_store.cc:276] 0810 19:47:52.223820 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.223894 (+ 74us) service_pool.cc:224] Handling call
0810 19:47:54.142631 (+1918737us) ts_tablet_manager.cc:1151] Deleting tablet 3cda6eb6d4b847edb2624a267bc3522d
0810 19:47:54.142646 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.142746 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1906899}
W20260810 19:47:54.145231 9831 consensus_peers.cc:597] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9e761e94dbf4baba5e44a89b6c6a81c. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:54.143740 10377 tablet_replica.cc:333] T 58b33df59ffe49a9b07606b6dc9279eb P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:54.145943 10377 raft_consensus.cc:2243] T 58b33df59ffe49a9b07606b6dc9279eb P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:54.146162 10377 raft_consensus.cc:2272] T 58b33df59ffe49a9b07606b6dc9279eb P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:54.147135 10377 ts_tablet_manager.cc:1916] T 58b33df59ffe49a9b07606b6dc9279eb P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:47:54.147240 9395 catalog_manager.cc:5017] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 3cda6eb6d4b847edb2624a267bc3522d because the tablet was not found. No further retry: Not found: Tablet not found: 3cda6eb6d4b847edb2624a267bc3522d
I20260810 19:47:54.147406 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b2ee8ebe11e4e5cb6a91592170c6c3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:47:54.150302 9830 consensus_peers.cc:597] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9e761e94dbf4baba5e44a89b6c6a81c. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:54.152813 10375 ts_tablet_manager.cc:1929] T 0efa6f35ed284933b9fc53c1cb32da82 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:54.153080 10375 log.cc:1199] T 0efa6f35ed284933b9fc53c1cb32da82 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/0efa6f35ed284933b9fc53c1cb32da82
I20260810 19:47:54.153386 10366 tablet_bootstrap.cc:654] T 5d3598b5743244e39efd12703ec15aea P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:54.153740 10375 ts_tablet_manager.cc:1950] T 0efa6f35ed284933b9fc53c1cb32da82 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:54.154613 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 5aa0f24443a34714a44137a77c12bbc3 (DEFAULT_TABLE table=default.Table_ff8803fe033d45a79877574c5f39b756 [id=27c3951fbb3e4e4fb7bb119cec174eb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.155191 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aa0f24443a34714a44137a77c12bbc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.155835 9410 catalog_manager.cc:5719] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193). New cstate: current_term: 1 leader_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:47:54.157474 10140 tablet_service.cc:1511] Processing CreateTablet for tablet ee5f38d91bb349a9ae1da8ba69d2ddbc (DEFAULT_TABLE table=default.Table_0a16454a2da548e3a7130a52dbd5143a [id=b1b37ac7ddef44d7b86d2d668527a046]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.162227 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee5f38d91bb349a9ae1da8ba69d2ddbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.164330 10371 ts_tablet_manager.cc:1929] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:54.165669 10371 log.cc:1199] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/3ca9d34cb609413d9df495bf191cc409
I20260810 19:47:54.166214 10371 ts_tablet_manager.cc:1950] T 3ca9d34cb609413d9df495bf191cc409 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:54.167040 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 5aa0f24443a34714a44137a77c12bbc3 (DEFAULT_TABLE table=default.Table_ff8803fe033d45a79877574c5f39b756 [id=27c3951fbb3e4e4fb7bb119cec174eb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.167564 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 3ca9d34cb609413d9df495bf191cc409 (table default.Table_0c6321a554ff4c1a82855f8178d69454 [id=4eec13b150fe4e169ac63d4cd23b6c02]) successfully deleted
I20260810 19:47:54.167632 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aa0f24443a34714a44137a77c12bbc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.172791 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 5aa0f24443a34714a44137a77c12bbc3 (DEFAULT_TABLE table=default.Table_ff8803fe033d45a79877574c5f39b756 [id=27c3951fbb3e4e4fb7bb119cec174eb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.173378 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aa0f24443a34714a44137a77c12bbc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.173777 9407 master_service.cc:960] ReplaceTablet: received request to replace tablet 00fe7d9a548a487d965d92b53cdf9250 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:54.174192 9904 tablet_service.cc:1511] Processing CreateTablet for tablet bafc42f0cdf94ebd823dfb678df8a83b (DEFAULT_TABLE table=default.Table_004470a924c946e2bf1d76b810f6ef8a [id=df54120a0a0140fe9561db53b23364b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.174714 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bafc42f0cdf94ebd823dfb678df8a83b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.175817 9675 tablet_service.cc:1511] Processing CreateTablet for tablet bafc42f0cdf94ebd823dfb678df8a83b (DEFAULT_TABLE table=default.Table_004470a924c946e2bf1d76b810f6ef8a [id=df54120a0a0140fe9561db53b23364b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.176285 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bafc42f0cdf94ebd823dfb678df8a83b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.177634 10371 tablet_replica.cc:333] T 74dddd12f2314d6ab5a6717025b13a51 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:54.177902 10371 raft_consensus.cc:2243] T 74dddd12f2314d6ab5a6717025b13a51 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:54.178125 10371 raft_consensus.cc:2272] T 74dddd12f2314d6ab5a6717025b13a51 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:54.178838 10371 ts_tablet_manager.cc:1916] T 74dddd12f2314d6ab5a6717025b13a51 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:47:54.184094 10067 consensus_peers.cc:597] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c1777a713b1d4a58919b5f6abe779ab8. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:54.184490 10128 tablet_service.cc:1558] Processing DeleteTablet for tablet aa457d1f5cf2445eb3d869bc6ecf60b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:54.185599 10128 tablet_service.cc:1511] Processing CreateTablet for tablet bafc42f0cdf94ebd823dfb678df8a83b (DEFAULT_TABLE table=default.Table_004470a924c946e2bf1d76b810f6ef8a [id=df54120a0a0140fe9561db53b23364b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.186116 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bafc42f0cdf94ebd823dfb678df8a83b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.184821 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 228) took 3270 ms. Trace:
I20260810 19:47:54.190008 10375 rpcz_store.cc:276] 0810 19:47:50.914214 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.914565 (+ 351us) service_pool.cc:224] Handling call
0810 19:47:54.102167 (+3187602us) ts_tablet_manager.cc:1151] Deleting tablet 0efa6f35ed284933b9fc53c1cb32da82
0810 19:47:54.102178 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.140593 (+ 38415us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.152726 (+ 12133us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.184761 (+ 32035us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3177860}
I20260810 19:47:54.191293 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 0efa6f35ed284933b9fc53c1cb32da82 (table default.Table_133f8005d08641b68da5bb9faa1e2d7b [id=e8a45897ddcf4bd2a31db1b1d8f6ee12]) successfully deleted
I20260810 19:47:54.197578 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 231) took 3222 ms. Trace:
I20260810 19:47:54.199151 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 85f1c7a75aac4d6a9462af4def91eaa4 (DEFAULT_TABLE table=default.Table_b2a435ba43114086a5c772c02c7ab120 [id=2d55615cd797441c8abf6ea5a64f2f9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.199535 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 85f1c7a75aac4d6a9462af4def91eaa4 (DEFAULT_TABLE table=default.Table_b2a435ba43114086a5c772c02c7ab120 [id=2d55615cd797441c8abf6ea5a64f2f9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.199489 10375 rpcz_store.cc:276] 0810 19:47:50.969317 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.969453 (+ 136us) service_pool.cc:224] Handling call
0810 19:47:54.191568 (+3222115us) ts_tablet_manager.cc:1151] Deleting tablet 3f18c24b01384299a4f941d7fb840032
0810 19:47:54.191584 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.191713 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3219447}
I20260810 19:47:54.199717 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85f1c7a75aac4d6a9462af4def91eaa4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:54.200088 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 3f18c24b01384299a4f941d7fb840032 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f18c24b01384299a4f941d7fb840032 already in progress: creating tablet
I20260810 19:47:54.200266 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85f1c7a75aac4d6a9462af4def91eaa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.203930 10377 ts_tablet_manager.cc:1929] T 58b33df59ffe49a9b07606b6dc9279eb P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:54.204097 10377 log.cc:1199] T 58b33df59ffe49a9b07606b6dc9279eb P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/58b33df59ffe49a9b07606b6dc9279eb
I20260810 19:47:54.204566 10377 ts_tablet_manager.cc:1950] T 58b33df59ffe49a9b07606b6dc9279eb P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:54.205520 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 286) took 1977 ms. Trace:
I20260810 19:47:54.205672 10377 rpcz_store.cc:276] 0810 19:47:52.227695 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.228023 (+ 328us) service_pool.cc:224] Handling call
0810 19:47:54.143636 (+1915613us) ts_tablet_manager.cc:1151] Deleting tablet 58b33df59ffe49a9b07606b6dc9279eb
0810 19:47:54.143648 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.161598 (+ 17950us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.203819 (+ 42221us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.205472 (+ 1653us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1906991}
I20260810 19:47:54.206269 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 58b33df59ffe49a9b07606b6dc9279eb (table default.Table_a289f25ff60e4733899134f73a70715c [id=356d1ec0f2784810895aecd1f2eed86a]) successfully deleted
I20260810 19:47:54.206637 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 233) took 3230 ms. Trace:
I20260810 19:47:54.207180 10375 rpcz_store.cc:276] 0810 19:47:50.972402 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.973420 (+ 1018us) service_pool.cc:224] Handling call
0810 19:47:54.200493 (+3227073us) ts_tablet_manager.cc:1151] Deleting tablet 476e762e46c04ae6bfef5e14df2d16e2
0810 19:47:54.200505 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.202977 (+ 2472us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3213556}
I20260810 19:47:54.207603 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f752dd58f7fe415f85280cbb9adb306c" } modify_external_catalogs: true
I20260810 19:47:54.207823 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f752dd58f7fe415f85280cbb9adb306c" } modify_external_catalogs: true
W20260810 19:47:54.207916 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 476e762e46c04ae6bfef5e14df2d16e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 476e762e46c04ae6bfef5e14df2d16e2 already in progress: creating tablet
I20260810 19:47:54.208513 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 237) took 3235 ms. Trace:
I20260810 19:47:54.208658 10375 rpcz_store.cc:276] 0810 19:47:50.972805 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.973275 (+ 470us) service_pool.cc:224] Handling call
0810 19:47:54.208303 (+3235028us) ts_tablet_manager.cc:1151] Deleting tablet e959898b2c4c4173aea107d3f090ca07
0810 19:47:54.208317 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.208454 (+ 137us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3221075}
I20260810 19:47:54.210861 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 19e2bf7b7d254894a07c5a75bf24e742
I20260810 19:47:54.211199 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 988d87b2b00a459d9afc44ba0ae1961e (DEFAULT_TABLE table=default.Table_3e50c2a587f045f090cdb0a281a1267f [id=f881fab647be45f786665629ab8baaee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.211726 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988d87b2b00a459d9afc44ba0ae1961e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.211814 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 235) took 3239 ms. Trace:
I20260810 19:47:54.211822 10367 tablet_bootstrap.cc:492] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:54.211897 10375 rpcz_store.cc:276] 0810 19:47:50.972597 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.972988 (+ 391us) service_pool.cc:224] Handling call
0810 19:47:54.211627 (+3238639us) ts_tablet_manager.cc:1151] Deleting tablet 965395b5072e4d47adac504e22a8d484
0810 19:47:54.211639 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.211758 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3221045}
I20260810 19:47:54.212014 10367 ts_tablet_manager.cc:1403] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.139s user 0.006s sys 0.003s
I20260810 19:47:54.211197 10140 tablet_service.cc:1511] Processing CreateTablet for tablet 85f1c7a75aac4d6a9462af4def91eaa4 (DEFAULT_TABLE table=default.Table_b2a435ba43114086a5c772c02c7ab120 [id=2d55615cd797441c8abf6ea5a64f2f9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.212575 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85f1c7a75aac4d6a9462af4def91eaa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.213011 10367 raft_consensus.cc:359] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.213255 10367 raft_consensus.cc:385] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:54.213374 10367 raft_consensus.cc:740] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:54.213631 10367 consensus_queue.cc:260] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.214488 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 232) took 3242 ms. Trace:
I20260810 19:47:54.214581 10375 rpcz_store.cc:276] 0810 19:47:50.972243 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:50.973322 (+ 1079us) service_pool.cc:224] Handling call
0810 19:47:54.214271 (+3240949us) ts_tablet_manager.cc:1151] Deleting tablet 5d3598b5743244e39efd12703ec15aea
0810 19:47:54.214282 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.214434 (+ 152us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3159080}
I20260810 19:47:54.215085 10375 tablet_replica.cc:333] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:54.215296 10375 raft_consensus.cc:2243] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:54.215711 10375 raft_consensus.cc:2272] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:54.216387 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 19e2bf7b7d254894a07c5a75bf24e742 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:54.217836 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet e959898b2c4c4173aea107d3f090ca07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e959898b2c4c4173aea107d3f090ca07 already in progress: creating tablet
W20260810 19:47:54.218248 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 965395b5072e4d47adac504e22a8d484 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 965395b5072e4d47adac504e22a8d484 already in progress: creating tablet
I20260810 19:47:54.218257 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 19e2bf7b7d254894a07c5a75bf24e742 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:47:54.218606 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 5d3598b5743244e39efd12703ec15aea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d3598b5743244e39efd12703ec15aea already in progress: creating tablet
I20260810 19:47:54.218703 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet 19e2bf7b7d254894a07c5a75bf24e742 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:54.220019 10366 tablet_bootstrap.cc:492] T 5d3598b5743244e39efd12703ec15aea P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:54.220013 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4c9af5ce9ca6482d8a1aa433f970c274" } modify_external_catalogs: true
I20260810 19:47:54.220192 10366 ts_tablet_manager.cc:1403] T 5d3598b5743244e39efd12703ec15aea P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.107s user 0.004s sys 0.004s
I20260810 19:47:54.220249 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4c9af5ce9ca6482d8a1aa433f970c274" } modify_external_catalogs: true
I20260810 19:47:54.221058 10366 raft_consensus.cc:359] T 5d3598b5743244e39efd12703ec15aea P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.221194 11215 raft_consensus.cc:493] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:54.221273 10366 raft_consensus.cc:385] T 5d3598b5743244e39efd12703ec15aea P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:54.221395 10366 raft_consensus.cc:740] T 5d3598b5743244e39efd12703ec15aea P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:54.221491 10375 ts_tablet_manager.cc:1916] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:54.221513 11215 raft_consensus.cc:515] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.221658 10366 consensus_queue.cc:260] T 5d3598b5743244e39efd12703ec15aea P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.223263 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2ee8ebe11e4e5cb6a91592170c6c3d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:54.223483 10377 tablet_replica.cc:333] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:54.223517 9944 raft_consensus.cc:2393] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eadde59fd6504d679e47f03a60c64bb0 in current term 1: Already voted for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in this term.
I20260810 19:47:54.223723 10377 raft_consensus.cc:2243] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:54.224550 11215 leader_election.cc:290] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:47:54.225042 10068 leader_election.cc:343] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 5b2ee8ebe11e4e5cb6a91592170c6c3d
I20260810 19:47:54.225170 10068 leader_election.cc:304] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:54.225478 10911 raft_consensus.cc:493] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:54.225605 10911 raft_consensus.cc:515] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.226266 10911 leader_election.cc:290] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:54.226446 10911 raft_consensus.cc:3060] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:54.226486 10367 ts_tablet_manager.cc:1434] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260810 19:47:54.226821 10367 tablet_bootstrap.cc:492] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:54.230453 11132 catalog_manager.cc:1295] Loaded cluster ID: 8abb52f4596a48b3a090b657ee482300
I20260810 19:47:54.230525 9413 master_service.cc:960] ReplaceTablet: received request to replace tablet 28c9eecacc6540ac82ac7faabceec788 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:54.230556 11132 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575: loading cluster ID for follower catalog manager: success
W20260810 19:47:54.231556 10067 leader_election.cc:343] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: e177140cad404e978b927c810b87ae0c
I20260810 19:47:54.231745 10366 ts_tablet_manager.cc:1434] T 5d3598b5743244e39efd12703ec15aea P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260810 19:47:54.231997 10911 raft_consensus.cc:2749] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:54.232954 10377 raft_consensus.cc:2272] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:54.233636 10377 ts_tablet_manager.cc:1916] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:47:54.234136 10068 leader_election.cc:343] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: e177140cad404e978b927c810b87ae0c
I20260810 19:47:54.234259 10068 leader_election.cc:304] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:54.234969 11080 raft_consensus.cc:2749] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:54.238116 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_53bdbd217fb14fa892a0a49daf36f7af" } modify_external_catalogs: true
I20260810 19:47:54.238137 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 988d87b2b00a459d9afc44ba0ae1961e (DEFAULT_TABLE table=default.Table_3e50c2a587f045f090cdb0a281a1267f [id=f881fab647be45f786665629ab8baaee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.238348 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_53bdbd217fb14fa892a0a49daf36f7af" } modify_external_catalogs: true
I20260810 19:47:54.239039 10366 tablet_bootstrap.cc:492] T 9e9603994555425289db23bd5c38cc99 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:54.240163 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 988d87b2b00a459d9afc44ba0ae1961e (DEFAULT_TABLE table=default.Table_3e50c2a587f045f090cdb0a281a1267f [id=f881fab647be45f786665629ab8baaee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.240754 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988d87b2b00a459d9afc44ba0ae1961e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.241451 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 4571e0c723f74c828220b33116fed9e9 (DEFAULT_TABLE table=default.Table_f77071b80f324808b6401b4f8d20d2cb [id=8dbf3227e8ae402aa46b9b31b715faa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.242300 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4571e0c723f74c828220b33116fed9e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.243530 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988d87b2b00a459d9afc44ba0ae1961e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.249210 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 4571e0c723f74c828220b33116fed9e9 (DEFAULT_TABLE table=default.Table_f77071b80f324808b6401b4f8d20d2cb [id=8dbf3227e8ae402aa46b9b31b715faa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.249665 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4571e0c723f74c828220b33116fed9e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.258585 10370 tablet_bootstrap.cc:492] T 860dbb6d0a004c43bdce09075272fa70 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:54.258863 10370 ts_tablet_manager.cc:1403] T 860dbb6d0a004c43bdce09075272fa70 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.129s user 0.004s sys 0.001s
I20260810 19:47:54.259234 10375 ts_tablet_manager.cc:1929] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260810 19:47:54.259255 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e8a23221e8447bd83592c05c9d1149c consensus state has no leader
I20260810 19:47:54.259378 10375 log.cc:1199] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/09ab62f482b14cd4b86115e9a0423e7c
I20260810 19:47:54.259598 9416 master_service.cc:960] ReplaceTablet: received request to replace tablet 63486cc3f8774a11827b1cc5f1c16332 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:54.259867 10375 ts_tablet_manager.cc:1950] T 09ab62f482b14cd4b86115e9a0423e7c P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:54.260346 10370 raft_consensus.cc:359] T 860dbb6d0a004c43bdce09075272fa70 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.260548 10370 raft_consensus.cc:385] T 860dbb6d0a004c43bdce09075272fa70 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:54.260651 10370 raft_consensus.cc:740] T 860dbb6d0a004c43bdce09075272fa70 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:54.260739 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 239) took 3253 ms. Trace:
I20260810 19:47:54.260846 10375 rpcz_store.cc:276] 0810 19:47:51.007403 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:51.007457 (+ 54us) service_pool.cc:224] Handling call
0810 19:47:54.214994 (+3207537us) ts_tablet_manager.cc:1151] Deleting tablet 09ab62f482b14cd4b86115e9a0423e7c
0810 19:47:54.215005 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.229185 (+ 14180us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.259135 (+ 29950us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.260694 (+ 1559us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3153213}
I20260810 19:47:54.260995 10370 consensus_queue.cc:260] T 860dbb6d0a004c43bdce09075272fa70 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.261358 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 09ab62f482b14cd4b86115e9a0423e7c (table default.Table_5af45f52e4024048836c48234ef3a903 [id=4fda913821434991b62c8de128735a25]) successfully deleted
I20260810 19:47:54.262956 10377 ts_tablet_manager.cc:1929] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:54.263123 10377 log.cc:1199] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/3ca9d34cb609413d9df495bf191cc409
I20260810 19:47:54.263500 10377 ts_tablet_manager.cc:1950] T 3ca9d34cb609413d9df495bf191cc409 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:54.264868 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_acc6948ab5c0460bb57f457835e70743" } new_table_name: "default.Table_2c70d731dd51405188ec44cbbcffaf57" modify_external_catalogs: true
I20260810 19:47:54.266726 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 242) took 3131 ms. Trace:
I20260810 19:47:54.266865 10375 rpcz_store.cc:276] 0810 19:47:51.135400 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:51.135463 (+ 63us) service_pool.cc:224] Handling call
0810 19:47:54.266527 (+3131064us) ts_tablet_manager.cc:1151] Deleting tablet d2c77a8ac1614bb286e4e168bcf999f3
0810 19:47:54.266540 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.266681 (+ 141us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3130843}
W20260810 19:47:54.267403 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet d2c77a8ac1614bb286e4e168bcf999f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2c77a8ac1614bb286e4e168bcf999f3 already in progress: creating tablet
I20260810 19:47:54.267691 10371 ts_tablet_manager.cc:1929] T 74dddd12f2314d6ab5a6717025b13a51 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:54.267902 10371 log.cc:1199] T 74dddd12f2314d6ab5a6717025b13a51 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/74dddd12f2314d6ab5a6717025b13a51
I20260810 19:47:54.268168 10370 ts_tablet_manager.cc:1434] T 860dbb6d0a004c43bdce09075272fa70 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260810 19:47:54.268270 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 291) took 1976 ms. Trace:
I20260810 19:47:54.268345 10371 ts_tablet_manager.cc:1950] T 74dddd12f2314d6ab5a6717025b13a51 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:54.268394 10377 rpcz_store.cc:276] 0810 19:47:52.292122 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.292339 (+ 217us) service_pool.cc:224] Handling call
0810 19:47:54.223403 (+1931064us) ts_tablet_manager.cc:1151] Deleting tablet 3ca9d34cb609413d9df495bf191cc409
0810 19:47:54.223413 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.237003 (+ 13590us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.262872 (+ 25869us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.268200 (+ 5328us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9013,"tablet-delete.queue_time_us":1924711}
I20260810 19:47:54.268904 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 292) took 1932 ms. Trace:
I20260810 19:47:54.268959 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 3ca9d34cb609413d9df495bf191cc409 (table default.Table_0c6321a554ff4c1a82855f8178d69454 [id=4eec13b150fe4e169ac63d4cd23b6c02]) successfully deleted
I20260810 19:47:54.269006 10377 rpcz_store.cc:276] 0810 19:47:52.336365 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.336446 (+ 81us) service_pool.cc:224] Handling call
0810 19:47:54.268725 (+1932279us) ts_tablet_manager.cc:1151] Deleting tablet 4dba7046bdfd41f1a2ad6f299a723776
0810 19:47:54.268737 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.268849 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1901054}
I20260810 19:47:54.269445 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 293) took 1872 ms. Trace:
I20260810 19:47:54.269519 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 74dddd12f2314d6ab5a6717025b13a51 (table default.Table_b0123864189f4f8bbe188d35a6e10013 [id=9fd5b60a3ce44aaca14478da98f66bc5]) successfully deleted
W20260810 19:47:54.269533 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 4dba7046bdfd41f1a2ad6f299a723776 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4dba7046bdfd41f1a2ad6f299a723776 already in progress: creating tablet
I20260810 19:47:54.269543 10377 rpcz_store.cc:276] 0810 19:47:52.397073 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.397329 (+ 256us) service_pool.cc:224] Handling call
0810 19:47:54.269248 (+1871919us) ts_tablet_manager.cc:1151] Deleting tablet 839dcdb448d14a8f8e452145ccf41263
0810 19:47:54.269258 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.269394 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1871570}
I20260810 19:47:54.269850 10377 tablet_replica.cc:333] T 00dabf43505f4fc89be39ee8fb41c7ee P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:54.270279 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 259) took 2684 ms. Trace:
W20260810 19:47:54.270270 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 839dcdb448d14a8f8e452145ccf41263 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 839dcdb448d14a8f8e452145ccf41263 already in progress: creating tablet
I20260810 19:47:54.270426 10375 rpcz_store.cc:276] 0810 19:47:51.585627 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:51.585697 (+ 70us) service_pool.cc:224] Handling call
0810 19:47:54.270114 (+2684417us) ts_tablet_manager.cc:1151] Deleting tablet 3c828ae089774fb9b0582141f4b99313
0810 19:47:54.270124 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.270241 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2684136}
W20260810 19:47:54.270861 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 3c828ae089774fb9b0582141f4b99313 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c828ae089774fb9b0582141f4b99313 already in progress: creating tablet
I20260810 19:47:54.271080 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 260) took 2503 ms. Trace:
I20260810 19:47:54.271204 10375 rpcz_store.cc:276] 0810 19:47:51.767545 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:51.771012 (+ 3467us) service_pool.cc:224] Handling call
0810 19:47:54.270923 (+2499911us) ts_tablet_manager.cc:1151] Deleting tablet 7737acd216204209ba0327e26e85cfe6
0810 19:47:54.270933 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.271045 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2495159}
I20260810 19:47:54.271760 10377 raft_consensus.cc:2243] T 00dabf43505f4fc89be39ee8fb41c7ee P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 19:47:54.271848 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 7737acd216204209ba0327e26e85cfe6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7737acd216204209ba0327e26e85cfe6 already in progress: creating tablet
I20260810 19:47:54.272018 10377 raft_consensus.cc:2272] T 00dabf43505f4fc89be39ee8fb41c7ee P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 19:47:54.272315 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bafc42f0cdf94ebd823dfb678df8a83b consensus state has no leader
I20260810 19:47:54.272643 10377 ts_tablet_manager.cc:1916] T 00dabf43505f4fc89be39ee8fb41c7ee P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:54.273203 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 4571e0c723f74c828220b33116fed9e9 (DEFAULT_TABLE table=default.Table_f77071b80f324808b6401b4f8d20d2cb [id=8dbf3227e8ae402aa46b9b31b715faa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.274590 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 262) took 2502 ms. Trace:
I20260810 19:47:54.274739 10375 rpcz_store.cc:276] 0810 19:47:51.772489 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:51.772546 (+ 57us) service_pool.cc:224] Handling call
0810 19:47:54.271590 (+2499044us) ts_tablet_manager.cc:1151] Deleting tablet c8602b7360b747a3af756b139635d95c
0810 19:47:54.274366 (+ 2776us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.274541 (+ 175us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2495712}
W20260810 19:47:54.275210 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet c8602b7360b747a3af756b139635d95c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c8602b7360b747a3af756b139635d95c already in progress: creating tablet
I20260810 19:47:54.276162 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4571e0c723f74c828220b33116fed9e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.276947 10367 tablet_bootstrap.cc:654] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:54.280747 10377 ts_tablet_manager.cc:1929] T 00dabf43505f4fc89be39ee8fb41c7ee P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:47:54.280900 10377 log.cc:1199] T 00dabf43505f4fc89be39ee8fb41c7ee P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/00dabf43505f4fc89be39ee8fb41c7ee
I20260810 19:47:54.281641 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_33028416824c4623be1af7797d6d605a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:54.281747 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet 860dbb6d0a004c43bdce09075272fa70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:54.282162 10377 ts_tablet_manager.cc:1950] T 00dabf43505f4fc89be39ee8fb41c7ee P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
W20260810 19:47:54.282732 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33028416824c4623be1af7797d6d605a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:54.283317 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 294) took 1885 ms. Trace:
I20260810 19:47:54.283468 10377 rpcz_store.cc:276] 0810 19:47:52.397522 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.397721 (+ 199us) service_pool.cc:224] Handling call
0810 19:47:54.269766 (+1872045us) ts_tablet_manager.cc:1151] Deleting tablet 00dabf43505f4fc89be39ee8fb41c7ee
0810 19:47:54.269776 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.277222 (+ 7446us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.280643 (+ 3421us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.283262 (+ 2619us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1871759}
I20260810 19:47:54.282346 10366 tablet_bootstrap.cc:654] T 9e9603994555425289db23bd5c38cc99 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:54.285315 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 00dabf43505f4fc89be39ee8fb41c7ee (table default.Table_257ddf6dffe443b7bb3a6d5e7f1e93a2 [id=6b30bf93c566421593a182e1768c0482]) successfully deleted
I20260810 19:47:54.285858 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 295) took 1887 ms. Trace:
I20260810 19:47:54.286034 10377 rpcz_store.cc:276] 0810 19:47:52.398535 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.400121 (+ 1586us) service_pool.cc:224] Handling call
0810 19:47:54.285671 (+1885550us) ts_tablet_manager.cc:1151] Deleting tablet a5625dc6303d44c6be28abd6278ce034
0810 19:47:54.285683 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.285804 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1885218}
I20260810 19:47:54.286903 10377 tablet_replica.cc:333] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:54.287171 10377 raft_consensus.cc:2243] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:54.287560 10377 pending_rounds.cc:70] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691: Trying to abort 1 pending ops.
I20260810 19:47:54.287710 10377 pending_rounds.cc:77] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058654040190976 op_type: NO_OP noop_request { }
I20260810 19:47:54.287909 10377 raft_consensus.cc:2889] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:54.288255 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 261) took 2516 ms. Trace:
I20260810 19:47:54.288456 10377 raft_consensus.cc:2272] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:54.288394 10375 rpcz_store.cc:276] 0810 19:47:51.771971 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:51.772037 (+ 66us) service_pool.cc:224] Handling call
0810 19:47:54.275469 (+2503432us) ts_tablet_manager.cc:1151] Deleting tablet dd632a01fe424a3a956d445ce01e31d2
0810 19:47:54.288075 (+ 12606us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.288215 (+ 140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2490794}
I20260810 19:47:54.289050 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 263) took 2292 ms. Trace:
W20260810 19:47:54.289165 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet dd632a01fe424a3a956d445ce01e31d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dd632a01fe424a3a956d445ce01e31d2 already in progress: creating tablet
I20260810 19:47:54.289268 10375 rpcz_store.cc:276] 0810 19:47:51.996639 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:51.996703 (+ 64us) service_pool.cc:224] Handling call
0810 19:47:54.288904 (+2292201us) ts_tablet_manager.cc:1151] Deleting tablet 08e29e23d54f47968a06be98b313918d
0810 19:47:54.288914 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.289014 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2291912}
I20260810 19:47:54.289649 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 264) took 2256 ms. Trace:
I20260810 19:47:54.289757 10375 rpcz_store.cc:276] 0810 19:47:52.033136 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.033462 (+ 326us) service_pool.cc:224] Handling call
0810 19:47:54.289506 (+2256044us) ts_tablet_manager.cc:1151] Deleting tablet 3916a976efef43428942135e777edcec
0810 19:47:54.289518 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.289612 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2255685}
I20260810 19:47:54.290230 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 266) took 2256 ms. Trace:
I20260810 19:47:54.290197 10932 consensus_queue.cc:1048] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:54.290369 10375 rpcz_store.cc:276] 0810 19:47:52.033404 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.033594 (+ 190us) service_pool.cc:224] Handling call
0810 19:47:54.290068 (+2256474us) ts_tablet_manager.cc:1151] Deleting tablet 6f0150de0d60425b807be532ce0ba6c3
0810 19:47:54.290077 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.290198 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2256066}
W20260810 19:47:54.290567 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 3916a976efef43428942135e777edcec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3916a976efef43428942135e777edcec already in progress: creating tablet
I20260810 19:47:54.290658 10375 tablet_replica.cc:333] T a01d3ec3c8914fe495f7a0f3c7c312f8 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:54.290899 10375 raft_consensus.cc:2243] T a01d3ec3c8914fe495f7a0f3c7c312f8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:54.291095 10375 raft_consensus.cc:2272] T a01d3ec3c8914fe495f7a0f3c7c312f8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:54.291703 10375 ts_tablet_manager.cc:1916] T a01d3ec3c8914fe495f7a0f3c7c312f8 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:54.294613 10370 tablet_bootstrap.cc:492] T 92e3d52bd5b741a4adcabb343b6770b8 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:54.294703 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 92e3d52bd5b741a4adcabb343b6770b8
I20260810 19:47:54.295250 9420 catalog_manager.cc:6807] ReplaceTablet: tablet 92e3d52bd5b741a4adcabb343b6770b8 deleted and replaced by tablet 5f4e2adee0264e418ff8c54912973e60
I20260810 19:47:54.296690 10370 tablet_bootstrap.cc:654] T 92e3d52bd5b741a4adcabb343b6770b8 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:54.297048 11132 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575: acquiring CA information for follower catalog manager: success
I20260810 19:47:54.297322 9415 master_service.cc:960] ReplaceTablet: received request to replace tablet da3d8ade850c4d36bd2756c36706195d from {username='slave'} at 127.0.0.1:56048
W20260810 19:47:54.298838 10068 consensus_peers.cc:597] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 74dddd12f2314d6ab5a6717025b13a51. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:54.300100 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 9e861473094f42dfa22b9c00145ed1fe (DEFAULT_TABLE table=default.Table_cc256890a9a1416588021bfab5b9ee71 [id=33b51db437384acc95b35bc1868227e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.300617 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 92e3d52bd5b741a4adcabb343b6770b8 with delete_type TABLET_DATA_DELETED (replaced by tablet 5f4e2adee0264e418ff8c54912973e60) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:54.300704 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e861473094f42dfa22b9c00145ed1fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.301343 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet 58b33df59ffe49a9b07606b6dc9279eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:54.301689 10128 tablet_service.cc:1558] Processing DeleteTablet for tablet 92e3d52bd5b741a4adcabb343b6770b8 with delete_type TABLET_DATA_DELETED (replaced by tablet 5f4e2adee0264e418ff8c54912973e60) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:54.303148 10371 tablet_replica.cc:333] T 4f8bf9f998ad44df98239767d17e3486 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:54.303499 10371 raft_consensus.cc:2243] T 4f8bf9f998ad44df98239767d17e3486 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:54.303792 10371 raft_consensus.cc:2272] T 4f8bf9f998ad44df98239767d17e3486 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:54.304564 10371 ts_tablet_manager.cc:1916] T 4f8bf9f998ad44df98239767d17e3486 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:54.305634 10367 tablet_bootstrap.cc:492] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:54.305917 10367 ts_tablet_manager.cc:1403] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.079s user 0.004s sys 0.000s
I20260810 19:47:54.305909 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 9e861473094f42dfa22b9c00145ed1fe (DEFAULT_TABLE table=default.Table_cc256890a9a1416588021bfab5b9ee71 [id=33b51db437384acc95b35bc1868227e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.306483 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e861473094f42dfa22b9c00145ed1fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.306865 10367 raft_consensus.cc:359] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.307179 10367 raft_consensus.cc:385] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:54.307314 10367 raft_consensus.cc:740] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:54.307684 10367 consensus_queue.cc:260] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.308410 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 92e3d52bd5b741a4adcabb343b6770b8 with delete_type TABLET_DATA_DELETED (replaced by tablet 5f4e2adee0264e418ff8c54912973e60) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:54.310467 9831 consensus_peers.cc:597] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38ee7973736c4a0a921261d37b74f290. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:54.313263 10367 ts_tablet_manager.cc:1434] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260810 19:47:54.313805 10367 tablet_bootstrap.cc:492] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:54.316469 10367 tablet_bootstrap.cc:654] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:54.316694 9421 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 7010009b9c344fca9bc4ef804829af21
I20260810 19:47:54.323522 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_d2b8c5a92e3d43b89de4938297a90542"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:54.324230 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2b8c5a92e3d43b89de4938297a90542 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:54.324682 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 9e861473094f42dfa22b9c00145ed1fe (DEFAULT_TABLE table=default.Table_cc256890a9a1416588021bfab5b9ee71 [id=33b51db437384acc95b35bc1868227e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.325193 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e861473094f42dfa22b9c00145ed1fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.330080 10377 ts_tablet_manager.cc:1916] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:54.332903 10932 raft_consensus.cc:493] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:54.333101 10932 raft_consensus.cc:515] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.333869 10932 leader_election.cc:290] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:54.334801 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e15a8d1e7d41e68eef25d30d668e61" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:54.334854 10164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e15a8d1e7d41e68eef25d30d668e61" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:54.335079 9714 raft_consensus.cc:2468] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
W20260810 19:47:54.335593 9830 leader_election.cc:343] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:54.336942 9831 leader_election.cc:304] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:54.338748 10932 raft_consensus.cc:2804] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:54.338904 10932 raft_consensus.cc:493] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:54.339005 10932 raft_consensus.cc:3060] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:54.342752 10932 raft_consensus.cc:515] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.342916 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_051685b8260741de820a8b26b13d617f" } new_table_name: "default.Table_26a587e2e39a43e9bda9bf51491d2b81" modify_external_catalogs: true
I20260810 19:47:54.343402 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d3598b5743244e39efd12703ec15aea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:54.343652 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 25e15a8d1e7d41e68eef25d30d668e61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:54.345415 11067 consensus_queue.cc:1048] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:54.350800 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e15a8d1e7d41e68eef25d30d668e61" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:54.351024 9714 raft_consensus.cc:3060] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:54.353531 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f560ed7ea0c4075bad1375d86738861 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b2b20dc77954af7a203f357c746be29) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:54.354064 9714 raft_consensus.cc:2468] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:54.354831 9831 leader_election.cc:304] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:54.355181 9420 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet aa5702d7b3bd421eb7b8a4e0f181d2d4 (table default.Table_5f6b1710e7cc447dbf34e05882706750 [id=a837d5f74eac4f74b2029f46d73acc93]). Expected version 2 got 0
I20260810 19:47:54.356230 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ee35d887df1944efbd0d031717ecbcee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:54.357123 10366 tablet_bootstrap.cc:492] T 9e9603994555425289db23bd5c38cc99 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:54.357322 10366 ts_tablet_manager.cc:1403] T 9e9603994555425289db23bd5c38cc99 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.118s user 0.005s sys 0.001s
I20260810 19:47:54.358290 10366 raft_consensus.cc:359] T 9e9603994555425289db23bd5c38cc99 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.358587 10366 raft_consensus.cc:385] T 9e9603994555425289db23bd5c38cc99 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:54.358659 10366 raft_consensus.cc:740] T 9e9603994555425289db23bd5c38cc99 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:54.358912 10366 consensus_queue.cc:260] T 9e9603994555425289db23bd5c38cc99 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:54.359660 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee35d887df1944efbd0d031717ecbcee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:54.361385 10371 ts_tablet_manager.cc:1929] T 4f8bf9f998ad44df98239767d17e3486 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:54.361550 10371 log.cc:1199] T 4f8bf9f998ad44df98239767d17e3486 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/4f8bf9f998ad44df98239767d17e3486
I20260810 19:47:54.361960 10371 ts_tablet_manager.cc:1950] T 4f8bf9f998ad44df98239767d17e3486 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:54.363380 10377 ts_tablet_manager.cc:1929] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:54.363530 10377 log.cc:1199] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/b9e761e94dbf4baba5e44a89b6c6a81c
I20260810 19:47:54.363938 10377 ts_tablet_manager.cc:1950] T b9e761e94dbf4baba5e44a89b6c6a81c P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:54.365494 10366 ts_tablet_manager.cc:1434] T 9e9603994555425289db23bd5c38cc99 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.008s user 0.000s sys 0.003s
I20260810 19:47:54.367168 10366 tablet_bootstrap.cc:492] T 860dbb6d0a004c43bdce09075272fa70 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:54.368959 11087 raft_consensus.cc:493] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:54.369145 11087 raft_consensus.cc:515] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.369894 11087 leader_election.cc:290] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:54.369963 10366 tablet_bootstrap.cc:654] T 860dbb6d0a004c43bdce09075272fa70 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:54.371320 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e3d52bd5b741a4adcabb343b6770b8" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:54.372073 9611 leader_election.cc:343] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:54.372704 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 00fe7d9a548a487d965d92b53cdf9250
I20260810 19:47:54.373265 9407 catalog_manager.cc:6807] ReplaceTablet: tablet 00fe7d9a548a487d965d92b53cdf9250 deleted and replaced by tablet 9ed73161398f4f54a20a9173c18b4d3c
I20260810 19:47:54.374374 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 00fe7d9a548a487d965d92b53cdf9250 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ed73161398f4f54a20a9173c18b4d3c) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:54.374467 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet 00fe7d9a548a487d965d92b53cdf9250 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ed73161398f4f54a20a9173c18b4d3c) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:54.375051 11260 raft_consensus.cc:2804] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:54.377328 10932 leader_election.cc:290] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:54.377411 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 00fe7d9a548a487d965d92b53cdf9250 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ed73161398f4f54a20a9173c18b4d3c) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:54.379663 10164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e15a8d1e7d41e68eef25d30d668e61" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:54.386957 10140 tablet_service.cc:1511] Processing CreateTablet for tablet 8fce298689e9415a8860b8734d73b10a (DEFAULT_TABLE table=default.Table_987f321d06054ef782d6aa76b7be0ae9 [id=4c476fd4be224f719254ec5da0f5e2ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.387187 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 8fce298689e9415a8860b8734d73b10a (DEFAULT_TABLE table=default.Table_987f321d06054ef782d6aa76b7be0ae9 [id=4c476fd4be224f719254ec5da0f5e2ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.387501 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fce298689e9415a8860b8734d73b10a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.387646 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fce298689e9415a8860b8734d73b10a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.389087 9408 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 220a437d2ec44e10a2a711b7f7032c82
I20260810 19:47:54.389951 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 1a393149727043f3a3c9f58aa051b065
I20260810 19:47:54.391868 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a393149727043f3a3c9f58aa051b065 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:54.392629 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a393149727043f3a3c9f58aa051b065 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:54.393003 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_393de2876fae4c068e06628713ffe649"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:54.394519 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_393de2876fae4c068e06628713ffe649 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:54.394680 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a1fa6532e8104ca59b2dca19999e2e61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:54.395395 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1fa6532e8104ca59b2dca19999e2e61 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:54.395567 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1fad6d00d9714e6494abb90b7d4141e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:54.396063 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1fad6d00d9714e6494abb90b7d4141e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:54.397881 9830 leader_election.cc:343] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:54.400298 11132 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 19:47:54.401403 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a393149727043f3a3c9f58aa051b065 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:47:54.401975 9831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 47198.4us
I20260810 19:47:54.402675 11266 raft_consensus.cc:493] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:54.403242 11266 raft_consensus.cc:515] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.404436 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 8fce298689e9415a8860b8734d73b10a (DEFAULT_TABLE table=default.Table_987f321d06054ef782d6aa76b7be0ae9 [id=4c476fd4be224f719254ec5da0f5e2ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.405000 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fce298689e9415a8860b8734d73b10a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.405972 11266 leader_election.cc:290] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:54.406692 9413 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 551950e2d6b040dc80dd33581ac43597
I20260810 19:47:54.406726 10164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842a5dacf9d145889e97069d3c8084b8" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:54.406950 11087 raft_consensus.cc:493] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:54.407120 11087 raft_consensus.cc:515] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.407805 11087 leader_election.cc:290] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:54.408713 10164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a92eb8626f465caf563b72598a685f" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:54.409262 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet e4a92eb8626f465caf563b72598a685f with delete_type TABLET_DATA_DELETED (replaced by tablet 08e29e23d54f47968a06be98b313918d) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:54.409330 9611 leader_election.cc:343] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:54.410730 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842a5dacf9d145889e97069d3c8084b8" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:54.411024 9714 raft_consensus.cc:2468] T 842a5dacf9d145889e97069d3c8084b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
W20260810 19:47:54.407455 9830 leader_election.cc:343] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:54.409896 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e3d52bd5b741a4adcabb343b6770b8" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:54.412832 9944 raft_consensus.cc:2468] T 92e3d52bd5b741a4adcabb343b6770b8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:54.410387 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 298) took 1986 ms. Trace:
I20260810 19:47:54.410419 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a92eb8626f465caf563b72598a685f" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:54.413398 9948 raft_consensus.cc:2468] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:54.413825 10377 rpcz_store.cc:276] 0810 19:47:52.423624 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.424496 (+ 872us) service_pool.cc:224] Handling call
0810 19:47:54.286831 (+1862335us) ts_tablet_manager.cc:1151] Deleting tablet b9e761e94dbf4baba5e44a89b6c6a81c
0810 19:47:54.286842 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.359573 (+ 72731us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.363260 (+ 3687us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.410280 (+ 47020us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65,"tablet-delete.queue_time_us":1862073}
I20260810 19:47:54.414419 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_60e8f95672f048c5afa43569031f3d12"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:54.415135 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60e8f95672f048c5afa43569031f3d12 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:54.415480 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet b9e761e94dbf4baba5e44a89b6c6a81c (table default.Table_3ffc95fe00014a0b8398de5aced22f11 [id=d277a804313e4f35a31b58d4f682efe6]) successfully deleted
I20260810 19:47:54.415949 11266 raft_consensus.cc:493] T 9e9603994555425289db23bd5c38cc99 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:54.416110 11266 raft_consensus.cc:515] T 9e9603994555425289db23bd5c38cc99 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.416731 11266 leader_election.cc:290] T 9e9603994555425289db23bd5c38cc99 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:54.418000 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 5654c48929564a96a55ed0444c9e1a04 (DEFAULT_TABLE table=default.Table_f90f1a0c22fa4781812518f44c9d7b17 [id=d12cb82567fd409988672b04a2e05a5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.418505 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5654c48929564a96a55ed0444c9e1a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.418550 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 1a393149727043f3a3c9f58aa051b065 (DEFAULT_TABLE table=default.Table_f752dd58f7fe415f85280cbb9adb306c [id=8f9c3952ab4b4930943001c3d43d6d7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.418829 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 5654c48929564a96a55ed0444c9e1a04 (DEFAULT_TABLE table=default.Table_f90f1a0c22fa4781812518f44c9d7b17 [id=d12cb82567fd409988672b04a2e05a5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.419018 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a393149727043f3a3c9f58aa051b065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.419242 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5654c48929564a96a55ed0444c9e1a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.421304 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 300) took 1949 ms. Trace:
I20260810 19:47:54.421435 10377 rpcz_store.cc:276] 0810 19:47:52.472003 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.472062 (+ 59us) service_pool.cc:224] Handling call
0810 19:47:54.415100 (+1943038us) ts_tablet_manager.cc:1151] Deleting tablet 896b7cfdb0ca4904aaeafa13ff19365e
0810 19:47:54.421047 (+ 5947us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.421261 (+ 214us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1923277}
I20260810 19:47:54.421860 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 310) took 1820 ms. Trace:
I20260810 19:47:54.421962 10377 rpcz_store.cc:276] 0810 19:47:52.601693 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.601769 (+ 76us) service_pool.cc:224] Handling call
0810 19:47:54.421715 (+1819946us) ts_tablet_manager.cc:1151] Deleting tablet 15c070c23de34348ad3426c894e11022
0810 19:47:54.421724 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.421829 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1819725}
W20260810 19:47:54.422582 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 896b7cfdb0ca4904aaeafa13ff19365e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 896b7cfdb0ca4904aaeafa13ff19365e already in progress: creating tablet
W20260810 19:47:54.423113 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 15c070c23de34348ad3426c894e11022 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15c070c23de34348ad3426c894e11022 already in progress: creating tablet
I20260810 19:47:54.425623 10367 tablet_bootstrap.cc:492] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:54.425840 10367 ts_tablet_manager.cc:1403] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.112s user 0.007s sys 0.000s
W20260810 19:47:54.426398 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 73abedd88ba548bdb5a23f508b77403d has no consensus state
I20260810 19:47:54.426882 10367 raft_consensus.cc:359] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.427104 10367 raft_consensus.cc:385] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:54.427204 10367 raft_consensus.cc:740] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:54.427474 10367 consensus_queue.cc:260] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.430089 10367 ts_tablet_manager.cc:1434] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 19:47:54.422276 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 307) took 1847 ms. Trace:
I20260810 19:47:54.431360 10377 rpcz_store.cc:276] 0810 19:47:52.575084 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.583451 (+ 8367us) service_pool.cc:224] Handling call
0810 19:47:54.422167 (+1838716us) ts_tablet_manager.cc:1151] Deleting tablet 63486cc3f8774a11827b1cc5f1c16332
0810 19:47:54.422175 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.422249 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1820009}
I20260810 19:47:54.431923 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 313) took 1754 ms. Trace:
I20260810 19:47:54.431955 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 4f8bf9f998ad44df98239767d17e3486 (table default.Table_3716ce5bda064fe3bc3d27c7b0e61fd7 [id=dbb22676ab2e4df580db999a0116fdee]) successfully deleted
I20260810 19:47:54.432047 10377 rpcz_store.cc:276] 0810 19:47:52.677780 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.678006 (+ 226us) service_pool.cc:224] Handling call
0810 19:47:54.431707 (+1753701us) ts_tablet_manager.cc:1151] Deleting tablet d99b34f901484fad87cff4bb9ab56fc8
0810 19:47:54.431721 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.431879 (+ 158us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1733830}
W20260810 19:47:54.432266 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 60bd14fb8c2e40dc955352518d463ccb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60bd14fb8c2e40dc955352518d463ccb already in progress: creating tablet
I20260810 19:47:54.432457 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 314) took 1684 ms. Trace:
W20260810 19:47:54.432557 9397 catalog_manager.cc:5017] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 64470598ccec45a7ae3e3c77fe4b9518 because the tablet was not found. No further retry: Not found: Tablet not found: 64470598ccec45a7ae3e3c77fe4b9518
W20260810 19:47:54.432994 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 63486cc3f8774a11827b1cc5f1c16332 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63486cc3f8774a11827b1cc5f1c16332 already in progress: creating tablet
W20260810 19:47:54.433485 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet d99b34f901484fad87cff4bb9ab56fc8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d99b34f901484fad87cff4bb9ab56fc8 already in progress: creating tablet
I20260810 19:47:54.434245 9831 leader_election.cc:304] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:54.434599 10932 consensus_queue.cc:1048] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:54.435223 10932 raft_consensus.cc:2804] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:54.436002 10932 raft_consensus.cc:493] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:54.436203 10932 raft_consensus.cc:3060] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:54.436134 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a1b1eb3faa4746e7835c3e64900c3a00" } new_table_name: "default.Table_c79485070ea445268631af7e706e5061" modify_external_catalogs: true
I20260810 19:47:54.437251 10371 tablet_replica.cc:333] T 9e9603994555425289db23bd5c38cc99 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:54.437523 10371 raft_consensus.cc:2243] T 9e9603994555425289db23bd5c38cc99 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:54.437739 10371 raft_consensus.cc:2272] T 9e9603994555425289db23bd5c38cc99 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:54.438454 10371 ts_tablet_manager.cc:1916] T 9e9603994555425289db23bd5c38cc99 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:54.432566 10377 rpcz_store.cc:276] 0810 19:47:52.747942 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.748306 (+ 364us) service_pool.cc:224] Handling call
0810 19:47:54.432301 (+1683995us) ts_tablet_manager.cc:1151] Deleting tablet 0dd49d6fa79e4677b753b6cf9117b02d
0810 19:47:54.432312 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.432422 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1683692}
I20260810 19:47:54.440039 10932 raft_consensus.cc:515] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:54.440436 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 0dd49d6fa79e4677b753b6cf9117b02d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0dd49d6fa79e4677b753b6cf9117b02d already in progress: creating tablet
I20260810 19:47:54.441252 10932 leader_election.cc:290] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:54.441550 10377 tablet_replica.cc:333] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:54.443679 10377 raft_consensus.cc:2243] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:54.444294 10377 raft_consensus.cc:2272] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:54.444928 10377 ts_tablet_manager.cc:1916] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:54.448307 9611 leader_election.cc:304] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:54.448848 9611 leader_election.cc:304] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:54.449311 11190 raft_consensus.cc:2804] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:54.449434 11190 raft_consensus.cc:493] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:54.449548 11190 raft_consensus.cc:3060] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:54.449811 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842a5dacf9d145889e97069d3c8084b8" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:54.450060 9717 raft_consensus.cc:3060] T 842a5dacf9d145889e97069d3c8084b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:54.451109 10936 raft_consensus.cc:2804] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:54.451202 10936 raft_consensus.cc:493] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:54.451303 10936 raft_consensus.cc:3060] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:54.451388 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 1a393149727043f3a3c9f58aa051b065 (DEFAULT_TABLE table=default.Table_f752dd58f7fe415f85280cbb9adb306c [id=8f9c3952ab4b4930943001c3d43d6d7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.451732 9412 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 31c8699875b54be888b3128df1b673aa (table default.Table_c35c3a44fcc44bba8a8c334292245b49 [id=5abc1f7beec444a4a988fbfcb8b45623]). Expected version 1 got 0
I20260810 19:47:54.451858 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a393149727043f3a3c9f58aa051b065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.452683 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 64470598ccec45a7ae3e3c77fe4b9518 (DEFAULT_TABLE table=default.Table_20489495f6794646b9eda0458ee58d91 [id=16ed3d0d9475472283f6d95c69c60f8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.452721 9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9603994555425289db23bd5c38cc99" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:54.452702 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1c98bf082e38462a83cbf3d6850868b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:54.453140 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64470598ccec45a7ae3e3c77fe4b9518. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:54.453281 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c98bf082e38462a83cbf3d6850868b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:54.455318 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 64470598ccec45a7ae3e3c77fe4b9518 (DEFAULT_TABLE table=default.Table_20489495f6794646b9eda0458ee58d91 [id=16ed3d0d9475472283f6d95c69c60f8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.455744 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64470598ccec45a7ae3e3c77fe4b9518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.456916 11260 raft_consensus.cc:697] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:47:54.457427 11260 consensus_queue.cc:237] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.457927 10367 tablet_bootstrap.cc:492] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
W20260810 19:47:54.462608 9831 leader_election.cc:343] T 9e9603994555425289db23bd5c38cc99 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: Tablet not RUNNING: STOPPED
I20260810 19:47:54.464740 10366 tablet_bootstrap.cc:492] T 860dbb6d0a004c43bdce09075272fa70 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:54.466674 10366 ts_tablet_manager.cc:1403] T 860dbb6d0a004c43bdce09075272fa70 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.100s user 0.005s sys 0.006s
I20260810 19:47:54.466583 11190 raft_consensus.cc:515] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.467311 11190 leader_election.cc:290] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:47:54.467433 10068 consensus_peers.cc:597] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d90d9c9f6524859a0e33e649dd80f7c. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:54.467701 10366 raft_consensus.cc:359] T 860dbb6d0a004c43bdce09075272fa70 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.467908 10366 raft_consensus.cc:385] T 860dbb6d0a004c43bdce09075272fa70 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:54.471053 10936 raft_consensus.cc:515] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.471737 10366 raft_consensus.cc:740] T 860dbb6d0a004c43bdce09075272fa70 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:54.472362 10936 leader_election.cc:290] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:54.474504 10164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9603994555425289db23bd5c38cc99" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:54.475978 9830 leader_election.cc:304] T 9e9603994555425289db23bd5c38cc99 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:54.476389 11276 raft_consensus.cc:2749] T 9e9603994555425289db23bd5c38cc99 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:54.476552 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842a5dacf9d145889e97069d3c8084b8" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:54.474179 10366 consensus_queue.cc:260] T 860dbb6d0a004c43bdce09075272fa70 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:54.477217 9830 leader_election.cc:343] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:54.477563 10366 ts_tablet_manager.cc:1434] T 860dbb6d0a004c43bdce09075272fa70 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260810 19:47:54.477536 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a92eb8626f465caf563b72598a685f" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:54.477506 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 1a393149727043f3a3c9f58aa051b065 (DEFAULT_TABLE table=default.Table_f752dd58f7fe415f85280cbb9adb306c [id=8f9c3952ab4b4930943001c3d43d6d7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.477854 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e3d52bd5b741a4adcabb343b6770b8" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:54.477946 10366 tablet_bootstrap.cc:492] T aa457d1f5cf2445eb3d869bc6ecf60b3 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:54.477998 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a393149727043f3a3c9f58aa051b065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.481451 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e3d52bd5b741a4adcabb343b6770b8" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:54.481667 9948 raft_consensus.cc:3060] T 92e3d52bd5b741a4adcabb343b6770b8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:47:54.483117 9611 leader_election.cc:343] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:54.483430 9611 leader_election.cc:343] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:54.486371 9948 raft_consensus.cc:2468] T 92e3d52bd5b741a4adcabb343b6770b8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:54.487865 10140 tablet_service.cc:1511] Processing CreateTablet for tablet 5654c48929564a96a55ed0444c9e1a04 (DEFAULT_TABLE table=default.Table_f90f1a0c22fa4781812518f44c9d7b17 [id=d12cb82567fd409988672b04a2e05a5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.488499 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5654c48929564a96a55ed0444c9e1a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.491665 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet da3d8ade850c4d36bd2756c36706195d
I20260810 19:47:54.492242 9415 catalog_manager.cc:6807] ReplaceTablet: tablet da3d8ade850c4d36bd2756c36706195d deleted and replaced by tablet 87bbcc651d034e2a826478b805792e48
I20260810 19:47:54.493363 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a92eb8626f465caf563b72598a685f" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:54.493649 9948 raft_consensus.cc:3060] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:54.493656 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet da3d8ade850c4d36bd2756c36706195d with delete_type TABLET_DATA_DELETED (replaced by tablet 87bbcc651d034e2a826478b805792e48) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:54.496594 9948 raft_consensus.cc:2468] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:54.496762 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet da3d8ade850c4d36bd2756c36706195d with delete_type TABLET_DATA_DELETED (replaced by tablet 87bbcc651d034e2a826478b805792e48) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:54.497704 9611 leader_election.cc:304] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:54.500761 10936 raft_consensus.cc:2804] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:54.500957 10936 raft_consensus.cc:697] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:54.501257 10936 consensus_queue.cc:237] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.508520 9611 leader_election.cc:304] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:54.509120 11190 raft_consensus.cc:2804] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:54.509236 9415 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 31c8699875b54be888b3128df1b673aa (table default.Table_c35c3a44fcc44bba8a8c334292245b49 [id=5abc1f7beec444a4a988fbfcb8b45623]). Expected version 1 got 0
I20260810 19:47:54.509305 11190 raft_consensus.cc:697] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:54.509478 9415 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet aa5702d7b3bd421eb7b8a4e0f181d2d4 (table default.Table_5f6b1710e7cc447dbf34e05882706750 [id=a837d5f74eac4f74b2029f46d73acc93]). Expected version 2 got 0
I20260810 19:47:54.509601 11190 consensus_queue.cc:237] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.511699 9415 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet aa5702d7b3bd421eb7b8a4e0f181d2d4 (table default.Table_5f6b1710e7cc447dbf34e05882706750 [id=a837d5f74eac4f74b2029f46d73acc93]). Expected version 2 got 0
I20260810 19:47:54.513473 10366 tablet_bootstrap.cc:654] T aa457d1f5cf2445eb3d869bc6ecf60b3 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:54.513321 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0fa5ed82975d484a938aba25478b3c40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:54.513985 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0fa5ed82975d484a938aba25478b3c40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:54.522823 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet da3d8ade850c4d36bd2756c36706195d with delete_type TABLET_DATA_DELETED (replaced by tablet 87bbcc651d034e2a826478b805792e48) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:54.524192 10371 ts_tablet_manager.cc:1929] T 9e9603994555425289db23bd5c38cc99 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:54.526783 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_dc64f7c8549548b29cd6e8486da72211" } modify_external_catalogs: true
I20260810 19:47:54.527007 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_dc64f7c8549548b29cd6e8486da72211" } modify_external_catalogs: true
I20260810 19:47:54.535277 10370 tablet_bootstrap.cc:492] T 92e3d52bd5b741a4adcabb343b6770b8 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:54.535712 10370 ts_tablet_manager.cc:1403] T 92e3d52bd5b741a4adcabb343b6770b8 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.241s user 0.003s sys 0.003s
W20260810 19:47:54.537531 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 263a5695e7754b44a64edbda27b42135 has no consensus state
I20260810 19:47:54.537865 10370 raft_consensus.cc:359] T 92e3d52bd5b741a4adcabb343b6770b8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.539698 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_7984b3459b7c46eab35b53ef578aa0a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:54.540366 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7984b3459b7c46eab35b53ef578aa0a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:54.545754 10370 raft_consensus.cc:385] T 92e3d52bd5b741a4adcabb343b6770b8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:54.546799 10377 ts_tablet_manager.cc:1929] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:54.547012 10377 log.cc:1199] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/5b2ee8ebe11e4e5cb6a91592170c6c3d
I20260810 19:47:54.541524 11190 raft_consensus.cc:493] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:54.547418 10377 ts_tablet_manager.cc:1950] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:54.547864 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 315) took 1674 ms. Trace:
I20260810 19:47:54.547977 10377 rpcz_store.cc:276] 0810 19:47:52.873733 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.873796 (+ 63us) service_pool.cc:224] Handling call
0810 19:47:54.441471 (+1567675us) ts_tablet_manager.cc:1151] Deleting tablet 5b2ee8ebe11e4e5cb6a91592170c6c3d
0810 19:47:54.441485 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.489376 (+ 47891us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.546669 (+ 57293us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.547808 (+ 1139us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1567387}
I20260810 19:47:54.547464 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 64470598ccec45a7ae3e3c77fe4b9518 (DEFAULT_TABLE table=default.Table_20489495f6794646b9eda0458ee58d91 [id=16ed3d0d9475472283f6d95c69c60f8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.548519 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 5b2ee8ebe11e4e5cb6a91592170c6c3d (table default.Table_bc109c4a41b649f0843393e4184b81be [id=932a3e3e563546b6b0cb7850cc4f3e1f]) successfully deleted
I20260810 19:47:54.548717 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64470598ccec45a7ae3e3c77fe4b9518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.549384 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 316) took 1598 ms. Trace:
I20260810 19:47:54.549486 10377 rpcz_store.cc:276] 0810 19:47:52.951136 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.951214 (+ 78us) service_pool.cc:224] Handling call
0810 19:47:54.549178 (+1597964us) ts_tablet_manager.cc:1151] Deleting tablet 21208dd824fe432fa307cbb88d37aaa2
0810 19:47:54.549189 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.549317 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1597658}
W20260810 19:47:54.550033 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 21208dd824fe432fa307cbb88d37aaa2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21208dd824fe432fa307cbb88d37aaa2 already in progress: creating tablet
I20260810 19:47:54.550282 10366 tablet_bootstrap.cc:492] T aa457d1f5cf2445eb3d869bc6ecf60b3 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:54.550611 11087 raft_consensus.cc:493] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:54.550796 11087 raft_consensus.cc:515] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.551770 11087 leader_election.cc:290] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:54.552103 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c8699875b54be888b3128df1b673aa" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:54.553123 9611 leader_election.cc:343] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:54.548127 10370 raft_consensus.cc:740] T 92e3d52bd5b741a4adcabb343b6770b8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:54.555157 10370 consensus_queue.cc:260] T 92e3d52bd5b741a4adcabb343b6770b8 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.555842 10370 ts_tablet_manager.cc:1434] T 92e3d52bd5b741a4adcabb343b6770b8 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20260810 19:47:54.556197 10370 tablet_bootstrap.cc:492] T 25e15a8d1e7d41e68eef25d30d668e61 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:54.558415 10370 tablet_bootstrap.cc:654] T 25e15a8d1e7d41e68eef25d30d668e61 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:54.560191 11190 raft_consensus.cc:515] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.561038 11190 leader_election.cc:290] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:54.563629 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860dbb6d0a004c43bdce09075272fa70" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:54.563874 10167 raft_consensus.cc:2468] T 860dbb6d0a004c43bdce09075272fa70 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:54.564550 9611 leader_election.cc:304] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:54.565120 9420 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet aa5702d7b3bd421eb7b8a4e0f181d2d4 (table default.Table_5f6b1710e7cc447dbf34e05882706750 [id=a837d5f74eac4f74b2029f46d73acc93]). Expected version 2 got 0
I20260810 19:47:54.565210 11190 raft_consensus.cc:2804] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:54.565342 11190 raft_consensus.cc:493] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:54.565429 11190 raft_consensus.cc:3060] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:54.568233 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3eb29b584f754b4ab55797b02f82462d" } new_table_name: "default.Table_65f4c2fb3d1c49ae9cdfc041e51bd182" modify_external_catalogs: true
I20260810 19:47:54.569311 11190 raft_consensus.cc:515] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.572145 9946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860dbb6d0a004c43bdce09075272fa70" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:54.573020 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860dbb6d0a004c43bdce09075272fa70" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:54.573279 10167 raft_consensus.cc:3060] T 860dbb6d0a004c43bdce09075272fa70 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:54.576169 10371 log.cc:1199] T 9e9603994555425289db23bd5c38cc99 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/9e9603994555425289db23bd5c38cc99
I20260810 19:47:54.576355 10167 raft_consensus.cc:2468] T 860dbb6d0a004c43bdce09075272fa70 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:54.576654 10371 ts_tablet_manager.cc:1950] T 9e9603994555425289db23bd5c38cc99 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:54.578078 10377 tablet_replica.cc:333] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:54.578351 10366 ts_tablet_manager.cc:1403] T aa457d1f5cf2445eb3d869bc6ecf60b3 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.073s user 0.005s sys 0.000s
I20260810 19:47:54.579101 9611 leader_election.cc:304] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:54.579437 11087 raft_consensus.cc:2804] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:54.579452 10366 raft_consensus.cc:359] T aa457d1f5cf2445eb3d869bc6ecf60b3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.579582 11087 raft_consensus.cc:697] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:54.579674 10366 raft_consensus.cc:385] T aa457d1f5cf2445eb3d869bc6ecf60b3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:54.579757 10366 raft_consensus.cc:740] T aa457d1f5cf2445eb3d869bc6ecf60b3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:54.579847 11087 consensus_queue.cc:237] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.580000 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c8699875b54be888b3128df1b673aa" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:54.580966 10371 tablet_replica.cc:333] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:54.581167 10371 raft_consensus.cc:2243] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
W20260810 19:47:54.581660 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 8fadd6f84c75466287b318ed7018b071 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fadd6f84c75466287b318ed7018b071 already in progress: creating tablet
I20260810 19:47:54.581748 10371 raft_consensus.cc:2272] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 19:47:54.583011 9611 leader_election.cc:343] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:54.583153 9611 leader_election.cc:304] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:54.584877 11087 raft_consensus.cc:2749] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:54.585227 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860dbb6d0a004c43bdce09075272fa70" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:54.585626 9946 raft_consensus.cc:3060] T 860dbb6d0a004c43bdce09075272fa70 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:54.586938 11190 leader_election.cc:290] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:54.588809 9946 raft_consensus.cc:2468] T 860dbb6d0a004c43bdce09075272fa70 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:54.591279 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3169e1b140894b6cb7c9b922101b6909" } new_table_name: "default.Table_3c331b2bd94d4303a3de78c1369771bc" modify_external_catalogs: true
I20260810 19:47:54.594236 10367 tablet_bootstrap.cc:654] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:54.595111 9717 raft_consensus.cc:2468] T 842a5dacf9d145889e97069d3c8084b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:54.595899 9831 leader_election.cc:304] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:54.597774 10366 consensus_queue.cc:260] T aa457d1f5cf2445eb3d869bc6ecf60b3 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.598013 11274 raft_consensus.cc:2804] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:54.598215 10371 ts_tablet_manager.cc:1916] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:47:54.599577 10067 consensus_peers.cc:597] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:54.599901 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 81aabb5656e7472f9223fd7acf10e43c (DEFAULT_TABLE table=default.Table_3169e1b140894b6cb7c9b922101b6909 [id=f9a169cfd328466b908bc057a70a9668]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.600390 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81aabb5656e7472f9223fd7acf10e43c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.601817 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 81aabb5656e7472f9223fd7acf10e43c (DEFAULT_TABLE table=default.Table_3169e1b140894b6cb7c9b922101b6909 [id=f9a169cfd328466b908bc057a70a9668]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.603163 10375 ts_tablet_manager.cc:1929] T a01d3ec3c8914fe495f7a0f3c7c312f8 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:54.603348 10375 log.cc:1199] T a01d3ec3c8914fe495f7a0f3c7c312f8 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/a01d3ec3c8914fe495f7a0f3c7c312f8
I20260810 19:47:54.603567 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 77cf30d2d79f404798378ab01af53b8c (DEFAULT_TABLE table=default.Table_88790a0f0d5c47079b55c152d71d4a1c [id=f06fa8a4ae1c4ce89691f8abad3d3e7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.603778 10375 ts_tablet_manager.cc:1950] T a01d3ec3c8914fe495f7a0f3c7c312f8 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:54.604674 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 444b49a69c8245b6944a76d53041154c (DEFAULT_TABLE table=default.Table_070cfe9bb949439ca652e166a5c0f63e [id=a16bb67de06846c38f490000206e507f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.605340 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 05059ef70a8e440ca2988bfeb610645d (DEFAULT_TABLE table=default.Table_39297078d5434aed9d01e90ff26623c8 [id=79f209949d0247619f04d8faa6f4568f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.606673 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 444b49a69c8245b6944a76d53041154c (DEFAULT_TABLE table=default.Table_070cfe9bb949439ca652e166a5c0f63e [id=a16bb67de06846c38f490000206e507f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.607117 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 444b49a69c8245b6944a76d53041154c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.607822 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 265) took 2574 ms. Trace:
I20260810 19:47:54.607924 10375 rpcz_store.cc:276] 0810 19:47:52.033293 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.033555 (+ 262us) service_pool.cc:224] Handling call
0810 19:47:54.290596 (+2257041us) ts_tablet_manager.cc:1151] Deleting tablet a01d3ec3c8914fe495f7a0f3c7c312f8
0810 19:47:54.290607 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.413230 (+122623us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.603081 (+189851us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.607754 (+ 4673us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2256500}
I20260810 19:47:54.610677 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 05059ef70a8e440ca2988bfeb610645d (DEFAULT_TABLE table=default.Table_39297078d5434aed9d01e90ff26623c8 [id=79f209949d0247619f04d8faa6f4568f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.611088 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05059ef70a8e440ca2988bfeb610645d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.605875 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 6ea318eddd8349a79d27ce5746f03798 (DEFAULT_TABLE table=default.Table_7924d8dbb4ea4a7c8809db86c7b3fbef [id=a8b0eeac86bf4ff5a8a71ca5432d07ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.612742 10367 tablet_bootstrap.cc:492] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:54.612932 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea318eddd8349a79d27ce5746f03798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.612950 10367 ts_tablet_manager.cc:1403] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.155s user 0.007s sys 0.002s
I20260810 19:47:54.613821 10367 raft_consensus.cc:359] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.614027 10367 raft_consensus.cc:385] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:54.614090 10367 raft_consensus.cc:740] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:54.614413 10367 consensus_queue.cc:260] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.614933 10367 ts_tablet_manager.cc:1434] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 19:47:54.606241 10120 tablet_service.cc:1511] Processing CreateTablet for tablet 77cf30d2d79f404798378ab01af53b8c (DEFAULT_TABLE table=default.Table_88790a0f0d5c47079b55c152d71d4a1c [id=f06fa8a4ae1c4ce89691f8abad3d3e7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.616530 10367 tablet_bootstrap.cc:492] T dad16ea0f82942de8587dd7c98c0d2df P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:54.616554 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77cf30d2d79f404798378ab01af53b8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.618353 10367 tablet_bootstrap.cc:654] T dad16ea0f82942de8587dd7c98c0d2df P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:54.618939 10375 tablet_replica.cc:333] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:54.619168 10375 raft_consensus.cc:2243] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:54.619428 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet a01d3ec3c8914fe495f7a0f3c7c312f8 (table default.Table_a1645668cf79415ca029a01169fbf874 [id=aec405416e584af6bfb8194b357d6dbc]) successfully deleted
I20260810 19:47:54.619596 10375 raft_consensus.cc:2272] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:54.619975 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_04f4dbba6a76450e93204861a2b94b0e" } modify_external_catalogs: true
I20260810 19:47:54.620203 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_04f4dbba6a76450e93204861a2b94b0e" } modify_external_catalogs: true
I20260810 19:47:54.624109 10375 ts_tablet_manager.cc:1916] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:54.627307 10370 tablet_bootstrap.cc:492] T 25e15a8d1e7d41e68eef25d30d668e61 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:54.631604 9659 tablet_service.cc:1511] Processing CreateTablet for tablet f6f9eb86c6c84b4a84d109d4741238e1 (DEFAULT_TABLE table=default.Table_3102211b2b544d6bae3547d4f9af2574 [id=c10c35b78ae24250a48631468376e8ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.633052 10134 tablet_service.cc:1511] Processing CreateTablet for tablet f6f9eb86c6c84b4a84d109d4741238e1 (DEFAULT_TABLE table=default.Table_3102211b2b544d6bae3547d4f9af2574 [id=c10c35b78ae24250a48631468376e8ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.633598 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6f9eb86c6c84b4a84d109d4741238e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.633544 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_393de2876fae4c068e06628713ffe649" } modify_external_catalogs: true
I20260810 19:47:54.633754 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_393de2876fae4c068e06628713ffe649" } modify_external_catalogs: true
I20260810 19:47:54.634783 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 6ea318eddd8349a79d27ce5746f03798 (DEFAULT_TABLE table=default.Table_7924d8dbb4ea4a7c8809db86c7b3fbef [id=a8b0eeac86bf4ff5a8a71ca5432d07ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.649807 11274 raft_consensus.cc:697] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:47:54.598609 10366 ts_tablet_manager.cc:1434] T aa457d1f5cf2445eb3d869bc6ecf60b3 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260810 19:47:54.650625 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81aabb5656e7472f9223fd7acf10e43c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.650945 9659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6f9eb86c6c84b4a84d109d4741238e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.651216 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77cf30d2d79f404798378ab01af53b8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.651818 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05059ef70a8e440ca2988bfeb610645d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.652417 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea318eddd8349a79d27ce5746f03798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.603832 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 6ea318eddd8349a79d27ce5746f03798 (DEFAULT_TABLE table=default.Table_7924d8dbb4ea4a7c8809db86c7b3fbef [id=a8b0eeac86bf4ff5a8a71ca5432d07ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.604247 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 77cf30d2d79f404798378ab01af53b8c (DEFAULT_TABLE table=default.Table_88790a0f0d5c47079b55c152d71d4a1c [id=f06fa8a4ae1c4ce89691f8abad3d3e7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.604583 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 444b49a69c8245b6944a76d53041154c (DEFAULT_TABLE table=default.Table_070cfe9bb949439ca652e166a5c0f63e [id=a16bb67de06846c38f490000206e507f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.604918 9911 tablet_service.cc:1511] Processing CreateTablet for tablet 05059ef70a8e440ca2988bfeb610645d (DEFAULT_TABLE table=default.Table_39297078d5434aed9d01e90ff26623c8 [id=79f209949d0247619f04d8faa6f4568f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.578369 10377 raft_consensus.cc:2243] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:54.653915 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 444b49a69c8245b6944a76d53041154c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:54.626637 9831 consensus_peers.cc:597] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4f8bf9f998ad44df98239767d17e3486. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:54.631208 9899 tablet_service.cc:1511] Processing CreateTablet for tablet f6f9eb86c6c84b4a84d109d4741238e1 (DEFAULT_TABLE table=default.Table_3102211b2b544d6bae3547d4f9af2574 [id=c10c35b78ae24250a48631468376e8ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.647338 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 81aabb5656e7472f9223fd7acf10e43c (DEFAULT_TABLE table=default.Table_3169e1b140894b6cb7c9b922101b6909 [id=f9a169cfd328466b908bc057a70a9668]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:54.662746 10911 consensus_queue.cc:1048] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:54.668529 10911 raft_consensus.cc:493] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:54.668735 10911 raft_consensus.cc:515] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.669561 10911 leader_election.cc:290] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
W20260810 19:47:54.670738 10068 leader_election.cc:343] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: aa457d1f5cf2445eb3d869bc6ecf60b3
W20260810 19:47:54.677140 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4b2b0f2fc93647f3bc1d79b4132c3703 consensus state has no leader
I20260810 19:47:54.650667 10366 tablet_bootstrap.cc:492] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:54.653062 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea318eddd8349a79d27ce5746f03798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.678515 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77cf30d2d79f404798378ab01af53b8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.682497 10366 tablet_bootstrap.cc:654] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:54.682572 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 444b49a69c8245b6944a76d53041154c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.684018 9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6f9eb86c6c84b4a84d109d4741238e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.686508 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05059ef70a8e440ca2988bfeb610645d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.653919 11267 consensus_queue.cc:1048] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260810 19:47:54.690126 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81aabb5656e7472f9223fd7acf10e43c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:54.666069 11268 raft_consensus.cc:493] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:54.690572 11268 raft_consensus.cc:515] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.650296 11274 consensus_queue.cc:237] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.691403 11268 leader_election.cc:290] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:54.675009 9946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa457d1f5cf2445eb3d869bc6ecf60b3" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:54.654240 10377 raft_consensus.cc:2272] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:54.692045 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46005eead530459eb2b636ae0a6767ad" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:54.692283 9717 raft_consensus.cc:2468] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:54.691850 9946 raft_consensus.cc:2468] T aa457d1f5cf2445eb3d869bc6ecf60b3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:47:54.693037 10377 ts_tablet_manager.cc:1916] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:54.693114 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46005eead530459eb2b636ae0a6767ad" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:54.693205 10067 leader_election.cc:304] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:54.693557 10911 raft_consensus.cc:2804] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:54.693671 10911 raft_consensus.cc:493] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:54.693744 10911 raft_consensus.cc:3060] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:54.693813 9831 leader_election.cc:304] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:54.694168 11268 raft_consensus.cc:2804] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:54.694283 11268 raft_consensus.cc:493] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:54.694391 11268 raft_consensus.cc:3060] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:54.696897 10911 raft_consensus.cc:515] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.697237 11268 raft_consensus.cc:515] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.698172 11268 leader_election.cc:290] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:54.698709 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46005eead530459eb2b636ae0a6767ad" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
W20260810 19:47:54.699154 9830 leader_election.cc:343] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:54.698177 9946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa457d1f5cf2445eb3d869bc6ecf60b3" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:54.699604 9946 raft_consensus.cc:3060] T aa457d1f5cf2445eb3d869bc6ecf60b3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:54.703322 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46005eead530459eb2b636ae0a6767ad" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:54.703387 10370 ts_tablet_manager.cc:1403] T 25e15a8d1e7d41e68eef25d30d668e61 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.075s user 0.003s sys 0.001s
I20260810 19:47:54.703560 9717 raft_consensus.cc:3060] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:54.712051 9717 raft_consensus.cc:2468] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
W20260810 19:47:54.713161 10068 leader_election.cc:343] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: aa457d1f5cf2445eb3d869bc6ecf60b3
I20260810 19:47:54.713141 10370 raft_consensus.cc:359] T 25e15a8d1e7d41e68eef25d30d668e61 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.713405 10370 raft_consensus.cc:385] T 25e15a8d1e7d41e68eef25d30d668e61 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:54.713573 10370 raft_consensus.cc:740] T 25e15a8d1e7d41e68eef25d30d668e61 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:54.713855 10370 consensus_queue.cc:260] T 25e15a8d1e7d41e68eef25d30d668e61 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.714709 10911 leader_election.cc:290] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:54.715030 10370 ts_tablet_manager.cc:1434] T 25e15a8d1e7d41e68eef25d30d668e61 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260810 19:47:54.715274 9946 raft_consensus.cc:2468] T aa457d1f5cf2445eb3d869bc6ecf60b3 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:47:54.715369 10370 tablet_bootstrap.cc:492] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:54.715971 10067 leader_election.cc:304] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:47:54.715317 9830 leader_election.cc:343] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:54.716624 10911 raft_consensus.cc:2804] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:54.716944 10911 raft_consensus.cc:697] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:47:54.717190 10370 tablet_bootstrap.cc:654] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:54.717419 10911 consensus_queue.cc:237] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:54.714705 9611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 131708us
I20260810 19:47:54.720278 10367 tablet_bootstrap.cc:492] T dad16ea0f82942de8587dd7c98c0d2df P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:54.720463 10367 ts_tablet_manager.cc:1403] T dad16ea0f82942de8587dd7c98c0d2df P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.104s user 0.000s sys 0.006s
I20260810 19:47:54.721992 10367 raft_consensus.cc:359] T dad16ea0f82942de8587dd7c98c0d2df P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.723680 9421 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 32c3796979bc4d2aba3e6cadab02a5dd
I20260810 19:47:54.730352 9831 leader_election.cc:304] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
W20260810 19:47:54.730546 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7d939e3df62a45d9a964d4df01be4bfb has no consensus state
I20260810 19:47:54.730806 9420 master_service.cc:960] ReplaceTablet: received request to replace tablet 5654c48929564a96a55ed0444c9e1a04 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:54.731406 10370 tablet_bootstrap.cc:492] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:54.731590 10370 ts_tablet_manager.cc:1403] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.001s
I20260810 19:47:54.732584 10370 raft_consensus.cc:359] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.732882 10370 raft_consensus.cc:385] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:54.732999 10370 raft_consensus.cc:740] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
W20260810 19:47:54.733264 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 81aabb5656e7472f9223fd7acf10e43c consensus state has no leader
I20260810 19:47:54.733350 10370 consensus_queue.cc:260] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.733657 9407 master_service.cc:960] ReplaceTablet: received request to replace tablet 7d3395886420455d9bdaf816c19ebae2 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:54.734015 10370 ts_tablet_manager.cc:1434] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:47:54.734441 10370 tablet_bootstrap.cc:492] T 34fdc03b114b405da9e3a17ef1ad87c4 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:54.734539 11260 raft_consensus.cc:2804] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:54.732638 10367 raft_consensus.cc:385] T dad16ea0f82942de8587dd7c98c0d2df P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:54.735548 10367 raft_consensus.cc:740] T dad16ea0f82942de8587dd7c98c0d2df P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:54.736605 10370 tablet_bootstrap.cc:654] T 34fdc03b114b405da9e3a17ef1ad87c4 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:54.741792 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_06a146e0e459439cba25bc9eaf210b12"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:54.742592 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_987f321d06054ef782d6aa76b7be0ae9" } modify_external_catalogs: true
I20260810 19:47:54.742748 11260 raft_consensus.cc:697] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:47:54.742825 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_987f321d06054ef782d6aa76b7be0ae9" } modify_external_catalogs: true
I20260810 19:47:54.745108 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_070cfe9bb949439ca652e166a5c0f63e" } modify_external_catalogs: true
I20260810 19:47:54.745306 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_070cfe9bb949439ca652e166a5c0f63e" } modify_external_catalogs: true
I20260810 19:47:54.745601 9407 master_service.cc:960] ReplaceTablet: received request to replace tablet 827dce05c192467589e2692fabd2a84e from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:54.745872 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_9a949158a5f2417ea8f015281b20659a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:54.746464 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a949158a5f2417ea8f015281b20659a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:54.747681 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ee35d887df1944efbd0d031717ecbcee" } new_table_name: "default.Table_ab79ddcb17e24ce7960c0c41dd451bc2" modify_external_catalogs: true
I20260810 19:47:54.750833 9415 rpcz_store.cc:275] Call kudu.master.MasterService.GetMasterRegistration from 127.0.0.1:37704 (request call id 1) took 1146 ms. Trace:
I20260810 19:47:54.750968 9415 rpcz_store.cc:276] 0810 19:47:53.604191 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:54.750575 (+1146384us) service_pool.cc:224] Handling call
0810 19:47:54.750797 (+ 222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:54.749408 11260 consensus_queue.cc:237] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.754426 10366 tablet_bootstrap.cc:492] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:54.754621 10366 ts_tablet_manager.cc:1403] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.104s user 0.005s sys 0.000s
W20260810 19:47:54.754889 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06a146e0e459439cba25bc9eaf210b12 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:54.756790 10370 tablet_bootstrap.cc:492] T 34fdc03b114b405da9e3a17ef1ad87c4 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:54.756958 10370 ts_tablet_manager.cc:1403] T 34fdc03b114b405da9e3a17ef1ad87c4 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.000s
I20260810 19:47:54.759544 10370 raft_consensus.cc:359] T 34fdc03b114b405da9e3a17ef1ad87c4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.760488 10370 raft_consensus.cc:385] T 34fdc03b114b405da9e3a17ef1ad87c4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:54.760783 10370 raft_consensus.cc:740] T 34fdc03b114b405da9e3a17ef1ad87c4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:54.761372 10370 consensus_queue.cc:260] T 34fdc03b114b405da9e3a17ef1ad87c4 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.763001 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2bdff833e300406db760c7c64d88e546" } new_table_name: "default.Table_64e5558a29af405b85912f54bebdf3be" modify_external_catalogs: true
I20260810 19:47:54.765497 10370 ts_tablet_manager.cc:1434] T 34fdc03b114b405da9e3a17ef1ad87c4 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260810 19:47:54.766387 10370 tablet_bootstrap.cc:492] T 46005eead530459eb2b636ae0a6767ad P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:54.773963 10370 tablet_bootstrap.cc:654] T 46005eead530459eb2b636ae0a6767ad P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:54.777053 10366 raft_consensus.cc:359] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.777303 10366 raft_consensus.cc:385] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:54.777853 10366 raft_consensus.cc:740] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:54.778169 10366 consensus_queue.cc:260] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.784435 10367 consensus_queue.cc:260] T dad16ea0f82942de8587dd7c98c0d2df P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.785178 10367 ts_tablet_manager.cc:1434] T dad16ea0f82942de8587dd7c98c0d2df P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.064s user 0.001s sys 0.001s
I20260810 19:47:54.785591 10367 tablet_bootstrap.cc:492] T 10617bdf2eed4dbd8d13ea1821443863 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:54.740857 10371 ts_tablet_manager.cc:1929] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:54.786302 10371 log.cc:1199] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/f2931130e9354f16a238712234c19217
I20260810 19:47:54.786851 10371 ts_tablet_manager.cc:1950] T f2931130e9354f16a238712234c19217 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:54.787777 10367 tablet_bootstrap.cc:654] T 10617bdf2eed4dbd8d13ea1821443863 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:54.787925 10371 tablet_replica.cc:333] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:54.788160 10371 raft_consensus.cc:2243] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:54.788363 10371 raft_consensus.cc:2272] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:54.788899 10371 ts_tablet_manager.cc:1916] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:54.794427 11295 raft_consensus.cc:493] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:54.794597 11295 raft_consensus.cc:515] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.795363 11295 leader_election.cc:290] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:54.795593 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet f2931130e9354f16a238712234c19217 (table default.Table_f1f332ce5d104c2b889c1faf78a0510f [id=a5becac787b84d398e96784d005d21f6]) successfully deleted
I20260810 19:47:54.798645 9418 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 70d5695e365d409f84d40c01c959bb59
I20260810 19:47:54.799110 9408 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 72c78fb52e2a449c8923e6a49be39a3d
I20260810 19:47:54.801523 10375 ts_tablet_manager.cc:1929] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:54.803414 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3598b5743244e39efd12703ec15aea" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:54.804328 10120 tablet_service.cc:1558] Processing DeleteTablet for tablet 25e15a8d1e7d41e68eef25d30d668e61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:54.807457 10375 log.cc:1199] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/c1777a713b1d4a58919b5f6abe779ab8
I20260810 19:47:54.807794 10371 ts_tablet_manager.cc:1929] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:54.808321 9946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3598b5743244e39efd12703ec15aea" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:54.808938 10375 ts_tablet_manager.cc:1950] T c1777a713b1d4a58919b5f6abe779ab8 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:54.808974 9946 raft_consensus.cc:2468] T 5d3598b5743244e39efd12703ec15aea P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:54.809300 10366 ts_tablet_manager.cc:1434] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.024s user 0.000s sys 0.002s
I20260810 19:47:54.809882 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ad2d66c3b58b43b98ceb756a5a078f78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:54.809949 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 269) took 2708 ms. Trace:
I20260810 19:47:54.810400 10375 rpcz_store.cc:276] 0810 19:47:52.102017 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.102086 (+ 69us) service_pool.cc:224] Handling call
0810 19:47:54.610559 (+2508473us) ts_tablet_manager.cc:1151] Deleting tablet c1777a713b1d4a58919b5f6abe779ab8
0810 19:47:54.610570 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.677581 (+ 67011us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.801405 (+123824us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.809910 (+ 8505us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2507091}
W20260810 19:47:54.810633 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad2d66c3b58b43b98ceb756a5a078f78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:54.810902 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet c1777a713b1d4a58919b5f6abe779ab8 (table default.Table_2819131cbbda496d8acccf4b8e83c322 [id=59935ce778c84929aa6ae71a1e33c63f]) successfully deleted
I20260810 19:47:54.811414 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 270) took 2693 ms. Trace:
I20260810 19:47:54.811561 10375 rpcz_store.cc:276] 0810 19:47:52.117498 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.117562 (+ 64us) service_pool.cc:224] Handling call
0810 19:47:54.811219 (+2693657us) ts_tablet_manager.cc:1151] Deleting tablet f3600d0528164850973cb296aaf6910f
0810 19:47:54.811229 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.811369 (+ 140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2692068}
W20260810 19:47:54.812687 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet f3600d0528164850973cb296aaf6910f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3600d0528164850973cb296aaf6910f already in progress: creating tablet
I20260810 19:47:54.813140 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 271) took 2683 ms. Trace:
I20260810 19:47:54.813381 10375 rpcz_store.cc:276] 0810 19:47:52.130114 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.130179 (+ 65us) service_pool.cc:224] Handling call
0810 19:47:54.812973 (+2682794us) ts_tablet_manager.cc:1151] Deleting tablet ffc4466b82bd49fcaad30e4d5325c7db
0810 19:47:54.812984 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.813096 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2682505}
I20260810 19:47:54.813854 9611 leader_election.cc:304] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:54.814162 11295 raft_consensus.cc:2804] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260810 19:47:54.814249 9611 leader_election.cc:343] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:54.814293 11295 raft_consensus.cc:493] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:54.814402 11295 raft_consensus.cc:3060] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:54.809127 10371 log.cc:1199] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/46005eead530459eb2b636ae0a6767ad
I20260810 19:47:54.816110 10371 ts_tablet_manager.cc:1950] T 46005eead530459eb2b636ae0a6767ad P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:54.818713 11295 raft_consensus.cc:515] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.819483 11295 leader_election.cc:290] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:54.824698 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 8fce298689e9415a8860b8734d73b10a
I20260810 19:47:54.826489 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fce298689e9415a8860b8734d73b10a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:54.828428 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_4e0b9ea93b4e4164a3580c481782f8f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:54.829123 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e0b9ea93b4e4164a3580c481782f8f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:54.830363 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 46005eead530459eb2b636ae0a6767ad (table default.Table_2a994cac12d24a589728d6edb766c2af [id=098d4c95bab142c2b56fecac4113a429]) successfully deleted
I20260810 19:47:54.831066 10371 tablet_replica.cc:333] T 34fdc03b114b405da9e3a17ef1ad87c4 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:54.825832 10120 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fce298689e9415a8860b8734d73b10a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:54.828495 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 34fdc03b114b405da9e3a17ef1ad87c4 with delete_type TABLET_DATA_DELETED (replaced by tablet 9e8a23221e8447bd83592c05c9d1149c) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:54.832770 10371 raft_consensus.cc:2243] T 34fdc03b114b405da9e3a17ef1ad87c4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 19:47:54.833284 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet ffc4466b82bd49fcaad30e4d5325c7db because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ffc4466b82bd49fcaad30e4d5325c7db already in progress: creating tablet
I20260810 19:47:54.833316 11328 tablet.cc:1724] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:47:54.834422 10371 raft_consensus.cc:2272] T 34fdc03b114b405da9e3a17ef1ad87c4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:54.834923 10375 tablet_replica.cc:333] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:54.835120 10371 ts_tablet_manager.cc:1916] T 34fdc03b114b405da9e3a17ef1ad87c4 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:54.836357 10375 raft_consensus.cc:2243] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:54.838300 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 827dce05c192467589e2692fabd2a84e
I20260810 19:47:54.838869 9407 catalog_manager.cc:6807] ReplaceTablet: tablet 827dce05c192467589e2692fabd2a84e deleted and replaced by tablet 5a35be79a8924213ab860a9da04a598c
I20260810 19:47:54.832062 11326 tablet.cc:1724] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:47:54.841356 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_d9ae7658a1f24bd8aa85ffbc2ac9ee0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:54.841982 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9ae7658a1f24bd8aa85ffbc2ac9ee0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:54.847445 10366 tablet_bootstrap.cc:492] T 5f560ed7ea0c4075bad1375d86738861 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:54.850869 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_15c8defb54eb499da22f7c2fa62e6613"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:54.851497 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15c8defb54eb499da22f7c2fa62e6613 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:54.851475 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 827dce05c192467589e2692fabd2a84e with delete_type TABLET_DATA_DELETED (replaced by tablet 5a35be79a8924213ab860a9da04a598c) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:54.849602 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fce298689e9415a8860b8734d73b10a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:54.858433 9899 tablet_service.cc:1558] Processing DeleteTablet for tablet 827dce05c192467589e2692fabd2a84e with delete_type TABLET_DATA_DELETED (replaced by tablet 5a35be79a8924213ab860a9da04a598c) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:54.849987 9946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3598b5743244e39efd12703ec15aea" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:54.859225 10366 tablet_bootstrap.cc:654] T 5f560ed7ea0c4075bad1375d86738861 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:54.869473 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 253f302c00cc42ff84076b0c17f7670a has no consensus state
I20260810 19:47:54.869823 9421 master_service.cc:960] ReplaceTablet: received request to replace tablet 8fadd6f84c75466287b318ed7018b071 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:54.839092 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3598b5743244e39efd12703ec15aea" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:54.839926 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 827dce05c192467589e2692fabd2a84e with delete_type TABLET_DATA_DELETED (replaced by tablet 5a35be79a8924213ab860a9da04a598c) from {username='slave'} at 127.0.0.1:41610
W20260810 19:47:54.840596 10067 consensus_peers.cc:597] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58b33df59ffe49a9b07606b6dc9279eb. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:54.850857 10166 raft_consensus.cc:3060] T 34fdc03b114b405da9e3a17ef1ad87c4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:54.872891 10375 raft_consensus.cc:2272] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:54.873612 10375 ts_tablet_manager.cc:1916] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:54.875003 10377 ts_tablet_manager.cc:1929] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:54.875165 10377 log.cc:1199] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/38ee7973736c4a0a921261d37b74f290
I20260810 19:47:54.875946 10377 ts_tablet_manager.cc:1950] T 38ee7973736c4a0a921261d37b74f290 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:54.876395 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 317) took 1907 ms. Trace:
I20260810 19:47:54.861871 10911 raft_consensus.cc:493] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:54.876603 10377 rpcz_store.cc:276] 0810 19:47:52.968919 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.968978 (+ 59us) service_pool.cc:224] Handling call
0810 19:47:54.550464 (+1581486us) ts_tablet_manager.cc:1151] Deleting tablet 38ee7973736c4a0a921261d37b74f290
0810 19:47:54.550474 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.759749 (+209275us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.874887 (+115138us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.876352 (+ 1465us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1581159}
I20260810 19:47:54.876654 10911 raft_consensus.cc:515] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.877136 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 318) took 1897 ms. Trace:
I20260810 19:47:54.877247 10377 rpcz_store.cc:276] 0810 19:47:52.979538 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.979858 (+ 320us) service_pool.cc:224] Handling call
0810 19:47:54.876974 (+1897116us) ts_tablet_manager.cc:1151] Deleting tablet ebf33d82af9e494a8e85be8cba55d2c9
0810 19:47:54.876986 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.877099 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1896856}
I20260810 19:47:54.877377 10911 leader_election.cc:290] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:54.877596 10377 tablet_replica.cc:333] T 74dddd12f2314d6ab5a6717025b13a51 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:54.878225 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b995f3c3bca4501a6c62cf9025051b2" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:54.878510 9944 raft_consensus.cc:2393] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eadde59fd6504d679e47f03a60c64bb0 in current term 1: Already voted for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in this term.
W20260810 19:47:54.878275 9611 leader_election.cc:343] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:54.879108 9946 raft_consensus.cc:3060] T 5d3598b5743244e39efd12703ec15aea P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:54.879925 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b995f3c3bca4501a6c62cf9025051b2" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:54.880841 10068 leader_election.cc:304] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:54.881536 10911 raft_consensus.cc:3060] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:47:54.884364 10068 consensus_peers.cc:597] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e9603994555425289db23bd5c38cc99. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:54.884776 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2d55b7a83d4d4faeb63acf0fd1c205b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:54.885001 9946 raft_consensus.cc:2468] T 5d3598b5743244e39efd12703ec15aea P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:54.885165 10911 raft_consensus.cc:2749] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:54.886368 9611 leader_election.cc:304] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:54.887017 11295 raft_consensus.cc:2804] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:54.887189 11295 raft_consensus.cc:697] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:54.887537 11295 consensus_queue.cc:237] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:54.888969 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d55b7a83d4d4faeb63acf0fd1c205b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:54.892571 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 38ee7973736c4a0a921261d37b74f290 (table default.Table_12b12f4993a449a48336de17e0c39fc1 [id=f6c45c0da9e6448dbb64115902fef084]) successfully deleted
W20260810 19:47:54.892874 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet ebf33d82af9e494a8e85be8cba55d2c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebf33d82af9e494a8e85be8cba55d2c9 already in progress: creating tablet
I20260810 19:47:54.893360 11067 consensus_queue.cc:1048] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:54.894608 10377 raft_consensus.cc:2243] T 74dddd12f2314d6ab5a6717025b13a51 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 19:47:54.896067 10067 consensus_peers.cc:597] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:54.896976 10377 pending_rounds.cc:70] T 74dddd12f2314d6ab5a6717025b13a51 P 6986ed920dcb4af29a5eeeda6f671691: Trying to abort 1 pending ops.
I20260810 19:47:54.897217 10377 pending_rounds.cc:77] T 74dddd12f2314d6ab5a6717025b13a51 P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058655994920960 op_type: NO_OP noop_request { }
I20260810 19:47:54.897519 10377 raft_consensus.cc:2889] T 74dddd12f2314d6ab5a6717025b13a51 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:54.897722 10377 raft_consensus.cc:2272] T 74dddd12f2314d6ab5a6717025b13a51 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:54.898749 10377 ts_tablet_manager.cc:1916] T 74dddd12f2314d6ab5a6717025b13a51 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:47:54.904701 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 971e9abee86444a7a9e923b0962ae751 consensus state has no leader
I20260810 19:47:54.907591 10367 tablet_bootstrap.cc:492] T 10617bdf2eed4dbd8d13ea1821443863 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:54.907876 10367 ts_tablet_manager.cc:1403] T 10617bdf2eed4dbd8d13ea1821443863 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.122s user 0.007s sys 0.002s
I20260810 19:47:54.908138 10366 tablet_bootstrap.cc:492] T 5f560ed7ea0c4075bad1375d86738861 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:54.908337 10366 ts_tablet_manager.cc:1403] T 5f560ed7ea0c4075bad1375d86738861 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.099s user 0.003s sys 0.007s
I20260810 19:47:54.909169 10366 raft_consensus.cc:359] T 5f560ed7ea0c4075bad1375d86738861 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.911952 10366 raft_consensus.cc:385] T 5f560ed7ea0c4075bad1375d86738861 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:54.912052 10366 raft_consensus.cc:740] T 5f560ed7ea0c4075bad1375d86738861 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:54.912398 10366 consensus_queue.cc:260] T 5f560ed7ea0c4075bad1375d86738861 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.912961 10366 ts_tablet_manager.cc:1434] T 5f560ed7ea0c4075bad1375d86738861 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 19:47:54.913488 10366 tablet_bootstrap.cc:492] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:54.914237 11330 tablet.cc:1724] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:47:54.914381 10367 raft_consensus.cc:359] T 10617bdf2eed4dbd8d13ea1821443863 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.914620 10367 raft_consensus.cc:385] T 10617bdf2eed4dbd8d13ea1821443863 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:54.914713 10367 raft_consensus.cc:740] T 10617bdf2eed4dbd8d13ea1821443863 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
W20260810 19:47:54.918188 9831 consensus_peers.cc:597] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:54.921703 10375 ts_tablet_manager.cc:1929] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:54.921904 10375 log.cc:1199] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/a78f955a3ca946189de7ea96baee35f6
I20260810 19:47:54.923134 10367 consensus_queue.cc:260] T 10617bdf2eed4dbd8d13ea1821443863 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.923521 11295 raft_consensus.cc:493] T 10617bdf2eed4dbd8d13ea1821443863 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:54.923578 10375 ts_tablet_manager.cc:1950] T a78f955a3ca946189de7ea96baee35f6 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:54.923707 11295 raft_consensus.cc:515] T 10617bdf2eed4dbd8d13ea1821443863 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:54.924510 10366 tablet_bootstrap.cc:654] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:54.924563 11295 leader_election.cc:290] T 10617bdf2eed4dbd8d13ea1821443863 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:54.924790 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 276) took 2713 ms. Trace:
I20260810 19:47:54.925510 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10617bdf2eed4dbd8d13ea1821443863" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:54.925617 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10617bdf2eed4dbd8d13ea1821443863" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:54.926332 9611 leader_election.cc:343] T 10617bdf2eed4dbd8d13ea1821443863 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:54.926674 9611 leader_election.cc:343] T 10617bdf2eed4dbd8d13ea1821443863 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:54.927536 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_26a587e2e39a43e9bda9bf51491d2b81" } new_table_name: "default.Table_a3cddbf5a63a44a7ba3c412022b3a088" modify_external_catalogs: true
I20260810 19:47:54.934414 9611 leader_election.cc:304] T 10617bdf2eed4dbd8d13ea1821443863 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:54.938017 11295 raft_consensus.cc:2749] T 10617bdf2eed4dbd8d13ea1821443863 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:54.938755 11295 consensus_queue.cc:1048] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:54.924942 10375 rpcz_store.cc:276] 0810 19:47:52.210947 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.212966 (+ 2019us) service_pool.cc:224] Handling call
0810 19:47:54.834833 (+2621867us) ts_tablet_manager.cc:1151] Deleting tablet a78f955a3ca946189de7ea96baee35f6
0810 19:47:54.834846 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.877210 (+ 42364us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.921604 (+ 44394us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.924722 (+ 3118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2621592}
I20260810 19:47:54.940690 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 275) took 2730 ms. Trace:
I20260810 19:47:54.941128 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet a78f955a3ca946189de7ea96baee35f6 (table default.Table_130fb9e1e90b4c679e2c0ef4cec28827 [id=3225dd83c5dc4e6c9ad6c37794312256]) successfully deleted
I20260810 19:47:54.940868 10375 rpcz_store.cc:276] 0810 19:47:52.210651 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.229125 (+ 18474us) service_pool.cc:224] Handling call
0810 19:47:54.940493 (+2711368us) ts_tablet_manager.cc:1151] Deleting tablet 06af03c8a87141febef768bd56c72c39
0810 19:47:54.940505 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.940627 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2711055}
I20260810 19:47:54.944041 10375 tablet_replica.cc:333] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:54.944329 10375 raft_consensus.cc:2243] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:54.944615 10375 raft_consensus.cc:2272] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 19:47:54.946084 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 06af03c8a87141febef768bd56c72c39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06af03c8a87141febef768bd56c72c39 already in progress: creating tablet
I20260810 19:47:54.950881 10375 ts_tablet_manager.cc:1916] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:54.954752 10367 ts_tablet_manager.cc:1434] T 10617bdf2eed4dbd8d13ea1821443863 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.042s user 0.002s sys 0.000s
I20260810 19:47:54.959421 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_52a19c74f223463fa626772f18c826bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:54.963127 10367 tablet_bootstrap.cc:492] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:54.969599 10367 tablet_bootstrap.cc:654] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:54.970513 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52a19c74f223463fa626772f18c826bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:54.975069 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_34c6844eadfe492e86d60e0326815185"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:54.975695 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34c6844eadfe492e86d60e0326815185 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:54.977257 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c53d9c7f87054a568e99b3f08135ff87" } modify_external_catalogs: true
I20260810 19:47:54.977502 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c53d9c7f87054a568e99b3f08135ff87" } modify_external_catalogs: true
I20260810 19:47:54.987495 10377 ts_tablet_manager.cc:1929] T 74dddd12f2314d6ab5a6717025b13a51 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:54.987761 10377 log.cc:1199] T 74dddd12f2314d6ab5a6717025b13a51 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/74dddd12f2314d6ab5a6717025b13a51
I20260810 19:47:54.988281 10377 ts_tablet_manager.cc:1950] T 74dddd12f2314d6ab5a6717025b13a51 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
W20260810 19:47:54.988668 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 263a5695e7754b44a64edbda27b42135 has no consensus state
I20260810 19:47:54.989786 10370 tablet_bootstrap.cc:492] T 46005eead530459eb2b636ae0a6767ad P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:54.989845 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 319) took 1987 ms. Trace:
I20260810 19:47:54.991139 10370 ts_tablet_manager.cc:1403] T 46005eead530459eb2b636ae0a6767ad P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.224s user 0.010s sys 0.008s
I20260810 19:47:54.992523 10375 ts_tablet_manager.cc:1929] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:54.992723 10375 log.cc:1199] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/4f8bf9f998ad44df98239767d17e3486
I20260810 19:47:54.993240 10375 ts_tablet_manager.cc:1950] T 4f8bf9f998ad44df98239767d17e3486 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:54.997668 10377 rpcz_store.cc:276] 0810 19:47:53.001984 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.002044 (+ 60us) service_pool.cc:224] Handling call
0810 19:47:54.877511 (+1875467us) ts_tablet_manager.cc:1151] Deleting tablet 74dddd12f2314d6ab5a6717025b13a51
0810 19:47:54.877522 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.896836 (+ 19314us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x616000171a54. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd473022780 00007fd4743a9023 00007fd476f6ec67 00007fd476fa1d34 00007fd476f82750 00007fd476f824dd 0000000000aaf86c 00007fd466f6784f 00007fd466f6ab4b 00007fd466f6a9c8
0810 19:47:54.906159 (+ 9323us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.987349 (+ 81190us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.989806 (+ 2457us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38611840,"tablet-delete.queue_time_us":1875162}
I20260810 19:47:54.973455 10371 ts_tablet_manager.cc:1929] T 34fdc03b114b405da9e3a17ef1ad87c4 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:54.989557 11295 consensus_queue.cc:1048] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:55.003311 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 279) took 2755 ms. Trace:
I20260810 19:47:54.994403 10370 raft_consensus.cc:359] T 46005eead530459eb2b636ae0a6767ad P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.003628 10370 raft_consensus.cc:385] T 46005eead530459eb2b636ae0a6767ad P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:55.003750 10370 raft_consensus.cc:740] T 46005eead530459eb2b636ae0a6767ad P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:55.004117 10370 consensus_queue.cc:260] T 46005eead530459eb2b636ae0a6767ad P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.007721 10370 ts_tablet_manager.cc:1434] T 46005eead530459eb2b636ae0a6767ad P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260810 19:47:55.008142 10370 tablet_bootstrap.cc:492] T e4a92eb8626f465caf563b72598a685f P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:55.012677 10371 log.cc:1199] T 34fdc03b114b405da9e3a17ef1ad87c4 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/34fdc03b114b405da9e3a17ef1ad87c4
I20260810 19:47:55.013099 10370 tablet_bootstrap.cc:654] T e4a92eb8626f465caf563b72598a685f P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:55.013470 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 74dddd12f2314d6ab5a6717025b13a51 (table default.Table_b0123864189f4f8bbe188d35a6e10013 [id=9fd5b60a3ce44aaca14478da98f66bc5]) successfully deleted
I20260810 19:47:55.009245 10366 tablet_bootstrap.cc:492] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:55.013967 10366 ts_tablet_manager.cc:1403] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.101s user 0.003s sys 0.001s
I20260810 19:47:55.014984 10366 raft_consensus.cc:359] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.015268 10366 raft_consensus.cc:385] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:55.015476 10366 raft_consensus.cc:740] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:55.016054 10371 ts_tablet_manager.cc:1950] T 34fdc03b114b405da9e3a17ef1ad87c4 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:55.017077 10366 consensus_queue.cc:260] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.016535 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 320) took 1972 ms. Trace:
I20260810 19:47:55.017894 10377 rpcz_store.cc:276] 0810 19:47:53.044059 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.044115 (+ 56us) service_pool.cc:224] Handling call
0810 19:47:55.016349 (+1972234us) ts_tablet_manager.cc:1151] Deleting tablet 72b39babf851404c89adb317033015ec
0810 19:47:55.016364 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.016498 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1971981}
I20260810 19:47:55.018477 10375 rpcz_store.cc:276] 0810 19:47:52.247445 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.247564 (+ 119us) service_pool.cc:224] Handling call
0810 19:47:54.943941 (+2696377us) ts_tablet_manager.cc:1151] Deleting tablet 4f8bf9f998ad44df98239767d17e3486
0810 19:47:54.943952 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.966748 (+ 22796us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.992425 (+ 25677us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.003249 (+ 10824us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2695062}
I20260810 19:47:55.019076 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 4f8bf9f998ad44df98239767d17e3486 (table default.Table_3716ce5bda064fe3bc3d27c7b0e61fd7 [id=dbb22676ab2e4df580db999a0116fdee]) successfully deleted
I20260810 19:47:55.019134 10375 tablet_replica.cc:333] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:55.019418 10375 raft_consensus.cc:2243] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:55.020857 10375 raft_consensus.cc:2272] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 19:47:55.027225 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 72b39babf851404c89adb317033015ec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72b39babf851404c89adb317033015ec already in progress: creating tablet
I20260810 19:47:55.027819 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 321) took 1973 ms. Trace:
I20260810 19:47:55.028630 10377 rpcz_store.cc:276] 0810 19:47:53.053957 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.054018 (+ 61us) service_pool.cc:224] Handling call
0810 19:47:55.027642 (+1973624us) ts_tablet_manager.cc:1151] Deleting tablet 9fb544dff4eb4642b7e282657ae15d19
0810 19:47:55.027652 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.027772 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1973386}
I20260810 19:47:55.025184 10366 ts_tablet_manager.cc:1434] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
W20260810 19:47:55.029440 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 9fb544dff4eb4642b7e282657ae15d19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9fb544dff4eb4642b7e282657ae15d19 already in progress: creating tablet
I20260810 19:47:55.031124 10366 tablet_bootstrap.cc:492] T 3badc88d94a34ff7a053ed312f0dd646 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:55.031242 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2127777800d84906905aac5e1b9eaf64"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:55.031471 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 346) took 1190 ms. Trace:
I20260810 19:47:55.031740 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 322) took 1764 ms. Trace:
I20260810 19:47:55.031850 10377 rpcz_store.cc:276] 0810 19:47:53.267293 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.267769 (+ 476us) service_pool.cc:224] Handling call
0810 19:47:55.029104 (+1761335us) ts_tablet_manager.cc:1151] Deleting tablet 6992e7ef8e794ddc879ae04f9f78b8bd
0810 19:47:55.029114 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.031699 (+ 2585us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1761049}
W20260810 19:47:55.031941 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2127777800d84906905aac5e1b9eaf64 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:55.032377 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 6992e7ef8e794ddc879ae04f9f78b8bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6992e7ef8e794ddc879ae04f9f78b8bd already in progress: creating tablet
I20260810 19:47:55.033228 10371 rpcz_store.cc:276] 0810 19:47:53.840694 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.840950 (+ 256us) service_pool.cc:224] Handling call
0810 19:47:54.830959 (+990009us) ts_tablet_manager.cc:1151] Deleting tablet 34fdc03b114b405da9e3a17ef1ad87c4
0810 19:47:54.830974 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:54.863022 (+ 32048us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:54.973333 (+110311us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.031416 (+ 58083us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":982248}
I20260810 19:47:55.034051 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_18277a006ecd4ec08e1ac6a597417bd1" } new_table_name: "default.Table_df0d4b51d323454e8afa1c87c993a1ed" modify_external_catalogs: true
I20260810 19:47:55.035262 10366 tablet_bootstrap.cc:654] T 3badc88d94a34ff7a053ed312f0dd646 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:55.035413 10370 tablet_bootstrap.cc:492] T e4a92eb8626f465caf563b72598a685f P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:55.035580 10370 ts_tablet_manager.cc:1403] T e4a92eb8626f465caf563b72598a685f P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.000s
I20260810 19:47:55.036031 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9725c5009e6f440fa3af441d38e40217" } new_table_name: "default.Table_1eab0f9ec4eb4314a4fb38f1b443d465" modify_external_catalogs: true
I20260810 19:47:55.036448 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 336) took 1209 ms. Trace:
I20260810 19:47:55.036532 10370 raft_consensus.cc:359] T e4a92eb8626f465caf563b72598a685f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.036561 10377 rpcz_store.cc:276] 0810 19:47:53.827087 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.829543 (+ 2456us) service_pool.cc:224] Handling call
0810 19:47:55.036278 (+1206735us) ts_tablet_manager.cc:1151] Deleting tablet 8fadd6f84c75466287b318ed7018b071
0810 19:47:55.036297 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.036412 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1205203}
I20260810 19:47:55.036731 10370 raft_consensus.cc:385] T e4a92eb8626f465caf563b72598a685f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:55.036837 10370 raft_consensus.cc:740] T e4a92eb8626f465caf563b72598a685f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
W20260810 19:47:55.037127 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 8fadd6f84c75466287b318ed7018b071 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fadd6f84c75466287b318ed7018b071 already in progress: creating tablet
I20260810 19:47:55.037107 10370 consensus_queue.cc:260] T e4a92eb8626f465caf563b72598a685f P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.037523 10371 tablet_replica.cc:333] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:55.037537 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 34fdc03b114b405da9e3a17ef1ad87c4 (table default.Table_943801654ea043f1b8740ea0215abc35 [id=5cf32f9df60d4b04a704522da9f7973d]) successfully deleted
I20260810 19:47:55.037768 10371 raft_consensus.cc:2243] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:55.038064 10371 pending_rounds.cc:70] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4: Trying to abort 1 pending ops.
I20260810 19:47:55.038143 10371 pending_rounds.cc:77] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058660681879552 op_type: NO_OP noop_request { }
I20260810 19:47:55.038255 10371 raft_consensus.cc:2889] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:55.038411 10371 raft_consensus.cc:2272] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:55.038786 10377 tablet_replica.cc:333] T 9e9603994555425289db23bd5c38cc99 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:55.039039 10377 raft_consensus.cc:2243] T 9e9603994555425289db23bd5c38cc99 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:55.039223 10377 raft_consensus.cc:2272] T 9e9603994555425289db23bd5c38cc99 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:55.039753 10377 ts_tablet_manager.cc:1916] T 9e9603994555425289db23bd5c38cc99 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:55.044001 10367 tablet_bootstrap.cc:492] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:55.044191 10367 ts_tablet_manager.cc:1403] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.081s user 0.002s sys 0.001s
I20260810 19:47:55.045202 10367 raft_consensus.cc:359] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.052007 9407 master_service.cc:960] ReplaceTablet: received request to replace tablet dcb3660108094399b36d19ea8e6b8308 from {username='slave'} at 127.0.0.1:56048
W20260810 19:47:55.056047 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d72c72f90964f34bbc2232118dc5172 has no consensus state
I20260810 19:47:55.056412 9412 master_service.cc:960] ReplaceTablet: received request to replace tablet e247ae3828e84092b836f3dd07b44bc6 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:55.056865 10367 raft_consensus.cc:385] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:55.057016 10367 raft_consensus.cc:740] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:55.057003 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4b39478b329141c790e4b1160cd6ffc2" } modify_external_catalogs: true
I20260810 19:47:55.057205 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4b39478b329141c790e4b1160cd6ffc2" } modify_external_catalogs: true
I20260810 19:47:55.057371 10367 consensus_queue.cc:260] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.058197 10367 ts_tablet_manager.cc:1434] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260810 19:47:55.039705 10375 ts_tablet_manager.cc:1916] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:47:55.062945 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3b6187dbe1ca42f79bf3eddd5475b929 consensus state has no leader
I20260810 19:47:55.063455 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_32e6a45ca640436c8efef8fa31883db9" } modify_external_catalogs: true
I20260810 19:47:55.063638 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_32e6a45ca640436c8efef8fa31883db9" } modify_external_catalogs: true
I20260810 19:47:55.065296 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_15c8defb54eb499da22f7c2fa62e6613" } modify_external_catalogs: true
I20260810 19:47:55.065507 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_15c8defb54eb499da22f7c2fa62e6613" } modify_external_catalogs: true
I20260810 19:47:55.066709 10366 tablet_bootstrap.cc:492] T 3badc88d94a34ff7a053ed312f0dd646 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:55.066923 10366 ts_tablet_manager.cc:1403] T 3badc88d94a34ff7a053ed312f0dd646 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.002s
I20260810 19:47:55.067744 10366 raft_consensus.cc:359] T 3badc88d94a34ff7a053ed312f0dd646 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.067979 10366 raft_consensus.cc:385] T 3badc88d94a34ff7a053ed312f0dd646 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:55.068061 10366 raft_consensus.cc:740] T 3badc88d94a34ff7a053ed312f0dd646 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:55.068382 10366 consensus_queue.cc:260] T 3badc88d94a34ff7a053ed312f0dd646 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.068972 10366 ts_tablet_manager.cc:1434] T 3badc88d94a34ff7a053ed312f0dd646 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:47:55.069271 10371 ts_tablet_manager.cc:1916] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:55.069424 10366 tablet_bootstrap.cc:492] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:55.072043 10366 tablet_bootstrap.cc:654] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:55.074617 10377 ts_tablet_manager.cc:1929] T 9e9603994555425289db23bd5c38cc99 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:55.075506 10377 log.cc:1199] T 9e9603994555425289db23bd5c38cc99 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/9e9603994555425289db23bd5c38cc99
I20260810 19:47:55.075941 10377 ts_tablet_manager.cc:1950] T 9e9603994555425289db23bd5c38cc99 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:55.076910 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 339) took 1249 ms. Trace:
I20260810 19:47:55.077025 10377 rpcz_store.cc:276] 0810 19:47:53.827354 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.829707 (+ 2353us) service_pool.cc:224] Handling call
0810 19:47:55.038715 (+1209008us) ts_tablet_manager.cc:1151] Deleting tablet 9e9603994555425289db23bd5c38cc99
0810 19:47:55.038727 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.050567 (+ 11840us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.074520 (+ 23953us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.076850 (+ 2330us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1206472}
I20260810 19:47:55.078450 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 338) took 1251 ms. Trace:
I20260810 19:47:55.078558 10377 rpcz_store.cc:276] 0810 19:47:53.827264 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.829687 (+ 2423us) service_pool.cc:224] Handling call
0810 19:47:55.078217 (+1248530us) ts_tablet_manager.cc:1151] Deleting tablet 64470598ccec45a7ae3e3c77fe4b9518
0810 19:47:55.078229 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.078401 (+ 172us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1245694}
W20260810 19:47:55.079084 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 64470598ccec45a7ae3e3c77fe4b9518 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64470598ccec45a7ae3e3c77fe4b9518 already in progress: creating tablet
I20260810 19:47:55.079496 10377 tablet_replica.cc:333] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:55.079717 10377 raft_consensus.cc:2243] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:55.079916 10377 raft_consensus.cc:2272] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:55.080567 10377 ts_tablet_manager.cc:1916] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:55.084444 10367 tablet_bootstrap.cc:492] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:55.090909 10366 tablet_bootstrap.cc:492] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:55.091130 10366 ts_tablet_manager.cc:1403] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.001s
I20260810 19:47:55.098851 10366 raft_consensus.cc:359] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.099088 10366 raft_consensus.cc:385] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:55.099184 10366 raft_consensus.cc:740] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:55.099450 10366 consensus_queue.cc:260] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.100039 10366 ts_tablet_manager.cc:1434] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20260810 19:47:55.094070 10367 tablet_bootstrap.cc:654] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:55.101473 9413 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 86cfb71abc0e4162944d7ed0b5be1abf
I20260810 19:47:55.101868 10366 tablet_bootstrap.cc:492] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:55.102002 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_cadbbfe4f5d04095b599c4f15a26eae5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:55.102494 10370 ts_tablet_manager.cc:1434] T e4a92eb8626f465caf563b72598a685f P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.067s user 0.002s sys 0.001s
W20260810 19:47:55.102643 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cadbbfe4f5d04095b599c4f15a26eae5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:55.113078 10370 tablet_bootstrap.cc:492] T 5d3598b5743244e39efd12703ec15aea P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:47:55.114622 9395 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 971e9abee86444a7a9e923b0962ae751 (table default.Table_64e5558a29af405b85912f54bebdf3be [id=f3f4d6ebcacf43489369bd8f742a0631], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 971e9abee86444a7a9e923b0962ae751 consensus state has no leader
I20260810 19:47:55.115728 10366 tablet_bootstrap.cc:654] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:55.117023 11295 raft_consensus.cc:493] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:55.117213 11295 raft_consensus.cc:515] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.117906 11295 leader_election.cc:290] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:55.118880 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f560ed7ea0c4075bad1375d86738861" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:55.119171 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f560ed7ea0c4075bad1375d86738861" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:55.119408 9948 raft_consensus.cc:2468] T 5f560ed7ea0c4075bad1375d86738861 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
W20260810 19:47:55.120299 9611 leader_election.cc:343] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:55.120810 9611 leader_election.cc:304] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:55.121338 11295 raft_consensus.cc:2804] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:55.121433 11295 raft_consensus.cc:493] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:55.121522 11295 raft_consensus.cc:3060] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:55.123255 10377 ts_tablet_manager.cc:1929] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:55.123391 10377 log.cc:1199] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/f2931130e9354f16a238712234c19217
I20260810 19:47:55.123819 10377 ts_tablet_manager.cc:1950] T f2931130e9354f16a238712234c19217 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:55.124483 11295 raft_consensus.cc:515] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.124784 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 337) took 1297 ms. Trace:
I20260810 19:47:55.124902 10377 rpcz_store.cc:276] 0810 19:47:53.827190 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.829662 (+ 2472us) service_pool.cc:224] Handling call
0810 19:47:55.079409 (+1249747us) ts_tablet_manager.cc:1151] Deleting tablet f2931130e9354f16a238712234c19217
0810 19:47:55.079419 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.105478 (+ 26059us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.123147 (+ 17669us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.124720 (+ 1573us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1246738}
I20260810 19:47:55.125159 10367 tablet_bootstrap.cc:492] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:55.125475 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet f2931130e9354f16a238712234c19217 (table default.Table_f1f332ce5d104c2b889c1faf78a0510f [id=a5becac787b84d398e96784d005d21f6]) successfully deleted
I20260810 19:47:55.125741 10367 ts_tablet_manager.cc:1403] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.041s user 0.006s sys 0.000s
I20260810 19:47:55.125974 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f560ed7ea0c4075bad1375d86738861" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:55.126164 9948 raft_consensus.cc:3060] T 5f560ed7ea0c4075bad1375d86738861 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:55.126701 10367 raft_consensus.cc:359] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.126930 10367 raft_consensus.cc:385] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:55.127017 10367 raft_consensus.cc:740] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:55.127338 10367 consensus_queue.cc:260] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.127532 10371 ts_tablet_manager.cc:1929] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:55.127653 10371 log.cc:1199] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/860dbb6d0a004c43bdce09075272fa70
I20260810 19:47:55.127916 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 331) took 1301 ms. Trace:
I20260810 19:47:55.128088 10371 ts_tablet_manager.cc:1950] T 860dbb6d0a004c43bdce09075272fa70 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:55.128039 10377 rpcz_store.cc:276] 0810 19:47:53.826553 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.838588 (+ 12035us) service_pool.cc:224] Handling call
0810 19:47:55.127737 (+1289149us) ts_tablet_manager.cc:1151] Deleting tablet 60bd14fb8c2e40dc955352518d463ccb
0810 19:47:55.127749 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.127870 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1288860}
W20260810 19:47:55.128571 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 60bd14fb8c2e40dc955352518d463ccb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60bd14fb8c2e40dc955352518d463ccb already in progress: creating tablet
I20260810 19:47:55.129627 10367 ts_tablet_manager.cc:1434] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 19:47:55.129714 10377 tablet_replica.cc:333] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:55.129854 9948 raft_consensus.cc:2468] T 5f560ed7ea0c4075bad1375d86738861 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:55.129959 10377 raft_consensus.cc:2243] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:55.130378 10377 raft_consensus.cc:2272] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:55.130529 9611 leader_election.cc:304] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:55.130861 10936 raft_consensus.cc:2804] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:55.130998 10936 raft_consensus.cc:697] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:55.131291 10936 consensus_queue.cc:237] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.132596 10377 ts_tablet_manager.cc:1916] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:55.134846 10366 tablet_bootstrap.cc:492] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:55.135020 10366 ts_tablet_manager.cc:1403] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.003s
I20260810 19:47:55.135196 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f560ed7ea0c4075bad1375d86738861" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
W20260810 19:47:55.135874 9611 leader_election.cc:343] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:55.135896 10366 raft_consensus.cc:359] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.136080 10366 raft_consensus.cc:385] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:55.136144 10366 raft_consensus.cc:740] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:55.136338 11295 leader_election.cc:290] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:55.136471 10366 consensus_queue.cc:260] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.136996 10366 ts_tablet_manager.cc:1434] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 19:47:55.138953 10366 tablet_bootstrap.cc:492] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:55.139254 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 348) took 1297 ms. Trace:
I20260810 19:47:55.139413 10371 rpcz_store.cc:276] 0810 19:47:53.842171 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.842330 (+ 159us) service_pool.cc:224] Handling call
0810 19:47:55.037434 (+1195104us) ts_tablet_manager.cc:1151] Deleting tablet 860dbb6d0a004c43bdce09075272fa70
0810 19:47:55.037449 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.082959 (+ 45510us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.127426 (+ 44467us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.139199 (+ 11773us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792,"tablet-delete.queue_time_us":1187058}
I20260810 19:47:55.139812 10371 tablet_replica.cc:333] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:55.140033 10371 raft_consensus.cc:2243] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:55.140218 10371 raft_consensus.cc:2272] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:55.140360 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 860dbb6d0a004c43bdce09075272fa70 (table default.Table_c86a4dc697bd4628bba90b74b908b5f9 [id=097f014eed014a6782f331bf23f6b2f2]) successfully deleted
I20260810 19:47:55.140864 10371 ts_tablet_manager.cc:1916] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:55.140866 11080 raft_consensus.cc:493] T 46005eead530459eb2b636ae0a6767ad P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:55.141074 10366 tablet_bootstrap.cc:654] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:55.141053 11080 raft_consensus.cc:515] T 46005eead530459eb2b636ae0a6767ad P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.141793 11080 leader_election.cc:290] T 46005eead530459eb2b636ae0a6767ad P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:47:55.143814 10068 leader_election.cc:343] T 46005eead530459eb2b636ae0a6767ad P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 46005eead530459eb2b636ae0a6767ad
I20260810 19:47:55.145236 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46005eead530459eb2b636ae0a6767ad" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:55.145946 10067 leader_election.cc:304] T 46005eead530459eb2b636ae0a6767ad P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:55.146482 11080 raft_consensus.cc:2749] T 46005eead530459eb2b636ae0a6767ad P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:55.148418 10371 ts_tablet_manager.cc:1929] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:55.148597 10371 log.cc:1199] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/25e15a8d1e7d41e68eef25d30d668e61
I20260810 19:47:55.149003 10371 ts_tablet_manager.cc:1950] T 25e15a8d1e7d41e68eef25d30d668e61 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:55.149995 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 347) took 1307 ms. Trace:
I20260810 19:47:55.150122 10371 rpcz_store.cc:276] 0810 19:47:53.842032 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.842270 (+ 238us) service_pool.cc:224] Handling call
0810 19:47:55.139726 (+1297456us) ts_tablet_manager.cc:1151] Deleting tablet 25e15a8d1e7d41e68eef25d30d668e61
0810 19:47:55.139737 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.144330 (+ 4593us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.148319 (+ 3989us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.149915 (+ 1596us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1288185}
I20260810 19:47:55.150730 10377 ts_tablet_manager.cc:1929] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:55.150725 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 25e15a8d1e7d41e68eef25d30d668e61 (table default.Table_6a56935e5e6145379899af090dfe23d4 [id=8c8a7865a0374b29a853783941137afb]) successfully deleted
I20260810 19:47:55.150882 10377 log.cc:1199] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/4f8bf9f998ad44df98239767d17e3486
I20260810 19:47:55.151351 10377 ts_tablet_manager.cc:1950] T 4f8bf9f998ad44df98239767d17e3486 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:55.153817 10367 tablet_bootstrap.cc:492] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:55.155445 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 330) took 1329 ms. Trace:
I20260810 19:47:55.155561 10377 rpcz_store.cc:276] 0810 19:47:53.826435 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.841000 (+ 14565us) service_pool.cc:224] Handling call
0810 19:47:55.129635 (+1288635us) ts_tablet_manager.cc:1151] Deleting tablet 4f8bf9f998ad44df98239767d17e3486
0810 19:47:55.129647 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.145604 (+ 15957us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.150644 (+ 5040us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.155383 (+ 4739us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1288414}
I20260810 19:47:55.155751 10367 tablet_bootstrap.cc:654] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:55.156126 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 4f8bf9f998ad44df98239767d17e3486 (table default.Table_3716ce5bda064fe3bc3d27c7b0e61fd7 [id=dbb22676ab2e4df580db999a0116fdee]) successfully deleted
I20260810 19:47:55.157050 10366 tablet_bootstrap.cc:492] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:55.157047 9408 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5 (table default.Table_b46992ec81974f6caad1ea769640dcf1 [id=d6d2d95e5e9f4e10a7d5a8153e66e4b6]). Expected version 2 got 0
I20260810 19:47:55.157196 10366 ts_tablet_manager.cc:1403] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.004s
I20260810 19:47:55.158027 10366 raft_consensus.cc:359] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.158226 10366 raft_consensus.cc:385] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:55.158206 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 7b995f3c3bca4501a6c62cf9025051b2
I20260810 19:47:55.158387 10366 raft_consensus.cc:740] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:55.158649 10366 consensus_queue.cc:260] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.158986 9412 master_service.cc:960] ReplaceTablet: received request to replace tablet 00fe7d9a548a487d965d92b53cdf9250 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:55.159281 10366 ts_tablet_manager.cc:1434] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:47:55.159637 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3ffc95fe00014a0b8398de5aced22f11" } new_table_name: "default.Table_33d8853eb1ce4caa81c8fe96f0ba2be0" modify_external_catalogs: true
I20260810 19:47:55.159731 10366 tablet_bootstrap.cc:492] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:55.161185 10377 tablet_replica.cc:333] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:55.161417 10377 raft_consensus.cc:2243] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:55.161664 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b995f3c3bca4501a6c62cf9025051b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:55.161810 10377 raft_consensus.cc:2272] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:55.163049 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b995f3c3bca4501a6c62cf9025051b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:55.163187 10366 tablet_bootstrap.cc:654] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:55.163371 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b995f3c3bca4501a6c62cf9025051b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:55.164793 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f0a3683ed3074e529e9eff3dc1509f6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:55.165483 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0a3683ed3074e529e9eff3dc1509f6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:55.165479 10377 ts_tablet_manager.cc:1916] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:55.166770 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 860dbb6d0a004c43bdce09075272fa70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:55.168854 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 351) took 1268 ms. Trace:
I20260810 19:47:55.168984 10371 rpcz_store.cc:276] 0810 19:47:53.900479 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.900544 (+ 65us) service_pool.cc:224] Handling call
0810 19:47:55.168633 (+1268089us) ts_tablet_manager.cc:1151] Deleting tablet dfea147ef3904ab49375def065c6f328
0810 19:47:55.168645 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.168780 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1267794}
W20260810 19:47:55.169495 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet dfea147ef3904ab49375def065c6f328 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfea147ef3904ab49375def065c6f328 already in progress: creating tablet
I20260810 19:47:55.169885 10371 tablet_replica.cc:333] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:55.170095 10371 raft_consensus.cc:2243] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:55.170423 10371 pending_rounds.cc:70] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4: Trying to abort 1 pending ops.
I20260810 19:47:55.170499 10371 pending_rounds.cc:77] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058661942611968 op_type: NO_OP noop_request { }
I20260810 19:47:55.170630 10371 raft_consensus.cc:2889] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:55.170740 10371 raft_consensus.cc:2272] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:55.172441 10371 ts_tablet_manager.cc:1916] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:55.172569 10377 ts_tablet_manager.cc:1929] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:55.172698 10377 log.cc:1199] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/34fdc03b114b405da9e3a17ef1ad87c4
I20260810 19:47:55.173105 10377 ts_tablet_manager.cc:1950] T 34fdc03b114b405da9e3a17ef1ad87c4 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:55.173946 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 342) took 1253 ms. Trace:
I20260810 19:47:55.174072 10377 rpcz_store.cc:276] 0810 19:47:53.920046 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.920117 (+ 71us) service_pool.cc:224] Handling call
0810 19:47:55.159490 (+1239373us) ts_tablet_manager.cc:1151] Deleting tablet 34fdc03b114b405da9e3a17ef1ad87c4
0810 19:47:55.161087 (+ 1597us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.169098 (+ 8011us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.172473 (+ 3375us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.173907 (+ 1434us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1239059}
I20260810 19:47:55.174669 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 34fdc03b114b405da9e3a17ef1ad87c4 (table default.Table_943801654ea043f1b8740ea0215abc35 [id=5cf32f9df60d4b04a704522da9f7973d]) successfully deleted
I20260810 19:47:55.176445 9415 catalog_manager.cc:5719] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:47:55.177033 9415 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet aa5702d7b3bd421eb7b8a4e0f181d2d4 (table default.Table_5f6b1710e7cc447dbf34e05882706750 [id=a837d5f74eac4f74b2029f46d73acc93]). Expected version 2 got 0
I20260810 19:47:55.177817 9421 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_5f6b1710e7cc447dbf34e05882706750 [id=a837d5f74eac4f74b2029f46d73acc93] alter complete (version 2)
I20260810 19:47:55.178411 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a015debe749f475f881da961dbe16fba" } new_table_name: "default.Table_a8eaabc9d0ef45729c9a7e9301083b99" modify_external_catalogs: true
I20260810 19:47:55.179141 10366 tablet_bootstrap.cc:492] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:55.179327 10366 ts_tablet_manager.cc:1403] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.000s
I20260810 19:47:55.180104 10366 raft_consensus.cc:359] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.180323 10366 raft_consensus.cc:385] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:55.180397 10366 raft_consensus.cc:740] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:55.180866 10366 consensus_queue.cc:260] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.181679 10366 ts_tablet_manager.cc:1434] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:47:55.182195 10366 tablet_bootstrap.cc:492] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:55.184149 10366 tablet_bootstrap.cc:654] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:55.185057 10377 tablet_replica.cc:333] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:55.185318 10377 raft_consensus.cc:2243] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:55.185500 10377 raft_consensus.cc:2272] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:55.185766 10371 ts_tablet_manager.cc:1929] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:55.185956 10371 log.cc:1199] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/5d3598b5743244e39efd12703ec15aea
I20260810 19:47:55.188587 10377 ts_tablet_manager.cc:1916] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:55.191256 10371 ts_tablet_manager.cc:1950] T 5d3598b5743244e39efd12703ec15aea P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:55.191741 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 356) took 1089 ms. Trace:
I20260810 19:47:55.191893 10371 rpcz_store.cc:276] 0810 19:47:54.101861 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:54.106959 (+ 5098us) service_pool.cc:224] Handling call
0810 19:47:55.169786 (+1062827us) ts_tablet_manager.cc:1151] Deleting tablet 5d3598b5743244e39efd12703ec15aea
0810 19:47:55.169797 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.178417 (+ 8620us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.185656 (+ 7239us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.191662 (+ 6006us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1062577}
I20260810 19:47:55.192480 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 5d3598b5743244e39efd12703ec15aea (table default.Table_798bf26932ec4547b2ed311ccba8467b [id=72812b2c16734101b42ea305500c759c]) successfully deleted
W20260810 19:47:55.193375 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 19e2bf7b7d254894a07c5a75bf24e742 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19e2bf7b7d254894a07c5a75bf24e742 already in progress: creating tablet
I20260810 19:47:55.193719 10371 tablet_replica.cc:333] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:55.193939 10371 raft_consensus.cc:2243] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:55.194250 10371 pending_rounds.cc:70] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4: Trying to abort 1 pending ops.
I20260810 19:47:55.194347 10371 pending_rounds.cc:77] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058660360302592 op_type: NO_OP noop_request { }
I20260810 19:47:55.194500 10371 raft_consensus.cc:2889] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:55.194628 10371 raft_consensus.cc:2272] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:55.194897 10370 tablet_bootstrap.cc:654] T 5d3598b5743244e39efd12703ec15aea P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:55.201043 10377 ts_tablet_manager.cc:1929] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:55.201226 10377 log.cc:1199] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/e4a92eb8626f465caf563b72598a685f
I20260810 19:47:55.201635 10377 ts_tablet_manager.cc:1950] T e4a92eb8626f465caf563b72598a685f P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:55.202657 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 345) took 1221 ms. Trace:
I20260810 19:47:55.202801 10377 rpcz_store.cc:276] 0810 19:47:53.981345 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.981406 (+ 61us) service_pool.cc:224] Handling call
0810 19:47:55.181899 (+1200493us) ts_tablet_manager.cc:1151] Deleting tablet e4a92eb8626f465caf563b72598a685f
0810 19:47:55.184989 (+ 3090us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.195974 (+ 10985us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.200949 (+ 4975us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.202580 (+ 1631us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1173621}
I20260810 19:47:55.203641 10371 ts_tablet_manager.cc:1916] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:55.209240 10377 tablet_replica.cc:333] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:55.209489 10377 raft_consensus.cc:2243] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:55.209779 10377 pending_rounds.cc:70] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691: Trying to abort 1 pending ops.
I20260810 19:47:55.209829 10377 pending_rounds.cc:77] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058661445783552 op_type: NO_OP noop_request { }
I20260810 19:47:55.209956 10377 raft_consensus.cc:2889] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:55.210044 10377 raft_consensus.cc:2272] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:55.212483 10377 ts_tablet_manager.cc:1916] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:55.212797 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 3680db3f1a5945a89c1198eb4849e58c (DEFAULT_TABLE table=default.Table_1fad6d00d9714e6494abb90b7d4141e9 [id=9601a761027047a2bbd739f0a1f86cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.213312 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3680db3f1a5945a89c1198eb4849e58c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.214962 10371 ts_tablet_manager.cc:1929] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:55.215128 10371 log.cc:1199] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/92e3d52bd5b741a4adcabb343b6770b8
I20260810 19:47:55.215607 10371 ts_tablet_manager.cc:1950] T 92e3d52bd5b741a4adcabb343b6770b8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:55.216952 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 92e3d52bd5b741a4adcabb343b6770b8 (table default.Table_4b3474ab5fac40a28a050d69fc60bfe5 [id=495386acd3524a388b83e38f07bf9967]) successfully deleted
I20260810 19:47:55.217412 10371 tablet_replica.cc:333] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
W20260810 19:47:55.207064 10067 consensus_peers.cc:597] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e9603994555425289db23bd5c38cc99. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:55.226393 10377 ts_tablet_manager.cc:1929] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:55.226594 10377 log.cc:1199] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/46005eead530459eb2b636ae0a6767ad
I20260810 19:47:55.229553 10377 ts_tablet_manager.cc:1950] T 46005eead530459eb2b636ae0a6767ad P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:55.230618 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 346) took 1248 ms. Trace:
I20260810 19:47:55.230749 10377 rpcz_store.cc:276] 0810 19:47:53.981925 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.981981 (+ 56us) service_pool.cc:224] Handling call
0810 19:47:55.209115 (+1227134us) ts_tablet_manager.cc:1151] Deleting tablet 46005eead530459eb2b636ae0a6767ad
0810 19:47:55.209131 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.216213 (+ 7082us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.226260 (+ 10047us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.230536 (+ 4276us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1197277}
I20260810 19:47:55.231282 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 46005eead530459eb2b636ae0a6767ad (table default.Table_2a994cac12d24a589728d6edb766c2af [id=098d4c95bab142c2b56fecac4113a429]) successfully deleted
I20260810 19:47:55.233541 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 341) took 1323 ms. Trace:
I20260810 19:47:55.233646 10377 rpcz_store.cc:276] 0810 19:47:53.910529 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.988256 (+ 77727us) service_pool.cc:224] Handling call
0810 19:47:55.233338 (+1245082us) ts_tablet_manager.cc:1151] Deleting tablet dfea147ef3904ab49375def065c6f328
0810 19:47:55.233352 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.233479 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1208606}
W20260810 19:47:55.234174 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet dfea147ef3904ab49375def065c6f328 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfea147ef3904ab49375def065c6f328 already in progress: creating tablet
I20260810 19:47:55.235507 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 353) took 1017 ms. Trace:
I20260810 19:47:55.236128 10377 rpcz_store.cc:276] 0810 19:47:54.217837 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:54.218574 (+ 737us) service_pool.cc:224] Handling call
0810 19:47:55.235303 (+1016729us) ts_tablet_manager.cc:1151] Deleting tablet 19e2bf7b7d254894a07c5a75bf24e742
0810 19:47:55.235318 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.235444 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1016374}
I20260810 19:47:55.236392 11267 raft_consensus.cc:493] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:55.236745 11267 raft_consensus.cc:515] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:55.236981 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 19e2bf7b7d254894a07c5a75bf24e742 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19e2bf7b7d254894a07c5a75bf24e742 already in progress: creating tablet
I20260810 19:47:55.237514 11267 leader_election.cc:290] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:55.237718 10377 tablet_replica.cc:333] T 92e3d52bd5b741a4adcabb343b6770b8 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:55.237926 10377 raft_consensus.cc:2243] T 92e3d52bd5b741a4adcabb343b6770b8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:55.238145 10377 raft_consensus.cc:2272] T 92e3d52bd5b741a4adcabb343b6770b8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:55.238554 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad16ea0f82942de8587dd7c98c0d2df" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:55.238761 10377 ts_tablet_manager.cc:1916] T 92e3d52bd5b741a4adcabb343b6770b8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:55.238799 9717 raft_consensus.cc:2468] T dad16ea0f82942de8587dd7c98c0d2df P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:55.239387 9831 leader_election.cc:304] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:55.239719 11267 raft_consensus.cc:2804] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:55.239816 11267 raft_consensus.cc:493] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:55.239925 11267 raft_consensus.cc:3060] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:55.241923 10371 raft_consensus.cc:2243] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:55.242480 10371 pending_rounds.cc:70] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4: Trying to abort 1 pending ops.
I20260810 19:47:55.242556 10371 pending_rounds.cc:77] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058662940577792 op_type: NO_OP noop_request { }
I20260810 19:47:55.242691 10371 raft_consensus.cc:2889] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:55.242813 10371 raft_consensus.cc:2272] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:55.246613 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 3680db3f1a5945a89c1198eb4849e58c (DEFAULT_TABLE table=default.Table_1fad6d00d9714e6494abb90b7d4141e9 [id=9601a761027047a2bbd739f0a1f86cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.246798 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 3680db3f1a5945a89c1198eb4849e58c (DEFAULT_TABLE table=default.Table_1fad6d00d9714e6494abb90b7d4141e9 [id=9601a761027047a2bbd739f0a1f86cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.247076 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3680db3f1a5945a89c1198eb4849e58c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.247239 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3680db3f1a5945a89c1198eb4849e58c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.250725 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 253f302c00cc42ff84076b0c17f7670a (DEFAULT_TABLE table=default.Table_ab79ddcb17e24ce7960c0c41dd451bc2 [id=9a73a382c71249058e61be3b0146826f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.251123 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253f302c00cc42ff84076b0c17f7670a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.251461 11267 raft_consensus.cc:515] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.246780 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 253f302c00cc42ff84076b0c17f7670a (DEFAULT_TABLE table=default.Table_ab79ddcb17e24ce7960c0c41dd451bc2 [id=9a73a382c71249058e61be3b0146826f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.252502 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253f302c00cc42ff84076b0c17f7670a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.252523 10377 ts_tablet_manager.cc:1929] T 92e3d52bd5b741a4adcabb343b6770b8 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:55.255208 10377 log.cc:1199] T 92e3d52bd5b741a4adcabb343b6770b8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/92e3d52bd5b741a4adcabb343b6770b8
I20260810 19:47:55.255578 10377 ts_tablet_manager.cc:1950] T 92e3d52bd5b741a4adcabb343b6770b8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:55.256132 10371 ts_tablet_manager.cc:1916] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:55.256742 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 92e3d52bd5b741a4adcabb343b6770b8 (table default.Table_4b3474ab5fac40a28a050d69fc60bfe5 [id=495386acd3524a388b83e38f07bf9967]) successfully deleted
W20260810 19:47:55.258929 9395 catalog_manager.cc:5017] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 58b33df59ffe49a9b07606b6dc9279eb because the tablet was not found. No further retry: Not found: Tablet not found: 58b33df59ffe49a9b07606b6dc9279eb
I20260810 19:47:55.259538 10377 tablet_replica.cc:333] T 5d3598b5743244e39efd12703ec15aea P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:55.259790 10377 raft_consensus.cc:2243] T 5d3598b5743244e39efd12703ec15aea P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:55.259976 10377 raft_consensus.cc:2272] T 5d3598b5743244e39efd12703ec15aea P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:55.261931 10377 ts_tablet_manager.cc:1916] T 5d3598b5743244e39efd12703ec15aea P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:55.261984 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad16ea0f82942de8587dd7c98c0d2df" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:55.263317 9830 leader_election.cc:343] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:55.263917 10371 ts_tablet_manager.cc:1929] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:55.264076 10371 log.cc:1199] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/5f560ed7ea0c4075bad1375d86738861
I20260810 19:47:55.264541 10371 ts_tablet_manager.cc:1950] T 5f560ed7ea0c4075bad1375d86738861 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:55.270169 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad16ea0f82942de8587dd7c98c0d2df" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
W20260810 19:47:55.271081 9830 leader_election.cc:343] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:55.271389 11267 leader_election.cc:290] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:55.271988 10370 tablet_bootstrap.cc:492] T 5d3598b5743244e39efd12703ec15aea P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:55.272178 10370 ts_tablet_manager.cc:1403] T 5d3598b5743244e39efd12703ec15aea P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.159s user 0.003s sys 0.000s
I20260810 19:47:55.273121 10370 raft_consensus.cc:359] T 5d3598b5743244e39efd12703ec15aea P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.273363 10370 raft_consensus.cc:385] T 5d3598b5743244e39efd12703ec15aea P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:55.273447 10370 raft_consensus.cc:740] T 5d3598b5743244e39efd12703ec15aea P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:55.273768 10370 consensus_queue.cc:260] T 5d3598b5743244e39efd12703ec15aea P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.274720 10370 ts_tablet_manager.cc:1434] T 5d3598b5743244e39efd12703ec15aea P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 19:47:55.275072 10370 tablet_bootstrap.cc:492] T 842a5dacf9d145889e97069d3c8084b8 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:55.277062 10370 tablet_bootstrap.cc:654] T 842a5dacf9d145889e97069d3c8084b8 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:55.283602 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 444b49a69c8245b6944a76d53041154c
I20260810 19:47:55.284965 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 444b49a69c8245b6944a76d53041154c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:55.285200 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 444b49a69c8245b6944a76d53041154c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:55.285830 9659 tablet_service.cc:1558] Processing DeleteTablet for tablet 444b49a69c8245b6944a76d53041154c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:55.297258 11267 raft_consensus.cc:493] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:55.297493 11267 raft_consensus.cc:515] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:55.298049 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a78960e1f2164c848297411b9273ac64 consensus state has no leader
I20260810 19:47:55.298408 9412 master_service.cc:960] ReplaceTablet: received request to replace tablet c8602b7360b747a3af756b139635d95c from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:55.298434 11267 leader_election.cc:290] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:55.299811 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d90d9c9f6524859a0e33e649dd80f7c" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:55.304361 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_4ec3ace539c444e08c5e84fff6a6f919"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:55.305059 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ec3ace539c444e08c5e84fff6a6f919 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:55.306411 11080 raft_consensus.cc:493] T 92e3d52bd5b741a4adcabb343b6770b8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:55.306631 11080 raft_consensus.cc:515] T 92e3d52bd5b741a4adcabb343b6770b8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.307420 11080 leader_election.cc:290] T 92e3d52bd5b741a4adcabb343b6770b8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
W20260810 19:47:55.309305 10067 leader_election.cc:343] T 92e3d52bd5b741a4adcabb343b6770b8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 92e3d52bd5b741a4adcabb343b6770b8
I20260810 19:47:55.309993 10377 ts_tablet_manager.cc:1929] T 5d3598b5743244e39efd12703ec15aea P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:55.310170 10377 log.cc:1199] T 5d3598b5743244e39efd12703ec15aea P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/5d3598b5743244e39efd12703ec15aea
I20260810 19:47:55.310632 10377 ts_tablet_manager.cc:1950] T 5d3598b5743244e39efd12703ec15aea P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:55.311870 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 5d3598b5743244e39efd12703ec15aea (table default.Table_798bf26932ec4547b2ed311ccba8467b [id=72812b2c16734101b42ea305500c759c]) successfully deleted
I20260810 19:47:55.315063 10377 tablet_replica.cc:333] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:55.315323 10377 raft_consensus.cc:2243] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:55.315635 10377 pending_rounds.cc:70] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691: Trying to abort 1 pending ops.
I20260810 19:47:55.315708 10377 pending_rounds.cc:77] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058660182532096 op_type: NO_OP noop_request { }
I20260810 19:47:55.315855 10377 raft_consensus.cc:2889] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:55.315959 10377 raft_consensus.cc:2272] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:55.317821 10367 tablet_bootstrap.cc:492] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:55.318025 10367 ts_tablet_manager.cc:1403] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.164s user 0.011s sys 0.008s
I20260810 19:47:55.318864 10377 ts_tablet_manager.cc:1916] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:55.318988 10367 raft_consensus.cc:359] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.319201 10367 raft_consensus.cc:385] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:55.319304 10367 raft_consensus.cc:740] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:55.319555 10367 consensus_queue.cc:260] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.320182 10367 ts_tablet_manager.cc:1434] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:47:55.321513 10375 ts_tablet_manager.cc:1929] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:55.321831 10375 log.cc:1199] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/58b33df59ffe49a9b07606b6dc9279eb
I20260810 19:47:55.323664 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 253f302c00cc42ff84076b0c17f7670a (DEFAULT_TABLE table=default.Table_ab79ddcb17e24ce7960c0c41dd451bc2 [id=9a73a382c71249058e61be3b0146826f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.324193 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253f302c00cc42ff84076b0c17f7670a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.324717 9659 tablet_service.cc:1511] Processing CreateTablet for tablet d7595dbb46b6441dbb811611da116791 (DEFAULT_TABLE table=default.Table_d2b8c5a92e3d43b89de4938297a90542 [id=43f4ba98204449f6a0902c584b3e7eb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.325819 9906 tablet_service.cc:1511] Processing CreateTablet for tablet d7595dbb46b6441dbb811611da116791 (DEFAULT_TABLE table=default.Table_d2b8c5a92e3d43b89de4938297a90542 [id=43f4ba98204449f6a0902c584b3e7eb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.326443 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7595dbb46b6441dbb811611da116791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.326392 10120 tablet_service.cc:1511] Processing CreateTablet for tablet d7595dbb46b6441dbb811611da116791 (DEFAULT_TABLE table=default.Table_d2b8c5a92e3d43b89de4938297a90542 [id=43f4ba98204449f6a0902c584b3e7eb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.326841 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7595dbb46b6441dbb811611da116791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.335879 10366 tablet_bootstrap.cc:492] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:55.336082 10366 ts_tablet_manager.cc:1403] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.154s user 0.018s sys 0.030s
I20260810 19:47:55.336385 11267 raft_consensus.cc:493] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:55.336572 11267 raft_consensus.cc:515] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.337335 10366 raft_consensus.cc:359] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.337522 10366 raft_consensus.cc:385] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:55.337615 10366 raft_consensus.cc:740] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:55.337873 10366 consensus_queue.cc:260] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.338052 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10617bdf2eed4dbd8d13ea1821443863" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:55.338521 10366 ts_tablet_manager.cc:1434] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:47:55.338762 10375 ts_tablet_manager.cc:1950] T 58b33df59ffe49a9b07606b6dc9279eb P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:55.339012 11267 leader_election.cc:290] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:47:55.339056 9830 leader_election.cc:343] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:55.339835 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 278) took 3092 ms. Trace:
I20260810 19:47:55.340134 10377 ts_tablet_manager.cc:1929] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:55.340045 10375 rpcz_store.cc:276] 0810 19:47:52.247246 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.249216 (+ 1970us) service_pool.cc:224] Handling call
0810 19:47:55.019052 (+2769836us) ts_tablet_manager.cc:1151] Deleting tablet 58b33df59ffe49a9b07606b6dc9279eb
0810 19:47:55.019067 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.157057 (+137990us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.321415 (+164358us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.339768 (+ 18353us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2769590}
I20260810 19:47:55.340296 10377 log.cc:1199] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/25e15a8d1e7d41e68eef25d30d668e61
I20260810 19:47:55.340677 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 58b33df59ffe49a9b07606b6dc9279eb (table default.Table_a289f25ff60e4733899134f73a70715c [id=356d1ec0f2784810895aecd1f2eed86a]) successfully deleted
I20260810 19:47:55.340816 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 283) took 2911 ms. Trace:
I20260810 19:47:55.340925 10375 rpcz_store.cc:276] 0810 19:47:52.429312 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.429390 (+ 78us) service_pool.cc:224] Handling call
0810 19:47:55.340606 (+2911216us) ts_tablet_manager.cc:1151] Deleting tablet 4dba7046bdfd41f1a2ad6f299a723776
0810 19:47:55.340617 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.340747 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2896106}
W20260810 19:47:55.341364 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 4dba7046bdfd41f1a2ad6f299a723776 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4dba7046bdfd41f1a2ad6f299a723776 already in progress: creating tablet
I20260810 19:47:55.341590 10366 tablet_bootstrap.cc:492] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:55.344034 11267 raft_consensus.cc:493] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:55.344221 11267 raft_consensus.cc:515] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.344969 11267 leader_election.cc:290] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:55.345304 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 284) took 2900 ms. Trace:
I20260810 19:47:55.345692 10375 rpcz_store.cc:276] 0810 19:47:52.445003 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.445140 (+ 137us) service_pool.cc:224] Handling call
0810 19:47:55.345089 (+2899949us) ts_tablet_manager.cc:1151] Deleting tablet 839dcdb448d14a8f8e452145ccf41263
0810 19:47:55.345102 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.345231 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2898417}
I20260810 19:47:55.346014 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8e8e1b5f3f452f8fdfe5a42fd021a5" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:55.346199 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 839dcdb448d14a8f8e452145ccf41263 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 839dcdb448d14a8f8e452145ccf41263 already in progress: creating tablet
I20260810 19:47:55.346277 10375 tablet_replica.cc:333] T 00dabf43505f4fc89be39ee8fb41c7ee P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:55.346585 10375 raft_consensus.cc:2243] T 00dabf43505f4fc89be39ee8fb41c7ee P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:55.346846 10375 raft_consensus.cc:2272] T 00dabf43505f4fc89be39ee8fb41c7ee P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:55.346858 10377 ts_tablet_manager.cc:1950] T 25e15a8d1e7d41e68eef25d30d668e61 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:55.347503 10375 ts_tablet_manager.cc:1916] T 00dabf43505f4fc89be39ee8fb41c7ee P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:55.347767 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 359) took 1007 ms. Trace:
I20260810 19:47:55.347893 10377 rpcz_store.cc:276] 0810 19:47:54.341184 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:54.342402 (+ 1218us) service_pool.cc:224] Handling call
0810 19:47:55.314947 (+972545us) ts_tablet_manager.cc:1151] Deleting tablet 25e15a8d1e7d41e68eef25d30d668e61
0810 19:47:55.314962 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.332979 (+ 18017us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.340050 (+ 7071us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.347698 (+ 7648us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":971138}
I20260810 19:47:55.349105 10377 tablet_replica.cc:333] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:55.349339 10377 raft_consensus.cc:2243] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:55.349385 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 25e15a8d1e7d41e68eef25d30d668e61 (table default.Table_6a56935e5e6145379899af090dfe23d4 [id=8c8a7865a0374b29a853783941137afb]) successfully deleted
I20260810 19:47:55.349565 10377 raft_consensus.cc:2272] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 19:47:55.349711 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 00fe7d9a548a487d965d92b53cdf9250 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00fe7d9a548a487d965d92b53cdf9250 already in progress: creating tablet
W20260810 19:47:55.349934 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 1a393149727043f3a3c9f58aa051b065 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a393149727043f3a3c9f58aa051b065 already in progress: creating tablet
W20260810 19:47:55.350106 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet da3d8ade850c4d36bd2756c36706195d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da3d8ade850c4d36bd2756c36706195d already in progress: creating tablet
W20260810 19:47:55.350250 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 827dce05c192467589e2692fabd2a84e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 827dce05c192467589e2692fabd2a84e already in progress: creating tablet
W20260810 19:47:55.352712 9830 leader_election.cc:343] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:55.353180 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 8fce298689e9415a8860b8734d73b10a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fce298689e9415a8860b8734d73b10a already in progress: creating tablet
I20260810 19:47:55.354806 10366 tablet_bootstrap.cc:654] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:55.354671 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_18e99ebc486045feb7406931bba3b281"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:55.354993 10377 ts_tablet_manager.cc:1916] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:47:55.355392 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18e99ebc486045feb7406931bba3b281 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:55.357195 11080 raft_consensus.cc:493] T 5d3598b5743244e39efd12703ec15aea P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:55.357381 11080 raft_consensus.cc:515] T 5d3598b5743244e39efd12703ec15aea P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.358184 11080 leader_election.cc:290] T 5d3598b5743244e39efd12703ec15aea P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
W20260810 19:47:55.360667 10067 leader_election.cc:343] T 5d3598b5743244e39efd12703ec15aea P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 5d3598b5743244e39efd12703ec15aea
I20260810 19:47:55.372001 10366 tablet_bootstrap.cc:492] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:55.372215 10366 ts_tablet_manager.cc:1403] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.000s
I20260810 19:47:55.372362 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 5e47086440ef4a249f1eed23db655879 (DEFAULT_TABLE table=default.Table_70edac9409204eb0bb559d56eddecbf7 [id=a2b6e3d955f3426781465b670f4fa727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.373122 10366 raft_consensus.cc:359] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.373381 10366 raft_consensus.cc:385] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:55.373467 10366 raft_consensus.cc:740] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:55.373742 10366 consensus_queue.cc:260] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.374338 10366 ts_tablet_manager.cc:1434] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:47:55.374830 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad16ea0f82942de8587dd7c98c0d2df" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:55.375077 9717 raft_consensus.cc:3060] T dad16ea0f82942de8587dd7c98c0d2df P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:47:55.375826 10068 leader_election.cc:343] T 5d3598b5743244e39efd12703ec15aea P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 5d3598b5743244e39efd12703ec15aea
I20260810 19:47:55.375981 10068 leader_election.cc:304] T 5d3598b5743244e39efd12703ec15aea P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:55.376839 11080 raft_consensus.cc:2749] T 5d3598b5743244e39efd12703ec15aea P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:55.379339 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 5654c48929564a96a55ed0444c9e1a04
I20260810 19:47:55.379853 9420 catalog_manager.cc:6807] ReplaceTablet: tablet 5654c48929564a96a55ed0444c9e1a04 deleted and replaced by tablet e87fd882e6b6413480a0cb06aee74722
W20260810 19:47:55.380729 9831 leader_election.cc:343] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 2d90d9c9f6524859a0e33e649dd80f7c
I20260810 19:47:55.380896 9831 leader_election.cc:304] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:55.381212 10377 ts_tablet_manager.cc:1929] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:55.381367 10377 log.cc:1199] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/7b995f3c3bca4501a6c62cf9025051b2
I20260810 19:47:55.381398 11267 raft_consensus.cc:2749] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:55.381884 10377 ts_tablet_manager.cc:1950] T 7b995f3c3bca4501a6c62cf9025051b2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:55.382284 10366 tablet_bootstrap.cc:492] T 81720b897a674b5380c6469d1600a979 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:55.382608 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 5654c48929564a96a55ed0444c9e1a04 with delete_type TABLET_DATA_DELETED (replaced by tablet e87fd882e6b6413480a0cb06aee74722) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:55.378618 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8e8e1b5f3f452f8fdfe5a42fd021a5" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:55.383117 9710 raft_consensus.cc:2468] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:55.383617 9659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7595dbb46b6441dbb811611da116791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.384348 9831 leader_election.cc:304] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:55.384807 11267 raft_consensus.cc:2804] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:55.384920 11267 raft_consensus.cc:493] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260810 19:47:55.384935 10068 leader_election.cc:343] T 92e3d52bd5b741a4adcabb343b6770b8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 92e3d52bd5b741a4adcabb343b6770b8
I20260810 19:47:55.385001 11267 raft_consensus.cc:3060] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:55.385099 10068 leader_election.cc:304] T 92e3d52bd5b741a4adcabb343b6770b8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:55.383885 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10617bdf2eed4dbd8d13ea1821443863" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:55.385615 9711 raft_consensus.cc:2468] T 10617bdf2eed4dbd8d13ea1821443863 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:55.385771 10911 raft_consensus.cc:2749] T 92e3d52bd5b741a4adcabb343b6770b8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:55.386258 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 367) took 1032 ms. Trace:
I20260810 19:47:55.386384 10371 rpcz_store.cc:276] 0810 19:47:54.353344 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:54.353425 (+ 81us) service_pool.cc:224] Handling call
0810 19:47:55.217311 (+863886us) ts_tablet_manager.cc:1151] Deleting tablet 5f560ed7ea0c4075bad1375d86738861
0810 19:47:55.217325 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.242156 (+ 24831us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x616000162754. stack: 00007fe77e16b326 00007fe77e16b0e0 00007fe77d19534d 00000000009a5774 00000000009a573d 00000000009a510a 00007fe78a26c780 00007fe78b5f3023 00007fe78e1b8c67 00007fe78e1ebd34 00007fe78e1cc750 00007fe78e1cc4dd 0000000000aaf86c 00007fe77e1b184f 00007fe77e1b4b4b 00007fe77e1b49c8
0810 19:47:55.259701 (+ 17545us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.263838 (+ 4137us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.386160 (+122322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55942784,"tablet-delete.queue_time_us":863625}
I20260810 19:47:55.387327 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 5f560ed7ea0c4075bad1375d86738861 (table default.Table_0de524b66ecf4dea8ab5e6b87c4f6261 [id=4de43e2ae0424104aa75c5d872b72d3a]) successfully deleted
I20260810 19:47:55.387518 9831 leader_election.cc:304] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:55.387934 11260 raft_consensus.cc:2804] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:55.387962 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 5654c48929564a96a55ed0444c9e1a04 with delete_type TABLET_DATA_DELETED (replaced by tablet e87fd882e6b6413480a0cb06aee74722) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:55.388043 11260 raft_consensus.cc:493] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:55.388145 11260 raft_consensus.cc:3060] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:55.389360 10120 tablet_service.cc:1558] Processing DeleteTablet for tablet 5654c48929564a96a55ed0444c9e1a04 with delete_type TABLET_DATA_DELETED (replaced by tablet e87fd882e6b6413480a0cb06aee74722) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:55.389662 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 368) took 1014 ms. Trace:
I20260810 19:47:55.389777 10371 rpcz_store.cc:276] 0810 19:47:54.374076 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:54.374144 (+ 68us) service_pool.cc:224] Handling call
0810 19:47:55.386685 (+1012541us) ts_tablet_manager.cc:1151] Deleting tablet 00fe7d9a548a487d965d92b53cdf9250
0810 19:47:55.388111 (+ 1426us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.388246 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1012088}
I20260810 19:47:55.390472 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e47086440ef4a249f1eed23db655879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.396274 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b3ebb4935f244802a7b2b6e1a33cb904"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:55.396493 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 00fe7d9a548a487d965d92b53cdf9250 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00fe7d9a548a487d965d92b53cdf9250 already in progress: creating tablet
W20260810 19:47:55.396903 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3ebb4935f244802a7b2b6e1a33cb904 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:55.396905 11260 raft_consensus.cc:515] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.398478 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10617bdf2eed4dbd8d13ea1821443863" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:55.399583 11267 raft_consensus.cc:515] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:55.400964 9830 leader_election.cc:343] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:55.400975 10120 tablet_service.cc:1511] Processing CreateTablet for tablet 5e47086440ef4a249f1eed23db655879 (DEFAULT_TABLE table=default.Table_70edac9409204eb0bb559d56eddecbf7 [id=a2b6e3d955f3426781465b670f4fa727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.401561 11267 leader_election.cc:290] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:55.401667 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e47086440ef4a249f1eed23db655879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.401937 11260 leader_election.cc:290] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:55.402721 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 5e47086440ef4a249f1eed23db655879 (DEFAULT_TABLE table=default.Table_70edac9409204eb0bb559d56eddecbf7 [id=a2b6e3d955f3426781465b670f4fa727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.403151 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e47086440ef4a249f1eed23db655879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.403224 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 7b995f3c3bca4501a6c62cf9025051b2 (table default.Table_4b39478b329141c790e4b1160cd6ffc2 [id=b05460b1d468433f9a6501203eb5f4ec]) successfully deleted
W20260810 19:47:55.403704 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 444b49a69c8245b6944a76d53041154c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 444b49a69c8245b6944a76d53041154c already in progress: creating tablet
W20260810 19:47:55.403959 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 5654c48929564a96a55ed0444c9e1a04 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5654c48929564a96a55ed0444c9e1a04 already in progress: creating tablet
I20260810 19:47:55.406541 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8e8e1b5f3f452f8fdfe5a42fd021a5" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
W20260810 19:47:55.407254 9830 leader_election.cc:343] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:55.408254 10367 tablet_bootstrap.cc:492] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:55.414852 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 369) took 1016 ms. Trace:
I20260810 19:47:55.414997 10371 rpcz_store.cc:276] 0810 19:47:54.391629 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:54.391724 (+ 95us) service_pool.cc:224] Handling call
0810 19:47:55.390066 (+998342us) ts_tablet_manager.cc:1151] Deleting tablet 1a393149727043f3a3c9f58aa051b065
0810 19:47:55.407509 (+ 17443us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.408132 (+ 623us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":998033}
W20260810 19:47:55.415814 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 1a393149727043f3a3c9f58aa051b065 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a393149727043f3a3c9f58aa051b065 already in progress: creating tablet
I20260810 19:47:55.418284 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10617bdf2eed4dbd8d13ea1821443863" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:55.420670 11260 raft_consensus.cc:493] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:55.420863 11260 raft_consensus.cc:515] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.421615 11260 leader_election.cc:290] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:55.422446 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 59a767c91abf45e79cebab582525ad2e
I20260810 19:47:55.422727 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3395886420455d9bdaf816c19ebae2" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:55.423382 9830 leader_election.cc:343] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:55.424624 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 59a767c91abf45e79cebab582525ad2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:55.425195 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 59a767c91abf45e79cebab582525ad2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:47:55.425961 9395 catalog_manager.cc:5017] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 59a767c91abf45e79cebab582525ad2e because the tablet was not found. No further retry: Not found: Tablet not found: 59a767c91abf45e79cebab582525ad2e
I20260810 19:47:55.427865 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e65a0539bebe443199c67a2723cd4af6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:55.428434 10366 tablet_bootstrap.cc:654] T 81720b897a674b5380c6469d1600a979 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:55.428551 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e65a0539bebe443199c67a2723cd4af6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:55.429900 9711 raft_consensus.cc:3060] T 10617bdf2eed4dbd8d13ea1821443863 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:55.430794 9717 raft_consensus.cc:2468] T dad16ea0f82942de8587dd7c98c0d2df P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:55.431478 11080 raft_consensus.cc:493] T 25e15a8d1e7d41e68eef25d30d668e61 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:55.431648 11080 raft_consensus.cc:515] T 25e15a8d1e7d41e68eef25d30d668e61 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.432389 11080 leader_election.cc:290] T 25e15a8d1e7d41e68eef25d30d668e61 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:55.432960 9831 leader_election.cc:304] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:55.432996 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8e8e1b5f3f452f8fdfe5a42fd021a5" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:55.433195 9710 raft_consensus.cc:3060] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:55.433665 11260 raft_consensus.cc:2804] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:55.433808 11260 raft_consensus.cc:697] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:47:55.434085 11260 consensus_queue.cc:237] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.434717 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3395886420455d9bdaf816c19ebae2" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
W20260810 19:47:55.436587 9831 leader_election.cc:343] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:55.436650 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 99aa001db52149dd90ce86e7261f7424 (DEFAULT_TABLE table=default.Table_35de6164baf24ff79163d6b665fc6b8c [id=17f46f6e25bd4c3084a0fcb333694b71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.436743 9831 leader_election.cc:304] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:55.437134 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99aa001db52149dd90ce86e7261f7424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.437124 11267 raft_consensus.cc:2749] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:55.438158 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 59a767c91abf45e79cebab582525ad2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:55.436718 10067 leader_election.cc:343] T 25e15a8d1e7d41e68eef25d30d668e61 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 25e15a8d1e7d41e68eef25d30d668e61
I20260810 19:47:55.442163 10371 tablet_replica.cc:333] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:55.442438 10371 raft_consensus.cc:2243] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
W20260810 19:47:55.443255 10068 leader_election.cc:343] T 25e15a8d1e7d41e68eef25d30d668e61 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 25e15a8d1e7d41e68eef25d30d668e61
I20260810 19:47:55.443459 10068 leader_election.cc:304] T 25e15a8d1e7d41e68eef25d30d668e61 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:55.443769 11080 raft_consensus.cc:2749] T 25e15a8d1e7d41e68eef25d30d668e61 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:55.444244 10371 pending_rounds.cc:70] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4: Trying to abort 1 pending ops.
I20260810 19:47:55.444340 10371 pending_rounds.cc:77] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058660395360256 op_type: NO_OP noop_request { }
I20260810 19:47:55.445093 10371 raft_consensus.cc:2889] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:55.445241 10371 raft_consensus.cc:2272] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:55.445431 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 56fa5de3bf7142b2b0978f9190091f33 (DEFAULT_TABLE table=default.Table_e1bd107e98074407bc8cbc5a0644d5b6 [id=87220e53176e4254a5238c988b6a7311]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.446278 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56fa5de3bf7142b2b0978f9190091f33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.447525 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 99aa001db52149dd90ce86e7261f7424 (DEFAULT_TABLE table=default.Table_35de6164baf24ff79163d6b665fc6b8c [id=17f46f6e25bd4c3084a0fcb333694b71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.448982 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 823bcbb987374ab4b9b0fc3d9d79b571
I20260810 19:47:55.451066 10139 tablet_service.cc:1558] Processing DeleteTablet for tablet 823bcbb987374ab4b9b0fc3d9d79b571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:55.448148 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99aa001db52149dd90ce86e7261f7424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.451300 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 823bcbb987374ab4b9b0fc3d9d79b571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:47:55.452039 9395 catalog_manager.cc:5017] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 823bcbb987374ab4b9b0fc3d9d79b571 because the tablet was not found. No further retry: Not found: Tablet not found: 823bcbb987374ab4b9b0fc3d9d79b571
I20260810 19:47:55.458653 10936 raft_consensus.cc:493] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:55.459892 10936 raft_consensus.cc:515] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.460561 10936 leader_election.cc:290] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:55.461352 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3badc88d94a34ff7a053ed312f0dd646" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:55.461581 9948 raft_consensus.cc:2468] T 3badc88d94a34ff7a053ed312f0dd646 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:55.461884 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 823bcbb987374ab4b9b0fc3d9d79b571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:55.462983 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3badc88d94a34ff7a053ed312f0dd646" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:55.464071 9611 leader_election.cc:304] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
W20260810 19:47:55.464432 9611 leader_election.cc:343] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:55.465451 10936 raft_consensus.cc:2804] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:55.465549 10936 raft_consensus.cc:493] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:55.466027 10936 raft_consensus.cc:3060] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:55.467057 10371 ts_tablet_manager.cc:1916] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:55.467891 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2d2422f738fe43f5aac8adbdaac041cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:55.468562 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d2422f738fe43f5aac8adbdaac041cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:55.470041 10936 raft_consensus.cc:515] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.472031 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 56fa5de3bf7142b2b0978f9190091f33 (DEFAULT_TABLE table=default.Table_e1bd107e98074407bc8cbc5a0644d5b6 [id=87220e53176e4254a5238c988b6a7311]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.472512 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56fa5de3bf7142b2b0978f9190091f33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.472728 9669 tablet_service.cc:1511] Processing CreateTablet for tablet f2606854f9954f2ea10610aeb1e60368 (DEFAULT_TABLE table=default.Table_a6baa15791834b67978359ba4d7dcc50 [id=4fe62c29683b4e5ca802b5cf74ae195e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.473127 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2606854f9954f2ea10610aeb1e60368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.478703 9710 raft_consensus.cc:2468] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:55.479378 9831 leader_election.cc:304] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:55.479712 11260 raft_consensus.cc:2804] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:55.479883 11260 raft_consensus.cc:697] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:47:55.480149 11260 consensus_queue.cc:237] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.481451 9416 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 10617bdf2eed4dbd8d13ea1821443863 (table default.Table_4502b22ebf5b47e5a0c8e0c3027e3251 [id=f1973d72068847eaabc823653402d194]). Expected version 2 got 0
I20260810 19:47:55.483640 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3badc88d94a34ff7a053ed312f0dd646" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:55.483888 9948 raft_consensus.cc:3060] T 3badc88d94a34ff7a053ed312f0dd646 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:55.485443 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 56fa5de3bf7142b2b0978f9190091f33 (DEFAULT_TABLE table=default.Table_e1bd107e98074407bc8cbc5a0644d5b6 [id=87220e53176e4254a5238c988b6a7311]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.485926 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56fa5de3bf7142b2b0978f9190091f33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.487293 9948 raft_consensus.cc:2468] T 3badc88d94a34ff7a053ed312f0dd646 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:55.487907 9611 leader_election.cc:304] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:55.488924 11295 raft_consensus.cc:2804] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:55.489754 11295 raft_consensus.cc:697] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:55.490099 11295 consensus_queue.cc:237] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.491314 9911 tablet_service.cc:1558] Processing DeleteTablet for tablet 74dddd12f2314d6ab5a6717025b13a51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:55.491475 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet 38ee7973736c4a0a921261d37b74f290 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:55.491650 9899 tablet_service.cc:1558] Processing DeleteTablet for tablet aa457d1f5cf2445eb3d869bc6ecf60b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:55.491829 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 860dbb6d0a004c43bdce09075272fa70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:55.492391 10377 tablet_replica.cc:333] T aa457d1f5cf2445eb3d869bc6ecf60b3 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:55.492609 10377 raft_consensus.cc:2243] T aa457d1f5cf2445eb3d869bc6ecf60b3 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:55.492604 10136 tablet_service.cc:1558] Processing DeleteTablet for tablet 46005eead530459eb2b636ae0a6767ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:55.492779 10377 raft_consensus.cc:2272] T aa457d1f5cf2445eb3d869bc6ecf60b3 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:55.492847 10139 tablet_service.cc:1558] Processing DeleteTablet for tablet e4a92eb8626f465caf563b72598a685f with delete_type TABLET_DATA_DELETED (replaced by tablet 08e29e23d54f47968a06be98b313918d) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:55.493359 10377 ts_tablet_manager.cc:1916] T aa457d1f5cf2445eb3d869bc6ecf60b3 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:55.467718 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 99aa001db52149dd90ce86e7261f7424 (DEFAULT_TABLE table=default.Table_35de6164baf24ff79163d6b665fc6b8c [id=17f46f6e25bd4c3084a0fcb333694b71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.495420 9711 raft_consensus.cc:2468] T 10617bdf2eed4dbd8d13ea1821443863 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:55.496002 9831 leader_election.cc:304] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:55.496470 11267 raft_consensus.cc:2804] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:55.496636 11267 raft_consensus.cc:697] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:47:55.496932 11267 consensus_queue.cc:237] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:55.498476 9395 catalog_manager.cc:5017] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 74dddd12f2314d6ab5a6717025b13a51 because the tablet was not found. No further retry: Not found: Tablet not found: 74dddd12f2314d6ab5a6717025b13a51
W20260810 19:47:55.498790 9395 catalog_manager.cc:5017] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 38ee7973736c4a0a921261d37b74f290 because the tablet was not found. No further retry: Not found: Tablet not found: 38ee7973736c4a0a921261d37b74f290
I20260810 19:47:55.501478 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_830b53d484b34185b3edd4c39fcb36b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:55.501984 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 46005eead530459eb2b636ae0a6767ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:47:55.502146 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_830b53d484b34185b3edd4c39fcb36b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:55.502528 10377 ts_tablet_manager.cc:1929] T aa457d1f5cf2445eb3d869bc6ecf60b3 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:55.502712 10377 log.cc:1199] T aa457d1f5cf2445eb3d869bc6ecf60b3 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/aa457d1f5cf2445eb3d869bc6ecf60b3
I20260810 19:47:55.503284 10377 ts_tablet_manager.cc:1950] T aa457d1f5cf2445eb3d869bc6ecf60b3 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:55.503671 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8a225580c44c484c97bef032a300c69b" } new_table_name: "default.Table_c5eab30c1c344809be5b1289a88d2ca3" modify_external_catalogs: true
I20260810 19:47:55.505146 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1bc09ade1e7c4459a7ee8927ee4e6873"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:55.505744 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1bc09ade1e7c4459a7ee8927ee4e6873 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:55.507210 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 3badc88d94a34ff7a053ed312f0dd646 with delete_type TABLET_DATA_DELETED (replaced by tablet b16108d31ced4e02b2d7d0ab1f581a2c) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:55.507280 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet aa457d1f5cf2445eb3d869bc6ecf60b3 (table default.Table_9381401bf3f44ef488064afeb31098bb [id=c8a0313d7b6a4b4fa813727cf4e8e38d]) successfully deleted
I20260810 19:47:55.508479 10377 tablet_replica.cc:333] T 860dbb6d0a004c43bdce09075272fa70 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:55.508858 10370 tablet_bootstrap.cc:492] T 842a5dacf9d145889e97069d3c8084b8 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:55.509037 10370 ts_tablet_manager.cc:1403] T 842a5dacf9d145889e97069d3c8084b8 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.234s user 0.002s sys 0.001s
I20260810 19:47:55.509207 10367 tablet_bootstrap.cc:654] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:55.509580 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99aa001db52149dd90ce86e7261f7424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.511780 10370 raft_consensus.cc:359] T 842a5dacf9d145889e97069d3c8084b8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:55.512013 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b54feebc7c9841d89808054602be7913 consensus state has no leader
I20260810 19:47:55.512010 10370 raft_consensus.cc:385] T 842a5dacf9d145889e97069d3c8084b8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:55.512104 10370 raft_consensus.cc:740] T 842a5dacf9d145889e97069d3c8084b8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:55.512454 10370 consensus_queue.cc:260] T 842a5dacf9d145889e97069d3c8084b8 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.513801 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f560ed7ea0c4075bad1375d86738861 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b2b20dc77954af7a203f357c746be29) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:55.514521 10936 leader_election.cc:290] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:55.514690 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3badc88d94a34ff7a053ed312f0dd646" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:55.515149 10370 ts_tablet_manager.cc:1434] T 842a5dacf9d145889e97069d3c8084b8 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260810 19:47:55.515534 10370 tablet_bootstrap.cc:492] T 5f560ed7ea0c4075bad1375d86738861 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:47:55.517041 9611 leader_election.cc:343] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:55.518209 10139 tablet_service.cc:1511] Processing CreateTablet for tablet f2606854f9954f2ea10610aeb1e60368 (DEFAULT_TABLE table=default.Table_a6baa15791834b67978359ba4d7dcc50 [id=4fe62c29683b4e5ca802b5cf74ae195e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.518384 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f2d7c165d2c465d9080b927d54807f7 with delete_type TABLET_DATA_DELETED (replaced by tablet 639c824ba4834734a4ebfd558181bebe) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:55.518755 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2606854f9954f2ea10610aeb1e60368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.518899 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d3598b5743244e39efd12703ec15aea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:55.521171 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 3520274768ed41abb010bb109127affa (DEFAULT_TABLE table=default.Table_f7094d91833544e996949b52a5a24386 [id=541cc0f8fabe41b4a2114eb70c9d5ba4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.522879 10370 tablet_bootstrap.cc:654] T 5f560ed7ea0c4075bad1375d86738861 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:55.525000 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a6baa15791834b67978359ba4d7dcc50" } new_table_name: "default.Table_33ab9a72c1d543beb6a25830c7f1aa23" modify_external_catalogs: true
I20260810 19:47:55.525135 10136 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d3598b5743244e39efd12703ec15aea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:55.527540 11274 consensus_queue.cc:1048] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:55.534677 9908 tablet_service.cc:1511] Processing CreateTablet for tablet f2606854f9954f2ea10610aeb1e60368 (DEFAULT_TABLE table=default.Table_a6baa15791834b67978359ba4d7dcc50 [id=4fe62c29683b4e5ca802b5cf74ae195e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.534778 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet dcb3660108094399b36d19ea8e6b8308
I20260810 19:47:55.535373 9407 catalog_manager.cc:6807] ReplaceTablet: tablet dcb3660108094399b36d19ea8e6b8308 deleted and replaced by tablet f5fa6060b9ef48cea6830cd9d19424ea
I20260810 19:47:55.536365 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet dcb3660108094399b36d19ea8e6b8308 with delete_type TABLET_DATA_DELETED (replaced by tablet f5fa6060b9ef48cea6830cd9d19424ea) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:55.536720 10370 tablet_bootstrap.cc:492] T 5f560ed7ea0c4075bad1375d86738861 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:55.536856 10139 tablet_service.cc:1558] Processing DeleteTablet for tablet dcb3660108094399b36d19ea8e6b8308 with delete_type TABLET_DATA_DELETED (replaced by tablet f5fa6060b9ef48cea6830cd9d19424ea) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:55.537057 10370 ts_tablet_manager.cc:1403] T 5f560ed7ea0c4075bad1375d86738861 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.002s
I20260810 19:47:55.537493 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2606854f9954f2ea10610aeb1e60368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.537612 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet dad16ea0f82942de8587dd7c98c0d2df with delete_type TABLET_DATA_DELETED (replaced by tablet 4f90707dba6e4a3ab7d4c6c197326411) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:55.538600 10370 raft_consensus.cc:359] T 5f560ed7ea0c4075bad1375d86738861 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.538930 10370 raft_consensus.cc:385] T 5f560ed7ea0c4075bad1375d86738861 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:55.539067 10370 raft_consensus.cc:740] T 5f560ed7ea0c4075bad1375d86738861 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:55.539419 10370 consensus_queue.cc:260] T 5f560ed7ea0c4075bad1375d86738861 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.540489 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 3520274768ed41abb010bb109127affa (DEFAULT_TABLE table=default.Table_f7094d91833544e996949b52a5a24386 [id=541cc0f8fabe41b4a2114eb70c9d5ba4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.540867 10370 ts_tablet_manager.cc:1434] T 5f560ed7ea0c4075bad1375d86738861 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 19:47:55.540956 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3520274768ed41abb010bb109127affa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.541208 10370 tablet_bootstrap.cc:492] T dad16ea0f82942de8587dd7c98c0d2df P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:55.542374 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1fad6d00d9714e6494abb90b7d4141e9" } new_table_name: "default.Table_68efca25ddd74752b30341b528693d1f" modify_external_catalogs: true
I20260810 19:47:55.545017 10370 tablet_bootstrap.cc:654] T dad16ea0f82942de8587dd7c98c0d2df P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:55.548002 10120 tablet_service.cc:1511] Processing CreateTablet for tablet 3520274768ed41abb010bb109127affa (DEFAULT_TABLE table=default.Table_f7094d91833544e996949b52a5a24386 [id=541cc0f8fabe41b4a2114eb70c9d5ba4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.548434 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3520274768ed41abb010bb109127affa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.508685 10377 raft_consensus.cc:2243] T 860dbb6d0a004c43bdce09075272fa70 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:55.561964 10377 raft_consensus.cc:2272] T 860dbb6d0a004c43bdce09075272fa70 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:55.563014 10377 ts_tablet_manager.cc:1916] T 860dbb6d0a004c43bdce09075272fa70 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:55.563841 10370 tablet_bootstrap.cc:492] T dad16ea0f82942de8587dd7c98c0d2df P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:55.564087 10370 ts_tablet_manager.cc:1403] T dad16ea0f82942de8587dd7c98c0d2df P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.001s
I20260810 19:47:55.565085 10370 raft_consensus.cc:359] T dad16ea0f82942de8587dd7c98c0d2df P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.565376 10370 raft_consensus.cc:385] T dad16ea0f82942de8587dd7c98c0d2df P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:55.565537 10370 raft_consensus.cc:740] T dad16ea0f82942de8587dd7c98c0d2df P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:55.565907 10370 consensus_queue.cc:260] T dad16ea0f82942de8587dd7c98c0d2df P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.566826 10370 ts_tablet_manager.cc:1434] T dad16ea0f82942de8587dd7c98c0d2df P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 19:47:55.567262 10370 tablet_bootstrap.cc:492] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:55.567602 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3520274768ed41abb010bb109127affa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.569247 10370 tablet_bootstrap.cc:654] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:55.575927 10371 ts_tablet_manager.cc:1929] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:55.576133 10371 log.cc:1199] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/e4a92eb8626f465caf563b72598a685f
I20260810 19:47:55.576395 10136 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f560ed7ea0c4075bad1375d86738861 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b2b20dc77954af7a203f357c746be29) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:55.576619 10371 ts_tablet_manager.cc:1950] T e4a92eb8626f465caf563b72598a685f P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:55.577617 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 366) took 1231 ms. Trace:
I20260810 19:47:55.577728 10371 rpcz_store.cc:276] 0810 19:47:54.346442 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:54.409168 (+ 62726us) service_pool.cc:224] Handling call
0810 19:47:55.415275 (+1006107us) ts_tablet_manager.cc:1151] Deleting tablet e4a92eb8626f465caf563b72598a685f
0810 19:47:55.434068 (+ 18793us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.572474 (+138406us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.575832 (+ 3358us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.577554 (+ 1722us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1005822}
I20260810 19:47:55.579212 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 48eee4ce10114021855075812e356652 (DEFAULT_TABLE table=default.Table_11f7a8e6101542a5935af66211bd2469 [id=a8bcb3d29fb749c5ab9fa745718d0fac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.577646 9899 tablet_service.cc:1511] Processing CreateTablet for tablet 1f895bcd21f647f2ab813903d600a31a (DEFAULT_TABLE table=default.Table_c4fa695c16634a2382811d87f8b8224b [id=69aa2ddd2b2d4733a1b0e29676c59330]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.579952 9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f895bcd21f647f2ab813903d600a31a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.581140 9412 catalog_manager.cc:5719] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:47:55.581616 9412 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5 (table default.Table_b46992ec81974f6caad1ea769640dcf1 [id=d6d2d95e5e9f4e10a7d5a8153e66e4b6]). Expected version 2 got 0
I20260810 19:47:55.582423 9412 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 31c8699875b54be888b3128df1b673aa (table default.Table_c35c3a44fcc44bba8a8c334292245b49 [id=5abc1f7beec444a4a988fbfcb8b45623]). Expected version 1 got 0
I20260810 19:47:55.582506 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 48eee4ce10114021855075812e356652 (DEFAULT_TABLE table=default.Table_11f7a8e6101542a5935af66211bd2469 [id=a8bcb3d29fb749c5ab9fa745718d0fac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.583051 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48eee4ce10114021855075812e356652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.583633 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 1f895bcd21f647f2ab813903d600a31a (DEFAULT_TABLE table=default.Table_c4fa695c16634a2382811d87f8b8224b [id=69aa2ddd2b2d4733a1b0e29676c59330]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.584822 9659 tablet_service.cc:1558] Processing DeleteTablet for tablet dcb3660108094399b36d19ea8e6b8308 with delete_type TABLET_DATA_DELETED (replaced by tablet f5fa6060b9ef48cea6830cd9d19424ea) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:55.584867 10375 ts_tablet_manager.cc:1929] T 00dabf43505f4fc89be39ee8fb41c7ee P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:47:55.585002 10375 log.cc:1199] T 00dabf43505f4fc89be39ee8fb41c7ee P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/00dabf43505f4fc89be39ee8fb41c7ee
I20260810 19:47:55.585464 10375 ts_tablet_manager.cc:1950] T 00dabf43505f4fc89be39ee8fb41c7ee P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:55.587420 9904 tablet_service.cc:1511] Processing CreateTablet for tablet b9b567b3338845e4a37cff2a955056ae (DEFAULT_TABLE table=default.Table_ad03d1f368ae4d98b1c5c74343beb59e [id=a102fdb234e04e4e8512e9062b5cfaaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.587889 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9b567b3338845e4a37cff2a955056ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.590615 9412 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 10617bdf2eed4dbd8d13ea1821443863 (table default.Table_4502b22ebf5b47e5a0c8e0c3027e3251 [id=f1973d72068847eaabc823653402d194]). Expected version 2 got 0
I20260810 19:47:55.591603 10125 tablet_service.cc:1511] Processing CreateTablet for tablet b9b567b3338845e4a37cff2a955056ae (DEFAULT_TABLE table=default.Table_ad03d1f368ae4d98b1c5c74343beb59e [id=a102fdb234e04e4e8512e9062b5cfaaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.592094 10137 tablet_service.cc:1511] Processing CreateTablet for tablet b4b6b17ce3354600b2f7450c6e483c69 (DEFAULT_TABLE table=default.Table_b3c82504d474465798c964cff5ce4371 [id=270934e8d981479d9f4b49bc54916f77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.592888 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet e4a92eb8626f465caf563b72598a685f (table default.Table_688c01e53a344393b3471974bad3b972 [id=7112ce97719c47919a3d24d1af7d07cd]) successfully deleted
I20260810 19:47:55.593030 9911 tablet_service.cc:1511] Processing CreateTablet for tablet b4b6b17ce3354600b2f7450c6e483c69 (DEFAULT_TABLE table=default.Table_b3c82504d474465798c964cff5ce4371 [id=270934e8d981479d9f4b49bc54916f77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.593474 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b6b17ce3354600b2f7450c6e483c69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.593945 9669 tablet_service.cc:1511] Processing CreateTablet for tablet b9b567b3338845e4a37cff2a955056ae (DEFAULT_TABLE table=default.Table_ad03d1f368ae4d98b1c5c74343beb59e [id=a102fdb234e04e4e8512e9062b5cfaaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.594173 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 66acbafdcc8540368693c8f463b41752 (DEFAULT_TABLE table=default.Table_928d46ef4c4b4192a572752826eb8264 [id=8a065838257e4c9ca0094e93491f386a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.594619 9675 tablet_service.cc:1511] Processing CreateTablet for tablet b4b6b17ce3354600b2f7450c6e483c69 (DEFAULT_TABLE table=default.Table_b3c82504d474465798c964cff5ce4371 [id=270934e8d981479d9f4b49bc54916f77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.594992 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9b567b3338845e4a37cff2a955056ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.595273 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66acbafdcc8540368693c8f463b41752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.595501 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b6b17ce3354600b2f7450c6e483c69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.597941 9668 tablet_service.cc:1511] Processing CreateTablet for tablet 823bcbb987374ab4b9b0fc3d9d79b571 (DEFAULT_TABLE table=default.Table_c53d9c7f87054a568e99b3f08135ff87 [id=55a3c423691d48feb82508b11c04ca4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.598414 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 823bcbb987374ab4b9b0fc3d9d79b571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.598649 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 66acbafdcc8540368693c8f463b41752 (DEFAULT_TABLE table=default.Table_928d46ef4c4b4192a572752826eb8264 [id=8a065838257e4c9ca0094e93491f386a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.599037 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66acbafdcc8540368693c8f463b41752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.602769 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 8b24b75629ec423b90e4bf287e7cfd38 (DEFAULT_TABLE table=default.Table_134e9e0b05db45adb8ebab5241b132b1 [id=9f58b113854b4d139e789332dfe00c8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.602748 10140 tablet_service.cc:1511] Processing CreateTablet for tablet 66acbafdcc8540368693c8f463b41752 (DEFAULT_TABLE table=default.Table_928d46ef4c4b4192a572752826eb8264 [id=8a065838257e4c9ca0094e93491f386a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.603194 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 823bcbb987374ab4b9b0fc3d9d79b571 (DEFAULT_TABLE table=default.Table_c53d9c7f87054a568e99b3f08135ff87 [id=55a3c423691d48feb82508b11c04ca4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.604399 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 823bcbb987374ab4b9b0fc3d9d79b571 (DEFAULT_TABLE table=default.Table_c53d9c7f87054a568e99b3f08135ff87 [id=55a3c423691d48feb82508b11c04ca4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.604837 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 823bcbb987374ab4b9b0fc3d9d79b571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.605849 11260 raft_consensus.cc:493] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:55.606007 11260 raft_consensus.cc:515] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.606881 11260 leader_election.cc:290] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:55.607347 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3916a976efef43428942135e777edcec" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
W20260810 19:47:55.607959 9831 leader_election.cc:343] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:55.606621 9659 tablet_service.cc:1511] Processing CreateTablet for tablet 1f895bcd21f647f2ab813903d600a31a (DEFAULT_TABLE table=default.Table_c4fa695c16634a2382811d87f8b8224b [id=69aa2ddd2b2d4733a1b0e29676c59330]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.608301 9668 tablet_service.cc:1511] Processing CreateTablet for tablet bb1e4400ca684da7b3b5e6592e19b6e6 (DEFAULT_TABLE table=default.Table_a1fa6532e8104ca59b2dca19999e2e61 [id=857eb3f1b89c41a6b2e3b30b375a585c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.608510 9659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f895bcd21f647f2ab813903d600a31a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.608690 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb1e4400ca684da7b3b5e6592e19b6e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.609565 10124 tablet_service.cc:1511] Processing CreateTablet for tablet bb1e4400ca684da7b3b5e6592e19b6e6 (DEFAULT_TABLE table=default.Table_a1fa6532e8104ca59b2dca19999e2e61 [id=857eb3f1b89c41a6b2e3b30b375a585c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.610679 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 8b24b75629ec423b90e4bf287e7cfd38 (DEFAULT_TABLE table=default.Table_134e9e0b05db45adb8ebab5241b132b1 [id=9f58b113854b4d139e789332dfe00c8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.611078 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b24b75629ec423b90e4bf287e7cfd38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.612627 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 263a5695e7754b44a64edbda27b42135 (DEFAULT_TABLE table=default.Table_a3cddbf5a63a44a7ba3c412022b3a088 [id=ef9ce56a9b874bfc92f88cae54ca0891]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.616348 9896 tablet_service.cc:1511] Processing CreateTablet for tablet bb1e4400ca684da7b3b5e6592e19b6e6 (DEFAULT_TABLE table=default.Table_a1fa6532e8104ca59b2dca19999e2e61 [id=857eb3f1b89c41a6b2e3b30b375a585c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.616788 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb1e4400ca684da7b3b5e6592e19b6e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.618649 9897 tablet_service.cc:1511] Processing CreateTablet for tablet 263a5695e7754b44a64edbda27b42135 (DEFAULT_TABLE table=default.Table_a3cddbf5a63a44a7ba3c412022b3a088 [id=ef9ce56a9b874bfc92f88cae54ca0891]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.619040 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 263a5695e7754b44a64edbda27b42135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.622468 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 8d93821ff46a4096a8ebbac83faabed7 (DEFAULT_TABLE table=default.Table_422e53637be84964a1cd4bb082fec236 [id=79d6de9ae42e416fba0595834b38ce40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.622633 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 8d93821ff46a4096a8ebbac83faabed7 (DEFAULT_TABLE table=default.Table_422e53637be84964a1cd4bb082fec236 [id=79d6de9ae42e416fba0595834b38ce40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.623082 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d93821ff46a4096a8ebbac83faabed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.623445 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 7459e64bd48449d2a8d4ff835b215d46 (DEFAULT_TABLE table=default.Table_4217f5ad81404f348810945248421770 [id=60c86daf4a0f4442ab6754a4e3dc2106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.625253 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 38b0c6a017dc4afc849090cca7ee8b26 (DEFAULT_TABLE table=default.Table_ae8fab9298ca4fa2bfe18cc16b490c48 [id=df9ef32c15fd46caab42b0a0214afd64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.626709 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 1bbd3fe2117c42058dc108b5dc18d560 (DEFAULT_TABLE table=default.Table_128b093f25d14ca588d1d03d416825fc [id=0b09de8d5e854ef9a8ede352326b381e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.627547 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 7459e64bd48449d2a8d4ff835b215d46 (DEFAULT_TABLE table=default.Table_4217f5ad81404f348810945248421770 [id=60c86daf4a0f4442ab6754a4e3dc2106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.627990 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7459e64bd48449d2a8d4ff835b215d46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.628762 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 2d72c72f90964f34bbc2232118dc5172 (DEFAULT_TABLE table=default.Table_1eab0f9ec4eb4314a4fb38f1b443d465 [id=85104f90d64e4270a62cab5a7814a36d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.629446 10142 tablet_service.cc:1511] Processing CreateTablet for tablet 59a767c91abf45e79cebab582525ad2e (DEFAULT_TABLE table=default.Table_32e6a45ca640436c8efef8fa31883db9 [id=d7ca25dd070e4a8ab702a123925bc985]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.630000 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 8b24b75629ec423b90e4bf287e7cfd38 (DEFAULT_TABLE table=default.Table_134e9e0b05db45adb8ebab5241b132b1 [id=9f58b113854b4d139e789332dfe00c8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.630025 10118 tablet_service.cc:1511] Processing CreateTablet for tablet 5f4e2adee0264e418ff8c54912973e60 (DEFAULT_TABLE table=default.Table_4b3474ab5fac40a28a050d69fc60bfe5 [id=495386acd3524a388b83e38f07bf9967]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.631903 10116 tablet_service.cc:1511] Processing CreateTablet for tablet 0292c3214aa84c40ace16760f414d912 (DEFAULT_TABLE table=default.Table_afff95e937d74160a65a9df332c769c9 [id=b3ab2ecf4f4247369ce62adeb445c834]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.632984 10115 tablet_service.cc:1511] Processing CreateTablet for tablet 9ed73161398f4f54a20a9173c18b4d3c (DEFAULT_TABLE table=default.Table_2adfdcdb33f543d49ea6f361bf8a55c4 [id=cfd27e7efc8f4c529e7dace21742b656]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.633649 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 38b0c6a017dc4afc849090cca7ee8b26 (DEFAULT_TABLE table=default.Table_ae8fab9298ca4fa2bfe18cc16b490c48 [id=df9ef32c15fd46caab42b0a0214afd64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.635540 9894 tablet_service.cc:1511] Processing CreateTablet for tablet 1bbd3fe2117c42058dc108b5dc18d560 (DEFAULT_TABLE table=default.Table_128b093f25d14ca588d1d03d416825fc [id=0b09de8d5e854ef9a8ede352326b381e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.638482 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38b0c6a017dc4afc849090cca7ee8b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.640293 9890 tablet_service.cc:1511] Processing CreateTablet for tablet 2d72c72f90964f34bbc2232118dc5172 (DEFAULT_TABLE table=default.Table_1eab0f9ec4eb4314a4fb38f1b443d465 [id=85104f90d64e4270a62cab5a7814a36d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.642776 9885 tablet_service.cc:1511] Processing CreateTablet for tablet 0292c3214aa84c40ace16760f414d912 (DEFAULT_TABLE table=default.Table_afff95e937d74160a65a9df332c769c9 [id=b3ab2ecf4f4247369ce62adeb445c834]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.643338 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 263a5695e7754b44a64edbda27b42135 (DEFAULT_TABLE table=default.Table_a3cddbf5a63a44a7ba3c412022b3a088 [id=ef9ce56a9b874bfc92f88cae54ca0891]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.642048 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 59a767c91abf45e79cebab582525ad2e (DEFAULT_TABLE table=default.Table_32e6a45ca640436c8efef8fa31883db9 [id=d7ca25dd070e4a8ab702a123925bc985]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.645561 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 9ed73161398f4f54a20a9173c18b4d3c (DEFAULT_TABLE table=default.Table_2adfdcdb33f543d49ea6f361bf8a55c4 [id=cfd27e7efc8f4c529e7dace21742b656]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.646421 9887 tablet_service.cc:1511] Processing CreateTablet for tablet 5f4e2adee0264e418ff8c54912973e60 (DEFAULT_TABLE table=default.Table_4b3474ab5fac40a28a050d69fc60bfe5 [id=495386acd3524a388b83e38f07bf9967]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.655606 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 38b0c6a017dc4afc849090cca7ee8b26 (DEFAULT_TABLE table=default.Table_ae8fab9298ca4fa2bfe18cc16b490c48 [id=df9ef32c15fd46caab42b0a0214afd64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.656950 9911 tablet_service.cc:1511] Processing CreateTablet for tablet 22a77c72f2244a08a65e3779c5895752 (DEFAULT_TABLE table=default.Table_49451bd4c68e46ccaf8bf19169c14fd8 [id=dd7f2450f16b4a57a40bfc50373ec099]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.655256 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 8d93821ff46a4096a8ebbac83faabed7 (DEFAULT_TABLE table=default.Table_422e53637be84964a1cd4bb082fec236 [id=79d6de9ae42e416fba0595834b38ce40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.657066 9685 tablet_service.cc:1511] Processing CreateTablet for tablet 1bbd3fe2117c42058dc108b5dc18d560 (DEFAULT_TABLE table=default.Table_128b093f25d14ca588d1d03d416825fc [id=0b09de8d5e854ef9a8ede352326b381e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.578734 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 48eee4ce10114021855075812e356652 (DEFAULT_TABLE table=default.Table_11f7a8e6101542a5935af66211bd2469 [id=a8bcb3d29fb749c5ab9fa745718d0fac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.657897 9677 tablet_service.cc:1511] Processing CreateTablet for tablet 59a767c91abf45e79cebab582525ad2e (DEFAULT_TABLE table=default.Table_32e6a45ca640436c8efef8fa31883db9 [id=d7ca25dd070e4a8ab702a123925bc985]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.658250 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b24b75629ec423b90e4bf287e7cfd38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.658231 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3916a976efef43428942135e777edcec" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:55.658464 9665 tablet_service.cc:1511] Processing CreateTablet for tablet 7459e64bd48449d2a8d4ff835b215d46 (DEFAULT_TABLE table=default.Table_4217f5ad81404f348810945248421770 [id=60c86daf4a0f4442ab6754a4e3dc2106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.659494 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f895bcd21f647f2ab813903d600a31a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.659984 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 285) took 3211 ms. Trace:
I20260810 19:47:55.660146 10375 rpcz_store.cc:276] 0810 19:47:52.448688 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.448782 (+ 94us) service_pool.cc:224] Handling call
0810 19:47:55.346156 (+2897374us) ts_tablet_manager.cc:1151] Deleting tablet 00dabf43505f4fc89be39ee8fb41c7ee
0810 19:47:55.346167 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.552654 (+206487us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.584764 (+ 32110us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:55.659930 (+ 75166us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2894290}
I20260810 19:47:55.660724 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 286) took 3195 ms. Trace:
I20260810 19:47:55.660872 10375 rpcz_store.cc:276] 0810 19:47:52.465184 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.465338 (+ 154us) service_pool.cc:224] Handling call
0810 19:47:55.660496 (+3195158us) ts_tablet_manager.cc:1151] Deleting tablet a5625dc6303d44c6be28abd6278ce034
0810 19:47:55.660511 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.660672 (+ 161us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3186057}
I20260810 19:47:55.661279 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 290) took 3183 ms. Trace:
I20260810 19:47:55.661406 10375 rpcz_store.cc:276] 0810 19:47:52.477607 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.477704 (+ 97us) service_pool.cc:224] Handling call
0810 19:47:55.661138 (+3183434us) ts_tablet_manager.cc:1151] Deleting tablet 896b7cfdb0ca4904aaeafa13ff19365e
0810 19:47:55.661149 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.661242 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3064753}
I20260810 19:47:55.661818 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 297) took 3103 ms. Trace:
I20260810 19:47:55.661937 10375 rpcz_store.cc:276] 0810 19:47:52.558456 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.576364 (+ 17908us) service_pool.cc:224] Handling call
0810 19:47:55.661667 (+3085303us) ts_tablet_manager.cc:1151] Deleting tablet 63486cc3f8774a11827b1cc5f1c16332
0810 19:47:55.661675 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.661771 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3036542}
I20260810 19:47:55.662333 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_80a86eb986c5424fb1702c55beb124c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:55.662894 10120 tablet_service.cc:1511] Processing CreateTablet for tablet 73abedd88ba548bdb5a23f508b77403d (DEFAULT_TABLE table=default.Table_2c70d731dd51405188ec44cbbcffaf57 [id=85908f0b736c4bf9bdbcd67352e2d491]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:55.663043 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80a86eb986c5424fb1702c55beb124c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:55.663354 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73abedd88ba548bdb5a23f508b77403d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.667593 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 22a77c72f2244a08a65e3779c5895752 (DEFAULT_TABLE table=default.Table_49451bd4c68e46ccaf8bf19169c14fd8 [id=dd7f2450f16b4a57a40bfc50373ec099]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.668128 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a77c72f2244a08a65e3779c5895752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.668171 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 00dabf43505f4fc89be39ee8fb41c7ee (table default.Table_257ddf6dffe443b7bb3a6d5e7f1e93a2 [id=6b30bf93c566421593a182e1768c0482]) successfully deleted
W20260810 19:47:55.668604 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 896b7cfdb0ca4904aaeafa13ff19365e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 896b7cfdb0ca4904aaeafa13ff19365e already in progress: creating tablet
W20260810 19:47:55.668874 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 63486cc3f8774a11827b1cc5f1c16332 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63486cc3f8774a11827b1cc5f1c16332 already in progress: creating tablet
I20260810 19:47:55.670023 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b24b75629ec423b90e4bf287e7cfd38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.671548 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 300) took 3057 ms. Trace:
I20260810 19:47:55.679932 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 263a5695e7754b44a64edbda27b42135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.682010 9660 tablet_service.cc:1511] Processing CreateTablet for tablet 73abedd88ba548bdb5a23f508b77403d (DEFAULT_TABLE table=default.Table_2c70d731dd51405188ec44cbbcffaf57 [id=85908f0b736c4bf9bdbcd67352e2d491]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.682211 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 5f4e2adee0264e418ff8c54912973e60 (DEFAULT_TABLE table=default.Table_4b3474ab5fac40a28a050d69fc60bfe5 [id=495386acd3524a388b83e38f07bf9967]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.691934 9663 tablet_service.cc:1511] Processing CreateTablet for tablet 749cea5cd8f842b891f4e2cab07c054e (DEFAULT_TABLE table=default.Table_eac904f0d8d945b3ab2e659358f3a485 [id=d319e3ece21e44b1860258156ffa0f72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.692186 9664 tablet_service.cc:1511] Processing CreateTablet for tablet eb3e7d34b5314bc7a7c5ed53792728ca (DEFAULT_TABLE table=default.Table_8a225580c44c484c97bef032a300c69b [id=64e2bbcc84434e268763f4ee1acc851d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.696183 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59a767c91abf45e79cebab582525ad2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.695552 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 9ed73161398f4f54a20a9173c18b4d3c (DEFAULT_TABLE table=default.Table_2adfdcdb33f543d49ea6f361bf8a55c4 [id=cfd27e7efc8f4c529e7dace21742b656]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.694304 9655 tablet_service.cc:1511] Processing CreateTablet for tablet 0292c3214aa84c40ace16760f414d912 (DEFAULT_TABLE table=default.Table_afff95e937d74160a65a9df332c769c9 [id=b3ab2ecf4f4247369ce62adeb445c834]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.698949 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 2d72c72f90964f34bbc2232118dc5172 (DEFAULT_TABLE table=default.Table_1eab0f9ec4eb4314a4fb38f1b443d465 [id=85104f90d64e4270a62cab5a7814a36d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.701895 9418 master_service.cc:960] ReplaceTablet: received request to replace tablet a78960e1f2164c848297411b9273ac64 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:55.703311 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38b0c6a017dc4afc849090cca7ee8b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.703615 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d93821ff46a4096a8ebbac83faabed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.704696 9660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73abedd88ba548bdb5a23f508b77403d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.706277 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 22a77c72f2244a08a65e3779c5895752 (DEFAULT_TABLE table=default.Table_49451bd4c68e46ccaf8bf19169c14fd8 [id=dd7f2450f16b4a57a40bfc50373ec099]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:55.714727 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eb3e7d34b5314bc7a7c5ed53792728ca consensus state has no leader
I20260810 19:47:55.715075 9415 master_service.cc:960] ReplaceTablet: received request to replace tablet a78960e1f2164c848297411b9273ac64 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:55.719902 9685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bbd3fe2117c42058dc108b5dc18d560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.725626 9135 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu pid 9247
I20260810 19:47:55.726861 9663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 749cea5cd8f842b891f4e2cab07c054e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.727380 9355 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 19:47:55.745712 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7459e64bd48449d2a8d4ff835b215d46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.748657 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 373) took 1251 ms. Trace:
I20260810 19:47:55.749411 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb3e7d34b5314bc7a7c5ed53792728ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.751823 11260 raft_consensus.cc:493] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:55.759454 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f4e2adee0264e418ff8c54912973e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.767316 9659 tablet_service.cc:1511] Processing CreateTablet for tablet deeb390ae00646089e9f1d453ddb54a1 (DEFAULT_TABLE table=default.Table_f1f332ce5d104c2b889c1faf78a0510f [id=a5becac787b84d398e96784d005d21f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.767707 9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0292c3214aa84c40ace16760f414d912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.772357 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d72c72f90964f34bbc2232118dc5172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.773734 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 73abedd88ba548bdb5a23f508b77403d (DEFAULT_TABLE table=default.Table_2c70d731dd51405188ec44cbbcffaf57 [id=85908f0b736c4bf9bdbcd67352e2d491]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.772670 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 83b19479978c46bf8a425ccf1225ef45 (DEFAULT_TABLE table=default.Table_b69402d23c6840e2955cfc41a73beb92 [id=bd770ee1a53e4a69b0c60287165c7b46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.785768 9659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deeb390ae00646089e9f1d453ddb54a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.789459 9673 tablet_service.cc:1511] Processing CreateTablet for tablet b3754889e4574fc3a936ac31cc6f496a (DEFAULT_TABLE table=default.Table_33028416824c4623be1af7797d6d605a [id=ab67d2215d85456cb3100985ad22b894]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.793756 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ed73161398f4f54a20a9173c18b4d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.800038 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a77c72f2244a08a65e3779c5895752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.801744 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3754889e4574fc3a936ac31cc6f496a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.802729 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83b19479978c46bf8a425ccf1225ef45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.807166 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 87bbcc651d034e2a826478b805792e48 (DEFAULT_TABLE table=default.Table_07cbcdfa939f47f0a8f10f834f5ce596 [id=51fc4051f8ac425e9b6b5f86acf32827]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.808048 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87bbcc651d034e2a826478b805792e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.809860 11260 raft_consensus.cc:515] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.810758 11260 leader_election.cc:290] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:55.812093 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a77c72f2244a08a65e3779c5895752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.817952 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c8699875b54be888b3128df1b673aa" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:55.818384 10367 tablet_bootstrap.cc:492] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:55.818722 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d72c72f90964f34bbc2232118dc5172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.823195 9711 raft_consensus.cc:2468] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:55.825920 9831 leader_election.cc:304] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:55.826534 11260 raft_consensus.cc:2804] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:55.826663 11260 raft_consensus.cc:493] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:55.826961 11260 raft_consensus.cc:3060] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:55.829397 10367 ts_tablet_manager.cc:1403] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.422s user 0.006s sys 0.017s
I20260810 19:47:55.833866 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bbd3fe2117c42058dc108b5dc18d560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.843873 9896 tablet_service.cc:1511] Processing CreateTablet for tablet eb3e7d34b5314bc7a7c5ed53792728ca (DEFAULT_TABLE table=default.Table_8a225580c44c484c97bef032a300c69b [id=64e2bbcc84434e268763f4ee1acc851d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.854008 9887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f4e2adee0264e418ff8c54912973e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.856923 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 83b19479978c46bf8a425ccf1225ef45 (DEFAULT_TABLE table=default.Table_b69402d23c6840e2955cfc41a73beb92 [id=bd770ee1a53e4a69b0c60287165c7b46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.857813 9677 tablet_service.cc:1511] Processing CreateTablet for tablet 985440898cc04a98877c15a5122a7dd3 (DEFAULT_TABLE table=default.Table_1d3d54acd6074609919e2db8b3c01576 [id=e974ea8378194b808889a3255371374e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.859025 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985440898cc04a98877c15a5122a7dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.860548 10367 raft_consensus.cc:359] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.861092 10367 raft_consensus.cc:385] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:55.861248 10367 raft_consensus.cc:740] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:55.861801 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 7d939e3df62a45d9a964d4df01be4bfb (DEFAULT_TABLE table=default.Table_65f4c2fb3d1c49ae9cdfc041e51bd182 [id=2292ed1c178a4d458f52885e45c76d41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.862061 9665 tablet_service.cc:1511] Processing CreateTablet for tablet a2fe67e8bd014acaa202c022c193cdc6 (DEFAULT_TABLE table=default.Table_9374c1b5d0ce4ebc9ca6f086b49f9778 [id=3b14f80137654337b24c2bb4131e58d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.862882 10367 consensus_queue.cc:260] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.863814 10367 ts_tablet_manager.cc:1434] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.034s user 0.000s sys 0.003s
I20260810 19:47:55.864279 10367 tablet_bootstrap.cc:492] T 6f0150de0d60425b807be532ce0ba6c3 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:55.864769 9908 tablet_service.cc:1511] Processing CreateTablet for tablet b3754889e4574fc3a936ac31cc6f496a (DEFAULT_TABLE table=default.Table_33028416824c4623be1af7797d6d605a [id=ab67d2215d85456cb3100985ad22b894]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.866643 10367 tablet_bootstrap.cc:654] T 6f0150de0d60425b807be532ce0ba6c3 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:55.867606 10911 raft_consensus.cc:493] T dad16ea0f82942de8587dd7c98c0d2df P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:55.867710 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d939e3df62a45d9a964d4df01be4bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.869598 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2fe67e8bd014acaa202c022c193cdc6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:55.878798 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f2606854f9954f2ea10610aeb1e60368 consensus state has no leader
I20260810 19:47:55.869438 9913 tablet_service.cc:1511] Processing CreateTablet for tablet deeb390ae00646089e9f1d453ddb54a1 (DEFAULT_TABLE table=default.Table_f1f332ce5d104c2b889c1faf78a0510f [id=a5becac787b84d398e96784d005d21f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.883494 9684 tablet_service.cc:1511] Processing CreateTablet for tablet d5aaedde75d54341a87764c6e89a03d6 (DEFAULT_TABLE table=default.Table_45a851a9919d48ad94da86574312fb58 [id=4a442dde52a84379bc58bc03c3e80beb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:55.885656 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3680db3f1a5945a89c1198eb4849e58c consensus state has no leader
I20260810 19:47:55.891739 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 18ed05a1eb4a4f6e9a7284caaa0bba05 (DEFAULT_TABLE table=default.Table_e218d405fb7e4196ab4d6439b8092138 [id=04cfb59bcc4e460f9063fe742900ba92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.896962 11260 raft_consensus.cc:515] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.902014 11260 leader_election.cc:290] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:55.902920 11260 raft_consensus.cc:493] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:55.905833 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb3e7d34b5314bc7a7c5ed53792728ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.883656 9666 tablet_service.cc:1511] Processing CreateTablet for tablet b59942eba1014659b6f601e74d53d880 (DEFAULT_TABLE table=default.Table_bd4c6fb49b17455592e347e1b07993b0 [id=cbf4bd478b75444e92d25287f6491bf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.887648 9660 tablet_service.cc:1511] Processing CreateTablet for tablet 676004738985441985278313d6064530 (DEFAULT_TABLE table=default.Table_2d7f246476ac4544a3fa089ec3c52657 [id=c681008d2b5f43a9b7b6ed2d72653b1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.813954 10371 rpcz_store.cc:276] 0810 19:47:54.492357 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:54.493442 (+ 1085us) service_pool.cc:224] Handling call
0810 19:47:55.741910 (+1248468us) ts_tablet_manager.cc:1151] Deleting tablet da3d8ade850c4d36bd2756c36706195d
0810 19:47:55.741934 (+ 24us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.744181 (+ 2247us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1247425}
W20260810 19:47:55.914482 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet da3d8ade850c4d36bd2756c36706195d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da3d8ade850c4d36bd2756c36706195d already in progress: creating tablet
I20260810 19:47:55.914085 9688 tablet_service.cc:1511] Processing CreateTablet for tablet b54feebc7c9841d89808054602be7913 (DEFAULT_TABLE table=default.Table_a8eaabc9d0ef45729c9a7e9301083b99 [id=7dc6f3ec58a44497bab92e1853cdb894]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.917485 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc41ad892a247848f5d2c1a0d3333ef (DEFAULT_TABLE table=default.Table_717c8249c368451e88c10baf2240d27f [id=6aa7b61a3c6a419b8581e359ded42a50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.829241 9668 tablet_service.cc:1511] Processing CreateTablet for tablet 18ed05a1eb4a4f6e9a7284caaa0bba05 (DEFAULT_TABLE table=default.Table_e218d405fb7e4196ab4d6439b8092138 [id=04cfb59bcc4e460f9063fe742900ba92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.906978 9669 tablet_service.cc:1511] Processing CreateTablet for tablet fafad8559b074dab958f03061e65b8c3 (DEFAULT_TABLE table=default.Table_8376743094a548beba588e486d56d283 [id=b1c1f3f8b5a64a7597e09eaf29ee995f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.919812 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0de524b66ecf4dea8ab5e6b87c4f6261" } modify_external_catalogs: true
I20260810 19:47:55.920048 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0de524b66ecf4dea8ab5e6b87c4f6261" } modify_external_catalogs: true
I20260810 19:47:55.921610 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_07cbcdfa939f47f0a8f10f834f5ce596" } modify_external_catalogs: true
I20260810 19:47:55.921792 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_07cbcdfa939f47f0a8f10f834f5ce596" } modify_external_catalogs: true
I20260810 19:47:55.925441 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_066ecd6fc0e0441eb69e39d946ba0b9a" } modify_external_catalogs: true
I20260810 19:47:55.925649 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_066ecd6fc0e0441eb69e39d946ba0b9a" } modify_external_catalogs: true
I20260810 19:47:55.927001 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ce92099864b748aaa3d27ac772ec799d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:55.927718 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce92099864b748aaa3d27ac772ec799d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:55.929257 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_dcf48c67df284776aca6205b880fbbc5" } new_table_name: "default.Table_551b211882fd4d67ba96228b8f0826e1" modify_external_catalogs: true
I20260810 19:47:55.931372 9421 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 81720b897a674b5380c6469d1600a979 (table default.Table_e4aeb59e91c24097bac9517b3c62b75a [id=8d7f043045ff44cd886367b5860f8433]). Expected version 1 got 0
I20260810 19:47:55.932610 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_5323ce7ca7d04a90811d8058dc7b08ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:55.933187 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5323ce7ca7d04a90811d8058dc7b08ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:55.941653 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_267ef2e8b32c47328dd2094f69e0940d" } modify_external_catalogs: true
I20260810 19:47:55.941912 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_267ef2e8b32c47328dd2094f69e0940d" } modify_external_catalogs: true
I20260810 19:47:55.943239 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 2b2b20dc77954af7a203f357c746be29
I20260810 19:47:55.944087 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_524d53e58b014d8d9816c1e62b40c7d9" } new_table_name: "default.Table_0a37179e5d0843fdaaa45705f79fe9c8" modify_external_catalogs: true
I20260810 19:47:55.946034 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet a78960e1f2164c848297411b9273ac64
I20260810 19:47:55.946645 9418 catalog_manager.cc:6807] ReplaceTablet: tablet a78960e1f2164c848297411b9273ac64 deleted and replaced by tablet fdd82537177a4142bddd0544485b00c4
I20260810 19:47:55.947012 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 87bbcc651d034e2a826478b805792e48
I20260810 19:47:55.948535 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_77e7389c3161415c96dd7dcbe6b2a829" } modify_external_catalogs: true
I20260810 19:47:55.948734 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_77e7389c3161415c96dd7dcbe6b2a829" } modify_external_catalogs: true
I20260810 19:47:55.955181 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 4198f46be0194875aea6a7952321bc69
I20260810 19:47:55.956609 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb1e4400ca684da7b3b5e6592e19b6e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.956666 10375 rpcz_store.cc:276] 0810 19:47:52.605107 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.605196 (+ 89us) service_pool.cc:224] Handling call
0810 19:47:55.662160 (+3056964us) ts_tablet_manager.cc:1151] Deleting tablet 15c070c23de34348ad3426c894e11022
0810 19:47:55.662169 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.662272 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3034819}
I20260810 19:47:55.957207 11080 raft_consensus.cc:493] T e4a92eb8626f465caf563b72598a685f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:55.957429 11080 raft_consensus.cc:515] T e4a92eb8626f465caf563b72598a685f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.958406 10911 raft_consensus.cc:515] T dad16ea0f82942de8587dd7c98c0d2df P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.964628 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f11b6cec3ddf4b339b5f90841b7b3d8b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:55.964783 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_bfa0ef28a4704e2589883d5ebd21cb92"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:55.965339 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bfa0ef28a4704e2589883d5ebd21cb92 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:55.966428 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a16400f647e94437932730ebd220e795"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:55.966800 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_156494e413e94dddafcb9fd6cb8e2498"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:55.967044 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a16400f647e94437932730ebd220e795 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:55.967263 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_156494e413e94dddafcb9fd6cb8e2498 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:55.968487 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_90f1232af7064dc2b768da280482a20b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:55.969055 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_90f1232af7064dc2b768da280482a20b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:55.965340 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f11b6cec3ddf4b339b5f90841b7b3d8b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:55.971989 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 648ef608fa0c45cc8be4bad80c4200be consensus state has no leader
I20260810 19:47:55.972983 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_471bc99d3aa9446c8a287a8ae160d06d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:55.973351 11080 leader_election.cc:290] T e4a92eb8626f465caf563b72598a685f P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
W20260810 19:47:55.973546 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_471bc99d3aa9446c8a287a8ae160d06d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:55.973832 11080 raft_consensus.cc:493] T 842a5dacf9d145889e97069d3c8084b8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:55.974012 11080 raft_consensus.cc:515] T 842a5dacf9d145889e97069d3c8084b8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.974135 9899 tablet_service.cc:1511] Processing CreateTablet for tablet 87bbcc651d034e2a826478b805792e48 (DEFAULT_TABLE table=default.Table_07cbcdfa939f47f0a8f10f834f5ce596 [id=51fc4051f8ac425e9b6b5f86acf32827]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:55.903682 11260 raft_consensus.cc:515] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:55.974721 11080 leader_election.cc:290] T 842a5dacf9d145889e97069d3c8084b8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:55.975013 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_70edac9409204eb0bb559d56eddecbf7" } new_table_name: "default.Table_b38998c1916842f1aa85263f019bde23" modify_external_catalogs: true
I20260810 19:47:55.970170 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_65864a250646401984a7263cf477ab07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:55.977079 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_65864a250646401984a7263cf477ab07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:55.978406 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 45194cae6ea44d9d8cf856d256fd534f
I20260810 19:47:55.982213 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 82c3f619c76e40c583bfcdf2bb77fe42
I20260810 19:47:55.982764 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 303) took 3280 ms. Trace:
I20260810 19:47:55.982995 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f4e2adee0264e418ff8c54912973e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:55.984611 10375 rpcz_store.cc:276] 0810 19:47:52.695776 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.695872 (+ 96us) service_pool.cc:224] Handling call
0810 19:47:55.957108 (+3261236us) ts_tablet_manager.cc:1151] Deleting tablet d99b34f901484fad87cff4bb9ab56fc8
0810 19:47:55.972804 (+ 15696us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.976259 (+ 3455us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3248477}
I20260810 19:47:55.985227 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 304) took 3236 ms. Trace:
I20260810 19:47:55.985457 10911 leader_election.cc:290] T dad16ea0f82942de8587dd7c98c0d2df P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:55.994891 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 87bbcc651d034e2a826478b805792e48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:55.996366 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842a5dacf9d145889e97069d3c8084b8" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:56.006430 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b54feebc7c9841d89808054602be7913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.012495 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b2b20dc77954af7a203f357c746be29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:56.012826 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ed73161398f4f54a20a9173c18b4d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.012872 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 45194cae6ea44d9d8cf856d256fd534f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:56.012460 9655 tablet_service.cc:1558] Processing DeleteTablet for tablet a78960e1f2164c848297411b9273ac64 with delete_type TABLET_DATA_DELETED (replaced by tablet fdd82537177a4142bddd0544485b00c4) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:56.013566 9655 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d3395886420455d9bdaf816c19ebae2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:56.013734 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 82c3f619c76e40c583bfcdf2bb77fe42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:56.014102 11295 raft_consensus.cc:493] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:56.014269 11295 raft_consensus.cc:515] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.012398 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 4198f46be0194875aea6a7952321bc69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:56.016028 11295 leader_election.cc:290] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:56.016445 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 380) took 1154 ms. Trace:
I20260810 19:47:56.024681 9709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad16ea0f82942de8587dd7c98c0d2df" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:56.027118 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 823bcbb987374ab4b9b0fc3d9d79b571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.026834 10371 rpcz_store.cc:276] 0810 19:47:54.826249 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:54.826369 (+ 120us) service_pool.cc:224] Handling call
0810 19:47:55.919260 (+1092891us) ts_tablet_manager.cc:1151] Deleting tablet 8fce298689e9415a8860b8734d73b10a
0810 19:47:55.919656 (+ 396us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.980175 (+ 60519us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1092587}
I20260810 19:47:55.985373 10375 rpcz_store.cc:276] 0810 19:47:52.748890 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.758232 (+ 9342us) service_pool.cc:224] Handling call
0810 19:47:55.985012 (+3226780us) ts_tablet_manager.cc:1151] Deleting tablet 0dd49d6fa79e4677b753b6cf9117b02d
0810 19:47:55.985027 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:55.985173 (+ 146us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3162337}
W20260810 19:47:56.028421 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 8fce298689e9415a8860b8734d73b10a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fce298689e9415a8860b8734d73b10a already in progress: creating tablet
W20260810 19:47:56.030771 10068 leader_election.cc:343] T e4a92eb8626f465caf563b72598a685f P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: e4a92eb8626f465caf563b72598a685f
W20260810 19:47:56.032493 10068 consensus_peers.cc:597] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa457d1f5cf2445eb3d869bc6ecf60b3. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:56.033046 10911 raft_consensus.cc:493] T 5f560ed7ea0c4075bad1375d86738861 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:56.033325 10911 raft_consensus.cc:515] T 5f560ed7ea0c4075bad1375d86738861 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.033392 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d7c165d2c465d9080b927d54807f7" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:56.033970 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b59942eba1014659b6f601e74d53d880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.034168 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b6b17ce3354600b2f7450c6e483c69. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:56.034174 9611 leader_election.cc:343] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:56.034386 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5aaedde75d54341a87764c6e89a03d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.035115 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc41ad892a247848f5d2c1a0d3333ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.036383 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 749cea5cd8f842b891f4e2cab07c054e (DEFAULT_TABLE table=default.Table_eac904f0d8d945b3ab2e659358f3a485 [id=d319e3ece21e44b1860258156ffa0f72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.037837 9660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 676004738985441985278313d6064530. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.038498 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18ed05a1eb4a4f6e9a7284caaa0bba05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.038825 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 381) took 1187 ms. Trace:
I20260810 19:47:56.039053 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 305) took 3078 ms. Trace:
I20260810 19:47:56.039261 10371 rpcz_store.cc:276] 0810 19:47:54.851278 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:54.851367 (+ 89us) service_pool.cc:224] Handling call
0810 19:47:56.029158 (+1177791us) ts_tablet_manager.cc:1151] Deleting tablet 827dce05c192467589e2692fabd2a84e
0810 19:47:56.029265 (+ 107us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:56.038601 (+ 9336us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1177476}
W20260810 19:47:56.040728 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 827dce05c192467589e2692fabd2a84e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 827dce05c192467589e2692fabd2a84e already in progress: creating tablet
I20260810 19:47:56.042142 10371 tablet_replica.cc:333] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:56.043181 11260 leader_election.cc:290] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:56.043212 10371 raft_consensus.cc:2243] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:56.045535 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fafad8559b074dab958f03061e65b8c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.049031 10366 tablet_bootstrap.cc:492] T 81720b897a674b5380c6469d1600a979 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:56.049476 9897 tablet_service.cc:1511] Processing CreateTablet for tablet a2fe67e8bd014acaa202c022c193cdc6 (DEFAULT_TABLE table=default.Table_9374c1b5d0ce4ebc9ca6f086b49f9778 [id=3b14f80137654337b24c2bb4131e58d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.051009 10375 rpcz_store.cc:276] 0810 19:47:52.952003 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.952069 (+ 66us) service_pool.cc:224] Handling call
0810 19:47:56.028437 (+3076368us) ts_tablet_manager.cc:1151] Deleting tablet 21208dd824fe432fa307cbb88d37aaa2
0810 19:47:56.028452 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:56.030413 (+ 1961us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3075960}
I20260810 19:47:56.051529 10375 tablet_replica.cc:333] T 38ee7973736c4a0a921261d37b74f290 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:56.051802 10375 raft_consensus.cc:2243] T 38ee7973736c4a0a921261d37b74f290 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:56.052037 10375 raft_consensus.cc:2272] T 38ee7973736c4a0a921261d37b74f290 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:56.052727 10375 ts_tablet_manager.cc:1916] T 38ee7973736c4a0a921261d37b74f290 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:56.058066 10116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0292c3214aa84c40ace16760f414d912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.059914 10911 leader_election.cc:290] T 5f560ed7ea0c4075bad1375d86738861 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:56.065443 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38b0c6a017dc4afc849090cca7ee8b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.068382 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48eee4ce10114021855075812e356652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.068949 10370 tablet_bootstrap.cc:492] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:56.072382 9709 raft_consensus.cc:2393] T dad16ea0f82942de8587dd7c98c0d2df P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eadde59fd6504d679e47f03a60c64bb0 in current term 1: Already voted for candidate 6986ed920dcb4af29a5eeeda6f671691 in this term.
I20260810 19:47:56.073973 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 7d939e3df62a45d9a964d4df01be4bfb (DEFAULT_TABLE table=default.Table_65f4c2fb3d1c49ae9cdfc041e51bd182 [id=2292ed1c178a4d458f52885e45c76d41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.077706 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18ed05a1eb4a4f6e9a7284caaa0bba05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.081444 10366 ts_tablet_manager.cc:1403] T 81720b897a674b5380c6469d1600a979 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.667s user 0.001s sys 0.027s
I20260810 19:47:56.081578 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_34c6844eadfe492e86d60e0326815185" } new_table_name: "default.Table_b1dee343716e4e969055ae6ed5d93b60" modify_external_catalogs: true
I20260810 19:47:56.090111 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e218d405fb7e4196ab4d6439b8092138" } new_table_name: "default.Table_5f86aedb4db8406090f1dd83566d57f8" modify_external_catalogs: true
I20260810 19:47:56.091302 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66acbafdcc8540368693c8f463b41752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.092934 10370 ts_tablet_manager.cc:1403] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.510s user 0.023s sys 0.033s
I20260810 19:47:56.093976 10370 raft_consensus.cc:359] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.094239 10370 raft_consensus.cc:385] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:56.094370 10370 raft_consensus.cc:740] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:56.094653 10370 consensus_queue.cc:260] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.095213 10370 ts_tablet_manager.cc:1434] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 19:47:56.095570 10370 tablet_bootstrap.cc:492] T 3badc88d94a34ff7a053ed312f0dd646 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:47:56.098346 10068 leader_election.cc:343] T 5f560ed7ea0c4075bad1375d86738861 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 5f560ed7ea0c4075bad1375d86738861
I20260810 19:47:56.102973 10134 tablet_service.cc:1511] Processing CreateTablet for tablet eb3e7d34b5314bc7a7c5ed53792728ca (DEFAULT_TABLE table=default.Table_8a225580c44c484c97bef032a300c69b [id=64e2bbcc84434e268763f4ee1acc851d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:56.106581 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 15c070c23de34348ad3426c894e11022 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15c070c23de34348ad3426c894e11022 already in progress: creating tablet
W20260810 19:47:56.106959 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet d99b34f901484fad87cff4bb9ab56fc8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d99b34f901484fad87cff4bb9ab56fc8 already in progress: creating tablet
W20260810 19:47:56.107240 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 0dd49d6fa79e4677b753b6cf9117b02d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0dd49d6fa79e4677b753b6cf9117b02d already in progress: creating tablet
I20260810 19:47:56.108399 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2c45b8ef81f94485a39df1d41c96f9a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:56.109066 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c45b8ef81f94485a39df1d41c96f9a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:56.111722 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d939e3df62a45d9a964d4df01be4bfb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:56.112696 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 21208dd824fe432fa307cbb88d37aaa2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21208dd824fe432fa307cbb88d37aaa2 already in progress: creating tablet
I20260810 19:47:56.113981 9948 raft_consensus.cc:3060] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:56.114452 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad16ea0f82942de8587dd7c98c0d2df" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:56.115159 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ed73161398f4f54a20a9173c18b4d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.116729 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842a5dacf9d145889e97069d3c8084b8" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:56.113570 10120 tablet_service.cc:1511] Processing CreateTablet for tablet 749cea5cd8f842b891f4e2cab07c054e (DEFAULT_TABLE table=default.Table_eac904f0d8d945b3ab2e659358f3a485 [id=d319e3ece21e44b1860258156ffa0f72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.123359 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb3e7d34b5314bc7a7c5ed53792728ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.124855 10166 raft_consensus.cc:3060] T 842a5dacf9d145889e97069d3c8084b8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:56.125764 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c8699875b54be888b3128df1b673aa" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:56.118240 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 985440898cc04a98877c15a5122a7dd3 (DEFAULT_TABLE table=default.Table_1d3d54acd6074609919e2db8b3c01576 [id=e974ea8378194b808889a3255371374e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:56.133596 9395 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 971e9abee86444a7a9e923b0962ae751 (table default.Table_64e5558a29af405b85912f54bebdf3be [id=f3f4d6ebcacf43489369bd8f742a0631], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 971e9abee86444a7a9e923b0962ae751 consensus state has no leader
W20260810 19:47:56.134258 9831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 246334us
W20260810 19:47:56.136135 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5e47086440ef4a249f1eed23db655879 consensus state has no leader
W20260810 19:47:56.137744 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b91737c2129e4ca385b4e1c8999c62b4 has no consensus state
I20260810 19:47:56.140008 9416 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 4d654dada92a4939914d26ab72a5f5e8 (table default.Table_551b211882fd4d67ba96228b8f0826e1 [id=a8bdf6ea608f4279971af4c9eff71db6]). Expected version 2 got 1
I20260810 19:47:56.140295 9416 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5 (table default.Table_b46992ec81974f6caad1ea769640dcf1 [id=d6d2d95e5e9f4e10a7d5a8153e66e4b6]). Expected version 2 got 0
I20260810 19:47:56.145941 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c4fa695c16634a2382811d87f8b8224b" } modify_external_catalogs: true
I20260810 19:47:56.146500 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c4fa695c16634a2382811d87f8b8224b" } modify_external_catalogs: true
I20260810 19:47:56.147825 10371 raft_consensus.cc:2272] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:56.151315 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_39297078d5434aed9d01e90ff26623c8" } modify_external_catalogs: true
I20260810 19:47:56.151525 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_39297078d5434aed9d01e90ff26623c8" } modify_external_catalogs: true
I20260810 19:47:56.155241 9946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f560ed7ea0c4075bad1375d86738861" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:56.156417 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_5e59db5efe264421a5f3455e9aa63c62"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:56.156374 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_fe3c84ad30eb4d57a6d20ec860c02286"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:56.156997 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe3c84ad30eb4d57a6d20ec860c02286 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:56.157161 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48eee4ce10114021855075812e356652. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:56.156997 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e59db5efe264421a5f3455e9aa63c62 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:56.158602 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ff8803fe033d45a79877574c5f39b756" } new_table_name: "default.Table_6487065cb4a442eebc88bd267aede484" modify_external_catalogs: true
I20260810 19:47:56.159901 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c5eab30c1c344809be5b1289a88d2ca3" } modify_external_catalogs: true
I20260810 19:47:56.160101 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c5eab30c1c344809be5b1289a88d2ca3" } modify_external_catalogs: true
I20260810 19:47:56.166157 11295 raft_consensus.cc:493] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:56.167928 9946 raft_consensus.cc:2393] T 5f560ed7ea0c4075bad1375d86738861 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eadde59fd6504d679e47f03a60c64bb0 in current term 1: Already voted for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in this term.
I20260810 19:47:56.170369 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c8699875b54be888b3128df1b673aa" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:56.170826 11267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s user 0.002s sys 0.032s
W20260810 19:47:56.171797 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 18ed05a1eb4a4f6e9a7284caaa0bba05 consensus state has no leader
I20260810 19:47:56.174144 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_18e99ebc486045feb7406931bba3b281" } new_table_name: "default.Table_ad4523adf6cb4df7948a357515ec4b9a" modify_external_catalogs: true
I20260810 19:47:56.179026 10370 tablet_bootstrap.cc:654] T 3badc88d94a34ff7a053ed312f0dd646 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:56.181171 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5043edeafbb047c6a7619f91323879c2" } modify_external_catalogs: true
I20260810 19:47:56.181411 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5043edeafbb047c6a7619f91323879c2" } modify_external_catalogs: true
I20260810 19:47:56.182924 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 83b19479978c46bf8a425ccf1225ef45 (DEFAULT_TABLE table=default.Table_b69402d23c6840e2955cfc41a73beb92 [id=bd770ee1a53e4a69b0c60287165c7b46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.183265 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3754889e4574fc3a936ac31cc6f496a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:56.184476 11267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s user 0.002s sys 0.032s
I20260810 19:47:56.184676 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 05059ef70a8e440ca2988bfeb610645d
I20260810 19:47:56.185961 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet eb3e7d34b5314bc7a7c5ed53792728ca
W20260810 19:47:56.186758 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5aa0f24443a34714a44137a77c12bbc3 consensus state has no leader
I20260810 19:47:56.189018 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 1f895bcd21f647f2ab813903d600a31a
W20260810 19:47:56.190294 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a776693b6b4943a7b64e13ec10958c16 consensus state has no leader
I20260810 19:47:56.176754 11295 raft_consensus.cc:515] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.192258 9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87bbcc651d034e2a826478b805792e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.192751 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c8699875b54be888b3128df1b673aa" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:56.193006 9715 raft_consensus.cc:3060] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:56.193626 9709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d7c165d2c465d9080b927d54807f7" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:56.193872 9709 raft_consensus.cc:2468] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:56.202569 9664 tablet_service.cc:1511] Processing CreateTablet for tablet b8a7c2857add422281542e7f187979ab (DEFAULT_TABLE table=default.Table_f0a3683ed3074e529e9eff3dc1509f6d [id=f3ba4de841d44fbeaefab0db4c4a6a9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.203157 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8a7c2857add422281542e7f187979ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.205329 10367 tablet_bootstrap.cc:492] T 6f0150de0d60425b807be532ce0ba6c3 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:56.204981 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2502bd78450e4b1b940e7f64a514dc85" } modify_external_catalogs: true
I20260810 19:47:56.205969 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 05059ef70a8e440ca2988bfeb610645d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:56.206413 9677 tablet_service.cc:1511] Processing CreateTablet for tablet 25570b1795164aeca86a5313bd30a4c9 (DEFAULT_TABLE table=default.Table_4e0b9ea93b4e4164a3580c481782f8f4 [id=684a4fd9a0674c9ab382b116e5849fff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.206007 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2502bd78450e4b1b940e7f64a514dc85" } modify_external_catalogs: true
I20260810 19:47:56.207165 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 3da297aac2644fcabfcb21769576dca4 (DEFAULT_TABLE table=default.Table_ad2d66c3b58b43b98ceb756a5a078f78 [id=67f177aa933f4f00a3dcab7e11f61624]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.207664 9685 tablet_service.cc:1511] Processing CreateTablet for tablet 27aca44685be4a0b92767d13bad15daf (DEFAULT_TABLE table=default.Table_2d55b7a83d4d4faeb63acf0fd1c205b7 [id=b654f41c9aa74d3cb771ec66358c0473]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.208998 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25570b1795164aeca86a5313bd30a4c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.209152 9420 master_service.cc:960] ReplaceTablet: received request to replace tablet ae3e151180ae4d258d18365770acaaad from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:56.209591 10366 raft_consensus.cc:359] T 81720b897a674b5380c6469d1600a979 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.210671 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 8e8928f23c284477822d1f6308432dec (DEFAULT_TABLE table=default.Table_52a19c74f223463fa626772f18c826bd [id=b0481cad97294373a02773733421d077]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.211182 10367 ts_tablet_manager.cc:1403] T 6f0150de0d60425b807be532ce0ba6c3 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.341s user 0.009s sys 0.000s
I20260810 19:47:56.212016 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81720b897a674b5380c6469d1600a979" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:56.212622 9655 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f895bcd21f647f2ab813903d600a31a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:56.213037 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet eb3e7d34b5314bc7a7c5ed53792728ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:56.213232 11295 leader_election.cc:290] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:56.213722 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da297aac2644fcabfcb21769576dca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.214601 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e8928f23c284477822d1f6308432dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.216058 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 7add2dae2d1b4e8b9b95348e0334ba03 (DEFAULT_TABLE table=default.Table_06a146e0e459439cba25bc9eaf210b12 [id=6be2a52358f04826b4fd3f0941693b42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.216526 9685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27aca44685be4a0b92767d13bad15daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.217823 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7add2dae2d1b4e8b9b95348e0334ba03. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:56.218436 9611 leader_election.cc:343] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:56.218884 9655 tablet_service.cc:1511] Processing CreateTablet for tablet c9e2dbef6e7a48caa2964ab90fbf9b73 (DEFAULT_TABLE table=default.Table_0fa5ed82975d484a938aba25478b3c40 [id=91f4f92ca1804c5f866e3a6cdc8d5d30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.219630 10366 raft_consensus.cc:385] T 81720b897a674b5380c6469d1600a979 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:56.219791 9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9e2dbef6e7a48caa2964ab90fbf9b73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.220248 10377 ts_tablet_manager.cc:1929] T 860dbb6d0a004c43bdce09075272fa70 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:56.220587 9659 tablet_service.cc:1511] Processing CreateTablet for tablet b91737c2129e4ca385b4e1c8999c62b4 (DEFAULT_TABLE table=default.Table_b1dee343716e4e969055ae6ed5d93b60 [id=9a1f9fb7aee041a2a8b5cc736d74eaa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.221318 9659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91737c2129e4ca385b4e1c8999c62b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.221457 9898 tablet_service.cc:1511] Processing CreateTablet for tablet b59942eba1014659b6f601e74d53d880 (DEFAULT_TABLE table=default.Table_bd4c6fb49b17455592e347e1b07993b0 [id=cbf4bd478b75444e92d25287f6491bf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.226346 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 749cea5cd8f842b891f4e2cab07c054e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.227090 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 0e967384768b4ec7956f1b508e8ab2af
I20260810 19:47:56.228426 10377 log.cc:1199] T 860dbb6d0a004c43bdce09075272fa70 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/860dbb6d0a004c43bdce09075272fa70
I20260810 19:47:56.232560 10142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59a767c91abf45e79cebab582525ad2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.235374 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet ae3e151180ae4d258d18365770acaaad
I20260810 19:47:56.236011 9420 catalog_manager.cc:6807] ReplaceTablet: tablet ae3e151180ae4d258d18365770acaaad deleted and replaced by tablet 6dea3165feb842ecb58b7ace235abf38
I20260810 19:47:56.236327 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b59942eba1014659b6f601e74d53d880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.237227 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 55fb03a8dd3b40f5ba3de41fa7c01f5d (DEFAULT_TABLE table=default.Table_1c98bf082e38462a83cbf3d6850868b3 [id=b915a5fccb7c46a68ea7f5df2b5cf5ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.237766 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55fb03a8dd3b40f5ba3de41fa7c01f5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.241119 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 7de27c3442584746b76ea838d38f0b9b (DEFAULT_TABLE table=default.Table_60e8f95672f048c5afa43569031f3d12 [id=f76de132787a49c6af75b9fe63be9d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.241545 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7de27c3442584746b76ea838d38f0b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.242957 10366 raft_consensus.cc:740] T 81720b897a674b5380c6469d1600a979 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
W20260810 19:47:56.247735 11381 log.cc:927] Time spent T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691: Append to log took a long time: real 0.053s user 0.000s sys 0.000s
I20260810 19:47:56.247771 9946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d7c165d2c465d9080b927d54807f7" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:56.248076 9946 raft_consensus.cc:2468] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:56.250152 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 749cea5cd8f842b891f4e2cab07c054e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.251065 10119 tablet_service.cc:1511] Processing CreateTablet for tablet b3754889e4574fc3a936ac31cc6f496a (DEFAULT_TABLE table=default.Table_33028416824c4623be1af7797d6d605a [id=ab67d2215d85456cb3100985ad22b894]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.254935 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 87bbcc651d034e2a826478b805792e48 (DEFAULT_TABLE table=default.Table_07cbcdfa939f47f0a8f10f834f5ce596 [id=51fc4051f8ac425e9b6b5f86acf32827]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.256824 9715 raft_consensus.cc:2468] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:56.257656 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d7c165d2c465d9080b927d54807f7" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:56.258253 10136 tablet_service.cc:1511] Processing CreateTablet for tablet deeb390ae00646089e9f1d453ddb54a1 (DEFAULT_TABLE table=default.Table_f1f332ce5d104c2b889c1faf78a0510f [id=a5becac787b84d398e96784d005d21f6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:56.259080 10067 leader_election.cc:343] T e4a92eb8626f465caf563b72598a685f P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: e4a92eb8626f465caf563b72598a685f
I20260810 19:47:56.259351 10067 leader_election.cc:304] T e4a92eb8626f465caf563b72598a685f P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:56.261188 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 3159795344ae492fb099fca0e52fcf20 (DEFAULT_TABLE table=default.Table_d9ae7658a1f24bd8aa85ffbc2ac9ee0f [id=f13bcadbcbc14466907b2850e5dce367]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.261662 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3159795344ae492fb099fca0e52fcf20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.263664 10377 ts_tablet_manager.cc:1950] T 860dbb6d0a004c43bdce09075272fa70 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:56.265559 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_cb085f4d70f74c8885b3f837c4c94501"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:56.266258 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb085f4d70f74c8885b3f837c4c94501 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:56.268155 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c90bd097f5db43c6aefde84c1a39aa3a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:56.268823 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c90bd097f5db43c6aefde84c1a39aa3a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:56.270092 10366 consensus_queue.cc:260] T 81720b897a674b5380c6469d1600a979 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.272665 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 18ed05a1eb4a4f6e9a7284caaa0bba05 (DEFAULT_TABLE table=default.Table_e218d405fb7e4196ab4d6439b8092138 [id=04cfb59bcc4e460f9063fe742900ba92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.276561 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e7191b05092d4bb3873107f5e514dcba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:56.277240 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7191b05092d4bb3873107f5e514dcba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:56.277482 9677 tablet_service.cc:1511] Processing CreateTablet for tablet 5a35be79a8924213ab860a9da04a598c (DEFAULT_TABLE table=default.Table_dca6b457fbf744e089c4a583fca06cbb [id=4bce0610a04641ff86ab3af94e12e31d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.278008 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a35be79a8924213ab860a9da04a598c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.278277 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73abedd88ba548bdb5a23f508b77403d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.287566 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet 3680db3f1a5945a89c1198eb4849e58c from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:56.306550 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 3680db3f1a5945a89c1198eb4849e58c
I20260810 19:47:56.307135 9410 catalog_manager.cc:6807] ReplaceTablet: tablet 3680db3f1a5945a89c1198eb4849e58c deleted and replaced by tablet 33f2ea0d46f44fca88e16ea83ad67bc2
I20260810 19:47:56.311995 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e967384768b4ec7956f1b508e8ab2af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:56.313396 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83b19479978c46bf8a425ccf1225ef45. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:56.315243 9830 leader_election.cc:343] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:56.318490 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 39885c3e0adb4132945d507628f4f082
I20260810 19:47:56.318897 9830 leader_election.cc:304] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:56.319345 9665 tablet_service.cc:1511] Processing CreateTablet for tablet 3109703c51e54af78b58e9bbca50af33 (DEFAULT_TABLE table=default.Table_b3ebb4935f244802a7b2b6e1a33cb904 [id=0c0d86100d3444bbafc7f7def5c5a317]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.322216 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59a767c91abf45e79cebab582525ad2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.322134 9663 tablet_service.cc:1511] Processing CreateTablet for tablet f42e9b00e3da4d73b4beb1b325f09f4a (DEFAULT_TABLE table=default.Table_cadbbfe4f5d04095b599c4f15a26eae5 [id=5969227134794b0da0ce049c943e7151]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.322861 9668 tablet_service.cc:1511] Processing CreateTablet for tablet ea557438b7b74944b19e17d7fb8f20cf (DEFAULT_TABLE table=default.Table_2127777800d84906905aac5e1b9eaf64 [id=310d071d99754287862ab16b28a0b5cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.325364 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet ae3e151180ae4d258d18365770acaaad with delete_type TABLET_DATA_DELETED (replaced by tablet 6dea3165feb842ecb58b7ace235abf38) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:56.325812 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 6f4b5c6d5bd14c59b3cd3f8ee00a3301 (DEFAULT_TABLE table=default.Table_7984b3459b7c46eab35b53ef578aa0a9 [id=4bf40870a0554fb9b04a1f7cc8f87d85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.327848 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 676004738985441985278313d6064530 (DEFAULT_TABLE table=default.Table_2d7f246476ac4544a3fa089ec3c52657 [id=c681008d2b5f43a9b7b6ed2d72653b1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.328924 10367 raft_consensus.cc:359] T 6f0150de0d60425b807be532ce0ba6c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.331437 10366 ts_tablet_manager.cc:1434] T 81720b897a674b5380c6469d1600a979 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.233s user 0.002s sys 0.002s
I20260810 19:47:56.338291 9667 tablet_service.cc:1511] Processing CreateTablet for tablet a776693b6b4943a7b64e13ec10958c16 (DEFAULT_TABLE table=default.Table_ad4523adf6cb4df7948a357515ec4b9a [id=632c2c289ff24ddcbf9d13ffe1fcda15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.341049 10367 raft_consensus.cc:385] T 6f0150de0d60425b807be532ce0ba6c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:56.343129 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3109703c51e54af78b58e9bbca50af33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.345291 9831 leader_election.cc:304] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:56.346203 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deeb390ae00646089e9f1d453ddb54a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.346618 11267 raft_consensus.cc:2749] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:56.353039 9669 tablet_service.cc:1511] Processing CreateTablet for tablet e87fd882e6b6413480a0cb06aee74722 (DEFAULT_TABLE table=default.Table_f90f1a0c22fa4781812518f44c9d7b17 [id=d12cb82567fd409988672b04a2e05a5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.354204 10367 raft_consensus.cc:740] T 6f0150de0d60425b807be532ce0ba6c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:56.354586 10367 consensus_queue.cc:260] T 6f0150de0d60425b807be532ce0ba6c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.355501 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea557438b7b74944b19e17d7fb8f20cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.356178 10367 ts_tablet_manager.cc:1434] T 6f0150de0d60425b807be532ce0ba6c3 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.144s user 0.003s sys 0.000s
I20260810 19:47:56.356715 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a776693b6b4943a7b64e13ec10958c16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.361685 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 676004738985441985278313d6064530. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.362046 10366 tablet_bootstrap.cc:492] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:56.369102 9658 tablet_service.cc:1511] Processing CreateTablet for tablet cb2c9782c034435088f991bef8edf288 (DEFAULT_TABLE table=default.Table_9a949158a5f2417ea8f015281b20659a [id=8763b964126e48ba85394844a7628795]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.371534 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f4b5c6d5bd14c59b3cd3f8ee00a3301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.372093 10367 tablet_bootstrap.cc:492] T 11272d47d96f443187d63c184049871f P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
W20260810 19:47:56.379202 9673 consensus_meta.cc:287] T b3754889e4574fc3a936ac31cc6f496a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent flushing consensus metadata: real 0.525s user 0.008s sys 0.000s
I20260810 19:47:56.380788 9663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f42e9b00e3da4d73b4beb1b325f09f4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.385960 10371 ts_tablet_manager.cc:1916] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:56.389585 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 3680db3f1a5945a89c1198eb4849e58c with delete_type TABLET_DATA_DELETED (replaced by tablet 33f2ea0d46f44fca88e16ea83ad67bc2) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:56.389959 9831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 84872.7us
I20260810 19:47:56.403820 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2c9782c034435088f991bef8edf288. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:56.344899 9830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.195:43797, user_credentials={real_user=slave}} blocked reactor thread for 207754us
I20260810 19:47:56.408696 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 269adfeb1efe46d3944f33b245126665 (DEFAULT_TABLE table=default.Table_4ec3ace539c444e08c5e84fff6a6f919 [id=b7a9d407c9d74d0c8fd85c1d8498c3f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.414526 9831 leader_election.cc:304] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:56.414647 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e87fd882e6b6413480a0cb06aee74722. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.415357 9946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81720b897a674b5380c6469d1600a979" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:56.415604 9946 raft_consensus.cc:2468] T 81720b897a674b5380c6469d1600a979 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:56.416270 9906 tablet_service.cc:1511] Processing CreateTablet for tablet d5aaedde75d54341a87764c6e89a03d6 (DEFAULT_TABLE table=default.Table_45a851a9919d48ad94da86574312fb58 [id=4a442dde52a84379bc58bc03c3e80beb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.416923 9611 leader_election.cc:304] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:56.416988 11267 raft_consensus.cc:2804] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:56.417269 11267 raft_consensus.cc:697] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:47:56.417572 11267 consensus_queue.cc:237] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.420135 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 860dbb6d0a004c43bdce09075272fa70 (table default.Table_c86a4dc697bd4628bba90b74b908b5f9 [id=097f014eed014a6782f331bf23f6b2f2]) successfully deleted
W20260810 19:47:56.420477 9395 catalog_manager.cc:5017] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 46005eead530459eb2b636ae0a6767ad because the tablet was not found. No further retry: Not found: Tablet not found: 46005eead530459eb2b636ae0a6767ad
I20260810 19:47:56.420641 11410 raft_consensus.cc:2804] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260810 19:47:56.421195 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet dcb3660108094399b36d19ea8e6b8308 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dcb3660108094399b36d19ea8e6b8308 already in progress: creating tablet
I20260810 19:47:56.419410 11295 raft_consensus.cc:2804] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:56.424008 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5aaedde75d54341a87764c6e89a03d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.417479 9611 leader_election.cc:304] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:56.425034 11295 raft_consensus.cc:493] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260810 19:47:56.425302 11415 log.cc:927] Time spent T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691: Append to log took a long time: real 0.072s user 0.000s sys 0.000s
I20260810 19:47:56.426390 11412 consensus_queue.cc:1048] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260810 19:47:56.426440 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc41ad892a247848f5d2c1a0d3333ef (DEFAULT_TABLE table=default.Table_717c8249c368451e88c10baf2240d27f [id=6aa7b61a3c6a419b8581e359ded42a50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.432031 11295 raft_consensus.cc:3060] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:56.436661 11295 raft_consensus.cc:515] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.442011 11410 raft_consensus.cc:493] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:56.443819 11410 raft_consensus.cc:3060] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:56.444487 9885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0292c3214aa84c40ace16760f414d912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.448279 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc41ad892a247848f5d2c1a0d3333ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.454926 11295 leader_election.cc:290] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:56.456521 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985440898cc04a98877c15a5122a7dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.457276 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 269adfeb1efe46d3944f33b245126665. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.458739 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2fe67e8bd014acaa202c022c193cdc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.454125 9902 tablet_service.cc:1511] Processing CreateTablet for tablet b54feebc7c9841d89808054602be7913 (DEFAULT_TABLE table=default.Table_a8eaabc9d0ef45729c9a7e9301083b99 [id=7dc6f3ec58a44497bab92e1853cdb894]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.475418 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 39885c3e0adb4132945d507628f4f082 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:56.477470 11295 raft_consensus.cc:2804] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:56.478226 11295 raft_consensus.cc:493] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:56.478466 11295 raft_consensus.cc:3060] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:47:56.480437 9611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 62853.6us
I20260810 19:47:56.481873 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_fdb9a22aaf1046c7b949a64abb7f2fd5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:56.482628 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fdb9a22aaf1046c7b949a64abb7f2fd5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:56.483701 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ae8fab9298ca4fa2bfe18cc16b490c48" } new_table_name: "default.Table_074b5c424ed1463598daa05a715c76e6" modify_external_catalogs: true
I20260810 19:47:56.484357 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_562588ac5f0a40bb9639dc6131e4f151"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:56.484993 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_562588ac5f0a40bb9639dc6131e4f151 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:56.485416 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0b65da1621cf4a15bbb947263cbef587"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:56.486261 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2b214fd57f394b5bae33becc3b1439b3" } new_table_name: "default.Table_b1aaf42f1f01402f9f92aabf33808cd4" modify_external_catalogs: true
W20260810 19:47:56.486519 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b65da1621cf4a15bbb947263cbef587 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:56.487007 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_225d70cd8d7c4166ac7b297939047aed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:56.487538 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_225d70cd8d7c4166ac7b297939047aed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:56.487596 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0bb7c2bf3cb64b988e69e769ce83ff41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:56.487862 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b2a435ba43114086a5c772c02c7ab120" } new_table_name: "default.Table_08c83fc388864b6f8a1ed597dc70bffe" modify_external_catalogs: true
W20260810 19:47:56.488078 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0bb7c2bf3cb64b988e69e769ce83ff41 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:56.489151 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_11cc4f48379a47908e779ed3c995376a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:56.489773 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11cc4f48379a47908e779ed3c995376a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:56.493443 9896 tablet_service.cc:1511] Processing CreateTablet for tablet fafad8559b074dab958f03061e65b8c3 (DEFAULT_TABLE table=default.Table_8376743094a548beba588e486d56d283 [id=b1c1f3f8b5a64a7597e09eaf29ee995f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.508620 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f0150de0d60425b807be532ce0ba6c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:56.515292 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9b567b3338845e4a37cff2a955056ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.518996 10367 tablet_bootstrap.cc:654] T 11272d47d96f443187d63c184049871f P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:56.519972 9673 tablet_service.cc:1511] Processing CreateTablet for tablet f5fa6060b9ef48cea6830cd9d19424ea (DEFAULT_TABLE table=default.Table_9d569d756be84460b1b78812a13b95ad [id=14e993ddf3b646098d6d3a3e24d01b07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.520401 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 7d939e3df62a45d9a964d4df01be4bfb (DEFAULT_TABLE table=default.Table_65f4c2fb3d1c49ae9cdfc041e51bd182 [id=2292ed1c178a4d458f52885e45c76d41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.521889 11414 raft_consensus.cc:2749] T e4a92eb8626f465caf563b72598a685f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:56.523399 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5fa6060b9ef48cea6830cd9d19424ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.524089 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_91221657584a43cc936203848d895dab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:56.524787 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91221657584a43cc936203848d895dab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:56.527302 10067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 127893us
I20260810 19:47:56.527362 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d7c165d2c465d9080b927d54807f7" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:56.529838 10140 tablet_service.cc:1511] Processing CreateTablet for tablet a2fe67e8bd014acaa202c022c193cdc6 (DEFAULT_TABLE table=default.Table_9374c1b5d0ce4ebc9ca6f086b49f9778 [id=3b14f80137654337b24c2bb4131e58d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.530381 10166 raft_consensus.cc:3060] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:56.532352 11295 raft_consensus.cc:515] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.533214 11295 leader_election.cc:290] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:56.540051 10067 leader_election.cc:304] T dad16ea0f82942de8587dd7c98c0d2df P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:56.540371 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18ed05a1eb4a4f6e9a7284caaa0bba05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.540715 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87bbcc651d034e2a826478b805792e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.541440 11414 raft_consensus.cc:3060] T dad16ea0f82942de8587dd7c98c0d2df P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:56.544377 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d939e3df62a45d9a964d4df01be4bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.546267 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3754889e4574fc3a936ac31cc6f496a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:56.550026 9611 leader_election.cc:343] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:56.550994 10067 consensus_peers.cc:597] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa457d1f5cf2445eb3d869bc6ecf60b3. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:56.552444 11295 raft_consensus.cc:493] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:56.552928 11295 raft_consensus.cc:515] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.553436 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83b19479978c46bf8a425ccf1225ef45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.554569 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deeb390ae00646089e9f1d453ddb54a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.555917 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81720b897a674b5380c6469d1600a979" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:56.559871 10116 tablet_service.cc:1511] Processing CreateTablet for tablet 985440898cc04a98877c15a5122a7dd3 (DEFAULT_TABLE table=default.Table_1d3d54acd6074609919e2db8b3c01576 [id=e974ea8378194b808889a3255371374e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.567332 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2fe67e8bd014acaa202c022c193cdc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.558032 10067 leader_election.cc:304] T 842a5dacf9d145889e97069d3c8084b8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:56.569850 11404 raft_consensus.cc:2749] T 842a5dacf9d145889e97069d3c8084b8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:56.572187 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f7094d91833544e996949b52a5a24386" } new_table_name: "default.Table_f9e687e842744de19940ff3ddb74dfa1" modify_external_catalogs: true
W20260810 19:47:56.572616 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 38b0c6a017dc4afc849090cca7ee8b26 consensus state has no leader
I20260810 19:47:56.573127 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_39a71ac764f44ae1bb2168baeea4cb85" } new_table_name: "default.Table_b059137abb0e458bbadca41a2f2e8b50" modify_external_catalogs: true
W20260810 19:47:56.573119 9611 leader_election.cc:343] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:56.574682 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9b40fd0d57ea4b71aeef2d66f4958ac8 consensus state has no leader
I20260810 19:47:56.574847 11295 leader_election.cc:290] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:56.575264 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_eac904f0d8d945b3ab2e659358f3a485" } modify_external_catalogs: true
I20260810 19:47:56.575471 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_eac904f0d8d945b3ab2e659358f3a485" } modify_external_catalogs: true
I20260810 19:47:56.576566 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 263a5695e7754b44a64edbda27b42135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.576584 10067 leader_election.cc:304] T 5f560ed7ea0c4075bad1375d86738861 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:56.586093 11410 raft_consensus.cc:515] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.586874 10118 tablet_service.cc:1511] Processing CreateTablet for tablet b59942eba1014659b6f601e74d53d880 (DEFAULT_TABLE table=default.Table_bd4c6fb49b17455592e347e1b07993b0 [id=cbf4bd478b75444e92d25287f6491bf7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:56.588742 9611 consensus_peers.cc:597] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:56.589030 10911 raft_consensus.cc:3060] T 5f560ed7ea0c4075bad1375d86738861 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:56.589417 10116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985440898cc04a98877c15a5122a7dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.595247 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet dad16ea0f82942de8587dd7c98c0d2df with delete_type TABLET_DATA_DELETED (replaced by tablet 4f90707dba6e4a3ab7d4c6c197326411) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:56.598006 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d7c165d2c465d9080b927d54807f7" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:56.597918 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81720b897a674b5380c6469d1600a979" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:56.598245 9944 raft_consensus.cc:3060] T 81720b897a674b5380c6469d1600a979 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:56.598644 10371 ts_tablet_manager.cc:1929] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:56.598793 10371 log.cc:1199] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/7b995f3c3bca4501a6c62cf9025051b2
I20260810 19:47:56.599291 10371 ts_tablet_manager.cc:1950] T 7b995f3c3bca4501a6c62cf9025051b2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:56.600154 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 382) took 1438 ms. Trace:
I20260810 19:47:56.600271 10371 rpcz_store.cc:276] 0810 19:47:55.161481 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.161544 (+ 63us) service_pool.cc:224] Handling call
0810 19:47:56.041717 (+880173us) ts_tablet_manager.cc:1151] Deleting tablet 7b995f3c3bca4501a6c62cf9025051b2
0810 19:47:56.041783 (+ 66us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:56.511793 (+470010us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.598518 (+ 86725us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.600115 (+ 1597us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":879842}
I20260810 19:47:56.600840 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b59942eba1014659b6f601e74d53d880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.601468 10367 tablet_bootstrap.cc:492] T 11272d47d96f443187d63c184049871f P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:56.601476 10377 tablet_replica.cc:333] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:56.601740 10367 ts_tablet_manager.cc:1403] T 11272d47d96f443187d63c184049871f P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.242s user 0.005s sys 0.004s
I20260810 19:47:56.601733 10377 raft_consensus.cc:2243] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:56.602020 10377 pending_rounds.cc:70] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691: Trying to abort 1 pending ops.
I20260810 19:47:56.602110 10377 pending_rounds.cc:77] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058664180920320 op_type: NO_OP noop_request { }
I20260810 19:47:56.602257 10377 raft_consensus.cc:2889] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:56.602420 10377 raft_consensus.cc:2272] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:56.602330 10128 tablet_service.cc:1511] Processing CreateTablet for tablet d5aaedde75d54341a87764c6e89a03d6 (DEFAULT_TABLE table=default.Table_45a851a9919d48ad94da86574312fb58 [id=4a442dde52a84379bc58bc03c3e80beb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.602725 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b54feebc7c9841d89808054602be7913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.602795 10367 raft_consensus.cc:359] T 11272d47d96f443187d63c184049871f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.602829 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3395886420455d9bdaf816c19ebae2" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:56.603001 10367 raft_consensus.cc:385] T 11272d47d96f443187d63c184049871f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:56.603071 10367 raft_consensus.cc:740] T 11272d47d96f443187d63c184049871f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:56.603389 10367 consensus_queue.cc:260] T 11272d47d96f443187d63c184049871f P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.603919 10367 ts_tablet_manager.cc:1434] T 11272d47d96f443187d63c184049871f P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 19:47:56.604290 10367 tablet_bootstrap.cc:492] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:56.598284 9948 raft_consensus.cc:2393] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fcd31b1bbb0340cbacfce652b4ad8da4 in current term 1: Already voted for candidate 6986ed920dcb4af29a5eeeda6f671691 in this term.
W20260810 19:47:56.605710 9611 leader_election.cc:343] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:56.606165 10367 tablet_bootstrap.cc:654] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:56.607311 9611 leader_election.cc:304] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:56.613130 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 7b995f3c3bca4501a6c62cf9025051b2 (table default.Table_4b39478b329141c790e4b1160cd6ffc2 [id=b05460b1d468433f9a6501203eb5f4ec]) successfully deleted
I20260810 19:47:56.612773 10377 ts_tablet_manager.cc:1916] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:56.615295 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 3badc88d94a34ff7a053ed312f0dd646 with delete_type TABLET_DATA_DELETED (replaced by tablet b16108d31ced4e02b2d7d0ab1f581a2c) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:56.615126 11426 raft_consensus.cc:2749] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 19:47:56.615329 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_11f7a8e6101542a5935af66211bd2469" } modify_external_catalogs: true
I20260810 19:47:56.615568 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_11f7a8e6101542a5935af66211bd2469" } modify_external_catalogs: true
I20260810 19:47:56.616916 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f560ed7ea0c4075bad1375d86738861 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b2b20dc77954af7a203f357c746be29) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:56.621912 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7459e64bd48449d2a8d4ff835b215d46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.623009 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fafad8559b074dab958f03061e65b8c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.615139 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d7c165d2c465d9080b927d54807f7" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:56.628017 11410 leader_election.cc:290] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:56.627962 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3395886420455d9bdaf816c19ebae2" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:56.630671 9711 raft_consensus.cc:2393] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6986ed920dcb4af29a5eeeda6f671691 in current term 1: Already voted for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in this term.
W20260810 19:47:56.633847 9830 leader_election.cc:343] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:56.636976 9951 raft_consensus.cc:2468] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:56.636986 11260 consensus_queue.cc:1048] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260810 19:47:56.639477 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 3916a976efef43428942135e777edcec with delete_type TABLET_DATA_DELETED (replaced by tablet 988d87b2b00a459d9afc44ba0ae1961e) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:56.640007 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_551b211882fd4d67ba96228b8f0826e1" } modify_external_catalogs: true
I20260810 19:47:56.640246 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_551b211882fd4d67ba96228b8f0826e1" } modify_external_catalogs: true
I20260810 19:47:56.639341 9611 leader_election.cc:304] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:56.641885 11295 raft_consensus.cc:2804] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:56.642051 11295 raft_consensus.cc:493] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:56.642174 11295 raft_consensus.cc:3060] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:56.647797 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_422e53637be84964a1cd4bb082fec236" } modify_external_catalogs: true
I20260810 19:47:56.648051 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_422e53637be84964a1cd4bb082fec236" } modify_external_catalogs: true
W20260810 19:47:56.648334 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 63b649cbc1d141d8bb438105b8e8537c consensus state has no leader
I20260810 19:47:56.648613 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_43667bdf61e944278a0faf9e66d7a1e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:56.648871 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c5352053fa544be884fb272f00bd81f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:56.649238 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43667bdf61e944278a0faf9e66d7a1e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:56.649494 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c5352053fa544be884fb272f00bd81f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:56.650583 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3520274768ed41abb010bb109127affa consensus state has no leader
I20260810 19:47:56.650976 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_090260a0afce4bb5aaf644216af35443"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:56.651453 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_090260a0afce4bb5aaf644216af35443 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:56.655058 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 85f1c7a75aac4d6a9462af4def91eaa4 consensus state has no leader
I20260810 19:47:56.655572 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0a16454a2da548e3a7130a52dbd5143a" } modify_external_catalogs: true
I20260810 19:47:56.655823 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0a16454a2da548e3a7130a52dbd5143a" } modify_external_catalogs: true
I20260810 19:47:56.659466 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 383) took 1492 ms. Trace:
I20260810 19:47:56.661954 9887 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d3395886420455d9bdaf816c19ebae2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:56.660789 10371 rpcz_store.cc:276] 0810 19:47:55.166609 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.166674 (+ 65us) service_pool.cc:224] Handling call
0810 19:47:56.659271 (+1492597us) ts_tablet_manager.cc:1151] Deleting tablet 860dbb6d0a004c43bdce09075272fa70
0810 19:47:56.659287 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:56.659408 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1492333}
I20260810 19:47:56.662303 9887 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b2b20dc77954af7a203f357c746be29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:47:56.662756 9397 catalog_manager.cc:5017] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 860dbb6d0a004c43bdce09075272fa70 because the tablet was not found. No further retry: Not found: Tablet not found: 860dbb6d0a004c43bdce09075272fa70
I20260810 19:47:56.663272 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 386) took 1377 ms. Trace:
I20260810 19:47:56.663414 10371 rpcz_store.cc:276] 0810 19:47:55.285673 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.285736 (+ 63us) service_pool.cc:224] Handling call
0810 19:47:56.663052 (+1377316us) ts_tablet_manager.cc:1151] Deleting tablet 444b49a69c8245b6944a76d53041154c
0810 19:47:56.663064 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:56.663232 (+ 168us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1377062}
W20260810 19:47:56.663929 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 444b49a69c8245b6944a76d53041154c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 444b49a69c8245b6944a76d53041154c already in progress: creating tablet
I20260810 19:47:56.665493 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 4d654dada92a4939914d26ab72a5f5e8
I20260810 19:47:56.666819 9665 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d654dada92a4939914d26ab72a5f5e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:56.666957 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f2d7c165d2c465d9080b927d54807f7 with delete_type TABLET_DATA_DELETED (replaced by tablet 639c824ba4834734a4ebfd558181bebe) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:56.670758 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 389) took 1283 ms. Trace:
I20260810 19:47:56.672595 10371 rpcz_store.cc:276] 0810 19:47:55.386849 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.387162 (+ 313us) service_pool.cc:224] Handling call
0810 19:47:56.670548 (+1283386us) ts_tablet_manager.cc:1151] Deleting tablet 5654c48929564a96a55ed0444c9e1a04
0810 19:47:56.670564 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:56.670713 (+ 149us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1282460}
I20260810 19:47:56.674825 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d93821ff46a4096a8ebbac83faabed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.671059 11295 raft_consensus.cc:515] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.676623 11295 leader_election.cc:290] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:47:56.677208 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 5654c48929564a96a55ed0444c9e1a04 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5654c48929564a96a55ed0444c9e1a04 already in progress: creating tablet
I20260810 19:47:56.677781 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 390) took 1245 ms. Trace:
I20260810 19:47:56.678287 10371 rpcz_store.cc:276] 0810 19:47:55.432757 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.432845 (+ 88us) service_pool.cc:224] Handling call
0810 19:47:56.677618 (+1244773us) ts_tablet_manager.cc:1151] Deleting tablet 59a767c91abf45e79cebab582525ad2e
0810 19:47:56.677630 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:56.677744 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1239295}
I20260810 19:47:56.679891 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3395886420455d9bdaf816c19ebae2" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
W20260810 19:47:56.681833 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 59a767c91abf45e79cebab582525ad2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59a767c91abf45e79cebab582525ad2e already in progress: creating tablet
I20260810 19:47:56.682385 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 393) took 1223 ms. Trace:
I20260810 19:47:56.682562 10371 rpcz_store.cc:276] 0810 19:47:55.459384 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.459437 (+ 53us) service_pool.cc:224] Handling call
0810 19:47:56.682188 (+1222751us) ts_tablet_manager.cc:1151] Deleting tablet 823bcbb987374ab4b9b0fc3d9d79b571
0810 19:47:56.682199 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:56.682320 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1220172}
I20260810 19:47:56.683390 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bbd3fe2117c42058dc108b5dc18d560. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:56.683856 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 823bcbb987374ab4b9b0fc3d9d79b571 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 823bcbb987374ab4b9b0fc3d9d79b571 already in progress: creating tablet
W20260810 19:47:56.682886 9611 leader_election.cc:343] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:56.684398 10371 tablet_replica.cc:333] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:56.686951 10367 tablet_bootstrap.cc:492] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:56.690827 10367 ts_tablet_manager.cc:1403] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.087s user 0.001s sys 0.005s
I20260810 19:47:56.691828 10367 raft_consensus.cc:359] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.692694 10367 raft_consensus.cc:385] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:56.692865 10367 raft_consensus.cc:740] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:56.693166 10367 consensus_queue.cc:260] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.693815 10367 ts_tablet_manager.cc:1434] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 19:47:56.694036 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5aaedde75d54341a87764c6e89a03d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.694291 10367 tablet_bootstrap.cc:492] T ffc4466b82bd49fcaad30e4d5325c7db P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:56.694674 10371 raft_consensus.cc:2243] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:56.694981 10371 pending_rounds.cc:70] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4: Trying to abort 1 pending ops.
I20260810 19:47:56.694953 10911 raft_consensus.cc:2749] T 5f560ed7ea0c4075bad1375d86738861 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:56.695075 10371 pending_rounds.cc:77] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058664410427392 op_type: NO_OP noop_request { }
I20260810 19:47:56.695186 10371 raft_consensus.cc:2889] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:56.695315 10371 raft_consensus.cc:2272] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:56.695420 10911 raft_consensus.cc:493] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:56.695669 10911 raft_consensus.cc:515] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.697026 10367 tablet_bootstrap.cc:654] T ffc4466b82bd49fcaad30e4d5325c7db P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:56.700021 10370 tablet_bootstrap.cc:492] T 3badc88d94a34ff7a053ed312f0dd646 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:56.700220 10370 ts_tablet_manager.cc:1403] T 3badc88d94a34ff7a053ed312f0dd646 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.605s user 0.043s sys 0.010s
I20260810 19:47:56.701253 10370 raft_consensus.cc:359] T 3badc88d94a34ff7a053ed312f0dd646 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.707446 10370 raft_consensus.cc:385] T 3badc88d94a34ff7a053ed312f0dd646 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:56.710772 10367 tablet_bootstrap.cc:492] T ffc4466b82bd49fcaad30e4d5325c7db P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:56.711046 10375 ts_tablet_manager.cc:1929] T 38ee7973736c4a0a921261d37b74f290 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:56.711637 9413 catalog_manager.cc:5719] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:47:56.712114 9413 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 10617bdf2eed4dbd8d13ea1821443863 (table default.Table_4502b22ebf5b47e5a0c8e0c3027e3251 [id=f1973d72068847eaabc823653402d194]). Expected version 2 got 0
I20260810 19:47:56.717633 9665 tablet_service.cc:1511] Processing CreateTablet for tablet b853bf6bbc7845bc9cfa6347687582e2 (DEFAULT_TABLE table=default.Table_e7191b05092d4bb3873107f5e514dcba [id=7d69e5bb3bcc4efa9e77162f6316db9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.718170 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b853bf6bbc7845bc9cfa6347687582e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.722711 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 841f58b4e8f7465eaa7fa08629e0bc2a (DEFAULT_TABLE table=default.Table_fe3c84ad30eb4d57a6d20ec860c02286 [id=c401d03820c6453184e1da223c380872]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.723148 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 841f58b4e8f7465eaa7fa08629e0bc2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.723919 10911 leader_election.cc:290] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:56.724243 10371 ts_tablet_manager.cc:1916] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:56.726274 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d72c72f90964f34bbc2232118dc5172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.726739 9664 tablet_service.cc:1511] Processing CreateTablet for tablet c8311ccef92c48b2a94bbb9e9262ea9d (DEFAULT_TABLE table=default.Table_5e59db5efe264421a5f3455e9aa63c62 [id=4b52435931f6482a8c3bca2d0c05bd53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.727183 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8311ccef92c48b2a94bbb9e9262ea9d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:56.727502 9135 external_mini_cluster.cc:1721] Unable to check leaks on /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu pid 9247: Timed out: CheckLeaks RPC to 127.8.235.253:37397 timed out after 1.000s (SENT)
I20260810 19:47:56.727725 9135 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu with pid 9247
I20260810 19:47:56.728376 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a8c87cbca48447fb8212f3f19946380f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:56.729079 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8c87cbca48447fb8212f3f19946380f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:56.729815 10370 raft_consensus.cc:740] T 3badc88d94a34ff7a053ed312f0dd646 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:56.730713 9677 tablet_service.cc:1511] Processing CreateTablet for tablet 0849ea9c04104a8184f8a8cd40e06fc2 (DEFAULT_TABLE table=default.Table_2c45b8ef81f94485a39df1d41c96f9a6 [id=061ee47a7ec24c2389a57b68997bff51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.731149 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0849ea9c04104a8184f8a8cd40e06fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.731120 10370 consensus_queue.cc:260] T 3badc88d94a34ff7a053ed312f0dd646 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.737746 11414 raft_consensus.cc:2749] T dad16ea0f82942de8587dd7c98c0d2df P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:56.747548 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 60e99cd75ada470380ab69da60ddac77 (DEFAULT_TABLE table=default.Table_f11b6cec3ddf4b339b5f90841b7b3d8b [id=e872b31132a34cf5bd9a65bde184c182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.748096 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60e99cd75ada470380ab69da60ddac77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.752002 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 22954e727fb44a24bd382b9caee9996b (DEFAULT_TABLE table=default.Table_a16400f647e94437932730ebd220e795 [id=1fee039754f440c398b5d2297eb89999]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.749801 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8e8e1b5f3f452f8fdfe5a42fd021a5" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:56.753144 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22954e727fb44a24bd382b9caee9996b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.757433 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 8d93821ff46a4096a8ebbac83faabed7
I20260810 19:47:56.757562 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 4579a71f8c8149798eb5f136135e5efe (DEFAULT_TABLE table=default.Table_90f1232af7064dc2b768da280482a20b [id=8387d76208d54536aab9a8cd1810c7de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.758031 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 48eee4ce10114021855075812e356652
I20260810 19:47:56.758071 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4579a71f8c8149798eb5f136135e5efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.757385 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 229dd737ee8547a89445593cc117fbc2 (DEFAULT_TABLE table=default.Table_bfa0ef28a4704e2589883d5ebd21cb92 [id=df4d2ed4289f45c68927ac7fb7c77f06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.758968 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 229dd737ee8547a89445593cc117fbc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.759809 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d93821ff46a4096a8ebbac83faabed7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:56.760074 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 48eee4ce10114021855075812e356652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:56.760782 10370 ts_tablet_manager.cc:1434] T 3badc88d94a34ff7a053ed312f0dd646 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.045s user 0.003s sys 0.000s
I20260810 19:47:56.765684 10371 ts_tablet_manager.cc:1929] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:56.767371 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 749cea5cd8f842b891f4e2cab07c054e
I20260810 19:47:56.769966 10371 log.cc:1199] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/3badc88d94a34ff7a053ed312f0dd646
W20260810 19:47:56.770076 10069 service_pool.cc:136] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:41610 dropped due to backpressure: service queue is full with 50 items
I20260810 19:47:56.772107 10371 ts_tablet_manager.cc:1950] T 3badc88d94a34ff7a053ed312f0dd646 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:56.770234 10069 service_pool.cc:137] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:41610 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 419)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 420)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 421)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 422)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 423)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 424)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 425)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 426)
Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:41610 (request call id 427)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 428)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 429)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 430)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 431)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 432)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 434)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 433)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 435)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 436)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 437)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 438)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 439)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 440)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 441)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 442)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 443)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 444)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 445)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 446)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 447)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 448)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 449)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 450)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 451)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 452)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 453)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 454)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 455)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 456)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 457)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 458)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 459)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 460)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 461)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 462)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 463)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 464)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 465)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 466)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 467)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 468)
I20260810 19:47:56.774675 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet ee5f38d91bb349a9ae1da8ba69d2ddbc
I20260810 19:47:56.777343 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e7191b05092d4bb3873107f5e514dcba" } new_table_name: "default.Table_606949bc090943c18541d6d8d7f908f9" modify_external_catalogs: true
I20260810 19:47:56.779219 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b42d252a590144aeb51d07c6d59bb5d1" } new_table_name: "default.Table_04364545a7b04d3faff6d4f818a349c0" modify_external_catalogs: true
I20260810 19:47:56.780789 9412 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 10617bdf2eed4dbd8d13ea1821443863 (table default.Table_4502b22ebf5b47e5a0c8e0c3027e3251 [id=f1973d72068847eaabc823653402d194]). Expected version 2 got 0
I20260810 19:47:56.781018 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_586af863bf334719a05f5ace5b1bb407"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:56.781332 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 396) took 1274 ms. Trace:
I20260810 19:47:56.781477 10371 rpcz_store.cc:276] 0810 19:47:55.506675 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.506724 (+ 49us) service_pool.cc:224] Handling call
0810 19:47:56.684320 (+1177596us) ts_tablet_manager.cc:1151] Deleting tablet 3badc88d94a34ff7a053ed312f0dd646
0810 19:47:56.684332 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:56.739795 (+ 55463us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.765573 (+ 25778us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.781274 (+ 15701us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1176928}
W20260810 19:47:56.781697 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_586af863bf334719a05f5ace5b1bb407 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:56.781927 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 397) took 1273 ms. Trace:
I20260810 19:47:56.782042 10371 rpcz_store.cc:276] 0810 19:47:55.508974 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.509022 (+ 48us) service_pool.cc:224] Handling call
0810 19:47:56.781779 (+1272757us) ts_tablet_manager.cc:1151] Deleting tablet 5f560ed7ea0c4075bad1375d86738861
0810 19:47:56.781788 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:56.781890 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1267825}
I20260810 19:47:56.782406 10371 tablet_replica.cc:333] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
W20260810 19:47:56.783237 9395 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:41610 dropped due to backpressure: service queue is full with 50 items
I20260810 19:47:56.783205 10069 service_pool.cc:137] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:41610 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 419)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 420)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 421)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 422)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 423)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 424)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 425)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 426)
Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:41610 (request call id 427)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 428)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 429)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 430)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 431)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 432)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 434)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 433)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 435)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 436)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 437)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 438)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 439)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 440)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 441)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 442)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 443)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 444)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 445)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 446)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 447)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 448)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 449)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 450)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 451)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 452)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 453)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 454)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 455)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 456)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 457)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 458)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 459)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 460)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 461)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 462)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 463)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 464)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 465)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 466)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 467)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 468)
I20260810 19:47:56.788237 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 3badc88d94a34ff7a053ed312f0dd646 (table default.Table_aa9a8825478043949020967cf580deca [id=7a0ce9b2817b49649075fde8c8bf9070]) successfully deleted
I20260810 19:47:56.790290 10370 tablet_bootstrap.cc:492] T 31c8699875b54be888b3128df1b673aa P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:56.790726 10115 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 404) took 1155 ms. Trace:
I20260810 19:47:56.790951 10115 rpcz_store.cc:276] 0810 19:47:55.632542 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.632655 (+ 113us) service_pool.cc:224] Handling call
0810 19:47:55.671417 (+ 38762us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:55.867437 (+196020us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.559091 (+691654us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.764671 (+205580us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:56.787562 (+ 22891us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:56.791751 10115 tablet_service.cc:1511] Processing CreateTablet for tablet 676004738985441985278313d6064530 (DEFAULT_TABLE table=default.Table_2d7f246476ac4544a3fa089ec3c52657 [id=c681008d2b5f43a9b7b6ed2d72653b1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.792623 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 676004738985441985278313d6064530. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.794991 10371 raft_consensus.cc:2243] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:56.796319 10371 raft_consensus.cc:2272] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:56.784986 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet ee5f38d91bb349a9ae1da8ba69d2ddbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:56.797776 10371 ts_tablet_manager.cc:1916] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:56.800118 9412 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 10617bdf2eed4dbd8d13ea1821443863 (table default.Table_4502b22ebf5b47e5a0c8e0c3027e3251 [id=f1973d72068847eaabc823653402d194]). Expected version 2 got 0
I20260810 19:47:56.800432 9412 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5 (table default.Table_b46992ec81974f6caad1ea769640dcf1 [id=d6d2d95e5e9f4e10a7d5a8153e66e4b6]). Expected version 2 got 0
I20260810 19:47:56.804008 10119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 411) took 1162 ms. Trace:
I20260810 19:47:56.804167 10119 rpcz_store.cc:276] 0810 19:47:55.641388 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.248949 (+607561us) service_pool.cc:224] Handling call
0810 19:47:56.251309 (+ 2360us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.251342 (+ 33us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.735881 (+484539us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.803754 (+ 67873us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:56.803946 (+ 192us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260810 19:47:56.804607 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b853bf6bbc7845bc9cfa6347687582e2 consensus state has no leader
I20260810 19:47:56.804785 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc41ad892a247848f5d2c1a0d3333ef (DEFAULT_TABLE table=default.Table_717c8249c368451e88c10baf2240d27f [id=6aa7b61a3c6a419b8581e359ded42a50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.805300 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc41ad892a247848f5d2c1a0d3333ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.807415 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 3916a976efef43428942135e777edcec with delete_type TABLET_DATA_DELETED (replaced by tablet 988d87b2b00a459d9afc44ba0ae1961e) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:56.807520 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 11272d47d96f443187d63c184049871f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:56.807575 10139 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 412) took 1145 ms. Trace:
W20260810 19:47:56.807873 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a45add97e0e54dce85225e175ecbb45a consensus state has no leader
I20260810 19:47:56.810848 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ec077aa44c9b4a918aef07f417121c14"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:56.811685 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec077aa44c9b4a918aef07f417121c14 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:56.812997 10139 rpcz_store.cc:276] 0810 19:47:55.642069 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.249918 (+607849us) service_pool.cc:224] Handling call
0810 19:47:56.500984 (+251066us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.501033 (+ 49us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.698164 (+197131us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.763329 (+ 65165us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:56.787471 (+ 24142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:56.813498 9887 tablet_service.cc:1558] Processing DeleteTablet for tablet a78960e1f2164c848297411b9273ac64 with delete_type TABLET_DATA_DELETED (replaced by tablet fdd82537177a4142bddd0544485b00c4) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:56.813597 10139 tablet_service.cc:1511] Processing CreateTablet for tablet b54feebc7c9841d89808054602be7913 (DEFAULT_TABLE table=default.Table_a8eaabc9d0ef45729c9a7e9301083b99 [id=7dc6f3ec58a44497bab92e1853cdb894]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.813694 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 87bbcc651d034e2a826478b805792e48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:56.814122 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b54feebc7c9841d89808054602be7913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.817037 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 7f4ca5a1ec3d4ca392f389f2dabae296 (DEFAULT_TABLE table=default.Table_5323ce7ca7d04a90811d8058dc7b08ea [id=7725ec1d880744a28616bfc8857bdff1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.817673 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f4ca5a1ec3d4ca392f389f2dabae296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.819787 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b58c92af875943db8e95a856d198aa99"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:56.820497 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b58c92af875943db8e95a856d198aa99 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:56.826134 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 81f0f3f88d26432fbadc5e90aaa5d158 (DEFAULT_TABLE table=default.Table_80a86eb986c5424fb1702c55beb124c1 [id=a779dbb85fac4fd691df7f5ab24b49f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.826655 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f0f3f88d26432fbadc5e90aaa5d158. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:56.826766 9830 leader_election.cc:343] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:56.827128 9830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.195:43797, user_credentials={real_user=slave}} blocked reactor thread for 192835us
W20260810 19:47:56.827596 9830 leader_election.cc:343] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:56.829332 10137 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 414) took 1141 ms. Trace:
I20260810 19:47:56.831710 10125 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 389) took 1240 ms. Trace:
I20260810 19:47:56.832079 10375 log.cc:1199] T 38ee7973736c4a0a921261d37b74f290 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/38ee7973736c4a0a921261d37b74f290
I20260810 19:47:56.832643 10375 ts_tablet_manager.cc:1950] T 38ee7973736c4a0a921261d37b74f290 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:56.835829 10366 tablet_bootstrap.cc:654] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:56.837364 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d90d9c9f6524859a0e33e649dd80f7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:48 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:56.841150 10137 rpcz_store.cc:276] 0810 19:47:55.644370 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.252463 (+608093us) service_pool.cc:224] Handling call
0810 19:47:56.520615 (+268152us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.520640 (+ 25us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.712820 (+192180us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.763444 (+ 50624us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:56.785928 (+ 22484us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2629}
I20260810 19:47:56.845268 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_aa202a92fde548cabef2ed26a3f65999"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:56.845961 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa202a92fde548cabef2ed26a3f65999 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:56.846664 10130 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 395) took 1222 ms. Trace:
I20260810 19:47:56.851217 11412 consensus_queue.cc:1048] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260810 19:47:56.852880 10130 rpcz_store.cc:276] 0810 19:47:55.612315 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.612373 (+ 58us) service_pool.cc:224] Handling call
0810 19:47:55.670655 (+ 58282us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:55.670688 (+ 33us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.703049 (+1032361us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.834456 (+131407us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:56.834621 (+ 165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:56.855428 10140 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 415) took 1199 ms. Trace:
I20260810 19:47:56.855708 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_60e8f95672f048c5afa43569031f3d12" } new_table_name: "default.Table_9eeefa885ca24021833ff2fc5016de3e" modify_external_catalogs: true
I20260810 19:47:56.858579 9887 tablet_service.cc:1558] Processing DeleteTablet for tablet 4198f46be0194875aea6a7952321bc69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:56.859666 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e00c7d0fdf6741b5855eee8cf797b84a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:56.860332 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e00c7d0fdf6741b5855eee8cf797b84a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:56.863756 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_5f48352d6cc34542b53e9d665bef9168"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:56.864241 10135 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 396) took 1242 ms. Trace:
W20260810 19:47:56.864414 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f48352d6cc34542b53e9d665bef9168 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:56.865655 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e1bd107e98074407bc8cbc5a0644d5b6" } new_table_name: "default.Table_2ef5bea5eb994cf689de41a97d978b28" modify_external_catalogs: true
I20260810 19:47:56.850294 11410 consensus_queue.cc:1048] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260810 19:47:56.864822 10125 rpcz_store.cc:276] 0810 19:47:55.591063 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.591282 (+ 219us) service_pool.cc:224] Handling call
0810 19:47:55.868551 (+277269us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:55.868578 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.635860 (+767282us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.831481 (+195621us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:56.831659 (+ 178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:56.865070 10140 rpcz_store.cc:276] 0810 19:47:55.645422 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.501389 (+855967us) service_pool.cc:224] Handling call
0810 19:47:56.530067 (+ 28678us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.530106 (+ 39us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.733572 (+203466us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.839084 (+105512us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:56.844990 (+ 5906us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:56.867029 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4ec3ace539c444e08c5e84fff6a6f919" } new_table_name: "default.Table_696557d30f2f4005b23f9da6ad1f38c4" modify_external_catalogs: true
I20260810 19:47:56.869115 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 82c3f619c76e40c583bfcdf2bb77fe42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:56.869378 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b1aaf42f1f01402f9f92aabf33808cd4" } modify_external_catalogs: true
I20260810 19:47:56.869566 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b1aaf42f1f01402f9f92aabf33808cd4" } modify_external_catalogs: true
I20260810 19:47:56.871261 10137 tablet_service.cc:1511] Processing CreateTablet for tablet fafad8559b074dab958f03061e65b8c3 (DEFAULT_TABLE table=default.Table_8376743094a548beba588e486d56d283 [id=b1c1f3f8b5a64a7597e09eaf29ee995f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.871821 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fafad8559b074dab958f03061e65b8c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.873580 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b2b20dc77954af7a203f357c746be29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:56.881484 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 306) took 3876 ms. Trace:
W20260810 19:47:56.882175 10067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 250661us
I20260810 19:47:56.886085 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_842365768e8f46b9840f02345ae40e42"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:56.886772 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_842365768e8f46b9840f02345ae40e42 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:56.889289 9890 consensus_meta.cc:287] T 2d72c72f90964f34bbc2232118dc5172 P 6986ed920dcb4af29a5eeeda6f671691: Time spent flushing consensus metadata: real 0.667s user 0.010s sys 0.010s
I20260810 19:47:56.891945 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0b398355dcf74f128f892997a49fd5af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:56.892082 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_4d4cbd339a304b6684323ba9e3a91e07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:56.892629 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b398355dcf74f128f892997a49fd5af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:56.898125 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet 87bbcc651d034e2a826478b805792e48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:47:56.898458 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 56fa5de3bf7142b2b0978f9190091f33 consensus state has no leader
I20260810 19:47:56.898507 9944 raft_consensus.cc:2468] T 81720b897a674b5380c6469d1600a979 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
W20260810 19:47:56.898883 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7de27c3442584746b76ea838d38f0b9b consensus state has no leader
W20260810 19:47:56.898940 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 269adfeb1efe46d3944f33b245126665 consensus state has no leader
I20260810 19:47:56.899497 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet dad16ea0f82942de8587dd7c98c0d2df with delete_type TABLET_DATA_DELETED (replaced by tablet 4f90707dba6e4a3ab7d4c6c197326411) from {username='slave'} at 127.0.0.1:41610
W20260810 19:47:56.892624 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d4cbd339a304b6684323ba9e3a91e07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:56.899787 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 4198f46be0194875aea6a7952321bc69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:56.900803 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 45194cae6ea44d9d8cf856d256fd534f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:56.901006 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 82c3f619c76e40c583bfcdf2bb77fe42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:56.901726 10375 rpcz_store.cc:276] 0810 19:47:52.968643 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.969467 (+ 824us) service_pool.cc:224] Handling call
0810 19:47:56.051432 (+3081965us) ts_tablet_manager.cc:1151] Deleting tablet 38ee7973736c4a0a921261d37b74f290
0810 19:47:56.051445 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:56.133318 (+ 81873us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.710944 (+577626us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.845166 (+134222us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3081587}
I20260810 19:47:56.904024 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 9b40fd0d57ea4b71aeef2d66f4958ac8
I20260810 19:47:56.904721 10142 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 400) took 1277 ms. Trace:
I20260810 19:47:56.904944 11404 raft_consensus.cc:493] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:56.907887 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 3109703c51e54af78b58e9bbca50af33 (DEFAULT_TABLE table=default.Table_b3ebb4935f244802a7b2b6e1a33cb904 [id=0c0d86100d3444bbafc7f7def5c5a317]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.912554 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3109703c51e54af78b58e9bbca50af33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.913645 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 45194cae6ea44d9d8cf856d256fd534f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:56.914232 9898 tablet_service.cc:1511] Processing CreateTablet for tablet f42e9b00e3da4d73b4beb1b325f09f4a (DEFAULT_TABLE table=default.Table_cadbbfe4f5d04095b599c4f15a26eae5 [id=5969227134794b0da0ce049c943e7151]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.901552 10069 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:41610 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 432)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 434)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 433)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 435)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 436)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 437)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 438)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 439)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 440)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 441)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 442)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 443)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 444)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 445)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 446)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 447)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 448)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 449)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 450)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 451)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 452)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 453)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 454)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 455)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 456)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 457)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 458)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 459)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 460)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 461)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 462)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 463)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 464)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 465)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 466)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 467)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 468)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 471)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 472)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 473)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 474)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 475)
I20260810 19:47:56.914729 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 73a2e6a512224caa892ac7541131349f (DEFAULT_TABLE table=default.Table_1bc09ade1e7c4459a7ee8927ee4e6873 [id=289a824c00a042669db22936f02b9b97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.915371 10367 ts_tablet_manager.cc:1403] T ffc4466b82bd49fcaad30e4d5325c7db P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.115s user 0.002s sys 0.008s
I20260810 19:47:56.916312 10367 raft_consensus.cc:359] T ffc4466b82bd49fcaad30e4d5325c7db P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.916548 10367 raft_consensus.cc:385] T ffc4466b82bd49fcaad30e4d5325c7db P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:56.916625 10367 raft_consensus.cc:740] T ffc4466b82bd49fcaad30e4d5325c7db P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:56.916878 10367 consensus_queue.cc:260] T ffc4466b82bd49fcaad30e4d5325c7db P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.917484 10367 ts_tablet_manager.cc:1434] T ffc4466b82bd49fcaad30e4d5325c7db P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:47:56.917878 10367 tablet_bootstrap.cc:492] T 06af03c8a87141febef768bd56c72c39 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:56.920794 10135 rpcz_store.cc:276] 0810 19:47:55.622087 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.622154 (+ 67us) service_pool.cc:224] Handling call
0810 19:47:55.670764 (+ 48610us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:55.670794 (+ 30us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.745631 (+1074837us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.864062 (+118431us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:56.864201 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:56.921380 10135 tablet_service.cc:1511] Processing CreateTablet for tablet b91737c2129e4ca385b4e1c8999c62b4 (DEFAULT_TABLE table=default.Table_b1dee343716e4e969055ae6ed5d93b60 [id=9a1f9fb7aee041a2a8b5cc736d74eaa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.921495 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f42e9b00e3da4d73b4beb1b325f09f4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.921831 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91737c2129e4ca385b4e1c8999c62b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.922399 10120 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 407) took 1212 ms. Trace:
I20260810 19:47:56.922577 10120 rpcz_store.cc:276] 0810 19:47:55.636373 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.072947 (+436574us) service_pool.cc:224] Handling call
0810 19:47:56.120867 (+ 47920us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.120898 (+ 31us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.693403 (+572505us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.848700 (+155297us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:56.848869 (+ 169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:56.923213 10120 tablet_service.cc:1511] Processing CreateTablet for tablet f42e9b00e3da4d73b4beb1b325f09f4a (DEFAULT_TABLE table=default.Table_cadbbfe4f5d04095b599c4f15a26eae5 [id=5969227134794b0da0ce049c943e7151]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.923699 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet a78960e1f2164c848297411b9273ac64 with delete_type TABLET_DATA_DELETED (replaced by tablet fdd82537177a4142bddd0544485b00c4) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:56.923993 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3395886420455d9bdaf816c19ebae2" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:56.924152 10140 tablet_service.cc:1511] Processing CreateTablet for tablet 8e8928f23c284477822d1f6308432dec (DEFAULT_TABLE table=default.Table_52a19c74f223463fa626772f18c826bd [id=b0481cad97294373a02773733421d077]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.924616 10134 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 408) took 1175 ms. Trace:
I20260810 19:47:56.924777 10134 rpcz_store.cc:276] 0810 19:47:55.637648 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.073460 (+435812us) service_pool.cc:224] Handling call
0810 19:47:56.103998 (+ 30538us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.104048 (+ 50us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.786843 (+682795us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.812709 (+ 25866us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:56.812908 (+ 199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:56.925290 9677 tablet_service.cc:1558] Processing DeleteTablet for tablet 749cea5cd8f842b891f4e2cab07c054e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:56.925321 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 27aca44685be4a0b92767d13bad15daf (DEFAULT_TABLE table=default.Table_2d55b7a83d4d4faeb63acf0fd1c205b7 [id=b654f41c9aa74d3cb771ec66358c0473]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.925751 10370 tablet_bootstrap.cc:654] T 31c8699875b54be888b3128df1b673aa P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:56.926397 10136 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 410) took 1218 ms. Trace:
I20260810 19:47:56.926573 10136 rpcz_store.cc:276] 0810 19:47:55.639949 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.247243 (+607294us) service_pool.cc:224] Handling call
0810 19:47:56.258509 (+ 11266us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.258539 (+ 30us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.688117 (+429578us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.855277 (+167160us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:56.858064 (+ 2787us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:56.927103 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 25570b1795164aeca86a5313bd30a4c9 (DEFAULT_TABLE table=default.Table_4e0b9ea93b4e4164a3580c481782f8f4 [id=684a4fd9a0674c9ab382b116e5849fff]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:56.927151 9611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 60894.9us
I20260810 19:47:56.927518 10144 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 409) took 1221 ms. Trace:
I20260810 19:47:56.927667 10144 rpcz_store.cc:276] 0810 19:47:55.638805 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.177839 (+539034us) service_pool.cc:224] Handling call
0810 19:47:56.183230 (+ 5391us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.183264 (+ 34us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.720049 (+536785us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.860013 (+139964us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:56.860173 (+ 160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:56.928079 10144 tablet_service.cc:1558] Processing DeleteTablet for tablet 05059ef70a8e440ca2988bfeb610645d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:56.928376 10144 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f895bcd21f647f2ab813903d600a31a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:56.928715 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a2e6a512224caa892ac7541131349f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.928808 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 3da297aac2644fcabfcb21769576dca4 (DEFAULT_TABLE table=default.Table_ad2d66c3b58b43b98ceb756a5a078f78 [id=67f177aa933f4f00a3dcab7e11f61624]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.929141 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 307) took 3922 ms. Trace:
I20260810 19:47:56.929239 10375 rpcz_store.cc:276] 0810 19:47:52.979784 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:52.980270 (+ 486us) service_pool.cc:224] Handling call
0810 19:47:56.902096 (+3921826us) ts_tablet_manager.cc:1151] Deleting tablet ebf33d82af9e494a8e85be8cba55d2c9
0810 19:47:56.902109 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:56.902598 (+ 489us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3921576}
I20260810 19:47:56.929692 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 308) took 3884 ms. Trace:
I20260810 19:47:56.929780 10375 rpcz_store.cc:276] 0810 19:47:53.044742 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.044805 (+ 63us) service_pool.cc:224] Handling call
0810 19:47:56.929505 (+3884700us) ts_tablet_manager.cc:1151] Deleting tablet 72b39babf851404c89adb317033015ec
0810 19:47:56.929514 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:56.929632 (+ 118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3875974}
I20260810 19:47:56.930197 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 309) took 3875 ms. Trace:
I20260810 19:47:56.930277 10375 rpcz_store.cc:276] 0810 19:47:53.054670 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.054727 (+ 57us) service_pool.cc:224] Handling call
0810 19:47:56.930035 (+3875308us) ts_tablet_manager.cc:1151] Deleting tablet 9fb544dff4eb4642b7e282657ae15d19
0810 19:47:56.930043 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:56.930135 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3875093}
I20260810 19:47:56.930657 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 311) took 3663 ms. Trace:
I20260810 19:47:56.930734 10375 rpcz_store.cc:276] 0810 19:47:53.267606 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.268122 (+ 516us) service_pool.cc:224] Handling call
0810 19:47:56.930508 (+3662386us) ts_tablet_manager.cc:1151] Deleting tablet 6992e7ef8e794ddc879ae04f9f78b8bd
0810 19:47:56.930516 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:56.930605 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3662152}
I20260810 19:47:56.931038 10375 tablet_replica.cc:333] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:56.932695 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25570b1795164aeca86a5313bd30a4c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.933069 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da297aac2644fcabfcb21769576dca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.933586 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f42e9b00e3da4d73b4beb1b325f09f4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.933920 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e8928f23c284477822d1f6308432dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.934520 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27aca44685be4a0b92767d13bad15daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.936791 11404 raft_consensus.cc:515] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.937383 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b40fd0d57ea4b71aeef2d66f4958ac8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:56.937350 9677 tablet_service.cc:1511] Processing CreateTablet for tablet 82609a50781d43f38baa6b76187e02ef (DEFAULT_TABLE table=default.Table_c90bd097f5db43c6aefde84c1a39aa3a [id=b1f85880703241f5861724dacc9062a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.937564 9951 raft_consensus.cc:3060] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:56.937609 9673 tablet_service.cc:1511] Processing CreateTablet for tablet fdd82537177a4142bddd0544485b00c4 (DEFAULT_TABLE table=default.Table_33d8853eb1ce4caa81c8fe96f0ba2be0 [id=d277a804313e4f35a31b58d4f682efe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.937760 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82609a50781d43f38baa6b76187e02ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.937708 11404 leader_election.cc:290] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:56.937951 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdd82537177a4142bddd0544485b00c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.938684 10142 rpcz_store.cc:276] 0810 19:47:55.627615 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.629187 (+ 1572us) service_pool.cc:224] Handling call
0810 19:47:55.868451 (+239264us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:55.868481 (+ 30us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.840394 (+971913us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.904513 (+ 64119us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:56.904678 (+ 165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:56.939069 9611 leader_election.cc:304] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:56.939294 10142 tablet_service.cc:1558] Processing DeleteTablet for tablet eb3e7d34b5314bc7a7c5ed53792728ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:56.939530 9665 tablet_service.cc:1511] Processing CreateTablet for tablet cbcaa7106df24aaeb07428b7b590e282 (DEFAULT_TABLE table=default.Table_471bc99d3aa9446c8a287a8ae160d06d [id=a61b27909b65459793d63e8c8bae4d58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.939764 10142 tablet_service.cc:1511] Processing CreateTablet for tablet 7add2dae2d1b4e8b9b95348e0334ba03 (DEFAULT_TABLE table=default.Table_06a146e0e459439cba25bc9eaf210b12 [id=6be2a52358f04826b4fd3f0941693b42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.940171 10142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7add2dae2d1b4e8b9b95348e0334ba03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.943060 10118 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 417) took 1214 ms. Trace:
I20260810 19:47:56.943238 10118 rpcz_store.cc:276] 0810 19:47:55.648338 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.557498 (+909160us) service_pool.cc:224] Handling call
0810 19:47:56.589875 (+ 32377us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.589910 (+ 35us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.800298 (+210388us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.862113 (+ 61815us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:56.862270 (+ 157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:56.943787 10118 tablet_service.cc:1511] Processing CreateTablet for tablet c9e2dbef6e7a48caa2964ab90fbf9b73 (DEFAULT_TABLE table=default.Table_0fa5ed82975d484a938aba25478b3c40 [id=91f4f92ca1804c5f866e3a6cdc8d5d30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.944247 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9e2dbef6e7a48caa2964ab90fbf9b73. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:56.945643 10068 leader_election.cc:343] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 3ca9d34cb609413d9df495bf191cc409
I20260810 19:47:56.947657 9887 tablet_service.cc:1511] Processing CreateTablet for tablet 3109703c51e54af78b58e9bbca50af33 (DEFAULT_TABLE table=default.Table_b3ebb4935f244802a7b2b6e1a33cb904 [id=0c0d86100d3444bbafc7f7def5c5a317]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.948096 9887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3109703c51e54af78b58e9bbca50af33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.948783 9908 tablet_service.cc:1511] Processing CreateTablet for tablet b8a7c2857add422281542e7f187979ab (DEFAULT_TABLE table=default.Table_f0a3683ed3074e529e9eff3dc1509f6d [id=f3ba4de841d44fbeaefab0db4c4a6a9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.948983 10375 raft_consensus.cc:2243] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:56.949162 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8a7c2857add422281542e7f187979ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.949656 10375 raft_consensus.cc:2272] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:56.950124 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbcaa7106df24aaeb07428b7b590e282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.949805 9907 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 414) took 1200 ms. Trace:
I20260810 19:47:56.950764 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 471ff7c225dd498fa39751202beec3a9 (DEFAULT_TABLE table=default.Table_cb085f4d70f74c8885b3f837c4c94501 [id=c9a13735c4f7435d98909590d99b2f5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.951443 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet ffc4466b82bd49fcaad30e4d5325c7db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:56.950701 9907 rpcz_store.cc:276] 0810 19:47:55.645350 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.654106 (+ 8756us) service_pool.cc:224] Handling call
0810 19:47:55.774264 (+120158us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:55.774344 (+ 80us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.842678 (+1068334us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.845526 (+ 2848us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:56.845691 (+ 165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:56.953364 9420 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5 (table default.Table_b46992ec81974f6caad1ea769640dcf1 [id=d6d2d95e5e9f4e10a7d5a8153e66e4b6]). Expected version 2 got 0
I20260810 19:47:56.954550 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 471ff7c225dd498fa39751202beec3a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.954803 11295 raft_consensus.cc:2804] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:56.958288 9890 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 410) took 1315 ms. Trace:
I20260810 19:47:56.961916 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_586af863bf334719a05f5ace5b1bb407" } modify_external_catalogs: true
I20260810 19:47:56.962183 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_586af863bf334719a05f5ace5b1bb407" } modify_external_catalogs: true
I20260810 19:47:56.963855 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_842365768e8f46b9840f02345ae40e42" } modify_external_catalogs: true
I20260810 19:47:56.964041 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_842365768e8f46b9840f02345ae40e42" } modify_external_catalogs: true
I20260810 19:47:56.966877 11295 raft_consensus.cc:697] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:56.967058 10145 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 401) took 1338 ms. Trace:
I20260810 19:47:56.967197 10145 rpcz_store.cc:276] 0810 19:47:55.628473 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.628531 (+ 58us) service_pool.cc:224] Handling call
0810 19:47:55.671252 (+ 42721us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:55.671284 (+ 32us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.880314 (+1209030us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.895525 (+ 15211us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:56.967005 (+ 71480us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:56.967744 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 55fb03a8dd3b40f5ba3de41fa7c01f5d (DEFAULT_TABLE table=default.Table_1c98bf082e38462a83cbf3d6850868b3 [id=b915a5fccb7c46a68ea7f5df2b5cf5ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.968251 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55fb03a8dd3b40f5ba3de41fa7c01f5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.968729 9657 tablet_service.cc:1511] Processing CreateTablet for tablet ea9408ecf3784a80ac0c064e1689d25e (DEFAULT_TABLE table=default.Table_156494e413e94dddafcb9fd6cb8e2498 [id=aabf9535ecdb44d1b3245f8f05542f28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.968725 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 97c78c188c024b0f9da45cd99d2cb80c (DEFAULT_TABLE table=default.Table_65864a250646401984a7263cf477ab07 [id=2f1d802c24844383976d2799035e9d0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.916131 11440 raft_consensus.cc:493] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcd31b1bbb0340cbacfce652b4ad8da4)
I20260810 19:47:56.969534 10124 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 413) took 1272 ms. Trace:
I20260810 19:47:56.970153 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a8eaabc9d0ef45729c9a7e9301083b99" } modify_external_catalogs: true
I20260810 19:47:56.970367 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a8eaabc9d0ef45729c9a7e9301083b99" } modify_external_catalogs: true
I20260810 19:47:56.972632 10125 tablet_service.cc:1511] Processing CreateTablet for tablet b8a7c2857add422281542e7f187979ab (DEFAULT_TABLE table=default.Table_f0a3683ed3074e529e9eff3dc1509f6d [id=f3ba4de841d44fbeaefab0db4c4a6a9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.972807 9418 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 5b3a0eb1b75c479ca11d814561a04682
I20260810 19:47:56.973687 9420 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 89ec4769eb354df4b736f95b4d74a6d2
I20260810 19:47:56.974550 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 674b44f34b2042d3aac0b399fada795e (DEFAULT_TABLE table=default.Table_2d2422f738fe43f5aac8adbdaac041cb [id=7ca0d44fb4b04bc09a6912fcb59a037c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.975244 10124 rpcz_store.cc:276] 0810 19:47:55.643209 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.249951 (+606742us) service_pool.cc:224] Handling call
0810 19:47:56.255249 (+ 5298us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.255282 (+ 33us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.758968 (+503686us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.912208 (+153240us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:56.915938 (+ 3730us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:56.979598 9666 tablet_service.cc:1511] Processing CreateTablet for tablet c2604484e3114564812653a15298cc0b (DEFAULT_TABLE table=default.Table_e65a0539bebe443199c67a2723cd4af6 [id=e3fc833ec8be41748f0a1c2ef8f26b1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:56.982671 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea9408ecf3784a80ac0c064e1689d25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.985176 11295 consensus_queue.cc:237] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.987219 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674b44f34b2042d3aac0b399fada795e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.987440 10122 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 399) took 1343 ms. Trace:
I20260810 19:47:56.987651 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8a7c2857add422281542e7f187979ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.988157 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97c78c188c024b0f9da45cd99d2cb80c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:56.989485 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2604484e3114564812653a15298cc0b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:56.989537 10067 leader_election.cc:343] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 3ca9d34cb609413d9df495bf191cc409
I20260810 19:47:56.989722 10067 leader_election.cc:304] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:56.991286 11400 raft_consensus.cc:2749] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 19:47:56.974349 11440 raft_consensus.cc:515] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:56.997468 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 7de27c3442584746b76ea838d38f0b9b (DEFAULT_TABLE table=default.Table_60e8f95672f048c5afa43569031f3d12 [id=f76de132787a49c6af75b9fe63be9d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.003219 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7de27c3442584746b76ea838d38f0b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.002419 10122 rpcz_store.cc:276] 0810 19:47:55.626305 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.626388 (+ 83us) service_pool.cc:224] Handling call
0810 19:47:55.671150 (+ 44762us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:55.671178 (+ 28us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.796595 (+1125417us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.969693 (+173098us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:56.969855 (+ 162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.006590 9895 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 416) took 1235 ms. Trace:
I20260810 19:47:57.011122 11400 raft_consensus.cc:493] T 3badc88d94a34ff7a053ed312f0dd646 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:57.012753 9905 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 418) took 1257 ms. Trace:
I20260810 19:47:57.012898 9905 rpcz_store.cc:276] 0810 19:47:55.687831 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.852895 (+165064us) service_pool.cc:224] Handling call
0810 19:47:55.857701 (+ 4806us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:55.860232 (+ 2531us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.600423 (+740191us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.921341 (+320918us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:56.944477 (+ 23136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.021342 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 3159795344ae492fb099fca0e52fcf20 (DEFAULT_TABLE table=default.Table_d9ae7658a1f24bd8aa85ffbc2ac9ee0f [id=f13bcadbcbc14466907b2850e5dce367]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.021869 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3159795344ae492fb099fca0e52fcf20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.013595 11400 raft_consensus.cc:515] T 3badc88d94a34ff7a053ed312f0dd646 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.034373 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 38ee7973736c4a0a921261d37b74f290 (table default.Table_12b12f4993a449a48336de17e0c39fc1 [id=f6c45c0da9e6448dbb64115902fef084]) successfully deleted
W20260810 19:47:57.035127 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet ebf33d82af9e494a8e85be8cba55d2c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebf33d82af9e494a8e85be8cba55d2c9 already in progress: creating tablet
W20260810 19:47:57.035374 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 72b39babf851404c89adb317033015ec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72b39babf851404c89adb317033015ec already in progress: creating tablet
W20260810 19:47:57.035578 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 9fb544dff4eb4642b7e282657ae15d19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9fb544dff4eb4642b7e282657ae15d19 already in progress: creating tablet
W20260810 19:47:57.035799 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 6992e7ef8e794ddc879ae04f9f78b8bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6992e7ef8e794ddc879ae04f9f78b8bd already in progress: creating tablet
I20260810 19:47:57.042147 9895 rpcz_store.cc:276] 0810 19:47:55.648644 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.832415 (+183771us) service_pool.cc:224] Handling call
0810 19:47:56.036767 (+204352us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.036802 (+ 35us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.830923 (+794121us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.883888 (+ 52965us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:56.884063 (+ 175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.029748 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8e8e1b5f3f452f8fdfe5a42fd021a5" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:57.046224 9883 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 413) took 1306 ms. Trace:
I20260810 19:47:57.046397 9883 rpcz_store.cc:276] 0810 19:47:55.642518 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.642881 (+ 363us) service_pool.cc:224] Handling call
0810 19:47:55.645782 (+ 2901us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:55.645821 (+ 39us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.460147 (+814326us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.947253 (+487106us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:56.947398 (+ 145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.046976 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 3da297aac2644fcabfcb21769576dca4 (DEFAULT_TABLE table=default.Table_ad2d66c3b58b43b98ceb756a5a078f78 [id=67f177aa933f4f00a3dcab7e11f61624]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.047497 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da297aac2644fcabfcb21769576dca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.048220 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 27aca44685be4a0b92767d13bad15daf (DEFAULT_TABLE table=default.Table_2d55b7a83d4d4faeb63acf0fd1c205b7 [id=b654f41c9aa74d3cb771ec66358c0473]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.048266 9890 rpcz_store.cc:276] 0810 19:47:55.637400 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.637639 (+ 239us) service_pool.cc:224] Handling call
0810 19:47:55.640525 (+ 2886us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:55.640566 (+ 41us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.002621 (+362055us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.934705 (+932084us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:56.952953 (+ 18248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.048648 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27aca44685be4a0b92767d13bad15daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.048615 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 05059ef70a8e440ca2988bfeb610645d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:57.048887 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f895bcd21f647f2ab813903d600a31a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:57.049041 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet eb3e7d34b5314bc7a7c5ed53792728ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:57.049484 10139 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 421) took 1395 ms. Trace:
I20260810 19:47:57.052337 10116 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 416) took 1389 ms. Trace:
I20260810 19:47:57.052274 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f70a4e380a494ed0be7890bf577fb42c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:57.053047 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f70a4e380a494ed0be7890bf577fb42c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:57.053455 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2b91ab11caf848a3844e81653da4e93e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:57.054028 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b91ab11caf848a3844e81653da4e93e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:57.054648 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6d2e6ad78a7841e891fae5f687a3c392" } modify_external_catalogs: true
I20260810 19:47:57.054857 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6d2e6ad78a7841e891fae5f687a3c392" } modify_external_catalogs: true
I20260810 19:47:57.041579 11400 leader_election.cc:290] T 3badc88d94a34ff7a053ed312f0dd646 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:57.057423 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_97b0b4e69a6a4a56bf37ba9561c5271e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:57.057962 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97b0b4e69a6a4a56bf37ba9561c5271e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:57.058401 10139 rpcz_store.cc:276] 0810 19:47:55.654308 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.813296 (+1158988us) service_pool.cc:224] Handling call
0810 19:47:56.813821 (+ 525us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.813852 (+ 31us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.817654 (+ 3802us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.049266 (+231612us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.049439 (+ 173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.058830 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5f48352d6cc34542b53e9d665bef9168" } new_table_name: "default.Table_4f9606f9dd734d9c9ef67a3e0eafbdac" modify_external_catalogs: true
I20260810 19:47:57.059026 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 5a35be79a8924213ab860a9da04a598c (DEFAULT_TABLE table=default.Table_dca6b457fbf744e089c4a583fca06cbb [id=4bce0610a04641ff86ab3af94e12e31d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.059218 10116 rpcz_store.cc:276] 0810 19:47:55.646433 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.553886 (+907453us) service_pool.cc:224] Handling call
0810 19:47:56.560099 (+ 6213us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.560129 (+ 30us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.844543 (+284414us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.035975 (+191432us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.036129 (+ 154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.059293 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5f6b1710e7cc447dbf34e05882706750" } new_table_name: "default.Table_85e674f117d5404eb01680b66429bc7b" modify_external_catalogs: true
I20260810 19:47:57.042235 11440 leader_election.cc:290] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:57.052953 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_812ed15779a140729fc82552535b01f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:57.060715 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_812ed15779a140729fc82552535b01f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:57.061885 9407 catalog_manager.cc:5719] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193). New cstate: current_term: 1 leader_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:47:57.062284 9407 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 81720b897a674b5380c6469d1600a979 (table default.Table_e4aeb59e91c24097bac9517b3c62b75a [id=8d7f043045ff44cd886367b5860f8433]). Expected version 1 got 0
I20260810 19:47:57.062513 10128 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 418) took 1385 ms. Trace:
I20260810 19:47:57.065642 9890 tablet_service.cc:1511] Processing CreateTablet for tablet 6f4b5c6d5bd14c59b3cd3f8ee00a3301 (DEFAULT_TABLE table=default.Table_7984b3459b7c46eab35b53ef578aa0a9 [id=4bf40870a0554fb9b04a1f7cc8f87d85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.066198 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f4b5c6d5bd14c59b3cd3f8ee00a3301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.067054 9951 raft_consensus.cc:2468] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:57.067397 9892 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 409) took 1309 ms. Trace:
I20260810 19:47:57.067520 9892 rpcz_store.cc:276] 0810 19:47:55.635351 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.635643 (+ 292us) service_pool.cc:224] Handling call
0810 19:47:55.643628 (+ 7985us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:55.644514 (+ 886us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.594114 (+949600us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:56.934561 (+340447us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:56.944548 (+ 9987us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.068054 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 7add2dae2d1b4e8b9b95348e0334ba03 (DEFAULT_TABLE table=default.Table_06a146e0e459439cba25bc9eaf210b12 [id=6be2a52358f04826b4fd3f0941693b42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.068482 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7add2dae2d1b4e8b9b95348e0334ba03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.068785 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet b54feebc7c9841d89808054602be7913
I20260810 19:47:57.069006 9899 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 422) took 1242 ms. Trace:
I20260810 19:47:57.069144 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 8e8928f23c284477822d1f6308432dec (DEFAULT_TABLE table=default.Table_52a19c74f223463fa626772f18c826bd [id=b0481cad97294373a02773733421d077]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.071565 10370 tablet_bootstrap.cc:492] T 31c8699875b54be888b3128df1b673aa P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:57.071802 10128 rpcz_store.cc:276] 0810 19:47:55.649140 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.599997 (+950857us) service_pool.cc:224] Handling call
0810 19:47:56.602576 (+ 2579us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.602602 (+ 26us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.856505 (+253903us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.031725 (+175220us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.034240 (+ 2515us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.073128 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e8928f23c284477822d1f6308432dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.073608 10116 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e967384768b4ec7956f1b508e8ab2af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:57.073822 10375 ts_tablet_manager.cc:1916] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:57.078341 10067 leader_election.cc:304] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:57.079147 10115 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 419) took 1413 ms. Trace:
I20260810 19:47:57.083325 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3badc88d94a34ff7a053ed312f0dd646" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:57.084843 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet b5f30148b5c84f7cbdfabd0186611cc4
I20260810 19:47:57.085716 9899 rpcz_store.cc:276] 0810 19:47:55.826025 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.866934 (+ 40909us) service_pool.cc:224] Handling call
0810 19:47:56.005216 (+138282us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.005279 (+ 63us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.611922 (+606643us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.068757 (+456835us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.068939 (+ 182us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260810 19:47:57.088042 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b2034784996149158c10b868f61ff418 has no consensus state
I20260810 19:47:57.088450 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 25570b1795164aeca86a5313bd30a4c9 (DEFAULT_TABLE table=default.Table_4e0b9ea93b4e4164a3580c481782f8f4 [id=684a4fd9a0674c9ab382b116e5849fff]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:57.088708 9835 connection.cc:573] client connection to 127.8.235.253:37397 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 19:47:57.088932 10116 tablet_service.cc:1511] Processing CreateTablet for tablet ea557438b7b74944b19e17d7fb8f20cf (DEFAULT_TABLE table=default.Table_2127777800d84906905aac5e1b9eaf64 [id=310d071d99754287862ab16b28a0b5cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.092631 9907 tablet_service.cc:1511] Processing CreateTablet for tablet b91737c2129e4ca385b4e1c8999c62b4 (DEFAULT_TABLE table=default.Table_b1dee343716e4e969055ae6ed5d93b60 [id=9a1f9fb7aee041a2a8b5cc736d74eaa7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:57.097478 11465 negotiation.cc:336] Failed RPC negotiation. Trace:
0810 19:47:57.079687 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.8.235.253:37397 (local address 127.0.0.1:43668)
0810 19:47:57.096627 (+ 16940us) negotiation.cc:107] Waiting for socket to connect
0810 19:47:57.096805 (+ 178us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.235.253:37397: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":16483,"thread_start_us":16669,"threads_started":1}
I20260810 19:47:57.098335 10119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 420) took 1446 ms. Trace:
I20260810 19:47:57.098621 11440 raft_consensus.cc:2749] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 19:47:57.098592 10115 rpcz_store.cc:276] 0810 19:47:55.650227 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.791389 (+1141162us) service_pool.cc:224] Handling call
0810 19:47:56.792088 (+ 699us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.792402 (+ 314us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.868893 (+ 76491us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.063102 (+194209us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.063273 (+ 171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.101398 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_9747046448e44dc4ab648e6759baad73"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:57.102087 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9747046448e44dc4ab648e6759baad73 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:57.101857 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_03860438702347aba8b5460c42468832"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:57.102757 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03860438702347aba8b5460c42468832 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:57.104703 9899 tablet_service.cc:1511] Processing CreateTablet for tablet c9e2dbef6e7a48caa2964ab90fbf9b73 (DEFAULT_TABLE table=default.Table_0fa5ed82975d484a938aba25478b3c40 [id=91f4f92ca1804c5f866e3a6cdc8d5d30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.104920 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ad2d66c3b58b43b98ceb756a5a078f78" } new_table_name: "default.Table_f6f4b21d44ba45339d95ca1933e92cd9" modify_external_catalogs: true
I20260810 19:47:57.104930 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_083cd789bfe84da991cf9678c9a635ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:57.105594 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_083cd789bfe84da991cf9678c9a635ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:57.106611 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0445d007d0d8477dbd940cd0d2d99fe0" } new_table_name: "default.Table_75f34d0b0d844a1dba7d3ed6a75b3555" modify_external_catalogs: true
I20260810 19:47:57.106666 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f1684a112499413eab2a008659bd34ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:57.107167 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1684a112499413eab2a008659bd34ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:57.108597 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_31db32caf8c24fcbb27ba3ab77fe50b0" } new_table_name: "default.Table_73a9257f3a444ce6a1e35cf5b4cddbd9" modify_external_catalogs: true
W20260810 19:47:57.101580 10067 leader_election.cc:343] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: f2931130e9354f16a238712234c19217
W20260810 19:47:57.111845 9400 consensus_peers.cc:597] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a -> Peer f52c40e347e24ab4b3129e7064f4a43e (127.8.235.253:37397): Couldn't send request to peer f52c40e347e24ab4b3129e7064f4a43e. Status: Network error: Client connection negotiation failed: client connection to 127.8.235.253:37397: connect: Connection reset by peer (error 104). This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:57.112788 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f9e687e842744de19940ff3ddb74dfa1" } modify_external_catalogs: true
I20260810 19:47:57.112998 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f9e687e842744de19940ff3ddb74dfa1" } modify_external_catalogs: true
W20260810 19:47:57.110380 10070 connection.cc:573] client connection to 127.8.235.253:37397 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 19:47:57.114192 10370 ts_tablet_manager.cc:1403] T 31c8699875b54be888b3128df1b673aa P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.307s user 0.006s sys 0.001s
I20260810 19:47:57.114420 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_66575d35b8014f0bbbceffff435faf55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:57.114961 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66575d35b8014f0bbbceffff435faf55 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:57.116117 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a5fdc77e962244aab9851f792183f5d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:57.116600 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a5fdc77e962244aab9851f792183f5d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:57.120164 10128 tablet_service.cc:1558] Processing DeleteTablet for tablet ae3e151180ae4d258d18365770acaaad with delete_type TABLET_DATA_DELETED (replaced by tablet 6dea3165feb842ecb58b7ace235abf38) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:57.120396 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a35be79a8924213ab860a9da04a598c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.121501 10127 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 397) took 1472 ms. Trace:
I20260810 19:47:57.121624 10127 rpcz_store.cc:276] 0810 19:47:55.623130 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.623188 (+ 58us) service_pool.cc:224] Handling call
0810 19:47:55.670866 (+ 47678us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:55.670916 (+ 50us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.902695 (+1231779us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.095146 (+192451us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.095366 (+ 220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.122756 9611 leader_election.cc:304] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:57.121721 10128 tablet_service.cc:1511] Processing CreateTablet for tablet e87fd882e6b6413480a0cb06aee74722 (DEFAULT_TABLE table=default.Table_f90f1a0c22fa4781812518f44c9d7b17 [id=d12cb82567fd409988672b04a2e05a5b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:57.123193 9611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 52521.2us
I20260810 19:47:57.123642 10367 tablet_bootstrap.cc:654] T 06af03c8a87141febef768bd56c72c39 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:57.125661 9830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.195:43797, user_credentials={real_user=slave}} blocked reactor thread for 265681us
W20260810 19:47:57.125878 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b33aa8be266a434cba899da7514c47e9 consensus state has no leader
I20260810 19:47:57.126076 9951 raft_consensus.cc:2393] T 3badc88d94a34ff7a053ed312f0dd646 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eadde59fd6504d679e47f03a60c64bb0 in current term 1: Already voted for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in this term.
I20260810 19:47:57.127461 11295 raft_consensus.cc:493] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:57.130654 10119 rpcz_store.cc:276] 0810 19:47:55.651829 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.804447 (+1152618us) service_pool.cc:224] Handling call
0810 19:47:56.805030 (+ 583us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.805064 (+ 34us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:57.064768 (+259704us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.098083 (+ 33315us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.098261 (+ 178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.131876 11295 raft_consensus.cc:515] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.132679 11295 leader_election.cc:290] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:57.132850 11426 raft_consensus.cc:2804] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:57.133908 10115 tablet_service.cc:1511] Processing CreateTablet for tablet a776693b6b4943a7b64e13ec10958c16 (DEFAULT_TABLE table=default.Table_ad4523adf6cb4df7948a357515ec4b9a [id=632c2c289ff24ddcbf9d13ffe1fcda15]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:57.134347 9397 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 253f302c00cc42ff84076b0c17f7670a (table default.Table_ab79ddcb17e24ce7960c0c41dd451bc2 [id=9a73a382c71249058e61be3b0146826f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 253f302c00cc42ff84076b0c17f7670a consensus state has no leader
I20260810 19:47:57.137001 10120 tablet_service.cc:1511] Processing CreateTablet for tablet cb2c9782c034435088f991bef8edf288 (DEFAULT_TABLE table=default.Table_9a949158a5f2417ea8f015281b20659a [id=8763b964126e48ba85394844a7628795]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:57.137379 10068 leader_election.cc:343] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: f2931130e9354f16a238712234c19217
I20260810 19:47:57.139611 10068 leader_election.cc:304] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:57.139803 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 9118f949ded748d7b90f00948f49be55 (DEFAULT_TABLE table=default.Table_830b53d484b34185b3edd4c39fcb36b5 [id=6cc8c0a07ee74ec99d7ccf22c3d6f494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.140671 11440 raft_consensus.cc:2749] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 19:47:57.142822 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3da297aac2644fcabfcb21769576dca4 consensus state has no leader
W20260810 19:47:57.144367 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ca733de7babe4343ab26dbca2c9020b2 consensus state has no leader
I20260810 19:47:57.144882 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9118f949ded748d7b90f00948f49be55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.145354 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3916a976efef43428942135e777edcec" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:57.144282 11426 raft_consensus.cc:697] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:57.145742 10370 raft_consensus.cc:359] T 31c8699875b54be888b3128df1b673aa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.147143 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 3520274768ed41abb010bb109127affa
I20260810 19:47:57.146824 11295 raft_consensus.cc:493] T 6f0150de0d60425b807be532ce0ba6c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:57.148381 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet 3680db3f1a5945a89c1198eb4849e58c with delete_type TABLET_DATA_DELETED (replaced by tablet 33f2ea0d46f44fca88e16ea83ad67bc2) from {username='slave'} at 127.0.0.1:41610
W20260810 19:47:57.148723 9611 leader_election.cc:343] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:57.148977 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet b54feebc7c9841d89808054602be7913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:57.146116 11426 consensus_queue.cc:237] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.149820 10370 raft_consensus.cc:385] T 31c8699875b54be888b3128df1b673aa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:57.149940 10370 raft_consensus.cc:740] T 31c8699875b54be888b3128df1b673aa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:57.150633 9673 tablet_service.cc:1558] Processing DeleteTablet for tablet b5f30148b5c84f7cbdfabd0186611cc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:57.150837 9617 connection.cc:573] client connection to 127.8.235.253:37397 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 19:47:57.151028 10370 consensus_queue.cc:260] T 31c8699875b54be888b3128df1b673aa P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.151700 10370 ts_tablet_manager.cc:1434] T 31c8699875b54be888b3128df1b673aa P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.037s user 0.003s sys 0.000s
I20260810 19:47:57.152966 11295 raft_consensus.cc:515] T 6f0150de0d60425b807be532ce0ba6c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.153759 11295 leader_election.cc:290] T 6f0150de0d60425b807be532ce0ba6c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:57.156376 9673 tablet_service.cc:1558] Processing DeleteTablet for tablet 3520274768ed41abb010bb109127affa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:57.160707 10068 leader_election.cc:343] T 3badc88d94a34ff7a053ed312f0dd646 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 3badc88d94a34ff7a053ed312f0dd646
I20260810 19:47:57.164018 10370 tablet_bootstrap.cc:492] T 10617bdf2eed4dbd8d13ea1821443863 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:57.164716 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0150de0d60425b807be532ce0ba6c3" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:57.168125 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 6f4b5c6d5bd14c59b3cd3f8ee00a3301 (DEFAULT_TABLE table=default.Table_7984b3459b7c46eab35b53ef578aa0a9 [id=4bf40870a0554fb9b04a1f7cc8f87d85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.168532 10371 ts_tablet_manager.cc:1929] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:57.168701 10371 log.cc:1199] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/4f2d7c165d2c465d9080b927d54807f7
I20260810 19:47:57.169085 10371 ts_tablet_manager.cc:1950] T 4f2d7c165d2c465d9080b927d54807f7 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:57.169974 10135 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 434) took 1012 ms. Trace:
I20260810 19:47:57.170048 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 398) took 1652 ms. Trace:
I20260810 19:47:57.173307 10140 tablet_service.cc:1511] Processing CreateTablet for tablet c8311ccef92c48b2a94bbb9e9262ea9d (DEFAULT_TABLE table=default.Table_5e59db5efe264421a5f3455e9aa63c62 [id=4b52435931f6482a8c3bca2d0c05bd53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.175087 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 269adfeb1efe46d3944f33b245126665 (DEFAULT_TABLE table=default.Table_4ec3ace539c444e08c5e84fff6a6f919 [id=b7a9d407c9d74d0c8fd85c1d8498c3f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.176388 10136 tablet_service.cc:1558] Processing DeleteTablet for tablet 39885c3e0adb4132945d507628f4f082 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:47:57.176595 9611 leader_election.cc:343] T 6f0150de0d60425b807be532ce0ba6c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:57.176996 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 60e99cd75ada470380ab69da60ddac77 (DEFAULT_TABLE table=default.Table_f11b6cec3ddf4b339b5f90841b7b3d8b [id=e872b31132a34cf5bd9a65bde184c182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.177762 10116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea557438b7b74944b19e17d7fb8f20cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.178074 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 269adfeb1efe46d3944f33b245126665. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.178331 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a776693b6b4943a7b64e13ec10958c16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.182126 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9d569d756be84460b1b78812a13b95ad" } modify_external_catalogs: true
I20260810 19:47:57.182364 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9d569d756be84460b1b78812a13b95ad" } modify_external_catalogs: true
I20260810 19:47:57.182641 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e87fd882e6b6413480a0cb06aee74722. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.185555 10122 tablet_service.cc:1511] Processing CreateTablet for tablet f5fa6060b9ef48cea6830cd9d19424ea (DEFAULT_TABLE table=default.Table_9d569d756be84460b1b78812a13b95ad [id=14e993ddf3b646098d6d3a3e24d01b07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.185922 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_083cd789bfe84da991cf9678c9a635ff" } modify_external_catalogs: true
I20260810 19:47:57.186126 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_083cd789bfe84da991cf9678c9a635ff" } modify_external_catalogs: true
I20260810 19:47:57.186980 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 4579a71f8c8149798eb5f136135e5efe (DEFAULT_TABLE table=default.Table_90f1232af7064dc2b768da280482a20b [id=8387d76208d54536aab9a8cd1810c7de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.187975 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f4b5c6d5bd14c59b3cd3f8ee00a3301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.189711 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet f5fa6060b9ef48cea6830cd9d19424ea
I20260810 19:47:57.192073 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 841f58b4e8f7465eaa7fa08629e0bc2a (DEFAULT_TABLE table=default.Table_fe3c84ad30eb4d57a6d20ec860c02286 [id=c401d03820c6453184e1da223c380872]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.192615 10118 tablet_service.cc:1511] Processing CreateTablet for tablet 0849ea9c04104a8184f8a8cd40e06fc2 (DEFAULT_TABLE table=default.Table_2c45b8ef81f94485a39df1d41c96f9a6 [id=061ee47a7ec24c2389a57b68997bff51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.193634 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d654dada92a4939914d26ab72a5f5e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:57.194141 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 22954e727fb44a24bd382b9caee9996b (DEFAULT_TABLE table=default.Table_a16400f647e94437932730ebd220e795 [id=1fee039754f440c398b5d2297eb89999]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.194657 10135 rpcz_store.cc:276] 0810 19:47:56.149617 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.921091 (+771474us) service_pool.cc:224] Handling call
0810 19:47:56.921604 (+ 513us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.921633 (+ 29us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:57.056560 (+134927us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.154553 (+ 97993us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.161969 (+ 7416us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.195048 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d93821ff46a4096a8ebbac83faabed7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:57.195288 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet 48eee4ce10114021855075812e356652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:57.202862 9410 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 8b04e3d3342f4d26b1b7eb7f17459c06
I20260810 19:47:57.205078 9412 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 31c8699875b54be888b3128df1b673aa (table default.Table_c35c3a44fcc44bba8a8c334292245b49 [id=5abc1f7beec444a4a988fbfcb8b45623]). Expected version 1 got 0
I20260810 19:47:57.170138 10371 rpcz_store.cc:276] 0810 19:47:55.518002 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.518054 (+ 52us) service_pool.cc:224] Handling call
0810 19:47:56.782304 (+1264250us) ts_tablet_manager.cc:1151] Deleting tablet 4f2d7c165d2c465d9080b927d54807f7
0810 19:47:56.782348 (+ 44us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.030218 (+247870us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.168427 (+138209us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.169981 (+ 1554us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1263781}
I20260810 19:47:57.195714 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 229dd737ee8547a89445593cc117fbc2 (DEFAULT_TABLE table=default.Table_bfa0ef28a4704e2589883d5ebd21cb92 [id=df4d2ed4289f45c68927ac7fb7c77f06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.197346 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2c9782c034435088f991bef8edf288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.195545 10137 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 422) took 1470 ms. Trace:
I20260810 19:47:57.211123 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 399) took 1689 ms. Trace:
I20260810 19:47:57.211265 10371 rpcz_store.cc:276] 0810 19:47:55.518769 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.518828 (+ 59us) service_pool.cc:224] Handling call
0810 19:47:57.206677 (+1687849us) ts_tablet_manager.cc:1151] Deleting tablet 5d3598b5743244e39efd12703ec15aea
0810 19:47:57.206694 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.207701 (+ 1007us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1687669}
I20260810 19:47:57.211656 10371 tablet_replica.cc:333] T dad16ea0f82942de8587dd7c98c0d2df P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:57.211874 10371 raft_consensus.cc:2243] T dad16ea0f82942de8587dd7c98c0d2df P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:57.212078 10371 raft_consensus.cc:2272] T dad16ea0f82942de8587dd7c98c0d2df P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:57.212734 10371 ts_tablet_manager.cc:1916] T dad16ea0f82942de8587dd7c98c0d2df P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:57.237942 9896 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 431) took 1068 ms. Trace:
I20260810 19:47:57.238181 9902 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 430) took 1072 ms. Trace:
I20260810 19:47:57.243589 9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9e2dbef6e7a48caa2964ab90fbf9b73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.201339 10119 tablet_service.cc:1511] Processing CreateTablet for tablet b853bf6bbc7845bc9cfa6347687582e2 (DEFAULT_TABLE table=default.Table_e7191b05092d4bb3873107f5e514dcba [id=7d69e5bb3bcc4efa9e77162f6316db9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.244871 10067 leader_election.cc:304] T 3badc88d94a34ff7a053ed312f0dd646 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:57.245499 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0150de0d60425b807be532ce0ba6c3" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:57.245844 9885 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 412) took 1507 ms. Trace:
I20260810 19:47:57.243705 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3916a976efef43428942135e777edcec" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:47:57.246627 9611 leader_election.cc:343] T 6f0150de0d60425b807be532ce0ba6c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:57.246788 9611 leader_election.cc:304] T 6f0150de0d60425b807be532ce0ba6c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:57.247135 11426 raft_consensus.cc:2749] T 6f0150de0d60425b807be532ce0ba6c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:57.247717 10137 rpcz_store.cc:276] 0810 19:47:55.654990 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.844409 (+1189419us) service_pool.cc:224] Handling call
0810 19:47:56.871590 (+ 27181us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.871620 (+ 30us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.918831 (+ 47211us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.125665 (+206834us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.125913 (+ 248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.248831 10366 tablet_bootstrap.cc:492] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:57.249794 9894 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 408) took 1513 ms. Trace:
I20260810 19:47:57.249904 9894 rpcz_store.cc:276] 0810 19:47:55.634224 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.634297 (+ 73us) service_pool.cc:224] Handling call
0810 19:47:55.636333 (+ 2036us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:55.636399 (+ 66us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.669970 (+1033571us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.112855 (+442885us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.147837 (+ 34982us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.250022 11440 raft_consensus.cc:3060] T 3badc88d94a34ff7a053ed312f0dd646 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:57.250528 9894 tablet_service.cc:1511] Processing CreateTablet for tablet 55fb03a8dd3b40f5ba3de41fa7c01f5d (DEFAULT_TABLE table=default.Table_1c98bf082e38462a83cbf3d6850868b3 [id=b915a5fccb7c46a68ea7f5df2b5cf5ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.250984 9901 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 429) took 1175 ms. Trace:
I20260810 19:47:57.251148 9951 raft_consensus.cc:2468] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:47:57.251118 9901 rpcz_store.cc:276] 0810 19:47:56.047943 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.418734 (+370791us) service_pool.cc:224] Handling call
0810 19:47:56.441913 (+ 23179us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.441961 (+ 48us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.960370 (+518409us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.218380 (+258010us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.218553 (+ 173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19956}
I20260810 19:47:57.251012 9896 rpcz_store.cc:276] 0810 19:47:56.080026 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.461794 (+381768us) service_pool.cc:224] Handling call
0810 19:47:56.493722 (+ 31928us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.493754 (+ 32us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.864496 (+370742us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.113485 (+248989us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.147923 (+ 34438us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.251850 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 7de27c3442584746b76ea838d38f0b9b (DEFAULT_TABLE table=default.Table_60e8f95672f048c5afa43569031f3d12 [id=f76de132787a49c6af75b9fe63be9d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.252115 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 3159795344ae492fb099fca0e52fcf20 (DEFAULT_TABLE table=default.Table_d9ae7658a1f24bd8aa85ffbc2ac9ee0f [id=f13bcadbcbc14466907b2850e5dce367]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.252838 10371 ts_tablet_manager.cc:1929] T dad16ea0f82942de8587dd7c98c0d2df P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:57.252846 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet 749cea5cd8f842b891f4e2cab07c054e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:47:57.254036 11450 log.cc:927] Time spent T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691: Append to log took a long time: real 0.147s user 0.000s sys 0.000s
I20260810 19:47:57.254491 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25570b1795164aeca86a5313bd30a4c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.252921 9611 leader_election.cc:304] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:57.255425 11426 raft_consensus.cc:2804] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:57.255550 11426 raft_consensus.cc:493] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:57.255636 11426 raft_consensus.cc:3060] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:57.256058 9885 rpcz_store.cc:276] 0810 19:47:55.639988 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.640696 (+ 708us) service_pool.cc:224] Handling call
0810 19:47:55.643229 (+ 2533us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:55.643280 (+ 51us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.870520 (+1227240us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.076839 (+206319us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.147153 (+ 70314us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24501}
I20260810 19:47:57.256253 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3159795344ae492fb099fca0e52fcf20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.256645 9885 tablet_service.cc:1511] Processing CreateTablet for tablet 5a35be79a8924213ab860a9da04a598c (DEFAULT_TABLE table=default.Table_dca6b457fbf744e089c4a583fca06cbb [id=4bce0610a04641ff86ab3af94e12e31d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.257012 9885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a35be79a8924213ab860a9da04a598c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.258469 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7de27c3442584746b76ea838d38f0b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.258711 11426 raft_consensus.cc:515] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.260012 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55fb03a8dd3b40f5ba3de41fa7c01f5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.260190 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3916a976efef43428942135e777edcec" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:57.260411 9951 raft_consensus.cc:3060] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:57.260407 11426 leader_election.cc:290] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:57.260681 10371 log.cc:1199] T dad16ea0f82942de8587dd7c98c0d2df P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/dad16ea0f82942de8587dd7c98c0d2df
I20260810 19:47:57.261096 10371 ts_tablet_manager.cc:1950] T dad16ea0f82942de8587dd7c98c0d2df P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:57.262004 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 395) took 1755 ms. Trace:
I20260810 19:47:57.262130 10371 rpcz_store.cc:276] 0810 19:47:55.506544 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.537437 (+ 30893us) service_pool.cc:224] Handling call
0810 19:47:57.211559 (+1674122us) ts_tablet_manager.cc:1151] Deleting tablet dad16ea0f82942de8587dd7c98c0d2df
0810 19:47:57.211573 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.223606 (+ 12033us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.252709 (+ 29103us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.261957 (+ 9248us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1673729}
I20260810 19:47:57.262637 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 401) took 1722 ms. Trace:
I20260810 19:47:57.262765 10371 rpcz_store.cc:276] 0810 19:47:55.540160 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.584702 (+ 44542us) service_pool.cc:224] Handling call
0810 19:47:57.262462 (+1677760us) ts_tablet_manager.cc:1151] Deleting tablet dcb3660108094399b36d19ea8e6b8308
0810 19:47:57.262475 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.262602 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1677501}
I20260810 19:47:57.263139 10366 ts_tablet_manager.cc:1403] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.917s user 0.005s sys 0.023s
I20260810 19:47:57.263144 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 440) took 1268 ms. Trace:
I20260810 19:47:57.263249 10371 rpcz_store.cc:276] 0810 19:47:55.994748 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.994785 (+ 37us) service_pool.cc:224] Handling call
0810 19:47:57.262999 (+1268214us) ts_tablet_manager.cc:1151] Deleting tablet 87bbcc651d034e2a826478b805792e48
0810 19:47:57.263011 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.263111 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1267844}
I20260810 19:47:57.263619 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 438) took 1312 ms. Trace:
I20260810 19:47:57.263736 10371 rpcz_store.cc:276] 0810 19:47:55.950918 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.955328 (+ 4410us) service_pool.cc:224] Handling call
0810 19:47:57.263493 (+1308165us) ts_tablet_manager.cc:1151] Deleting tablet 2b2b20dc77954af7a203f357c746be29
0810 19:47:57.263503 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.263586 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1250809}
I20260810 19:47:57.264102 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 442) took 1269 ms. Trace:
I20260810 19:47:57.264204 10371 rpcz_store.cc:276] 0810 19:47:55.994914 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.012742 (+ 17828us) service_pool.cc:224] Handling call
0810 19:47:57.263947 (+1251205us) ts_tablet_manager.cc:1151] Deleting tablet 45194cae6ea44d9d8cf856d256fd534f
0810 19:47:57.263956 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.264068 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1250960}
I20260810 19:47:57.264292 10366 raft_consensus.cc:359] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.264381 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91737c2129e4ca385b4e1c8999c62b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.264516 10366 raft_consensus.cc:385] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:57.264537 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 439) took 1270 ms. Trace:
I20260810 19:47:57.264600 10366 raft_consensus.cc:740] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:57.264631 10371 rpcz_store.cc:276] 0810 19:47:55.994606 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.997688 (+ 3082us) service_pool.cc:224] Handling call
0810 19:47:57.264411 (+1266723us) ts_tablet_manager.cc:1151] Deleting tablet a78960e1f2164c848297411b9273ac64
0810 19:47:57.264420 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.264504 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1250959}
I20260810 19:47:57.264915 10371 tablet_replica.cc:333] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:57.264856 10366 consensus_queue.cc:260] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.265127 10371 raft_consensus.cc:2243] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:57.265391 10371 pending_rounds.cc:70] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4: Trying to abort 1 pending ops.
I20260810 19:47:57.265484 10371 pending_rounds.cc:77] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058671207043072 op_type: NO_OP noop_request { }
I20260810 19:47:57.265576 10366 ts_tablet_manager.cc:1434] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:47:57.265597 10371 raft_consensus.cc:2889] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:57.265722 10371 raft_consensus.cc:2272] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:57.266291 10366 tablet_bootstrap.cc:492] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:57.267639 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 4f2d7c165d2c465d9080b927d54807f7 (table default.Table_35ada13f5f5a41b0a93a57276b7756d9 [id=fa3844f34a5b4d55b6e87ec2164eb8fb]) successfully deleted
W20260810 19:47:57.267936 9397 catalog_manager.cc:5017] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 5d3598b5743244e39efd12703ec15aea because the tablet was not found. No further retry: Not found: Tablet not found: 5d3598b5743244e39efd12703ec15aea
I20260810 19:47:57.268235 10366 tablet_bootstrap.cc:654] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:57.268356 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet dad16ea0f82942de8587dd7c98c0d2df (table default.Table_59b5d4d82ac044e0a101d8f598a44e43 [id=4fde0c720763432cac09c13172372936]) successfully deleted
W20260810 19:47:57.268630 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 87bbcc651d034e2a826478b805792e48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87bbcc651d034e2a826478b805792e48 already in progress: creating tablet
I20260810 19:47:57.268680 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 6dea3165feb842ecb58b7ace235abf38 (DEFAULT_TABLE table=default.Table_250f18957ff84ad58246dfec016f0abf [id=197d5993ea8643288fe8814a51e4bfd4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:57.268827 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 2b2b20dc77954af7a203f357c746be29 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b2b20dc77954af7a203f357c746be29 already in progress: creating tablet
W20260810 19:47:57.269043 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 45194cae6ea44d9d8cf856d256fd534f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45194cae6ea44d9d8cf856d256fd534f already in progress: creating tablet
W20260810 19:47:57.269268 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet a78960e1f2164c848297411b9273ac64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a78960e1f2164c848297411b9273ac64 already in progress: creating tablet
I20260810 19:47:57.271514 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dea3165feb842ecb58b7ace235abf38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.272061 9412 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 10617bdf2eed4dbd8d13ea1821443863 (table default.Table_4502b22ebf5b47e5a0c8e0c3027e3251 [id=f1973d72068847eaabc823653402d194]). Expected version 2 got 0
I20260810 19:47:57.272322 9412 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 81720b897a674b5380c6469d1600a979 (table default.Table_e4aeb59e91c24097bac9517b3c62b75a [id=8d7f043045ff44cd886367b5860f8433]). Expected version 1 got 0
I20260810 19:47:57.272543 9412 catalog_manager.cc:5719] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:47:57.272933 9412 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 31c8699875b54be888b3128df1b673aa (table default.Table_c35c3a44fcc44bba8a8c334292245b49 [id=5abc1f7beec444a4a988fbfcb8b45623]). Expected version 1 got 0
I20260810 19:47:57.273167 9412 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5 (table default.Table_b46992ec81974f6caad1ea769640dcf1 [id=d6d2d95e5e9f4e10a7d5a8153e66e4b6]). Expected version 2 got 0
I20260810 19:47:57.274719 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22954e727fb44a24bd382b9caee9996b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:57.275943 9830 consensus_peers.cc:597] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:57.277952 9911 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 415) took 1608 ms. Trace:
I20260810 19:47:57.283284 9911 rpcz_store.cc:276] 0810 19:47:55.647680 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.656672 (+ 8992us) service_pool.cc:224] Handling call
0810 19:47:55.657172 (+ 500us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:55.657199 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.854988 (+1197789us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.255460 (+400472us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.255626 (+ 166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.283967 9911 tablet_service.cc:1511] Processing CreateTablet for tablet ea557438b7b74944b19e17d7fb8f20cf (DEFAULT_TABLE table=default.Table_2127777800d84906905aac5e1b9eaf64 [id=310d071d99754287862ab16b28a0b5cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.286162 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_6bacbec2a69f41549e72fa5a46246b11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:57.286921 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6bacbec2a69f41549e72fa5a46246b11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:57.290176 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0cf27f44c96c48b6a8f46cf6bcd77713" } new_table_name: "default.Table_c6af56cc89144541a50f07ce309f7aaf" modify_external_catalogs: true
I20260810 19:47:57.291728 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_fd5af78e376540b2be18db6a65953a46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:57.292353 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd5af78e376540b2be18db6a65953a46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:57.293802 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_33028416824c4623be1af7797d6d605a" } new_table_name: "default.Table_6f102dcbbfc04cefa60e2601ea7bb372" modify_external_catalogs: true
I20260810 19:47:57.297178 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_5518a17337794a478179be2f1e73ed88"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:57.297798 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5518a17337794a478179be2f1e73ed88 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:57.299259 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ba42032e7344423a0e86c55d613f27d consensus state has no leader
I20260810 19:47:57.303392 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1a90c42d93434c0ab29e50e010af4212"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:57.303974 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a90c42d93434c0ab29e50e010af4212 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:57.306429 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea557438b7b74944b19e17d7fb8f20cf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:57.308239 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b3754889e4574fc3a936ac31cc6f496a consensus state has no leader
I20260810 19:47:57.311076 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 4abd3c95aa394e1cad066d49d22b5764 (DEFAULT_TABLE table=default.Table_ce92099864b748aaa3d27ac772ec799d [id=094ccb77d95f490f9f73c80a85f4c60a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.311905 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4abd3c95aa394e1cad066d49d22b5764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.313992 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3916a976efef43428942135e777edcec" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:57.316089 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet f5fa6060b9ef48cea6830cd9d19424ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:57.325498 9913 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 419) took 1592 ms. Trace:
W20260810 19:47:57.327329 9611 leader_election.cc:343] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:57.329448 10142 tablet_service.cc:1558] Processing DeleteTablet for tablet ee5f38d91bb349a9ae1da8ba69d2ddbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:57.329504 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d7c165d2c465d9080b927d54807f7" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:57.329560 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 81f0f3f88d26432fbadc5e90aaa5d158 (DEFAULT_TABLE table=default.Table_80a86eb986c5424fb1702c55beb124c1 [id=a779dbb85fac4fd691df7f5ab24b49f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.329754 9913 rpcz_store.cc:276] 0810 19:47:55.690908 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.853470 (+162562us) service_pool.cc:224] Handling call
0810 19:47:55.912558 (+ 59088us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:55.916317 (+ 3759us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.935186 (+1018869us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.282883 (+347697us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.283070 (+ 187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.330041 10142 tablet_service.cc:1511] Processing CreateTablet for tablet 82609a50781d43f38baa6b76187e02ef (DEFAULT_TABLE table=default.Table_c90bd097f5db43c6aefde84c1a39aa3a [id=b1f85880703241f5861724dacc9062a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.330090 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 7f4ca5a1ec3d4ca392f389f2dabae296 (DEFAULT_TABLE table=default.Table_5323ce7ca7d04a90811d8058dc7b08ea [id=7725ec1d880744a28616bfc8857bdff1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.330178 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e967384768b4ec7956f1b508e8ab2af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:57.331954 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 229dd737ee8547a89445593cc117fbc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.251075 9902 rpcz_store.cc:276] 0810 19:47:56.075398 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.447149 (+371751us) service_pool.cc:224] Handling call
0810 19:47:56.461425 (+ 14276us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.461460 (+ 35us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.653405 (+191945us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.104593 (+451188us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.147333 (+ 42740us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.333624 9902 tablet_service.cc:1511] Processing CreateTablet for tablet a776693b6b4943a7b64e13ec10958c16 (DEFAULT_TABLE table=default.Table_ad4523adf6cb4df7948a357515ec4b9a [id=632c2c289ff24ddcbf9d13ffe1fcda15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.337720 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f4ca5a1ec3d4ca392f389f2dabae296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.338714 10125 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 432) took 1188 ms. Trace:
I20260810 19:47:57.342417 10142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82609a50781d43f38baa6b76187e02ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.343500 10125 rpcz_store.cc:276] 0810 19:47:56.147967 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.916754 (+768787us) service_pool.cc:224] Handling call
0810 19:47:56.974081 (+ 57327us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.974113 (+ 32us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:57.143433 (+169320us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.336058 (+192625us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.336246 (+ 188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.344606 10125 tablet_service.cc:1511] Processing CreateTablet for tablet cbcaa7106df24aaeb07428b7b590e282 (DEFAULT_TABLE table=default.Table_471bc99d3aa9446c8a287a8ae160d06d [id=a61b27909b65459793d63e8c8bae4d58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.344875 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f0f3f88d26432fbadc5e90aaa5d158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.346215 10370 tablet_bootstrap.cc:654] T 10617bdf2eed4dbd8d13ea1821443863 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:57.346964 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a776693b6b4943a7b64e13ec10958c16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.350028 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbcaa7106df24aaeb07428b7b590e282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.354378 10116 tablet_service.cc:1511] Processing CreateTablet for tablet fdd82537177a4142bddd0544485b00c4 (DEFAULT_TABLE table=default.Table_33d8853eb1ce4caa81c8fe96f0ba2be0 [id=d277a804313e4f35a31b58d4f682efe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.355007 10116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdd82537177a4142bddd0544485b00c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.356186 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet ae3e151180ae4d258d18365770acaaad with delete_type TABLET_DATA_DELETED (replaced by tablet 6dea3165feb842ecb58b7ace235abf38) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:57.358069 11491 tablet.cc:1724] T 4d654dada92a4939914d26ab72a5f5e8 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:47:57.374917 9913 tablet_service.cc:1511] Processing CreateTablet for tablet cb2c9782c034435088f991bef8edf288 (DEFAULT_TABLE table=default.Table_9a949158a5f2417ea8f015281b20659a [id=8763b964126e48ba85394844a7628795]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.379527 9951 raft_consensus.cc:2468] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:47:57.382773 10367 tablet_bootstrap.cc:492] T 06af03c8a87141febef768bd56c72c39 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:57.382978 10367 ts_tablet_manager.cc:1403] T 06af03c8a87141febef768bd56c72c39 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.465s user 0.005s sys 0.006s
I20260810 19:47:57.384089 9904 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 425) took 1512 ms. Trace:
I20260810 19:47:57.384243 9904 rpcz_store.cc:276] 0810 19:47:55.861135 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.076363 (+215228us) service_pool.cc:224] Handling call
0810 19:47:56.127211 (+ 50848us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.127268 (+ 57us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.984978 (+857710us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.373730 (+388752us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.373933 (+ 203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.385416 9611 leader_election.cc:304] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:57.386022 9904 tablet_service.cc:1511] Processing CreateTablet for tablet e87fd882e6b6413480a0cb06aee74722 (DEFAULT_TABLE table=default.Table_f90f1a0c22fa4781812518f44c9d7b17 [id=d12cb82567fd409988672b04a2e05a5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.387439 11426 raft_consensus.cc:2804] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:57.376677 9897 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 424) took 1530 ms. Trace:
I20260810 19:47:57.387842 11426 raft_consensus.cc:697] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:47:57.388252 11426 consensus_queue.cc:237] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.389799 10367 raft_consensus.cc:359] T 06af03c8a87141febef768bd56c72c39 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.390013 10367 raft_consensus.cc:385] T 06af03c8a87141febef768bd56c72c39 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:57.390112 10367 raft_consensus.cc:740] T 06af03c8a87141febef768bd56c72c39 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:57.390329 10367 consensus_queue.cc:260] T 06af03c8a87141febef768bd56c72c39 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.390586 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2c9782c034435088f991bef8edf288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.390897 10367 ts_tablet_manager.cc:1434] T 06af03c8a87141febef768bd56c72c39 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260810 19:47:57.391204 10367 tablet_bootstrap.cc:492] T d99b34f901484fad87cff4bb9ab56fc8 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:57.393028 10367 tablet_bootstrap.cc:654] T d99b34f901484fad87cff4bb9ab56fc8 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:57.393627 10377 ts_tablet_manager.cc:1929] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:57.393765 10377 log.cc:1199] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/dad16ea0f82942de8587dd7c98c0d2df
I20260810 19:47:57.394006 9897 rpcz_store.cc:276] 0810 19:47:55.838611 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.016105 (+177494us) service_pool.cc:224] Handling call
0810 19:47:56.049729 (+ 33624us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.049763 (+ 34us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:56.957779 (+908016us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.368558 (+410779us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.368783 (+ 225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.395912 10377 ts_tablet_manager.cc:1950] T dad16ea0f82942de8587dd7c98c0d2df P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:57.396368 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 432) took 1288 ms. Trace:
I20260810 19:47:57.397332 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e87fd882e6b6413480a0cb06aee74722. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.397732 10367 tablet_bootstrap.cc:492] T d99b34f901484fad87cff4bb9ab56fc8 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:57.397958 10367 ts_tablet_manager.cc:1403] T d99b34f901484fad87cff4bb9ab56fc8 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.002s
I20260810 19:47:57.398386 11469 raft_consensus.cc:493] T ffc4466b82bd49fcaad30e4d5325c7db P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:57.398665 11469 raft_consensus.cc:515] T ffc4466b82bd49fcaad30e4d5325c7db P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.399008 10367 raft_consensus.cc:359] T d99b34f901484fad87cff4bb9ab56fc8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.399209 10367 raft_consensus.cc:385] T d99b34f901484fad87cff4bb9ab56fc8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:57.399308 10367 raft_consensus.cc:740] T d99b34f901484fad87cff4bb9ab56fc8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:57.399616 10367 consensus_queue.cc:260] T d99b34f901484fad87cff4bb9ab56fc8 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.400187 10367 ts_tablet_manager.cc:1434] T d99b34f901484fad87cff4bb9ab56fc8 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:47:57.400554 10367 tablet_bootstrap.cc:492] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:57.402268 10367 tablet_bootstrap.cc:654] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:57.409796 10367 tablet_bootstrap.cc:492] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:57.410851 10367 ts_tablet_manager.cc:1403] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.004s
I20260810 19:47:57.410993 9897 tablet_service.cc:1511] Processing CreateTablet for tablet 269adfeb1efe46d3944f33b245126665 (DEFAULT_TABLE table=default.Table_4ec3ace539c444e08c5e84fff6a6f919 [id=b7a9d407c9d74d0c8fd85c1d8498c3f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.412235 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc4466b82bd49fcaad30e4d5325c7db" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:57.412252 10367 raft_consensus.cc:359] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.412442 10367 raft_consensus.cc:385] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:57.412525 10367 raft_consensus.cc:740] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:57.412735 10367 consensus_queue.cc:260] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:57.412997 9611 leader_election.cc:343] T ffc4466b82bd49fcaad30e4d5325c7db P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:57.419133 10367 ts_tablet_manager.cc:1434] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.008s user 0.000s sys 0.001s
I20260810 19:47:57.420240 11412 consensus_queue.cc:1048] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260810 19:47:57.424192 10367 tablet_bootstrap.cc:492] T 6992e7ef8e794ddc879ae04f9f78b8bd P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:57.427644 10367 tablet_bootstrap.cc:654] T 6992e7ef8e794ddc879ae04f9f78b8bd P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:57.416299 11469 leader_election.cc:290] T ffc4466b82bd49fcaad30e4d5325c7db P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:57.446777 10367 tablet_bootstrap.cc:492] T 6992e7ef8e794ddc879ae04f9f78b8bd P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:57.447779 10367 ts_tablet_manager.cc:1403] T 6992e7ef8e794ddc879ae04f9f78b8bd P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.024s user 0.000s sys 0.004s
I20260810 19:47:57.449270 10367 raft_consensus.cc:359] T 6992e7ef8e794ddc879ae04f9f78b8bd P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.454489 10367 raft_consensus.cc:385] T 6992e7ef8e794ddc879ae04f9f78b8bd P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:57.455626 9894 tablet_service.cc:1558] Processing DeleteTablet for tablet 39885c3e0adb4132945d507628f4f082 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:57.456130 9894 tablet_service.cc:1511] Processing CreateTablet for tablet 4579a71f8c8149798eb5f136135e5efe (DEFAULT_TABLE table=default.Table_90f1232af7064dc2b768da280482a20b [id=8387d76208d54536aab9a8cd1810c7de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.456902 10367 raft_consensus.cc:740] T 6992e7ef8e794ddc879ae04f9f78b8bd P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:57.458982 10367 consensus_queue.cc:260] T 6992e7ef8e794ddc879ae04f9f78b8bd P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.460292 10367 ts_tablet_manager.cc:1434] T 6992e7ef8e794ddc879ae04f9f78b8bd P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260810 19:47:57.461105 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d654dada92a4939914d26ab72a5f5e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:57.461828 10367 tablet_bootstrap.cc:492] T dd632a01fe424a3a956d445ce01e31d2 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:57.462913 9883 tablet_service.cc:1511] Processing CreateTablet for tablet b853bf6bbc7845bc9cfa6347687582e2 (DEFAULT_TABLE table=default.Table_e7191b05092d4bb3873107f5e514dcba [id=7d69e5bb3bcc4efa9e77162f6316db9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.468868 9887 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 445) took 1011 ms. Trace:
I20260810 19:47:57.465945 10371 ts_tablet_manager.cc:1916] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:57.469115 9887 rpcz_store.cc:276] 0810 19:47:56.457387 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.858794 (+401407us) service_pool.cc:224] Handling call
0810 19:47:56.947896 (+ 89102us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.947927 (+ 31us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:57.326703 (+378776us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.468371 (+141668us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.468794 (+ 423us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.469687 9887 tablet_service.cc:1511] Processing CreateTablet for tablet 841f58b4e8f7465eaa7fa08629e0bc2a (DEFAULT_TABLE table=default.Table_fe3c84ad30eb4d57a6d20ec860c02286 [id=c401d03820c6453184e1da223c380872]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.473439 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 81f0f3f88d26432fbadc5e90aaa5d158 (DEFAULT_TABLE table=default.Table_80a86eb986c5424fb1702c55beb124c1 [id=a779dbb85fac4fd691df7f5ab24b49f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.479126 10367 tablet_bootstrap.cc:654] T dd632a01fe424a3a956d445ce01e31d2 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:57.482839 11469 raft_consensus.cc:493] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:57.483137 11469 raft_consensus.cc:515] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.488286 11469 leader_election.cc:290] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:57.490815 10371 ts_tablet_manager.cc:1929] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:57.493839 10371 log.cc:1199] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/7d3395886420455d9bdaf816c19ebae2
I20260810 19:47:57.492642 10367 tablet_bootstrap.cc:492] T dd632a01fe424a3a956d445ce01e31d2 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:57.474175 9906 tablet_service.cc:1511] Processing CreateTablet for tablet c8311ccef92c48b2a94bbb9e9262ea9d (DEFAULT_TABLE table=default.Table_5e59db5efe264421a5f3455e9aa63c62 [id=4b52435931f6482a8c3bca2d0c05bd53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.476707 9899 tablet_service.cc:1511] Processing CreateTablet for tablet 0849ea9c04104a8184f8a8cd40e06fc2 (DEFAULT_TABLE table=default.Table_2c45b8ef81f94485a39df1d41c96f9a6 [id=061ee47a7ec24c2389a57b68997bff51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.477097 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 3680db3f1a5945a89c1198eb4849e58c with delete_type TABLET_DATA_DELETED (replaced by tablet 33f2ea0d46f44fca88e16ea83ad67bc2) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:57.494886 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0849ea9c04104a8184f8a8cd40e06fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.496598 10139 tablet_service.cc:1558] Processing DeleteTablet for tablet 3badc88d94a34ff7a053ed312f0dd646 with delete_type TABLET_DATA_DELETED (replaced by tablet b16108d31ced4e02b2d7d0ab1f581a2c) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:57.477236 9890 tablet_service.cc:1511] Processing CreateTablet for tablet f5fa6060b9ef48cea6830cd9d19424ea (DEFAULT_TABLE table=default.Table_9d569d756be84460b1b78812a13b95ad [id=14e993ddf3b646098d6d3a3e24d01b07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.477569 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 269adfeb1efe46d3944f33b245126665. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.478899 10366 tablet_bootstrap.cc:492] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:57.479080 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 60e99cd75ada470380ab69da60ddac77 (DEFAULT_TABLE table=default.Table_f11b6cec3ddf4b339b5f90841b7b3d8b [id=e872b31132a34cf5bd9a65bde184c182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.491333 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7737acd216204209ba0327e26e85cfe6" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:57.492286 10377 rpcz_store.cc:276] 0810 19:47:56.108008 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.496938 (+388930us) service_pool.cc:224] Handling call
0810 19:47:56.595569 (+ 98631us) ts_tablet_manager.cc:1151] Deleting tablet dad16ea0f82942de8587dd7c98c0d2df
0810 19:47:56.601386 (+ 5817us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.051281 (+449895us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.393162 (+341881us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.396332 (+ 3170us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":120}
I20260810 19:47:57.494623 10371 ts_tablet_manager.cc:1950] T 7d3395886420455d9bdaf816c19ebae2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:57.498086 10367 ts_tablet_manager.cc:1403] T dd632a01fe424a3a956d445ce01e31d2 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.003s
I20260810 19:47:57.505872 10367 raft_consensus.cc:359] T dd632a01fe424a3a956d445ce01e31d2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.510592 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4579a71f8c8149798eb5f136135e5efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.510943 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5fa6060b9ef48cea6830cd9d19424ea. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:57.512651 9611 leader_election.cc:343] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:57.515743 10367 raft_consensus.cc:385] T dd632a01fe424a3a956d445ce01e31d2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:57.518360 10367 raft_consensus.cc:740] T dd632a01fe424a3a956d445ce01e31d2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:57.520152 10139 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b40fd0d57ea4b71aeef2d66f4958ac8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:57.520750 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 471ff7c225dd498fa39751202beec3a9 (DEFAULT_TABLE table=default.Table_cb085f4d70f74c8885b3f837c4c94501 [id=c9a13735c4f7435d98909590d99b2f5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.520905 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5fa6060b9ef48cea6830cd9d19424ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.522192 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 471ff7c225dd498fa39751202beec3a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.524735 10366 ts_tablet_manager.cc:1403] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.232s user 0.015s sys 0.015s
W20260810 19:47:57.526093 9898 consensus_meta.cc:287] T f42e9b00e3da4d73b4beb1b325f09f4a P 6986ed920dcb4af29a5eeeda6f671691: Time spent flushing consensus metadata: real 0.515s user 0.003s sys 0.000s
I20260810 19:47:57.524951 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 444) took 1522 ms. Trace:
I20260810 19:47:57.526333 10135 tablet_service.cc:1511] Processing CreateTablet for tablet c2604484e3114564812653a15298cc0b (DEFAULT_TABLE table=default.Table_e65a0539bebe443199c67a2723cd4af6 [id=e3fc833ec8be41748f0a1c2ef8f26b1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.525542 10367 consensus_queue.cc:260] T dd632a01fe424a3a956d445ce01e31d2 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:57.530745 9944 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s user 0.010s sys 0.041s
I20260810 19:47:57.527182 10371 rpcz_store.cc:276] 0810 19:47:56.002011 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.013487 (+ 11476us) service_pool.cc:224] Handling call
0810 19:47:57.264854 (+1251367us) ts_tablet_manager.cc:1151] Deleting tablet 7d3395886420455d9bdaf816c19ebae2
0810 19:47:57.264864 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.477570 (+212706us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.490692 (+ 13122us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.524432 (+ 33740us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1251197}
I20260810 19:47:57.533541 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 7d3395886420455d9bdaf816c19ebae2 (table default.Table_da2146aa6d244f3f892e8cf1c68bda8f [id=febfd4d57fd54ce0bd4a406cc965303f]) successfully deleted
I20260810 19:47:57.535080 10377 tablet_replica.cc:333] T 3badc88d94a34ff7a053ed312f0dd646 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:57.523344 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d93821ff46a4096a8ebbac83faabed7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:57.535705 10128 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 454) took 1006 ms. Trace:
I20260810 19:47:57.536615 9887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 841f58b4e8f7465eaa7fa08629e0bc2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.536958 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 443) took 1541 ms. Trace:
I20260810 19:47:57.538544 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8311ccef92c48b2a94bbb9e9262ea9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.539788 10128 rpcz_store.cc:276] 0810 19:47:56.517656 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.120368 (+602712us) service_pool.cc:224] Handling call
0810 19:47:57.123366 (+ 2998us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:57.123395 (+ 29us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:57.376083 (+252688us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.523530 (+147447us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.523716 (+ 186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.540395 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 97c78c188c024b0f9da45cd99d2cb80c (DEFAULT_TABLE table=default.Table_65864a250646401984a7263cf477ab07 [id=2f1d802c24844383976d2799035e9d0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.541743 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60e99cd75ada470380ab69da60ddac77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.543152 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8311ccef92c48b2a94bbb9e9262ea9d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:57.518843 9830 leader_election.cc:343] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:57.546833 10127 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 455) took 1026 ms. Trace:
I20260810 19:47:57.546998 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 22954e727fb44a24bd382b9caee9996b (DEFAULT_TABLE table=default.Table_a16400f647e94437932730ebd220e795 [id=1fee039754f440c398b5d2297eb89999]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.539677 10367 ts_tablet_manager.cc:1434] T dd632a01fe424a3a956d445ce01e31d2 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.036s user 0.002s sys 0.002s
W20260810 19:47:57.549678 11468 negotiation.cc:336] Failed RPC negotiation. Trace:
0810 19:47:57.105429 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.8.235.253:37397 (local address 127.8.235.194:42597)
0810 19:47:57.508335 (+402906us) negotiation.cc:107] Waiting for socket to connect
0810 19:47:57.508474 (+ 139us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.235.253:37397: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":402758,"threads_started":1}
W20260810 19:47:57.551190 9944 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s user 0.010s sys 0.041s
I20260810 19:47:57.551157 9898 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 447) took 1068 ms. Trace:
I20260810 19:47:57.552454 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2604484e3114564812653a15298cc0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.552855 10127 rpcz_store.cc:276] 0810 19:47:56.517729 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.121861 (+604132us) service_pool.cc:224] Handling call
0810 19:47:57.175312 (+ 53451us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:57.175337 (+ 25us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:57.340005 (+164668us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.544306 (+204301us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.544475 (+ 169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.554656 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97c78c188c024b0f9da45cd99d2cb80c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:57.554697 10068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 186667us
I20260810 19:47:57.554854 9898 rpcz_store.cc:276] 0810 19:47:56.483286 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.913886 (+430600us) service_pool.cc:224] Handling call
0810 19:47:56.916170 (+ 2284us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:56.916213 (+ 43us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:57.011240 (+ 95027us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.526273 (+515033us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.526466 (+ 193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.556895 10377 raft_consensus.cc:2243] T 3badc88d94a34ff7a053ed312f0dd646 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:57.557799 10377 raft_consensus.cc:2272] T 3badc88d94a34ff7a053ed312f0dd646 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:57.539536 10371 rpcz_store.cc:276] 0810 19:47:55.995022 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.013019 (+ 17997us) service_pool.cc:224] Handling call
0810 19:47:57.533559 (+1520540us) ts_tablet_manager.cc:1151] Deleting tablet 82c3f619c76e40c583bfcdf2bb77fe42
0810 19:47:57.533577 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.536568 (+ 2991us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1519554}
I20260810 19:47:57.558473 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 441) took 1563 ms. Trace:
I20260810 19:47:57.558612 10371 rpcz_store.cc:276] 0810 19:47:55.994831 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.995184 (+ 353us) service_pool.cc:224] Handling call
0810 19:47:57.558278 (+1563094us) ts_tablet_manager.cc:1151] Deleting tablet 4198f46be0194875aea6a7952321bc69
0810 19:47:57.558287 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.558428 (+ 141us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1542504}
W20260810 19:47:57.558765 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 82c3f619c76e40c583bfcdf2bb77fe42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82c3f619c76e40c583bfcdf2bb77fe42 already in progress: creating tablet
I20260810 19:47:57.559033 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 453) took 1354 ms. Trace:
W20260810 19:47:57.559376 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 4198f46be0194875aea6a7952321bc69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4198f46be0194875aea6a7952321bc69 already in progress: creating tablet
I20260810 19:47:57.560258 9885 tablet_service.cc:1558] Processing DeleteTablet for tablet 48eee4ce10114021855075812e356652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:57.548748 11494 tablet.cc:1724] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:47:57.559744 10367 tablet_bootstrap.cc:492] T c7235af514fa47d899d7e38ee5662f6c P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:57.563419 10367 tablet_bootstrap.cc:654] T c7235af514fa47d899d7e38ee5662f6c P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:57.563747 11440 raft_consensus.cc:2749] T 3badc88d94a34ff7a053ed312f0dd646 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:57.565488 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 674b44f34b2042d3aac0b399fada795e (DEFAULT_TABLE table=default.Table_2d2422f738fe43f5aac8adbdaac041cb [id=7ca0d44fb4b04bc09a6912fcb59a037c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.567368 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 841f58b4e8f7465eaa7fa08629e0bc2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.559846 10371 rpcz_store.cc:276] 0810 19:47:56.205031 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.205139 (+ 108us) service_pool.cc:224] Handling call
0810 19:47:57.558898 (+1353759us) ts_tablet_manager.cc:1151] Deleting tablet 05059ef70a8e440ca2988bfeb610645d
0810 19:47:57.558907 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.559002 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1352788}
I20260810 19:47:57.576231 10354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0c56283079e74549afd0096f7e72046a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } } }
I20260810 19:47:57.576388 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ec7e4f3e68244e369e1ec60ad7e3fbee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:57.576509 10354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [sys.catalog]: This master's current role is: LEADER
W20260810 19:47:57.577080 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec7e4f3e68244e369e1ec60ad7e3fbee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:57.578632 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f0bb702e0c7148519ccd7a84a5e9e574" } modify_external_catalogs: true
I20260810 19:47:57.578892 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f0bb702e0c7148519ccd7a84a5e9e574" } modify_external_catalogs: true
I20260810 19:47:57.579470 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a70b9fa6ee4b4696b9f30fcfd17a3505"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:57.580148 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a70b9fa6ee4b4696b9f30fcfd17a3505 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:57.581756 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_156494e413e94dddafcb9fd6cb8e2498" } new_table_name: "default.Table_455517659634400cbd68b4d4516a4de9" modify_external_catalogs: true
I20260810 19:47:57.585762 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_6a0b31ab2f594e4885ce04f95c8b7854"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:57.586472 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a0b31ab2f594e4885ce04f95c8b7854 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:57.587745 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7924d8dbb4ea4a7c8809db86c7b3fbef" } new_table_name: "default.Table_3d2a5a2863e24c4bb90af582b7f3a9bb" modify_external_catalogs: true
I20260810 19:47:57.588989 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_020c6c0883f242f7968d900aaa1f0f68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:57.590472 11469 raft_consensus.cc:493] T 11272d47d96f443187d63c184049871f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:57.590656 11469 raft_consensus.cc:515] T 11272d47d96f443187d63c184049871f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.591450 11469 leader_election.cc:290] T 11272d47d96f443187d63c184049871f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:47:57.591670 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_020c6c0883f242f7968d900aaa1f0f68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:57.593465 10375 ts_tablet_manager.cc:1929] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:57.593568 10370 tablet_bootstrap.cc:492] T 10617bdf2eed4dbd8d13ea1821443863 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
W20260810 19:47:57.593611 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 05059ef70a8e440ca2988bfeb610645d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05059ef70a8e440ca2988bfeb610645d already in progress: creating tablet
I20260810 19:47:57.593748 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 455) took 1382 ms. Trace:
I20260810 19:47:57.593961 10371 rpcz_store.cc:276] 0810 19:47:56.210484 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.210592 (+ 108us) service_pool.cc:224] Handling call
0810 19:47:57.593027 (+1382435us) ts_tablet_manager.cc:1151] Deleting tablet 1f895bcd21f647f2ab813903d600a31a
0810 19:47:57.593044 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.593295 (+ 251us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1380185}
W20260810 19:47:57.594842 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 1f895bcd21f647f2ab813903d600a31a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f895bcd21f647f2ab813903d600a31a already in progress: creating tablet
I20260810 19:47:57.596696 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_225d70cd8d7c4166ac7b297939047aed" } modify_external_catalogs: true
I20260810 19:47:57.596926 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_225d70cd8d7c4166ac7b297939047aed" } modify_external_catalogs: true
I20260810 19:47:57.599165 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_33d8853eb1ce4caa81c8fe96f0ba2be0" } new_table_name: "default.Table_21d8962dbe56454188c9a5b8729034c3" modify_external_catalogs: true
I20260810 19:47:57.602254 10375 log.cc:1199] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/2d90d9c9f6524859a0e33e649dd80f7c
I20260810 19:47:57.602733 10370 ts_tablet_manager.cc:1403] T 10617bdf2eed4dbd8d13ea1821443863 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.432s user 0.018s sys 0.015s
I20260810 19:47:57.607689 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 454) took 1398 ms. Trace:
I20260810 19:47:57.607654 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc4466b82bd49fcaad30e4d5325c7db" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:57.608992 9611 leader_election.cc:343] T ffc4466b82bd49fcaad30e4d5325c7db P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:57.610411 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 73a2e6a512224caa892ac7541131349f (DEFAULT_TABLE table=default.Table_1bc09ade1e7c4459a7ee8927ee4e6873 [id=289a824c00a042669db22936f02b9b97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.610920 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet b54feebc7c9841d89808054602be7913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:57.611645 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7737acd216204209ba0327e26e85cfe6" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:57.619742 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11272d47d96f443187d63c184049871f" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:57.620600 10137 tablet_service.cc:1511] Processing CreateTablet for tablet ea9408ecf3784a80ac0c064e1689d25e (DEFAULT_TABLE table=default.Table_156494e413e94dddafcb9fd6cb8e2498 [id=aabf9535ecdb44d1b3245f8f05542f28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.623021 10115 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 451) took 1104 ms. Trace:
I20260810 19:47:57.623149 10115 rpcz_store.cc:276] 0810 19:47:56.517432 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.098861 (+581429us) service_pool.cc:224] Handling call
0810 19:47:57.134140 (+ 35279us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:57.134197 (+ 57us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:57.524436 (+390239us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.621335 (+ 96899us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.621508 (+ 173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.625077 10375 ts_tablet_manager.cc:1950] T 2d90d9c9f6524859a0e33e649dd80f7c P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:57.625120 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 3520274768ed41abb010bb109127affa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:57.625715 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 9118f949ded748d7b90f00948f49be55 (DEFAULT_TABLE table=default.Table_830b53d484b34185b3edd4c39fcb36b5 [id=6cc8c0a07ee74ec99d7ccf22c3d6f494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.626057 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 312) took 4066 ms. Trace:
I20260810 19:47:57.626181 10375 rpcz_store.cc:276] 0810 19:47:53.559657 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.559954 (+ 297us) service_pool.cc:224] Handling call
0810 19:47:56.930940 (+3370986us) ts_tablet_manager.cc:1151] Deleting tablet 2d90d9c9f6524859a0e33e649dd80f7c
0810 19:47:56.930959 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:56.949309 (+ 18350us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x6160000c3754. stack: 00007f3a51eb6326 00007f3a51eb60e0 00007f3a50ee034d 00000000009a5774 00000000009a573d 00000000009a510a 00007f3a5dfb7780 00007f3a5f33e023 00007f3a61f03c67 00007f3a61f36d34 00007f3a61f17750 00007f3a61f174dd 0000000000aaf86c 00007f3a51efc84f 00007f3a51effb4b 00007f3a51eff9c8
0810 19:47:57.167723 (+218414us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.592333 (+424610us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.626008 (+ 33675us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40767872,"tablet-delete.queue_time_us":3370749}
I20260810 19:47:57.626698 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 314) took 4066 ms. Trace:
I20260810 19:47:57.626821 10375 rpcz_store.cc:276] 0810 19:47:53.559893 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.560198 (+ 305us) service_pool.cc:224] Handling call
0810 19:47:57.626542 (+4066344us) ts_tablet_manager.cc:1151] Deleting tablet 3cda6eb6d4b847edb2624a267bc3522d
0810 19:47:57.626551 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.626662 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4066114}
I20260810 19:47:57.627174 10375 tablet_replica.cc:333] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:57.627066 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 2d90d9c9f6524859a0e33e649dd80f7c (table default.Table_4d9757a90ce34541a2c047891e32a42c [id=cec00e7815514025aee218d41250d360]) successfully deleted
I20260810 19:47:57.627429 10375 raft_consensus.cc:2243] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:57.627609 10375 raft_consensus.cc:2272] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 19:47:57.628190 9395 catalog_manager.cc:5017] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 3cda6eb6d4b847edb2624a267bc3522d because the tablet was not found. No further retry: Not found: Tablet not found: 3cda6eb6d4b847edb2624a267bc3522d
I20260810 19:47:57.628453 10375 ts_tablet_manager.cc:1916] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:57.631875 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet f5fa6060b9ef48cea6830cd9d19424ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:57.632095 10377 ts_tablet_manager.cc:1916] T 3badc88d94a34ff7a053ed312f0dd646 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:57.632380 10115 tablet_service.cc:1511] Processing CreateTablet for tablet 6dea3165feb842ecb58b7ace235abf38 (DEFAULT_TABLE table=default.Table_250f18957ff84ad58246dfec016f0abf [id=197d5993ea8643288fe8814a51e4bfd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.634889 10120 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 453) took 1082 ms. Trace:
I20260810 19:47:57.635012 10120 rpcz_store.cc:276] 0810 19:47:56.517576 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.119773 (+602197us) service_pool.cc:224] Handling call
0810 19:47:57.161468 (+ 41695us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:57.161538 (+ 70us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:57.545444 (+383906us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.599621 (+ 54177us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.599772 (+ 151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.635313 9885 tablet_service.cc:1511] Processing CreateTablet for tablet 7f4ca5a1ec3d4ca392f389f2dabae296 (DEFAULT_TABLE table=default.Table_5323ce7ca7d04a90811d8058dc7b08ea [id=7725ec1d880744a28616bfc8857bdff1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.635587 10120 tablet_service.cc:1511] Processing CreateTablet for tablet 4abd3c95aa394e1cad066d49d22b5764 (DEFAULT_TABLE table=default.Table_ce92099864b748aaa3d27ac772ec799d [id=094ccb77d95f490f9f73c80a85f4c60a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.634850 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60e99cd75ada470380ab69da60ddac77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.636433 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 229dd737ee8547a89445593cc117fbc2 (DEFAULT_TABLE table=default.Table_bfa0ef28a4704e2589883d5ebd21cb92 [id=df4d2ed4289f45c68927ac7fb7c77f06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.637107 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11272d47d96f443187d63c184049871f" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:57.638718 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea9408ecf3784a80ac0c064e1689d25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.641558 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 73a2e6a512224caa892ac7541131349f (DEFAULT_TABLE table=default.Table_1bc09ade1e7c4459a7ee8927ee4e6873 [id=289a824c00a042669db22936f02b9b97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.642572 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9118f949ded748d7b90f00948f49be55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.643674 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b853bf6bbc7845bc9cfa6347687582e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.644165 10370 raft_consensus.cc:359] T 10617bdf2eed4dbd8d13ea1821443863 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.645246 10370 raft_consensus.cc:385] T 10617bdf2eed4dbd8d13ea1821443863 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:57.645488 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dea3165feb842ecb58b7ace235abf38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.646661 9611 leader_election.cc:304] T ffc4466b82bd49fcaad30e4d5325c7db P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
W20260810 19:47:57.647305 9611 leader_election.cc:343] T 11272d47d96f443187d63c184049871f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:57.648552 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 749cea5cd8f842b891f4e2cab07c054e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:57.649852 10370 raft_consensus.cc:740] T 10617bdf2eed4dbd8d13ea1821443863 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:57.650395 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet b5f30148b5c84f7cbdfabd0186611cc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:57.651584 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4abd3c95aa394e1cad066d49d22b5764. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:57.656427 9611 leader_election.cc:343] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:57.656617 9611 leader_election.cc:304] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:57.657321 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674b44f34b2042d3aac0b399fada795e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.659714 9830 leader_election.cc:304] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:47:57.660385 9611 leader_election.cc:343] T 11272d47d96f443187d63c184049871f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:57.660544 9611 leader_election.cc:304] T 11272d47d96f443187d63c184049871f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:57.660961 11469 raft_consensus.cc:2749] T ffc4466b82bd49fcaad30e4d5325c7db P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:57.662879 11469 raft_consensus.cc:2749] T 11272d47d96f443187d63c184049871f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:57.663087 11426 raft_consensus.cc:2749] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:57.663213 10366 raft_consensus.cc:359] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.662571 10371 rpcz_store.cc:276] 0810 19:47:56.208780 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.208895 (+ 115us) service_pool.cc:224] Handling call
0810 19:47:57.605697 (+1396802us) ts_tablet_manager.cc:1151] Deleting tablet eb3e7d34b5314bc7a7c5ed53792728ca
0810 19:47:57.605717 (+ 20us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.607408 (+ 1691us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1392387}
I20260810 19:47:57.667212 11410 raft_consensus.cc:2749] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 19:47:57.667745 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a2e6a512224caa892ac7541131349f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.669847 9885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f4ca5a1ec3d4ca392f389f2dabae296. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:57.671131 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet eb3e7d34b5314bc7a7c5ed53792728ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb3e7d34b5314bc7a7c5ed53792728ca already in progress: creating tablet
I20260810 19:47:57.671476 11494 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:41610 (request call id 427) took 1540 ms. Trace:
I20260810 19:47:57.653501 10370 consensus_queue.cc:260] T 10617bdf2eed4dbd8d13ea1821443863 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.673043 10366 raft_consensus.cc:385] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:57.673467 10366 raft_consensus.cc:740] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:57.673753 10366 consensus_queue.cc:260] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.675740 10366 ts_tablet_manager.cc:1434] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.150s user 0.000s sys 0.002s
I20260810 19:47:57.676139 10366 tablet_bootstrap.cc:492] T 11272d47d96f443187d63c184049871f P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:57.675798 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 463) took 1447 ms. Trace:
I20260810 19:47:57.676239 10371 rpcz_store.cc:276] 0810 19:47:56.227980 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.287814 (+ 59834us) service_pool.cc:224] Handling call
0810 19:47:57.668749 (+1380935us) ts_tablet_manager.cc:1151] Deleting tablet 0e967384768b4ec7956f1b508e8ab2af
0810 19:47:57.668763 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.675672 (+ 6909us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1356510}
W20260810 19:47:57.676846 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 0e967384768b4ec7956f1b508e8ab2af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e967384768b4ec7956f1b508e8ab2af already in progress: creating tablet
I20260810 19:47:57.678574 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 464) took 1370 ms. Trace:
I20260810 19:47:57.678696 10371 rpcz_store.cc:276] 0810 19:47:56.308085 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.312243 (+ 4158us) service_pool.cc:224] Handling call
0810 19:47:57.678384 (+1366141us) ts_tablet_manager.cc:1151] Deleting tablet ae3e151180ae4d258d18365770acaaad
0810 19:47:57.678397 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.678528 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1352855}
I20260810 19:47:57.678807 9907 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 448) took 1193 ms. Trace:
I20260810 19:47:57.678916 9907 rpcz_store.cc:276] 0810 19:47:56.485348 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.954749 (+469401us) service_pool.cc:224] Handling call
0810 19:47:57.147600 (+192851us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:57.147637 (+ 37us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:57.447692 (+300055us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.677507 (+229815us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.677684 (+ 177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.679929 9907 tablet_service.cc:1511] Processing CreateTablet for tablet cbcaa7106df24aaeb07428b7b590e282 (DEFAULT_TABLE table=default.Table_471bc99d3aa9446c8a287a8ae160d06d [id=a61b27909b65459793d63e8c8bae4d58]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:57.680151 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet ae3e151180ae4d258d18365770acaaad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae3e151180ae4d258d18365770acaaad already in progress: creating tablet
I20260810 19:47:57.681277 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 471) took 1335 ms. Trace:
I20260810 19:47:57.681391 10371 rpcz_store.cc:276] 0810 19:47:56.345906 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.389486 (+ 43580us) service_pool.cc:224] Handling call
0810 19:47:57.681109 (+1291623us) ts_tablet_manager.cc:1151] Deleting tablet 3680db3f1a5945a89c1198eb4849e58c
0810 19:47:57.681123 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.681236 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1291360}
W20260810 19:47:57.681865 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 3680db3f1a5945a89c1198eb4849e58c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3680db3f1a5945a89c1198eb4849e58c already in progress: creating tablet
I20260810 19:47:57.682533 10122 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 456) took 1158 ms. Trace:
I20260810 19:47:57.682643 10122 rpcz_store.cc:276] 0810 19:47:56.517840 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.122392 (+604552us) service_pool.cc:224] Handling call
0810 19:47:57.187565 (+ 65173us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:57.187623 (+ 58us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:57.629081 (+441458us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.676376 (+ 47295us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.676535 (+ 159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.683431 10370 ts_tablet_manager.cc:1434] T 10617bdf2eed4dbd8d13ea1821443863 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.072s user 0.001s sys 0.002s
I20260810 19:47:57.687753 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b853bf6bbc7845bc9cfa6347687582e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.688133 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a2e6a512224caa892ac7541131349f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.689661 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 229dd737ee8547a89445593cc117fbc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.689795 10370 tablet_bootstrap.cc:492] T 4f2d7c165d2c465d9080b927d54807f7 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:57.678057 11494 rpcz_store.cc:276] 0810 19:47:56.131330 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.898442 (+767112us) service_pool.cc:224] Handling call
0810 19:47:57.671418 (+772976us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:47:56.906184 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 19:47:56.910382 (+ 4198us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 19:47:56.910393 (+ 11us) alter_schema_op.cc:66] Acquired schema lock
0810 19:47:56.910401 (+ 8us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 19:47:56.910448 (+ 47us) alter_schema_op.cc:128] START. Timestamp: 1786391276910391
0810 19:47:56.910451 (+ 3us) op_driver.cc:348] REPLICATION: starting
0810 19:47:56.911348 (+ 897us) log.cc:844] Serialized 173 byte log entry
0810 19:47:57.270209 (+358861us) op_driver.cc:464] REPLICATION: finished
0810 19:47:57.539357 (+269148us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 19:47:57.567836 (+ 28479us) log.cc:844] Serialized 5 byte log entry
0810 19:47:57.670699 (+102863us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.671027 (+ 328us) log.cc:844] Serialized 14 byte log entry
0810 19:47:57.671365 (+ 338us) alter_schema_op.cc:73] Released schema lock
0810 19:47:57.671371 (+ 6us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":258718,"prepare.queue_time_us":128,"prepare.run_cpu_time_us":4025,"prepare.run_wall_time_us":88017,"raft.queue_time_us":382,"raft.run_cpu_time_us":697,"raft.run_wall_time_us":696,"replication_time_us":359716,"thread_start_us":328870,"threads_started":2,"wal-append.queue_time_us":125142}]]}
I20260810 19:47:57.691447 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 82609a50781d43f38baa6b76187e02ef (DEFAULT_TABLE table=default.Table_c90bd097f5db43c6aefde84c1a39aa3a [id=b1f85880703241f5861724dacc9062a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.694099 11518 raft_consensus.cc:493] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:57.691653 9911 tablet_service.cc:1558] Processing DeleteTablet for tablet ee5f38d91bb349a9ae1da8ba69d2ddbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:57.694283 11518 raft_consensus.cc:515] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.697641 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f0f3f88d26432fbadc5e90aaa5d158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.698937 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 472) took 1352 ms. Trace:
I20260810 19:47:57.701099 10371 rpcz_store.cc:276] 0810 19:47:56.346062 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.389772 (+ 43710us) service_pool.cc:224] Handling call
0810 19:47:57.698677 (+1308905us) ts_tablet_manager.cc:1151] Deleting tablet 39885c3e0adb4132945d507628f4f082
0810 19:47:57.698716 (+ 39us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.698877 (+ 161us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1210349}
W20260810 19:47:57.701174 9830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.195:43797, user_credentials={real_user=slave}} blocked reactor thread for 171267us
W20260810 19:47:57.701727 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 39885c3e0adb4132945d507628f4f082 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39885c3e0adb4132945d507628f4f082 already in progress: creating tablet
I20260810 19:47:57.704216 10371 tablet_replica.cc:333] T 6f0150de0d60425b807be532ce0ba6c3 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:57.706871 10371 raft_consensus.cc:2243] T 6f0150de0d60425b807be532ce0ba6c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:57.707068 10371 raft_consensus.cc:2272] T 6f0150de0d60425b807be532ce0ba6c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:57.707684 10371 ts_tablet_manager.cc:1916] T 6f0150de0d60425b807be532ce0ba6c3 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:47:57.707937 10068 leader_election.cc:343] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: e177140cad404e978b927c810b87ae0c
I20260810 19:47:57.708928 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbcaa7106df24aaeb07428b7b590e282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.710439 11518 leader_election.cc:290] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:47:57.710625 10067 leader_election.cc:343] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: e177140cad404e978b927c810b87ae0c
I20260810 19:47:57.713277 10067 leader_election.cc:304] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:57.714906 10367 tablet_bootstrap.cc:492] T c7235af514fa47d899d7e38ee5662f6c P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:57.715107 10367 ts_tablet_manager.cc:1403] T c7235af514fa47d899d7e38ee5662f6c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.155s user 0.001s sys 0.005s
I20260810 19:47:57.715849 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4579a71f8c8149798eb5f136135e5efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.716015 10367 raft_consensus.cc:359] T c7235af514fa47d899d7e38ee5662f6c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.716236 10367 raft_consensus.cc:385] T c7235af514fa47d899d7e38ee5662f6c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:57.716315 10367 raft_consensus.cc:740] T c7235af514fa47d899d7e38ee5662f6c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:57.717495 10367 consensus_queue.cc:260] T c7235af514fa47d899d7e38ee5662f6c P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.719849 9407 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5 (table default.Table_b46992ec81974f6caad1ea769640dcf1 [id=d6d2d95e5e9f4e10a7d5a8153e66e4b6]). Expected version 2 got 0
I20260810 19:47:57.721261 10367 ts_tablet_manager.cc:1434] T c7235af514fa47d899d7e38ee5662f6c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260810 19:47:57.722105 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1d3d54acd6074609919e2db8b3c01576" } modify_external_catalogs: true
I20260810 19:47:57.722350 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1d3d54acd6074609919e2db8b3c01576" } modify_external_catalogs: true
I20260810 19:47:57.725149 10367 tablet_bootstrap.cc:492] T 45194cae6ea44d9d8cf856d256fd534f P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:57.729810 11518 raft_consensus.cc:2749] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:57.731475 10367 tablet_bootstrap.cc:654] T 45194cae6ea44d9d8cf856d256fd534f P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:57.732779 10144 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 452) took 1193 ms. Trace:
I20260810 19:47:57.736181 10366 tablet_bootstrap.cc:654] T 11272d47d96f443187d63c184049871f P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:57.736197 10144 rpcz_store.cc:276] 0810 19:47:56.517512 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.110303 (+592791us) service_pool.cc:224] Handling call
0810 19:47:57.168405 (+ 58102us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:57.168437 (+ 32us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:57.609982 (+441545us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.708904 (+ 98922us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.711061 (+ 2157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.737844 9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0849ea9c04104a8184f8a8cd40e06fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.738212 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82609a50781d43f38baa6b76187e02ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.745411 10136 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 464) took 1021 ms. Trace:
I20260810 19:47:57.745581 10136 rpcz_store.cc:276] 0810 19:47:56.724320 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.176617 (+452297us) service_pool.cc:224] Handling call
0810 19:47:57.177194 (+ 577us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:57.177220 (+ 26us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:57.713600 (+536380us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.745200 (+ 31600us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.745362 (+ 162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.747604 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 8e73953ad6e148749163ebeaa24ee6e4 (DEFAULT_TABLE table=default.Table_03860438702347aba8b5460c42468832 [id=f2a75289377648baba880ad15de2593a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.747810 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 2335ff2297624b53873738380abd07f8 (DEFAULT_TABLE table=default.Table_a5fdc77e962244aab9851f792183f5d9 [id=6342d71685b948419459b7f284b1a683]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.748076 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e73953ad6e148749163ebeaa24ee6e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.748282 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2335ff2297624b53873738380abd07f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.751168 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 2335ff2297624b53873738380abd07f8 (DEFAULT_TABLE table=default.Table_a5fdc77e962244aab9851f792183f5d9 [id=6342d71685b948419459b7f284b1a683]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.751536 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 08f78560ec9f465c94ef08fa2f067c0d (DEFAULT_TABLE table=default.Table_f1684a112499413eab2a008659bd34ab [id=c5336637b8ed45a89125bf55e9705230]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.751719 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2335ff2297624b53873738380abd07f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.751921 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08f78560ec9f465c94ef08fa2f067c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.752141 10135 tablet_service.cc:1511] Processing CreateTablet for tablet d59e5607e4184683bc3924266ed6ca20 (DEFAULT_TABLE table=default.Table_4d4cbd339a304b6684323ba9e3a91e07 [id=d0c29ff645394a1288424d707bdb1707]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.752534 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d59e5607e4184683bc3924266ed6ca20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.754274 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 81e61197234642468b4723518c72ec95 (DEFAULT_TABLE table=default.Table_f70a4e380a494ed0be7890bf577fb42c [id=b2dabb394b144980927766a256ac727f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.754730 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81e61197234642468b4723518c72ec95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.754830 10370 tablet_bootstrap.cc:654] T 4f2d7c165d2c465d9080b927d54807f7 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:57.759632 10130 tablet_service.cc:1511] Processing CreateTablet for tablet cf4a37857a944a7493ee13a6356b72ed (DEFAULT_TABLE table=default.Table_812ed15779a140729fc82552535b01f0 [id=cccb8fa3465940449dc27799466a7b25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.760102 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf4a37857a944a7493ee13a6356b72ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.760735 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 08f78560ec9f465c94ef08fa2f067c0d (DEFAULT_TABLE table=default.Table_f1684a112499413eab2a008659bd34ab [id=c5336637b8ed45a89125bf55e9705230]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.761059 9684 tablet_service.cc:1511] Processing CreateTablet for tablet b2034784996149158c10b868f61ff418 (DEFAULT_TABLE table=default.Table_4f9606f9dd734d9c9ef67a3e0eafbdac [id=e26f1f869df446a1b79e137e81562a49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.761214 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08f78560ec9f465c94ef08fa2f067c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.761463 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2034784996149158c10b868f61ff418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.761811 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 8e73953ad6e148749163ebeaa24ee6e4 (DEFAULT_TABLE table=default.Table_03860438702347aba8b5460c42468832 [id=f2a75289377648baba880ad15de2593a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.762187 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e73953ad6e148749163ebeaa24ee6e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.762616 9658 tablet_service.cc:1511] Processing CreateTablet for tablet f6b705416997444485dc187e11a25c34 (DEFAULT_TABLE table=default.Table_2b91ab11caf848a3844e81653da4e93e [id=580695047aa34b5a86f4ba98b06b0998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.762980 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6b705416997444485dc187e11a25c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.766630 9666 tablet_service.cc:1511] Processing CreateTablet for tablet cf4a37857a944a7493ee13a6356b72ed (DEFAULT_TABLE table=default.Table_812ed15779a140729fc82552535b01f0 [id=cccb8fa3465940449dc27799466a7b25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.767055 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf4a37857a944a7493ee13a6356b72ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.770699 9688 tablet_service.cc:1511] Processing CreateTablet for tablet d59e5607e4184683bc3924266ed6ca20 (DEFAULT_TABLE table=default.Table_4d4cbd339a304b6684323ba9e3a91e07 [id=d0c29ff645394a1288424d707bdb1707]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.770825 10136 tablet_service.cc:1511] Processing CreateTablet for tablet f6b705416997444485dc187e11a25c34 (DEFAULT_TABLE table=default.Table_2b91ab11caf848a3844e81653da4e93e [id=580695047aa34b5a86f4ba98b06b0998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.771176 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d59e5607e4184683bc3924266ed6ca20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.771298 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6b705416997444485dc187e11a25c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.774487 11426 raft_consensus.cc:493] T 6992e7ef8e794ddc879ae04f9f78b8bd P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:57.774688 11426 raft_consensus.cc:515] T 6992e7ef8e794ddc879ae04f9f78b8bd P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.775480 11426 leader_election.cc:290] T 6992e7ef8e794ddc879ae04f9f78b8bd P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:57.775697 9677 tablet_service.cc:1511] Processing CreateTablet for tablet 36f01bdcf7b24a58b80b6ca9ba307113 (DEFAULT_TABLE table=default.Table_43667bdf61e944278a0faf9e66d7a1e4 [id=aed8e86da457485094bcb9fe12ebcb54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.775890 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 81e61197234642468b4723518c72ec95 (DEFAULT_TABLE table=default.Table_f70a4e380a494ed0be7890bf577fb42c [id=b2dabb394b144980927766a256ac727f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.775988 9665 tablet_service.cc:1511] Processing CreateTablet for tablet a999e0d7e70e4b4fb53e17e51ab9b03a (DEFAULT_TABLE table=default.Table_91221657584a43cc936203848d895dab [id=c68c4188f38c4888a47420a503672bc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.776113 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36f01bdcf7b24a58b80b6ca9ba307113. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.776369 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a999e0d7e70e4b4fb53e17e51ab9b03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.776721 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81e61197234642468b4723518c72ec95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.776892 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6992e7ef8e794ddc879ae04f9f78b8bd" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:57.777622 9611 leader_election.cc:343] T 6992e7ef8e794ddc879ae04f9f78b8bd P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:57.785318 9657 tablet_service.cc:1511] Processing CreateTablet for tablet a7d3a90046d74f4087fd5b283581970d (DEFAULT_TABLE table=default.Table_c5352053fa544be884fb272f00bd81f9 [id=0ba2b2657a7342929dea6795c6078def]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.785928 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7d3a90046d74f4087fd5b283581970d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.790007 9684 tablet_service.cc:1511] Processing CreateTablet for tablet dc3164c171b84b04bc67c0218ece7e99 (DEFAULT_TABLE table=default.Table_e00c7d0fdf6741b5855eee8cf797b84a [id=c166b3e89f0442e9b3ac6b3cba32eaf3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.790689 9665 tablet_service.cc:1511] Processing CreateTablet for tablet a07fca1f298e4473aca7e9813bdd11d6 (DEFAULT_TABLE table=default.Table_0b65da1621cf4a15bbb947263cbef587 [id=9ca19d2c87c04718879d069321e10e82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.791445 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc3164c171b84b04bc67c0218ece7e99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.794782 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07fca1f298e4473aca7e9813bdd11d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.799367 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22954e727fb44a24bd382b9caee9996b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.802748 9902 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 465) took 1154 ms. Trace:
I20260810 19:47:57.802973 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6992e7ef8e794ddc879ae04f9f78b8bd" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:47:57.803762 9611 leader_election.cc:343] T 6992e7ef8e794ddc879ae04f9f78b8bd P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:57.803929 9611 leader_election.cc:304] T 6992e7ef8e794ddc879ae04f9f78b8bd P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:57.806284 9420 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 31c8699875b54be888b3128df1b673aa (table default.Table_c35c3a44fcc44bba8a8c334292245b49 [id=5abc1f7beec444a4a988fbfcb8b45623]). Expected version 1 got 0
I20260810 19:47:57.809151 9677 tablet_service.cc:1558] Processing DeleteTablet for tablet 06af03c8a87141febef768bd56c72c39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:57.809477 9673 tablet_service.cc:1558] Processing DeleteTablet for tablet d99b34f901484fad87cff4bb9ab56fc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:57.809764 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet dd632a01fe424a3a956d445ce01e31d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:57.809976 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet c7235af514fa47d899d7e38ee5662f6c with delete_type TABLET_DATA_DELETED (replaced by tablet 0bddaf5b5fc1404e83b079ffa97e7321) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:57.810220 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet 6992e7ef8e794ddc879ae04f9f78b8bd with delete_type TABLET_DATA_DELETED (replaced by tablet a2fe67e8bd014acaa202c022c193cdc6) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:57.810521 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 7737acd216204209ba0327e26e85cfe6 with delete_type TABLET_DATA_DELETED (replaced by tablet 5654c48929564a96a55ed0444c9e1a04) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:57.811936 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ea9408ecf3784a80ac0c064e1689d25e consensus state has no leader
I20260810 19:47:57.812620 11469 raft_consensus.cc:2749] T 6992e7ef8e794ddc879ae04f9f78b8bd P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:47:57.812795 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ea318eddd8349a79d27ce5746f03798 consensus state has no leader
I20260810 19:47:57.812870 11469 raft_consensus.cc:493] T d99b34f901484fad87cff4bb9ab56fc8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:57.813014 11469 raft_consensus.cc:515] T d99b34f901484fad87cff4bb9ab56fc8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.813750 11469 leader_election.cc:290] T d99b34f901484fad87cff4bb9ab56fc8 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:57.815685 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99b34f901484fad87cff4bb9ab56fc8" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:57.816002 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99b34f901484fad87cff4bb9ab56fc8" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:57.816907 9611 leader_election.cc:343] T d99b34f901484fad87cff4bb9ab56fc8 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:57.817164 9611 leader_election.cc:343] T d99b34f901484fad87cff4bb9ab56fc8 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:57.817257 9611 leader_election.cc:304] T d99b34f901484fad87cff4bb9ab56fc8 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:57.818161 11426 raft_consensus.cc:2749] T d99b34f901484fad87cff4bb9ab56fc8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:57.819044 9902 rpcz_store.cc:276] 0810 19:47:56.632972 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.333299 (+700327us) service_pool.cc:224] Handling call
0810 19:47:57.333846 (+ 547us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:57.333873 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:57.353498 (+ 19625us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.737205 (+383707us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.787355 (+ 50150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.819792 9902 tablet_service.cc:1511] Processing CreateTablet for tablet fdd82537177a4142bddd0544485b00c4 (DEFAULT_TABLE table=default.Table_33d8853eb1ce4caa81c8fe96f0ba2be0 [id=d277a804313e4f35a31b58d4f682efe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.822932 9911 tablet_service.cc:1511] Processing CreateTablet for tablet 9118f949ded748d7b90f00948f49be55 (DEFAULT_TABLE table=default.Table_830b53d484b34185b3edd4c39fcb36b5 [id=6cc8c0a07ee74ec99d7ccf22c3d6f494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.824433 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdd82537177a4142bddd0544485b00c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.826746 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9118f949ded748d7b90f00948f49be55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.836935 11529 tablet.cc:1724] T 4d654dada92a4939914d26ab72a5f5e8 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260810 19:47:57.838936 9611 consensus_peers.cc:597] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:57.840445 10375 ts_tablet_manager.cc:1929] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:57.841356 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 36f01bdcf7b24a58b80b6ca9ba307113 (DEFAULT_TABLE table=default.Table_43667bdf61e944278a0faf9e66d7a1e4 [id=aed8e86da457485094bcb9fe12ebcb54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.841995 10128 tablet_service.cc:1511] Processing CreateTablet for tablet dc3164c171b84b04bc67c0218ece7e99 (DEFAULT_TABLE table=default.Table_e00c7d0fdf6741b5855eee8cf797b84a [id=c166b3e89f0442e9b3ac6b3cba32eaf3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.843274 10115 tablet_service.cc:1511] Processing CreateTablet for tablet a07fca1f298e4473aca7e9813bdd11d6 (DEFAULT_TABLE table=default.Table_0b65da1621cf4a15bbb947263cbef587 [id=9ca19d2c87c04718879d069321e10e82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.843433 10130 tablet_service.cc:1511] Processing CreateTablet for tablet a999e0d7e70e4b4fb53e17e51ab9b03a (DEFAULT_TABLE table=default.Table_91221657584a43cc936203848d895dab [id=c68c4188f38c4888a47420a503672bc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.843319 10137 tablet_service.cc:1511] Processing CreateTablet for tablet b2034784996149158c10b868f61ff418 (DEFAULT_TABLE table=default.Table_4f9606f9dd734d9c9ef67a3e0eafbdac [id=e26f1f869df446a1b79e137e81562a49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.845908 10367 tablet_bootstrap.cc:492] T 45194cae6ea44d9d8cf856d256fd534f P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:57.846139 10367 ts_tablet_manager.cc:1403] T 45194cae6ea44d9d8cf856d256fd534f P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.121s user 0.004s sys 0.000s
I20260810 19:47:57.847113 10119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 460) took 1132 ms. Trace:
I20260810 19:47:57.847172 10367 raft_consensus.cc:359] T 45194cae6ea44d9d8cf856d256fd534f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.847512 10367 raft_consensus.cc:385] T 45194cae6ea44d9d8cf856d256fd534f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:57.847648 10367 raft_consensus.cc:740] T 45194cae6ea44d9d8cf856d256fd534f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:57.847975 10367 consensus_queue.cc:260] T 45194cae6ea44d9d8cf856d256fd534f P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.850214 10367 ts_tablet_manager.cc:1434] T 45194cae6ea44d9d8cf856d256fd534f P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 19:47:57.851404 10367 tablet_bootstrap.cc:492] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:57.853474 10367 tablet_bootstrap.cc:654] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:57.856148 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36f01bdcf7b24a58b80b6ca9ba307113. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.856786 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0b398355dcf74f128f892997a49fd5af" } modify_external_catalogs: true
I20260810 19:47:57.857205 10136 tablet_service.cc:1511] Processing CreateTablet for tablet a7d3a90046d74f4087fd5b283581970d (DEFAULT_TABLE table=default.Table_c5352053fa544be884fb272f00bd81f9 [id=0ba2b2657a7342929dea6795c6078def]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.858932 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 33f2ea0d46f44fca88e16ea83ad67bc2 (DEFAULT_TABLE table=default.Table_68efca25ddd74752b30341b528693d1f [id=9601a761027047a2bbd739f0a1f86cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.851048 10371 ts_tablet_manager.cc:1929] T 6f0150de0d60425b807be532ce0ba6c3 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:57.859467 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07fca1f298e4473aca7e9813bdd11d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.859505 10371 log.cc:1199] T 6f0150de0d60425b807be532ce0ba6c3 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/6f0150de0d60425b807be532ce0ba6c3
I20260810 19:47:57.859861 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33f2ea0d46f44fca88e16ea83ad67bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.860100 10371 ts_tablet_manager.cc:1950] T 6f0150de0d60425b807be532ce0ba6c3 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:57.861059 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 473) took 1353 ms. Trace:
I20260810 19:47:57.861232 10371 rpcz_store.cc:276] 0810 19:47:56.507553 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.508480 (+ 927us) service_pool.cc:224] Handling call
0810 19:47:57.704129 (+1195649us) ts_tablet_manager.cc:1151] Deleting tablet 6f0150de0d60425b807be532ce0ba6c3
0810 19:47:57.704145 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.830288 (+126143us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.850954 (+ 20666us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.861001 (+ 10047us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1195218}
I20260810 19:47:57.853791 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 33f2ea0d46f44fca88e16ea83ad67bc2 (DEFAULT_TABLE table=default.Table_68efca25ddd74752b30341b528693d1f [id=9601a761027047a2bbd739f0a1f86cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.863085 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33f2ea0d46f44fca88e16ea83ad67bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.863291 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0b398355dcf74f128f892997a49fd5af" } modify_external_catalogs: true
I20260810 19:47:57.864444 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_df0d4b51d323454e8afa1c87c993a1ed" } modify_external_catalogs: true
I20260810 19:47:57.864611 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_df0d4b51d323454e8afa1c87c993a1ed" } modify_external_catalogs: true
I20260810 19:47:57.864935 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc3164c171b84b04bc67c0218ece7e99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.859190 9412 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 10617bdf2eed4dbd8d13ea1821443863 (table default.Table_4502b22ebf5b47e5a0c8e0c3027e3251 [id=f1973d72068847eaabc823653402d194]). Expected version 2 got 0
I20260810 19:47:57.867270 9412 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5 (table default.Table_b46992ec81974f6caad1ea769640dcf1 [id=d6d2d95e5e9f4e10a7d5a8153e66e4b6]). Expected version 2 got 0
I20260810 19:47:57.859630 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_667a9496a2f84ffdb4a98329b167c827"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:57.869521 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 240b2ae8a1484de998d3ea972bc74cfe (DEFAULT_TABLE table=default.Table_fdb9a22aaf1046c7b949a64abb7f2fd5 [id=91410b334d9f46fc8794de0b13863d18]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:57.869829 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_667a9496a2f84ffdb4a98329b167c827 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:57.850697 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 240b2ae8a1484de998d3ea972bc74cfe (DEFAULT_TABLE table=default.Table_fdb9a22aaf1046c7b949a64abb7f2fd5 [id=91410b334d9f46fc8794de0b13863d18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.870569 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_91221657584a43cc936203848d895dab" } new_table_name: "default.Table_7bc93cc546f64bbb96c6c526f87fad54" modify_external_catalogs: true
I20260810 19:47:57.870831 10371 tablet_replica.cc:333] T 4d654dada92a4939914d26ab72a5f5e8 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:57.871039 10371 raft_consensus.cc:2243] T 4d654dada92a4939914d26ab72a5f5e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:57.871270 10371 raft_consensus.cc:2272] T 4d654dada92a4939914d26ab72a5f5e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:57.871577 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 0a3f0e184b7a472bb7ae2bea8db000ad (DEFAULT_TABLE table=default.Table_562588ac5f0a40bb9639dc6131e4f151 [id=9d71d073281846a181e5194bb8fff8a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.871702 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 240b2ae8a1484de998d3ea972bc74cfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.872442 10134 tablet_service.cc:1511] Processing CreateTablet for tablet f8cfda17c3434e73b8c37b8e6fd73bf7 (DEFAULT_TABLE table=default.Table_11cc4f48379a47908e779ed3c995376a [id=b6ceccc0fd2d42c3a63ce6a27df45452]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.862805 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 6f0150de0d60425b807be532ce0ba6c3 (table default.Table_336441014db542c6ba0f204ef41d4747 [id=c9d6f79ab23248c69ee6d6984f6fd55c]) successfully deleted
I20260810 19:47:57.860203 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_84322bc8610f43e086b0d790bd3e153f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:57.873409 10116 tablet_service.cc:1511] Processing CreateTablet for tablet e18d0da099b749f1bc9d9d276277b68f (DEFAULT_TABLE table=default.Table_225d70cd8d7c4166ac7b297939047aed [id=56f2a1d4ac0049f39f2a33bf837477b9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:57.873687 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84322bc8610f43e086b0d790bd3e153f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:57.873759 10120 tablet_service.cc:1511] Processing CreateTablet for tablet 8a9df6ac5a474724b113c1b3cd2b85dd (DEFAULT_TABLE table=default.Table_ec077aa44c9b4a918aef07f417121c14 [id=233590c34b8441a78a176ab27fba43cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.873847 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 18be14d8081c42129deb33897ab6433b (DEFAULT_TABLE table=default.Table_090260a0afce4bb5aaf644216af35443 [id=3d782ec093e74749b741df087f141ea4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.874046 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2034784996149158c10b868f61ff418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.875037 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 18be14d8081c42129deb33897ab6433b (DEFAULT_TABLE table=default.Table_090260a0afce4bb5aaf644216af35443 [id=3d782ec093e74749b741df087f141ea4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.876045 9684 tablet_service.cc:1511] Processing CreateTablet for tablet f8cfda17c3434e73b8c37b8e6fd73bf7 (DEFAULT_TABLE table=default.Table_11cc4f48379a47908e779ed3c995376a [id=b6ceccc0fd2d42c3a63ce6a27df45452]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.876825 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 8a9df6ac5a474724b113c1b3cd2b85dd (DEFAULT_TABLE table=default.Table_ec077aa44c9b4a918aef07f417121c14 [id=233590c34b8441a78a176ab27fba43cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.877446 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18be14d8081c42129deb33897ab6433b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.877681 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7d3a90046d74f4087fd5b283581970d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:57.878340 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fdd82537177a4142bddd0544485b00c4 consensus state has no leader
I20260810 19:47:57.878898 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8cfda17c3434e73b8c37b8e6fd73bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.878947 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 985440898cc04a98877c15a5122a7dd3
I20260810 19:47:57.879266 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a9df6ac5a474724b113c1b3cd2b85dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.880043 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet bafc42f0cdf94ebd823dfb678df8a83b
I20260810 19:47:57.882467 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet 985440898cc04a98877c15a5122a7dd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:57.882833 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet bafc42f0cdf94ebd823dfb678df8a83b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:57.883190 10375 log.cc:1199] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/3ca9d34cb609413d9df495bf191cc409
I20260810 19:47:57.884066 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 9e37ab519ffe4791ab276a9fc0d96ead (DEFAULT_TABLE table=default.Table_97b0b4e69a6a4a56bf37ba9561c5271e [id=93837e7d4dd346e9b6399dadea5e72a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.884205 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 240b2ae8a1484de998d3ea972bc74cfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.884598 10375 ts_tablet_manager.cc:1950] T 3ca9d34cb609413d9df495bf191cc409 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:57.884932 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a999e0d7e70e4b4fb53e17e51ab9b03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.886634 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet bafc42f0cdf94ebd823dfb678df8a83b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:57.888710 10116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18d0da099b749f1bc9d9d276277b68f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.847275 10119 rpcz_store.cc:276] 0810 19:47:56.714276 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.150862 (+436586us) service_pool.cc:224] Handling call
0810 19:47:57.253785 (+102923us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:57.253805 (+ 20us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:57.801647 (+547842us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.846658 (+ 45011us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.846837 (+ 179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.890741 9666 tablet_service.cc:1511] Processing CreateTablet for tablet e18d0da099b749f1bc9d9d276277b68f (DEFAULT_TABLE table=default.Table_225d70cd8d7c4166ac7b297939047aed [id=56f2a1d4ac0049f39f2a33bf837477b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.891295 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 45194cae6ea44d9d8cf856d256fd534f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:57.891820 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8cfda17c3434e73b8c37b8e6fd73bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.892580 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7984b3459b7c46eab35b53ef578aa0a9" } new_table_name: "default.Table_1aa658c1c6e94a0d8a3b20673d137896" modify_external_catalogs: true
I20260810 19:47:57.894145 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet e18d0da099b749f1bc9d9d276277b68f
I20260810 19:47:57.894578 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18be14d8081c42129deb33897ab6433b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.894781 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a9df6ac5a474724b113c1b3cd2b85dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.895044 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_97a0d74bc8984c71bcbfe393520ae3ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:57.895361 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_89c56d57fc044981b88f6709942097d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:57.895635 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97a0d74bc8984c71bcbfe393520ae3ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:57.895813 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89c56d57fc044981b88f6709942097d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:57.896991 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 3b6187dbe1ca42f79bf3eddd5475b929
I20260810 19:47:57.897866 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b6187dbe1ca42f79bf3eddd5475b929 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:57.899147 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet e18d0da099b749f1bc9d9d276277b68f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:57.900774 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_84ec8686acb8432fb832c484aab7c394"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:57.901235 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet 985440898cc04a98877c15a5122a7dd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:57.901409 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84ec8686acb8432fb832c484aab7c394 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:57.902541 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b6187dbe1ca42f79bf3eddd5475b929 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:57.902781 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_7eb33a7d7f654d9ba03184e013797f6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:57.903033 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e37ab519ffe4791ab276a9fc0d96ead. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:57.903338 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7eb33a7d7f654d9ba03184e013797f6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:57.903930 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3f0e184b7a472bb7ae2bea8db000ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.905457 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet e18d0da099b749f1bc9d9d276277b68f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:57.905966 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18d0da099b749f1bc9d9d276277b68f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.906915 10371 ts_tablet_manager.cc:1916] T 4d654dada92a4939914d26ab72a5f5e8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:57.918241 10370 tablet_bootstrap.cc:492] T 4f2d7c165d2c465d9080b927d54807f7 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:57.919468 10370 ts_tablet_manager.cc:1403] T 4f2d7c165d2c465d9080b927d54807f7 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.236s user 0.005s sys 0.005s
I20260810 19:47:57.920073 9913 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 467) took 1286 ms. Trace:
I20260810 19:47:57.920223 9913 rpcz_store.cc:276] 0810 19:47:56.633170 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.356433 (+723263us) service_pool.cc:224] Handling call
0810 19:47:57.375209 (+ 18776us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:57.375244 (+ 35us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:57.466488 (+ 91244us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.919842 (+453354us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.920026 (+ 184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.920509 10370 raft_consensus.cc:359] T 4f2d7c165d2c465d9080b927d54807f7 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.920742 10370 raft_consensus.cc:385] T 4f2d7c165d2c465d9080b927d54807f7 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:57.920821 10370 raft_consensus.cc:740] T 4f2d7c165d2c465d9080b927d54807f7 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:57.920770 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 471ff7c225dd498fa39751202beec3a9 (DEFAULT_TABLE table=default.Table_cb085f4d70f74c8885b3f837c4c94501 [id=c9a13735c4f7435d98909590d99b2f5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.919169 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 348fcf52fe1f4a3f9931487ebeba9311 (DEFAULT_TABLE table=default.Table_0b398355dcf74f128f892997a49fd5af [id=08114732be4641eba23deac686c7e853]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.921236 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 471ff7c225dd498fa39751202beec3a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.921221 10370 consensus_queue.cc:260] T 4f2d7c165d2c465d9080b927d54807f7 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.922780 11490 raft_consensus.cc:493] T 34fdc03b114b405da9e3a17ef1ad87c4 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6986ed920dcb4af29a5eeeda6f671691)
I20260810 19:47:57.922971 11490 raft_consensus.cc:515] T 34fdc03b114b405da9e3a17ef1ad87c4 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.923825 11490 leader_election.cc:290] T 34fdc03b114b405da9e3a17ef1ad87c4 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:57.924819 10370 ts_tablet_manager.cc:1434] T 4f2d7c165d2c465d9080b927d54807f7 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
W20260810 19:47:57.932420 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6f4b5c6d5bd14c59b3cd3f8ee00a3301 consensus state has no leader
W20260810 19:47:57.936288 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a999e0d7e70e4b4fb53e17e51ab9b03a consensus state has no leader
I20260810 19:47:57.936754 9890 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 470) took 1260 ms. Trace:
I20260810 19:47:57.936910 9890 rpcz_store.cc:276] 0810 19:47:56.633525 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.396663 (+763138us) service_pool.cc:224] Handling call
0810 19:47:57.510268 (+113605us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x61800000d518. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd466f16dbd 00007fd466f169de 00007fd47ae4eb7d 00007fd47ae4eb1c 00007fd476f893e4 00007fd476f6199d 00007fd476eb0361 00007fd470cf9646 00007fd470cf9375 00007fd46e06461e
0810 19:47:57.510362 (+ 94us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:57.510399 (+ 37us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:57.521450 (+ 11051us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.891437 (+369987us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.894409 (+ 2972us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7288064}
I20260810 19:47:57.942619 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 348fcf52fe1f4a3f9931487ebeba9311. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:57.942924 10067 leader_election.cc:343] T 34fdc03b114b405da9e3a17ef1ad87c4 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 34fdc03b114b405da9e3a17ef1ad87c4
I20260810 19:47:57.946452 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 348fcf52fe1f4a3f9931487ebeba9311
I20260810 19:47:57.948937 11490 raft_consensus.cc:493] T 31c8699875b54be888b3128df1b673aa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:57.949118 11490 raft_consensus.cc:515] T 31c8699875b54be888b3128df1b673aa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.949841 11490 leader_election.cc:290] T 31c8699875b54be888b3128df1b673aa P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:57.951186 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1422ee4f50d147659ee2338071831d14"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:57.951848 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b40fd0d57ea4b71aeef2d66f4958ac8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:57.952286 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet 348fcf52fe1f4a3f9931487ebeba9311 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:57.952407 9890 tablet_service.cc:1511] Processing CreateTablet for tablet c2604484e3114564812653a15298cc0b (DEFAULT_TABLE table=default.Table_e65a0539bebe443199c67a2723cd4af6 [id=e3fc833ec8be41748f0a1c2ef8f26b1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.952539 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 313) took 4392 ms. Trace:
I20260810 19:47:57.952641 10375 rpcz_store.cc:276] 0810 19:47:53.559796 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.560232 (+ 436us) service_pool.cc:224] Handling call
0810 19:47:57.627112 (+4066880us) ts_tablet_manager.cc:1151] Deleting tablet 3ca9d34cb609413d9df495bf191cc409
0810 19:47:57.627121 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.735589 (+108468us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.828984 (+ 93395us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.952480 (+123496us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4066540}
I20260810 19:47:57.953078 10375 tablet_replica.cc:333] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:57.953188 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 3ca9d34cb609413d9df495bf191cc409 (table default.Table_0c6321a554ff4c1a82855f8178d69454 [id=4eec13b150fe4e169ac63d4cd23b6c02]) successfully deleted
I20260810 19:47:57.953289 10375 raft_consensus.cc:2243] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:57.953540 9879 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:38260 (request call id 121) took 1368 ms. Trace:
I20260810 19:47:57.953691 10375 raft_consensus.cc:2272] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:57.955925 10375 ts_tablet_manager.cc:1916] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:47:57.958257 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1422ee4f50d147659ee2338071831d14 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:57.962368 10145 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41610 (request call id 465) took 1207 ms. Trace:
I20260810 19:47:57.963054 10139 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f2d7c165d2c465d9080b927d54807f7 with delete_type TABLET_DATA_DELETED (replaced by tablet 639c824ba4834734a4ebfd558181bebe) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:57.963245 10145 rpcz_store.cc:276] 0810 19:47:56.747801 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.180782 (+432981us) service_pool.cc:224] Handling call
0810 19:47:57.201297 (+ 20515us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:57.201378 (+ 81us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:57.785648 (+584270us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.934244 (+148596us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.955375 (+ 21131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:57.964030 10134 tablet_service.cc:1511] Processing CreateTablet for tablet cbc3d8b7b1b8488597b707d3343818b5 (DEFAULT_TABLE table=default.Table_aa202a92fde548cabef2ed26a3f65999 [id=3a075a443a0546e7af6d54e2ed2b3a75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.964454 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc3d8b7b1b8488597b707d3343818b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.973758 10377 ts_tablet_manager.cc:1929] T 3badc88d94a34ff7a053ed312f0dd646 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:57.973701 11426 consensus_queue.cc:1048] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260810 19:47:57.975286 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 348fcf52fe1f4a3f9931487ebeba9311 (DEFAULT_TABLE table=default.Table_0b398355dcf74f128f892997a49fd5af [id=08114732be4641eba23deac686c7e853]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.975765 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 348fcf52fe1f4a3f9931487ebeba9311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.980996 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c8699875b54be888b3128df1b673aa" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:57.982623 10130 tablet_service.cc:1511] Processing CreateTablet for tablet ec7e3cfb4dcb4aa68f1f2263dbdf67de (DEFAULT_TABLE table=default.Table_a8c87cbca48447fb8212f3f19946380f [id=6ef926d6305249bea2cb79c809852b7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.983971 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2604484e3114564812653a15298cc0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.986771 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 548a6996692549df8087393ccef7b4a2 (DEFAULT_TABLE table=default.Table_b58c92af875943db8e95a856d198aa99 [id=dc7531f9091e40939e35a34e6a14a666]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.987409 9879 rpcz_store.cc:276] 0810 19:47:56.585378 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.585755 (+ 377us) service_pool.cc:224] Handling call
0810 19:47:57.088525 (+502770us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x6160000e2354. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd472ff1860 00007fd476ee009f 00007fd4712b1bd6 00007fd4712b1905 00007fd46e06461e 00007fd46e0634fe 00007fd46e069738 00007fd46e06a09f 00007fd46e069ec8 0000000000aaf86c
0810 19:47:57.554694 (+466169us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x616000141754. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd472ff1860 00007fd476ee009f 00007fd4712b1bd6 00007fd4712b1905 00007fd46e06461e 00007fd46e0634fe 00007fd46e069738 00007fd46e06a09f 00007fd46e069ec8 0000000000aaf86c
0810 19:47:57.953488 (+398794us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1508294144}
I20260810 19:47:57.987926 9876 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:38260 (request call id 118) took 1799 ms. Trace:
I20260810 19:47:57.988037 9876 rpcz_store.cc:276] 0810 19:47:56.154829 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.155046 (+ 217us) service_pool.cc:224] Handling call
0810 19:47:57.074275 (+919229us) spinlock_profiling.cc:243] Waited 56.9 ms on lock 0x6160000e2954. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd472ff1860 00007fd476ee009f 00007fd4712b1bd6 00007fd4712b1905 00007fd46e06461e 00007fd46e0634fe 00007fd46e069738 00007fd46e06a09f 00007fd46e069ec8 0000000000aaf86c
0810 19:47:57.092903 (+ 18628us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x6160000e2354. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd472ff1860 00007fd476ee009f 00007fd4712b1bd6 00007fd4712b1905 00007fd46e06461e 00007fd46e0634fe 00007fd46e069738 00007fd46e06a09f 00007fd46e069ec8 0000000000aaf86c
0810 19:47:57.126251 (+ 33348us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x616000141530. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd4743b2d63 00007fd476edfea8 00007fd4712b1bd6 00007fd4712b1905 00007fd46e06461e 00007fd46e0634fe 00007fd46e069738 00007fd46e06a09f 00007fd46e069ec8 0000000000aaf86c
0810 19:47:57.554246 (+427995us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x616000141754. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd472ff1860 00007fd476ee009f 00007fd4712b1bd6 00007fd4712b1905 00007fd46e06461e 00007fd46e0634fe 00007fd46e069738 00007fd46e06a09f 00007fd46e069ec8 0000000000aaf86c
0810 19:47:57.953757 (+399511us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1147962112}
I20260810 19:47:57.988265 9895 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 451) took 1472 ms. Trace:
I20260810 19:47:57.987959 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 97c78c188c024b0f9da45cd99d2cb80c (DEFAULT_TABLE table=default.Table_65864a250646401984a7263cf477ab07 [id=2f1d802c24844383976d2799035e9d0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.989425 9135 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu
/tmp/dist-test-taskcRGNMp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.235.253:37397
--webserver_interface=127.8.235.253
--webserver_port=37717
--builtin_ntp_servers=127.8.235.212:46393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.235.254:33891,127.8.235.253:37397,127.8.235.252:43301
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260810 19:47:57.990551 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec7e3cfb4dcb4aa68f1f2263dbdf67de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:57.990921 10377 log.cc:1199] T 3badc88d94a34ff7a053ed312f0dd646 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/3badc88d94a34ff7a053ed312f0dd646
I20260810 19:47:57.991366 10377 ts_tablet_manager.cc:1950] T 3badc88d94a34ff7a053ed312f0dd646 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:57.991724 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 434) took 1883 ms. Trace:
I20260810 19:47:57.991850 10377 rpcz_store.cc:276] 0810 19:47:56.108249 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.595503 (+487254us) service_pool.cc:224] Handling call
0810 19:47:57.498481 (+902978us) ts_tablet_manager.cc:1151] Deleting tablet 3badc88d94a34ff7a053ed312f0dd646
0810 19:47:57.522922 (+ 24441us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x61800000d518. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd466f16dbd 00007fd466f17e2e 00007fd47ae9a0ed 00007fd47ae1a6c3 00007fd476f6d016 00007fd476f6e3a9 00007fd476fa1d34 00007fd476f82750 00007fd476f824dd 0000000000aaf86c
0810 19:47:57.522936 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.839847 (+316911us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.973652 (+133805us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.991664 (+ 18012us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4037504,"tablet-delete.queue_time_us":883028}
I20260810 19:47:57.992220 10377 tablet_replica.cc:333] T 5f560ed7ea0c4075bad1375d86738861 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:57.992426 10377 raft_consensus.cc:2243] T 5f560ed7ea0c4075bad1375d86738861 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:57.992532 11490 raft_consensus.cc:493] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcd31b1bbb0340cbacfce652b4ad8da4)
I20260810 19:47:57.992609 10377 raft_consensus.cc:2272] T 5f560ed7ea0c4075bad1375d86738861 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:57.992676 11490 raft_consensus.cc:515] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:57.993361 9880 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:38260 (request call id 117) took 2175 ms. Trace:
I20260810 19:47:57.993549 11490 leader_election.cc:290] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:47:57.991755 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 674b44f34b2042d3aac0b399fada795e (DEFAULT_TABLE table=default.Table_2d2422f738fe43f5aac8adbdaac041cb [id=7ca0d44fb4b04bc09a6912fcb59a037c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.999022 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 86203f7a635d406c95ed1d08cfc22400 (DEFAULT_TABLE table=default.Table_0bb7c2bf3cb64b988e69e769ce83ff41 [id=c5f77852ffd74cd2945869d890a66dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:57.999632 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86203f7a635d406c95ed1d08cfc22400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.006982 9895 rpcz_store.cc:276] 0810 19:47:56.494500 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.042499 (+547999us) service_pool.cc:224] Handling call
0810 19:47:57.147944 (+105445us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:57.147970 (+ 26us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:57.662358 (+514388us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:57.966239 (+303881us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:57.966443 (+ 204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:58.008407 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c8699875b54be888b3128df1b673aa" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:58.009012 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 548a6996692549df8087393ccef7b4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.011817 9880 rpcz_store.cc:276] 0810 19:47:55.774862 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.775095 (+ 233us) service_pool.cc:224] Handling call
0810 19:47:57.081003 (+1305908us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x6160000e2354. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd472ff1860 00007fd476ee009f 00007fd4712b1bd6 00007fd4712b1905 00007fd46e06461e 00007fd46e0634fe 00007fd46e069738 00007fd46e06a09f 00007fd46e069ec8 0000000000aaf86c
0810 19:47:57.553740 (+472737us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x616000141754. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd472ff1860 00007fd476ee009f 00007fd4712b1bd6 00007fd4712b1905 00007fd46e06461e 00007fd46e0634fe 00007fd46e069738 00007fd46e06a09f 00007fd46e069ec8 0000000000aaf86c
0810 19:47:57.800980 (+247240us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x61800002408c. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 0000000000a29280 00007fd476ee01c1 00007fd4712b1bd6 00007fd4712b1905 00007fd46e06461e 00007fd46e0634fe 00007fd46e069738 00007fd46e06a09f 00007fd46e069ec8 0000000000aaf86c
0810 19:47:57.949846 (+148866us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1536761600}
W20260810 19:47:58.012656 10067 leader_election.cc:343] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 7b995f3c3bca4501a6c62cf9025051b2
I20260810 19:47:58.015668 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97c78c188c024b0f9da45cd99d2cb80c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.019280 10375 ts_tablet_manager.cc:1929] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:58.019546 10375 log.cc:1199] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/74dddd12f2314d6ab5a6717025b13a51
I20260810 19:47:58.020078 10375 ts_tablet_manager.cc:1950] T 74dddd12f2314d6ab5a6717025b13a51 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:58.020809 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_074b5c424ed1463598daa05a715c76e6" } new_table_name: "default.Table_9c7e78bf368c4d99bca05e9fc4dfcbda" modify_external_catalogs: true
I20260810 19:47:58.022470 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1958ec28228543e19a55ae3083097318" } new_table_name: "default.Table_908acdc21674469e937e4539876e0267" modify_external_catalogs: true
I20260810 19:47:58.026572 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 323) took 4312 ms. Trace:
I20260810 19:47:58.026789 10375 rpcz_store.cc:276] 0810 19:47:53.713930 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.713994 (+ 64us) service_pool.cc:224] Handling call
0810 19:47:57.952987 (+4238993us) ts_tablet_manager.cc:1151] Deleting tablet 74dddd12f2314d6ab5a6717025b13a51
0810 19:47:57.952997 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.979339 (+ 26342us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.019157 (+ 39818us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.026518 (+ 7361us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4237439}
I20260810 19:47:58.027490 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 74dddd12f2314d6ab5a6717025b13a51 (table default.Table_b0123864189f4f8bbe188d35a6e10013 [id=9fd5b60a3ce44aaca14478da98f66bc5]) successfully deleted
I20260810 19:47:58.028697 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 324) took 4276 ms. Trace:
I20260810 19:47:58.028903 10375 rpcz_store.cc:276] 0810 19:47:53.751758 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.778012 (+ 26254us) service_pool.cc:224] Handling call
0810 19:47:58.028528 (+4250516us) ts_tablet_manager.cc:1151] Deleting tablet 60bd14fb8c2e40dc955352518d463ccb
0810 19:47:58.028540 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.028657 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4250010}
W20260810 19:47:58.030999 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 60bd14fb8c2e40dc955352518d463ccb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60bd14fb8c2e40dc955352518d463ccb already in progress: creating tablet
I20260810 19:47:58.031574 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 329) took 4239 ms. Trace:
I20260810 19:47:58.031780 10375 rpcz_store.cc:276] 0810 19:47:53.792235 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.792419 (+ 184us) service_pool.cc:224] Handling call
0810 19:47:58.031388 (+4238969us) ts_tablet_manager.cc:1151] Deleting tablet 8fadd6f84c75466287b318ed7018b071
0810 19:47:58.031400 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.031536 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4238567}
W20260810 19:47:58.032322 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 8fadd6f84c75466287b318ed7018b071 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fadd6f84c75466287b318ed7018b071 already in progress: creating tablet
I20260810 19:47:58.032912 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_252f2578ecab482bb7255aa483e17833"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:58.033638 10375 tablet_replica.cc:333] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
W20260810 19:47:58.033676 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_252f2578ecab482bb7255aa483e17833 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:58.033916 10375 raft_consensus.cc:2243] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:58.034644 10375 raft_consensus.cc:2272] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:58.035449 10375 ts_tablet_manager.cc:1916] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:58.035619 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 548a6996692549df8087393ccef7b4a2 (DEFAULT_TABLE table=default.Table_b58c92af875943db8e95a856d198aa99 [id=dc7531f9091e40939e35a34e6a14a666]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.036485 9407 master_service.cc:960] ReplaceTablet: received request to replace tablet 6355c14e38b3446493f7bd5e2a717341 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:58.040259 9885 tablet_service.cc:1511] Processing CreateTablet for tablet ea9408ecf3784a80ac0c064e1689d25e (DEFAULT_TABLE table=default.Table_156494e413e94dddafcb9fd6cb8e2498 [id=aabf9535ecdb44d1b3245f8f05542f28]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:58.040988 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7d93fd6556b146ca8933a6dc0a2357e8 consensus state has no leader
W20260810 19:47:58.041415 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 38b0c6a017dc4afc849090cca7ee8b26 consensus state has no leader
I20260810 19:47:58.043699 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 983adb7af7954ac0a2807cb75d531a5a (DEFAULT_TABLE table=default.Table_9747046448e44dc4ab648e6759baad73 [id=e460539cc73c4fa59757b6b683e59530]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.044255 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674b44f34b2042d3aac0b399fada795e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:58.044974 10068 leader_election.cc:343] T 34fdc03b114b405da9e3a17ef1ad87c4 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 34fdc03b114b405da9e3a17ef1ad87c4
I20260810 19:47:58.045132 10068 leader_election.cc:304] T 34fdc03b114b405da9e3a17ef1ad87c4 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:58.045620 11490 raft_consensus.cc:2749] T 34fdc03b114b405da9e3a17ef1ad87c4 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 19:47:58.046456 10068 leader_election.cc:304] T 31c8699875b54be888b3128df1b673aa P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:58.046917 11490 raft_consensus.cc:2749] T 31c8699875b54be888b3128df1b673aa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:58.048341 9897 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 469) took 1383 ms. Trace:
I20260810 19:47:58.048810 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 548a6996692549df8087393ccef7b4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.050098 9688 tablet_service.cc:1511] Processing CreateTablet for tablet cbc3d8b7b1b8488597b707d3343818b5 (DEFAULT_TABLE table=default.Table_aa202a92fde548cabef2ed26a3f65999 [id=3a075a443a0546e7af6d54e2ed2b3a75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.050906 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 348fcf52fe1f4a3f9931487ebeba9311 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:58.051644 9684 tablet_service.cc:1511] Processing CreateTablet for tablet ec7e3cfb4dcb4aa68f1f2263dbdf67de (DEFAULT_TABLE table=default.Table_a8c87cbca48447fb8212f3f19946380f [id=6ef926d6305249bea2cb79c809852b7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.052620 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 86203f7a635d406c95ed1d08cfc22400 (DEFAULT_TABLE table=default.Table_0bb7c2bf3cb64b988e69e769ce83ff41 [id=c5f77852ffd74cd2945869d890a66dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.053823 10375 ts_tablet_manager.cc:1929] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:58.054047 10375 log.cc:1199] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/f2931130e9354f16a238712234c19217
W20260810 19:47:58.054334 10068 leader_election.cc:343] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 7b995f3c3bca4501a6c62cf9025051b2
I20260810 19:47:58.054512 10068 leader_election.cc:304] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:58.054637 10375 ts_tablet_manager.cc:1950] T f2931130e9354f16a238712234c19217 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:58.055132 11490 raft_consensus.cc:2749] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 19:47:58.055606 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 330) took 4258 ms. Trace:
I20260810 19:47:58.055724 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 983adb7af7954ac0a2807cb75d531a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.055830 10375 rpcz_store.cc:276] 0810 19:47:53.797360 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.802712 (+ 5352us) service_pool.cc:224] Handling call
0810 19:47:58.033565 (+4230853us) ts_tablet_manager.cc:1151] Deleting tablet f2931130e9354f16a238712234c19217
0810 19:47:58.033576 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.039534 (+ 5958us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.053722 (+ 14188us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.055542 (+ 1820us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4230495}
I20260810 19:47:58.056551 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet f2931130e9354f16a238712234c19217 (table default.Table_f1f332ce5d104c2b889c1faf78a0510f [id=a5becac787b84d398e96784d005d21f6]) successfully deleted
I20260810 19:47:58.057194 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 331) took 4251 ms. Trace:
I20260810 19:47:58.057349 10375 rpcz_store.cc:276] 0810 19:47:53.805748 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.807433 (+ 1685us) service_pool.cc:224] Handling call
0810 19:47:58.056987 (+4249554us) ts_tablet_manager.cc:1151] Deleting tablet 64470598ccec45a7ae3e3c77fe4b9518
0810 19:47:58.057001 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.057133 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4249182}
W20260810 19:47:58.058066 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 64470598ccec45a7ae3e3c77fe4b9518 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64470598ccec45a7ae3e3c77fe4b9518 already in progress: creating tablet
I20260810 19:47:58.058719 10375 tablet_replica.cc:333] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:58.058864 9421 master_service.cc:960] ReplaceTablet: received request to replace tablet 971e9abee86444a7a9e923b0962ae751 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:58.059022 10375 raft_consensus.cc:2243] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:58.059648 10375 pending_rounds.cc:70] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:47:58.061872 10375 pending_rounds.cc:77] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058658287476736 op_type: NO_OP noop_request { }
I20260810 19:47:58.062176 10375 raft_consensus.cc:2889] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:58.062199 9881 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:38260 (request call id 119) took 1889 ms. Trace:
I20260810 19:47:58.062388 10375 raft_consensus.cc:2272] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:58.063212 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec7e3cfb4dcb4aa68f1f2263dbdf67de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.063261 10375 ts_tablet_manager.cc:1916] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:58.068204 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e94bbfae043b4fcf8004b5fdd86ac3f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:58.066761 9882 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:38260 (request call id 120) took 1612 ms. Trace:
W20260810 19:47:58.069172 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e94bbfae043b4fcf8004b5fdd86ac3f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:58.069506 9897 rpcz_store.cc:276] 0810 19:47:56.633414 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.394297 (+760883us) service_pool.cc:224] Handling call
0810 19:47:57.411280 (+ 16983us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:57.411312 (+ 32us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:57.833700 (+422388us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.006296 (+172596us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:58.017251 (+ 10955us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:58.072790 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc3d8b7b1b8488597b707d3343818b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.073823 9882 rpcz_store.cc:276] 0810 19:47:56.439660 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.439734 (+ 74us) service_pool.cc:224] Handling call
0810 19:47:57.080563 (+640829us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x6160000e2354. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd472ff1860 00007fd476ee009f 00007fd4712b1bd6 00007fd4712b1905 00007fd46e06461e 00007fd46e0634fe 00007fd46e069738 00007fd46e06a09f 00007fd46e069ec8 0000000000aaf86c
0810 19:47:57.554027 (+473464us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x616000141754. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd472ff1860 00007fd476ee009f 00007fd4712b1bd6 00007fd4712b1905 00007fd46e06461e 00007fd46e0634fe 00007fd46e069738 00007fd46e06a09f 00007fd46e069ec8 0000000000aaf86c
0810 19:47:57.800470 (+246443us) spinlock_profiling.cc:243] Waited 902 us on lock 0x61800002408c. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd4745bc26e 00007fd4743b2ffc 00007fd476edfea8 00007fd4712b1bd6 00007fd4712b1905 00007fd46e06461e 00007fd46e0634fe 00007fd46e069738 00007fd46e06a09f 00007fd46e069ec8
0810 19:47:58.051624 (+251154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1361117056}
I20260810 19:47:58.078619 9881 rpcz_store.cc:276] 0810 19:47:56.154977 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.155785 (+ 808us) service_pool.cc:224] Handling call
0810 19:47:57.074399 (+918614us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x6160000e2954. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd472ff1860 00007fd476ee009f 00007fd4712b1bd6 00007fd4712b1905 00007fd46e06461e 00007fd46e0634fe 00007fd46e069738 00007fd46e06a09f 00007fd46e069ec8 0000000000aaf86c
0810 19:47:57.554479 (+480080us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x616000141754. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd472ff1860 00007fd476ee009f 00007fd4712b1bd6 00007fd4712b1905 00007fd46e06461e 00007fd46e0634fe 00007fd46e069738 00007fd46e06a09f 00007fd46e069ec8 0000000000aaf86c
0810 19:47:58.044612 (+490133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1313672064}
I20260810 19:47:58.080979 10377 ts_tablet_manager.cc:1916] T 5f560ed7ea0c4075bad1375d86738861 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:58.081586 10375 ts_tablet_manager.cc:1929] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:58.081745 10375 log.cc:1199] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/9e9603994555425289db23bd5c38cc99
I20260810 19:47:58.086717 10375 ts_tablet_manager.cc:1950] T 9e9603994555425289db23bd5c38cc99 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:58.087901 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 332) took 4265 ms. Trace:
I20260810 19:47:58.088841 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86203f7a635d406c95ed1d08cfc22400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.089020 10375 rpcz_store.cc:276] 0810 19:47:53.822409 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.822543 (+ 134us) service_pool.cc:224] Handling call
0810 19:47:58.058595 (+4236052us) ts_tablet_manager.cc:1151] Deleting tablet 9e9603994555425289db23bd5c38cc99
0810 19:47:58.058609 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.077862 (+ 19253us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.081495 (+ 3633us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.087830 (+ 6335us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4235781}
I20260810 19:47:58.090885 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 334) took 4180 ms. Trace:
I20260810 19:47:58.092689 10375 rpcz_store.cc:276] 0810 19:47:53.909990 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.910769 (+ 779us) service_pool.cc:224] Handling call
0810 19:47:58.090619 (+4179850us) ts_tablet_manager.cc:1151] Deleting tablet dfea147ef3904ab49375def065c6f328
0810 19:47:58.090635 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.090817 (+ 182us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4168649}
I20260810 19:47:58.093459 9885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea9408ecf3784a80ac0c064e1689d25e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:58.093564 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet dfea147ef3904ab49375def065c6f328 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfea147ef3904ab49375def065c6f328 already in progress: creating tablet
I20260810 19:47:58.094148 10375 tablet_replica.cc:333] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:58.094472 10375 raft_consensus.cc:2243] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:58.094569 9904 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 468) took 1454 ms. Trace:
I20260810 19:47:58.094710 9904 rpcz_store.cc:276] 0810 19:47:56.633323 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.384502 (+751179us) service_pool.cc:224] Handling call
0810 19:47:57.386361 (+ 1859us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:57.386398 (+ 37us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:57.708399 (+322001us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.043572 (+335173us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:58.087373 (+ 43801us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:58.094846 10375 raft_consensus.cc:2272] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:58.095803 10375 ts_tablet_manager.cc:1916] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:58.102291 10371 ts_tablet_manager.cc:1929] T 4d654dada92a4939914d26ab72a5f5e8 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260810 19:47:58.103411 9412 master_service.cc:960] ReplaceTablet: received request to replace tablet 3582ed23ffdf4ff089952e29083e5425 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:58.106187 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f0150de0d60425b807be532ce0ba6c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:58.100445 9897 tablet_service.cc:1558] Processing DeleteTablet for tablet b5f30148b5c84f7cbdfabd0186611cc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:58.108392 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet 3520274768ed41abb010bb109127affa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:58.108628 9894 tablet_service.cc:1558] Processing DeleteTablet for tablet f5fa6060b9ef48cea6830cd9d19424ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:58.109723 10375 ts_tablet_manager.cc:1929] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:58.115787 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 6dea3165feb842ecb58b7ace235abf38 (DEFAULT_TABLE table=default.Table_250f18957ff84ad58246dfec016f0abf [id=197d5993ea8643288fe8814a51e4bfd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.116179 10375 log.cc:1199] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/e177140cad404e978b927c810b87ae0c
I20260810 19:47:58.116698 10375 ts_tablet_manager.cc:1950] T e177140cad404e978b927c810b87ae0c P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:58.117087 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 2335ff2297624b53873738380abd07f8 (DEFAULT_TABLE table=default.Table_a5fdc77e962244aab9851f792183f5d9 [id=6342d71685b948419459b7f284b1a683]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.117695 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 337) took 4135 ms. Trace:
I20260810 19:47:58.117889 10375 rpcz_store.cc:276] 0810 19:47:53.982077 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:53.982898 (+ 821us) service_pool.cc:224] Handling call
0810 19:47:58.094023 (+4111125us) ts_tablet_manager.cc:1151] Deleting tablet e177140cad404e978b927c810b87ae0c
0810 19:47:58.094039 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.102297 (+ 8258us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.109623 (+ 7326us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.117652 (+ 8029us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4108338}
I20260810 19:47:58.118059 9887 tablet_service.cc:1558] Processing DeleteTablet for tablet b54feebc7c9841d89808054602be7913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:58.118703 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet e177140cad404e978b927c810b87ae0c (table default.Table_143ff27d69cf41a79a51f8e391528ed5 [id=08a2a58f0f5646a9890870eda636e52a]) successfully deleted
I20260810 19:47:58.119309 10375 tablet_replica.cc:333] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:58.119620 10375 raft_consensus.cc:2243] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:58.120949 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet dad16ea0f82942de8587dd7c98c0d2df (table default.Table_59b5d4d82ac044e0a101d8f598a44e43 [id=4fde0c720763432cac09c13172372936]) successfully deleted
I20260810 19:47:58.122047 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 3badc88d94a34ff7a053ed312f0dd646 (table default.Table_aa9a8825478043949020967cf580deca [id=7a0ce9b2817b49649075fde8c8bf9070]) successfully deleted
I20260810 19:47:58.122608 10165 raft_consensus.cc:3060] T 31c8699875b54be888b3128df1b673aa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:58.123503 10166 raft_consensus.cc:3060] T 10617bdf2eed4dbd8d13ea1821443863 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:58.123855 10370 tablet_bootstrap.cc:492] T 7d3395886420455d9bdaf816c19ebae2 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:58.130779 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 4abd3c95aa394e1cad066d49d22b5764 (DEFAULT_TABLE table=default.Table_ce92099864b748aaa3d27ac772ec799d [id=094ccb77d95f490f9f73c80a85f4c60a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.130906 10370 tablet_bootstrap.cc:654] T 7d3395886420455d9bdaf816c19ebae2 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:58.133174 9665 tablet_service.cc:1511] Processing CreateTablet for tablet 9e37ab519ffe4791ab276a9fc0d96ead (DEFAULT_TABLE table=default.Table_97b0b4e69a6a4a56bf37ba9561c5271e [id=93837e7d4dd346e9b6399dadea5e72a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.133857 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e37ab519ffe4791ab276a9fc0d96ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.134917 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 08f78560ec9f465c94ef08fa2f067c0d (DEFAULT_TABLE table=default.Table_f1684a112499413eab2a008659bd34ab [id=c5336637b8ed45a89125bf55e9705230]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.135502 9887 tablet_service.cc:1511] Processing CreateTablet for tablet f6b705416997444485dc187e11a25c34 (DEFAULT_TABLE table=default.Table_2b91ab11caf848a3844e81653da4e93e [id=580695047aa34b5a86f4ba98b06b0998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.138412 10371 log.cc:1199] T 4d654dada92a4939914d26ab72a5f5e8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/4d654dada92a4939914d26ab72a5f5e8
I20260810 19:47:58.138564 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 0a3f0e184b7a472bb7ae2bea8db000ad (DEFAULT_TABLE table=default.Table_562588ac5f0a40bb9639dc6131e4f151 [id=9d71d073281846a181e5194bb8fff8a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.139277 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 983adb7af7954ac0a2807cb75d531a5a (DEFAULT_TABLE table=default.Table_9747046448e44dc4ab648e6759baad73 [id=e460539cc73c4fa59757b6b683e59530]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.139719 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 983adb7af7954ac0a2807cb75d531a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.144923 9667 tablet_service.cc:1511] Processing CreateTablet for tablet a8963894d23348d3844ab5377762d249 (DEFAULT_TABLE table=default.Table_66575d35b8014f0bbbceffff435faf55 [id=51849f14a84a4ea885e0a4f848b23b8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.146384 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3f0e184b7a472bb7ae2bea8db000ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.148439 10115 tablet_service.cc:1511] Processing CreateTablet for tablet a8963894d23348d3844ab5377762d249 (DEFAULT_TABLE table=default.Table_66575d35b8014f0bbbceffff435faf55 [id=51849f14a84a4ea885e0a4f848b23b8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.148942 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8963894d23348d3844ab5377762d249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.152721 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_602cb1451851485d819ae1c5853c46a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:58.153380 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_602cb1451851485d819ae1c5853c46a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:58.154634 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_812ed15779a140729fc82552535b01f0" } new_table_name: "default.Table_c2917d75b9d74bd0976597949c9fea0d" modify_external_catalogs: true
W20260810 19:47:58.155170 9400 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 7d93fd6556b146ca8933a6dc0a2357e8 (table default.Table_908acdc21674469e937e4539876e0267 [id=de4d62ebb8c440a1a71ed57ac4f3c530], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7d93fd6556b146ca8933a6dc0a2357e8 consensus state has no leader
I20260810 19:47:58.155841 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 971e9abee86444a7a9e923b0962ae751
I20260810 19:47:58.156055 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7b186c06f7bd4a98937d92630880d907" } modify_external_catalogs: true
I20260810 19:47:58.156287 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7b186c06f7bd4a98937d92630880d907" } modify_external_catalogs: true
I20260810 19:47:58.156414 9421 catalog_manager.cc:6807] ReplaceTablet: tablet 971e9abee86444a7a9e923b0962ae751 deleted and replaced by tablet d0f9a22f81894a829fcb350001fc532b
I20260810 19:47:58.156668 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3b8970ea8dcf44efa5779c1ce574f779"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:58.157275 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b8970ea8dcf44efa5779c1ce574f779 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:58.157781 9420 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 31c8699875b54be888b3128df1b673aa (table default.Table_c35c3a44fcc44bba8a8c334292245b49 [id=5abc1f7beec444a4a988fbfcb8b45623]). Expected version 1 got 0
I20260810 19:47:58.158766 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5bdde0f42da34c6f99e8462d17affb30" } modify_external_catalogs: true
I20260810 19:47:58.158776 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1c98bf082e38462a83cbf3d6850868b3" } modify_external_catalogs: true
I20260810 19:47:58.158977 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5bdde0f42da34c6f99e8462d17affb30" } modify_external_catalogs: true
I20260810 19:47:58.159042 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1c98bf082e38462a83cbf3d6850868b3" } modify_external_catalogs: true
I20260810 19:47:58.158874 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9eeefa885ca24021833ff2fc5016de3e" } modify_external_catalogs: true
I20260810 19:47:58.159456 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9eeefa885ca24021833ff2fc5016de3e" } modify_external_catalogs: true
I20260810 19:47:58.161408 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b65ffd5f22ef4b92ac73d90d4d1d682a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:58.162757 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b65ffd5f22ef4b92ac73d90d4d1d682a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:58.163688 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet 971e9abee86444a7a9e923b0962ae751 with delete_type TABLET_DATA_DELETED (replaced by tablet d0f9a22f81894a829fcb350001fc532b) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:58.165748 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8963894d23348d3844ab5377762d249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.166033 10367 tablet_bootstrap.cc:492] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:58.166258 10367 ts_tablet_manager.cc:1403] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.315s user 0.065s sys 0.039s
I20260810 19:47:58.166656 10375 raft_consensus.cc:2272] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:58.167605 10375 ts_tablet_manager.cc:1916] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:58.169946 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_9209b00d101f4479bd6324c62bff3a29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:58.170244 10371 ts_tablet_manager.cc:1950] T 4d654dada92a4939914d26ab72a5f5e8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
W20260810 19:47:58.170608 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9209b00d101f4479bd6324c62bff3a29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:58.170895 10367 raft_consensus.cc:359] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.171768 10367 raft_consensus.cc:385] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:58.171885 10367 raft_consensus.cc:740] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:58.173985 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 474) took 1504 ms. Trace:
I20260810 19:47:58.174248 10367 consensus_queue.cc:260] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.174863 10367 ts_tablet_manager.cc:1434] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260810 19:47:58.176131 9894 tablet_service.cc:1511] Processing CreateTablet for tablet 8e73953ad6e148749163ebeaa24ee6e4 (DEFAULT_TABLE table=default.Table_03860438702347aba8b5460c42468832 [id=f2a75289377648baba880ad15de2593a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.178411 11543 raft_consensus.cc:493] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:58.178606 11543 raft_consensus.cc:515] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.179412 11543 leader_election.cc:290] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:58.179795 9911 tablet_service.cc:1511] Processing CreateTablet for tablet cf4a37857a944a7493ee13a6356b72ed (DEFAULT_TABLE table=default.Table_812ed15779a140729fc82552535b01f0 [id=cccb8fa3465940449dc27799466a7b25]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:58.181387 10068 consensus_peers.cc:597] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d654dada92a4939914d26ab72a5f5e8. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:58.182425 11426 raft_consensus.cc:493] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:58.183920 10371 rpcz_store.cc:276] 0810 19:47:56.666675 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.666734 (+ 59us) service_pool.cc:224] Handling call
0810 19:47:57.870741 (+1204007us) ts_tablet_manager.cc:1151] Deleting tablet 4d654dada92a4939914d26ab72a5f5e8
0810 19:47:57.870751 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:57.981051 (+110300us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.064775 (+ 83724us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.171224 (+106449us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1203755}
I20260810 19:47:58.184414 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 483) took 1424 ms. Trace:
I20260810 19:47:58.183790 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 81e61197234642468b4723518c72ec95 (DEFAULT_TABLE table=default.Table_f70a4e380a494ed0be7890bf577fb42c [id=b2dabb394b144980927766a256ac727f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.184690 10371 rpcz_store.cc:276] 0810 19:47:56.759537 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.759724 (+ 187us) service_pool.cc:224] Handling call
0810 19:47:58.184249 (+1424525us) ts_tablet_manager.cc:1151] Deleting tablet 8d93821ff46a4096a8ebbac83faabed7
0810 19:47:58.184258 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.184381 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1424295}
I20260810 19:47:58.184996 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 4d654dada92a4939914d26ab72a5f5e8 (table default.Table_551b211882fd4d67ba96228b8f0826e1 [id=a8bdf6ea608f4279971af4c9eff71db6]) successfully deleted
I20260810 19:47:58.185139 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 484) took 1425 ms. Trace:
I20260810 19:47:58.185411 10371 rpcz_store.cc:276] 0810 19:47:56.759671 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.759990 (+ 319us) service_pool.cc:224] Handling call
0810 19:47:58.184973 (+1424983us) ts_tablet_manager.cc:1151] Deleting tablet 48eee4ce10114021855075812e356652
0810 19:47:58.184982 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.185106 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1424789}
W20260810 19:47:58.185670 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 8d93821ff46a4096a8ebbac83faabed7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d93821ff46a4096a8ebbac83faabed7 already in progress: creating tablet
I20260810 19:47:58.185803 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 486) took 1401 ms. Trace:
I20260810 19:47:58.186261 10371 rpcz_store.cc:276] 0810 19:47:56.784554 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.784877 (+ 323us) service_pool.cc:224] Handling call
0810 19:47:58.185680 (+1400803us) ts_tablet_manager.cc:1151] Deleting tablet ee5f38d91bb349a9ae1da8ba69d2ddbc
0810 19:47:58.185689 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.185770 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1388350}
I20260810 19:47:58.186584 10371 tablet_replica.cc:333] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:58.187175 10371 raft_consensus.cc:2243] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:58.187449 10371 pending_rounds.cc:70] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4: Trying to abort 1 pending ops.
I20260810 19:47:58.188091 10371 pending_rounds.cc:77] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058672185393152 op_type: NO_OP noop_request { }
I20260810 19:47:58.188233 10371 raft_consensus.cc:2889] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:58.188717 10371 raft_consensus.cc:2272] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 19:47:58.200966 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 48eee4ce10114021855075812e356652 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 48eee4ce10114021855075812e356652 already in progress: creating tablet
I20260810 19:47:58.201299 10375 ts_tablet_manager.cc:1929] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:58.201536 10375 log.cc:1199] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/5b2ee8ebe11e4e5cb6a91592170c6c3d
I20260810 19:47:58.201987 10375 ts_tablet_manager.cc:1950] T 5b2ee8ebe11e4e5cb6a91592170c6c3d P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:58.202307 10370 tablet_bootstrap.cc:492] T 7d3395886420455d9bdaf816c19ebae2 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:58.202574 10370 ts_tablet_manager.cc:1403] T 7d3395886420455d9bdaf816c19ebae2 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.079s user 0.004s sys 0.001s
I20260810 19:47:58.203250 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 340) took 4056 ms. Trace:
I20260810 19:47:58.203420 10375 rpcz_store.cc:276] 0810 19:47:54.147013 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:54.147301 (+ 288us) service_pool.cc:224] Handling call
0810 19:47:58.119231 (+3971930us) ts_tablet_manager.cc:1151] Deleting tablet 5b2ee8ebe11e4e5cb6a91592170c6c3d
0810 19:47:58.119245 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.182665 (+ 63420us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.201195 (+ 18530us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.203141 (+ 1946us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3971605}
I20260810 19:47:58.203711 10370 raft_consensus.cc:359] T 7d3395886420455d9bdaf816c19ebae2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.203929 10370 raft_consensus.cc:385] T 7d3395886420455d9bdaf816c19ebae2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:58.204031 10370 raft_consensus.cc:740] T 7d3395886420455d9bdaf816c19ebae2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:58.204277 10370 consensus_queue.cc:260] T 7d3395886420455d9bdaf816c19ebae2 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.204931 10370 ts_tablet_manager.cc:1434] T 7d3395886420455d9bdaf816c19ebae2 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:47:58.205261 10370 tablet_bootstrap.cc:492] T 81720b897a674b5380c6469d1600a979 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:58.204146 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 5b2ee8ebe11e4e5cb6a91592170c6c3d (table default.Table_bc109c4a41b649f0843393e4184b81be [id=932a3e3e563546b6b0cb7850cc4f3e1f]) successfully deleted
W20260810 19:47:58.211684 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet ee5f38d91bb349a9ae1da8ba69d2ddbc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee5f38d91bb349a9ae1da8ba69d2ddbc already in progress: creating tablet
I20260810 19:47:58.212459 10375 tablet_replica.cc:333] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:58.212775 10375 raft_consensus.cc:2243] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:58.213306 10375 pending_rounds.cc:70] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:47:58.213469 10375 pending_rounds.cc:77] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058661245796352 op_type: NO_OP noop_request { }
I20260810 19:47:58.213691 10375 raft_consensus.cc:2889] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:58.213878 10375 raft_consensus.cc:2272] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:58.214690 10375 ts_tablet_manager.cc:1916] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:58.226562 10371 ts_tablet_manager.cc:1916] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:58.228653 10367 tablet_bootstrap.cc:492] T f8e4de89977b4caf91b2c0a49d147d17 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:58.229341 11426 raft_consensus.cc:515] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.230248 11426 leader_election.cc:290] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:58.230823 10367 tablet_bootstrap.cc:654] T f8e4de89977b4caf91b2c0a49d147d17 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:58.230958 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dea3165feb842ecb58b7ace235abf38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.232154 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9714a8a1eeaf41d2bb01d3fa3ff7181d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:58.233234 9611 leader_election.cc:343] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:58.234365 11426 raft_consensus.cc:493] T c7235af514fa47d899d7e38ee5662f6c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:58.234547 11426 raft_consensus.cc:515] T c7235af514fa47d899d7e38ee5662f6c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.235641 11426 leader_election.cc:290] T c7235af514fa47d899d7e38ee5662f6c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:58.236503 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7235af514fa47d899d7e38ee5662f6c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:58.236771 10375 ts_tablet_manager.cc:1929] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:58.236919 10375 log.cc:1199] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/aa457d1f5cf2445eb3d869bc6ecf60b3
I20260810 19:47:58.237408 10375 ts_tablet_manager.cc:1950] T aa457d1f5cf2445eb3d869bc6ecf60b3 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
W20260810 19:47:58.237797 9611 leader_election.cc:343] T c7235af514fa47d899d7e38ee5662f6c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:58.238435 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 343) took 4054 ms. Trace:
I20260810 19:47:58.238585 10375 rpcz_store.cc:276] 0810 19:47:54.183697 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:54.184377 (+ 680us) service_pool.cc:224] Handling call
0810 19:47:58.212329 (+4027952us) ts_tablet_manager.cc:1151] Deleting tablet aa457d1f5cf2445eb3d869bc6ecf60b3
0810 19:47:58.212358 (+ 29us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.221960 (+ 9602us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.236667 (+ 14707us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.238377 (+ 1710us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4019859}
I20260810 19:47:58.239210 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet aa457d1f5cf2445eb3d869bc6ecf60b3 (table default.Table_9381401bf3f44ef488064afeb31098bb [id=c8a0313d7b6a4b4fa813727cf4e8e38d]) successfully deleted
I20260810 19:47:58.239761 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 346) took 4021 ms. Trace:
I20260810 19:47:58.239918 10375 rpcz_store.cc:276] 0810 19:47:54.218102 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:54.218161 (+ 59us) service_pool.cc:224] Handling call
0810 19:47:58.239588 (+4021427us) ts_tablet_manager.cc:1151] Deleting tablet 19e2bf7b7d254894a07c5a75bf24e742
0810 19:47:58.239599 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.239707 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4021138}
W20260810 19:47:58.240514 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 19e2bf7b7d254894a07c5a75bf24e742 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19e2bf7b7d254894a07c5a75bf24e742 already in progress: creating tablet
I20260810 19:47:58.240810 9890 tablet_service.cc:1511] Processing CreateTablet for tablet b2034784996149158c10b868f61ff418 (DEFAULT_TABLE table=default.Table_4f9606f9dd734d9c9ef67a3e0eafbdac [id=e26f1f869df446a1b79e137e81562a49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.240950 10375 tablet_replica.cc:333] T 860dbb6d0a004c43bdce09075272fa70 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:58.243593 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf4a37857a944a7493ee13a6356b72ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.244302 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet 971e9abee86444a7a9e923b0962ae751 with delete_type TABLET_DATA_DELETED (replaced by tablet d0f9a22f81894a829fcb350001fc532b) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:58.241273 10375 raft_consensus.cc:2243] T 860dbb6d0a004c43bdce09075272fa70 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:58.246080 10375 raft_consensus.cc:2272] T 860dbb6d0a004c43bdce09075272fa70 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:58.246740 10370 tablet_bootstrap.cc:654] T 81720b897a674b5380c6469d1600a979 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:58.249987 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2034784996149158c10b868f61ff418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.250114 10375 ts_tablet_manager.cc:1916] T 860dbb6d0a004c43bdce09075272fa70 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:58.254910 9906 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 495) took 1004 ms. Trace:
I20260810 19:47:58.255105 9906 rpcz_store.cc:276] 0810 19:47:57.242696 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.954064 (+711368us) service_pool.cc:224] Handling call
0810 19:47:57.988517 (+ 34453us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:57.988551 (+ 34us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:58.140175 (+151624us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.246632 (+106457us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:58.246807 (+ 175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:58.255782 9906 tablet_service.cc:1511] Processing CreateTablet for tablet dc3164c171b84b04bc67c0218ece7e99 (DEFAULT_TABLE table=default.Table_e00c7d0fdf6741b5855eee8cf797b84a [id=c166b3e89f0442e9b3ac6b3cba32eaf3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.256323 9907 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 490) took 1006 ms. Trace:
I20260810 19:47:58.256492 9907 rpcz_store.cc:276] 0810 19:47:57.242243 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.679150 (+436907us) service_pool.cc:224] Handling call
0810 19:47:57.689896 (+ 10746us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:57.689941 (+ 45us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:57.969468 (+279527us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.248122 (+278654us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:58.248282 (+ 160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:58.256670 10375 ts_tablet_manager.cc:1929] T 860dbb6d0a004c43bdce09075272fa70 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:58.257027 11426 raft_consensus.cc:493] T 45194cae6ea44d9d8cf856d256fd534f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:58.257336 11426 raft_consensus.cc:515] T 45194cae6ea44d9d8cf856d256fd534f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.257560 9907 tablet_service.cc:1511] Processing CreateTablet for tablet a7d3a90046d74f4087fd5b283581970d (DEFAULT_TABLE table=default.Table_c5352053fa544be884fb272f00bd81f9 [id=0ba2b2657a7342929dea6795c6078def]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.258131 11426 leader_election.cc:290] T 45194cae6ea44d9d8cf856d256fd534f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:58.258355 9898 tablet_service.cc:1511] Processing CreateTablet for tablet d59e5607e4184683bc3924266ed6ca20 (DEFAULT_TABLE table=default.Table_4d4cbd339a304b6684323ba9e3a91e07 [id=d0c29ff645394a1288424d707bdb1707]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.260783 10367 tablet_bootstrap.cc:492] T f8e4de89977b4caf91b2c0a49d147d17 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:58.260963 10367 ts_tablet_manager.cc:1403] T f8e4de89977b4caf91b2c0a49d147d17 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.086s user 0.006s sys 0.000s
I20260810 19:47:58.261829 10367 raft_consensus.cc:359] T f8e4de89977b4caf91b2c0a49d147d17 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.262034 10367 raft_consensus.cc:385] T f8e4de89977b4caf91b2c0a49d147d17 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:58.262144 10367 raft_consensus.cc:740] T f8e4de89977b4caf91b2c0a49d147d17 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:58.262435 10367 consensus_queue.cc:260] T f8e4de89977b4caf91b2c0a49d147d17 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.263186 10367 ts_tablet_manager.cc:1434] T f8e4de89977b4caf91b2c0a49d147d17 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 19:47:58.263547 10367 tablet_bootstrap.cc:492] T e959898b2c4c4173aea107d3f090ca07 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:58.265408 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08f78560ec9f465c94ef08fa2f067c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.265605 10367 tablet_bootstrap.cc:654] T e959898b2c4c4173aea107d3f090ca07 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:58.258896 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45194cae6ea44d9d8cf856d256fd534f" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:58.269400 9899 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 477) took 1028 ms. Trace:
I20260810 19:47:58.269537 9899 rpcz_store.cc:276] 0810 19:47:57.241053 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.476452 (+235399us) service_pool.cc:224] Handling call
0810 19:47:57.506563 (+ 30111us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:57.506597 (+ 34us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:58.067203 (+560606us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.269167 (+201964us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:58.269348 (+ 181us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260810 19:47:58.269907 9611 leader_election.cc:343] T 45194cae6ea44d9d8cf856d256fd534f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:58.265663 10370 tablet_bootstrap.cc:492] T 81720b897a674b5380c6469d1600a979 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:58.270249 10370 ts_tablet_manager.cc:1403] T 81720b897a674b5380c6469d1600a979 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.065s user 0.006s sys 0.000s
I20260810 19:47:58.270417 9899 tablet_service.cc:1511] Processing CreateTablet for tablet a07fca1f298e4473aca7e9813bdd11d6 (DEFAULT_TABLE table=default.Table_0b65da1621cf4a15bbb947263cbef587 [id=9ca19d2c87c04718879d069321e10e82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.271162 10370 raft_consensus.cc:359] T 81720b897a674b5380c6469d1600a979 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.271389 10370 raft_consensus.cc:385] T 81720b897a674b5380c6469d1600a979 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:58.271471 10370 raft_consensus.cc:740] T 81720b897a674b5380c6469d1600a979 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:58.271757 10370 consensus_queue.cc:260] T 81720b897a674b5380c6469d1600a979 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.274799 10370 ts_tablet_manager.cc:1434] T 81720b897a674b5380c6469d1600a979 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260810 19:47:58.275023 10371 ts_tablet_manager.cc:1929] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:58.275158 10371 log.cc:1199] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/3916a976efef43428942135e777edcec
I20260810 19:47:58.275341 10370 tablet_bootstrap.cc:492] T 6f0150de0d60425b807be532ce0ba6c3 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:58.275650 10371 ts_tablet_manager.cc:1950] T 3916a976efef43428942135e777edcec P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:58.278191 10366 tablet_bootstrap.cc:492] T 11272d47d96f443187d63c184049871f P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:58.278786 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d59e5607e4184683bc3924266ed6ca20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.279083 10375 log.cc:1199] T 860dbb6d0a004c43bdce09075272fa70 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/860dbb6d0a004c43bdce09075272fa70
I20260810 19:47:58.279605 10370 tablet_bootstrap.cc:654] T 6f0150de0d60425b807be532ce0ba6c3 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:58.279829 10375 ts_tablet_manager.cc:1950] T 860dbb6d0a004c43bdce09075272fa70 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:58.281680 10366 ts_tablet_manager.cc:1403] T 11272d47d96f443187d63c184049871f P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.602s user 0.004s sys 0.016s
I20260810 19:47:58.282035 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 349) took 4000 ms. Trace:
I20260810 19:47:58.282218 10375 rpcz_store.cc:276] 0810 19:47:54.281581 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:54.281639 (+ 58us) service_pool.cc:224] Handling call
0810 19:47:58.240838 (+3959199us) ts_tablet_manager.cc:1151] Deleting tablet 860dbb6d0a004c43bdce09075272fa70
0810 19:47:58.240849 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.253535 (+ 12686us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.256570 (+ 3035us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.281995 (+ 25425us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3958940}
I20260810 19:47:58.282804 10366 raft_consensus.cc:359] T 11272d47d96f443187d63c184049871f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.282897 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 860dbb6d0a004c43bdce09075272fa70 (table default.Table_c86a4dc697bd4628bba90b74b908b5f9 [id=097f014eed014a6782f331bf23f6b2f2]) successfully deleted
I20260810 19:47:58.283208 10366 raft_consensus.cc:385] T 11272d47d96f443187d63c184049871f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:58.283291 10375 tablet_replica.cc:333] T 92e3d52bd5b741a4adcabb343b6770b8 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:58.283375 10366 raft_consensus.cc:740] T 11272d47d96f443187d63c184049871f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:58.283703 10366 consensus_queue.cc:260] T 11272d47d96f443187d63c184049871f P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.284565 10375 raft_consensus.cc:2243] T 92e3d52bd5b741a4adcabb343b6770b8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:58.284801 10375 raft_consensus.cc:2272] T 92e3d52bd5b741a4adcabb343b6770b8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:58.285993 9902 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 491) took 1030 ms. Trace:
I20260810 19:47:58.287004 10375 ts_tablet_manager.cc:1916] T 92e3d52bd5b741a4adcabb343b6770b8 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:58.287477 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 489) took 1480 ms. Trace:
I20260810 19:47:58.287668 10371 rpcz_store.cc:276] 0810 19:47:56.807253 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.807309 (+ 56us) service_pool.cc:224] Handling call
0810 19:47:58.186525 (+1379216us) ts_tablet_manager.cc:1151] Deleting tablet 3916a976efef43428942135e777edcec
0810 19:47:58.186536 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.270119 (+ 83583us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.274922 (+ 4803us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.287424 (+ 12502us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1378944}
I20260810 19:47:58.288143 11426 raft_consensus.cc:493] T 06af03c8a87141febef768bd56c72c39 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:58.288311 11426 raft_consensus.cc:515] T 06af03c8a87141febef768bd56c72c39 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.288443 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 3916a976efef43428942135e777edcec (table default.Table_3e50c2a587f045f090cdb0a281a1267f [id=f881fab647be45f786665629ab8baaee]) successfully deleted
I20260810 19:47:58.288825 10371 tablet_replica.cc:333] T 11272d47d96f443187d63c184049871f P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:58.289110 10371 raft_consensus.cc:2243] T 11272d47d96f443187d63c184049871f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:58.289309 11426 leader_election.cc:290] T 06af03c8a87141febef768bd56c72c39 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:58.289521 10371 raft_consensus.cc:2272] T 11272d47d96f443187d63c184049871f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:58.290202 10371 ts_tablet_manager.cc:1916] T 11272d47d96f443187d63c184049871f P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:58.290210 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06af03c8a87141febef768bd56c72c39" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:58.290993 9611 leader_election.cc:343] T 06af03c8a87141febef768bd56c72c39 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:58.291271 10367 tablet_bootstrap.cc:492] T e959898b2c4c4173aea107d3f090ca07 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:58.291472 10367 ts_tablet_manager.cc:1403] T e959898b2c4c4173aea107d3f090ca07 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.000s
I20260810 19:47:58.292426 10367 raft_consensus.cc:359] T e959898b2c4c4173aea107d3f090ca07 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.292670 10367 raft_consensus.cc:385] T e959898b2c4c4173aea107d3f090ca07 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:58.292747 10367 raft_consensus.cc:740] T e959898b2c4c4173aea107d3f090ca07 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:58.293066 10367 consensus_queue.cc:260] T e959898b2c4c4173aea107d3f090ca07 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.293804 10367 ts_tablet_manager.cc:1434] T e959898b2c4c4173aea107d3f090ca07 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 19:47:58.294157 10367 tablet_bootstrap.cc:492] T 6af6dd8913f44e7f966ed2a128ae4fbf P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:58.295711 9902 rpcz_store.cc:276] 0810 19:47:57.242352 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.819447 (+577095us) service_pool.cc:224] Handling call
0810 19:47:57.820102 (+ 655us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:57.820132 (+ 30us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:58.070684 (+250552us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.272365 (+201681us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:58.272507 (+ 142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:58.296264 10367 tablet_bootstrap.cc:654] T 6af6dd8913f44e7f966ed2a128ae4fbf P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:58.296634 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 36f01bdcf7b24a58b80b6ca9ba307113 (DEFAULT_TABLE table=default.Table_43667bdf61e944278a0faf9e66d7a1e4 [id=aed8e86da457485094bcb9fe12ebcb54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.297199 9897 tablet_service.cc:1511] Processing CreateTablet for tablet a999e0d7e70e4b4fb53e17e51ab9b03a (DEFAULT_TABLE table=default.Table_91221657584a43cc936203848d895dab [id=c68c4188f38c4888a47420a503672bc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.305167 10375 ts_tablet_manager.cc:1929] T 92e3d52bd5b741a4adcabb343b6770b8 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:58.306739 10370 tablet_bootstrap.cc:492] T 6f0150de0d60425b807be532ce0ba6c3 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:58.307024 10370 ts_tablet_manager.cc:1403] T 6f0150de0d60425b807be532ce0ba6c3 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.032s user 0.005s sys 0.001s
I20260810 19:47:58.307590 10366 ts_tablet_manager.cc:1434] T 11272d47d96f443187d63c184049871f P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20260810 19:47:58.307890 10370 raft_consensus.cc:359] T 6f0150de0d60425b807be532ce0ba6c3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.308089 10370 raft_consensus.cc:385] T 6f0150de0d60425b807be532ce0ba6c3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:58.308045 10366 tablet_bootstrap.cc:492] T 6992e7ef8e794ddc879ae04f9f78b8bd P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:58.308171 10370 raft_consensus.cc:740] T 6f0150de0d60425b807be532ce0ba6c3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:58.308480 10370 consensus_queue.cc:260] T 6f0150de0d60425b807be532ce0ba6c3 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.311014 10370 ts_tablet_manager.cc:1434] T 6f0150de0d60425b807be532ce0ba6c3 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 19:47:58.311327 10370 tablet_bootstrap.cc:492] T 3916a976efef43428942135e777edcec P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:58.313103 10370 tablet_bootstrap.cc:654] T 3916a976efef43428942135e777edcec P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:58.315292 10367 tablet_bootstrap.cc:492] T 6af6dd8913f44e7f966ed2a128ae4fbf P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:58.315558 10367 ts_tablet_manager.cc:1403] T 6af6dd8913f44e7f966ed2a128ae4fbf P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.000s
I20260810 19:47:58.315816 10375 log.cc:1199] T 92e3d52bd5b741a4adcabb343b6770b8 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/92e3d52bd5b741a4adcabb343b6770b8
I20260810 19:47:58.316335 10375 ts_tablet_manager.cc:1950] T 92e3d52bd5b741a4adcabb343b6770b8 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:58.316684 10367 raft_consensus.cc:359] T 6af6dd8913f44e7f966ed2a128ae4fbf P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:58.316957 10367 raft_consensus.cc:385] T 6af6dd8913f44e7f966ed2a128ae4fbf P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:58.317111 10367 raft_consensus.cc:740] T 6af6dd8913f44e7f966ed2a128ae4fbf P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:58.317416 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 350) took 4017 ms. Trace:
I20260810 19:47:58.317487 10367 consensus_queue.cc:260] T 6af6dd8913f44e7f966ed2a128ae4fbf P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:58.317564 10375 rpcz_store.cc:276] 0810 19:47:54.299692 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:54.301600 (+ 1908us) service_pool.cc:224] Handling call
0810 19:47:58.283203 (+3981603us) ts_tablet_manager.cc:1151] Deleting tablet 92e3d52bd5b741a4adcabb343b6770b8
0810 19:47:58.283213 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.290695 (+ 7482us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.305079 (+ 14384us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.317354 (+ 12275us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3981322}
I20260810 19:47:58.318295 10367 ts_tablet_manager.cc:1434] T 6af6dd8913f44e7f966ed2a128ae4fbf P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:47:58.318367 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7d3a90046d74f4087fd5b283581970d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.318548 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 92e3d52bd5b741a4adcabb343b6770b8 (table default.Table_4b3474ab5fac40a28a050d69fc60bfe5 [id=495386acd3524a388b83e38f07bf9967]) successfully deleted
I20260810 19:47:58.318756 10367 tablet_bootstrap.cc:492] T bc753970b2464e38b03e377551276343 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:58.319468 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 352) took 3945 ms. Trace:
I20260810 19:47:58.320118 10375 rpcz_store.cc:276] 0810 19:47:54.374287 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:54.374369 (+ 82us) service_pool.cc:224] Handling call
0810 19:47:58.319247 (+3944878us) ts_tablet_manager.cc:1151] Deleting tablet 00fe7d9a548a487d965d92b53cdf9250
0810 19:47:58.319259 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.319408 (+ 149us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3944345}
I20260810 19:47:58.320655 10367 tablet_bootstrap.cc:654] T bc753970b2464e38b03e377551276343 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:58.320813 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 00fe7d9a548a487d965d92b53cdf9250 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00fe7d9a548a487d965d92b53cdf9250 already in progress: creating tablet
I20260810 19:47:58.321502 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36f01bdcf7b24a58b80b6ca9ba307113. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.321800 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a999e0d7e70e4b4fb53e17e51ab9b03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.325347 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 354) took 3932 ms. Trace:
I20260810 19:47:58.325492 10375 rpcz_store.cc:276] 0810 19:47:54.392446 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:54.392534 (+ 88us) service_pool.cc:224] Handling call
0810 19:47:58.324994 (+3932460us) ts_tablet_manager.cc:1151] Deleting tablet 1a393149727043f3a3c9f58aa051b065
0810 19:47:58.325004 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.325293 (+ 289us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3932204}
I20260810 19:47:58.325896 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 240b2ae8a1484de998d3ea972bc74cfe (DEFAULT_TABLE table=default.Table_fdb9a22aaf1046c7b949a64abb7f2fd5 [id=91410b334d9f46fc8794de0b13863d18]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:58.326117 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 1a393149727043f3a3c9f58aa051b065 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a393149727043f3a3c9f58aa051b065 already in progress: creating tablet
I20260810 19:47:58.326267 11543 raft_consensus.cc:493] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:58.326552 10371 ts_tablet_manager.cc:1929] T 11272d47d96f443187d63c184049871f P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:58.326663 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 357) took 3830 ms. Trace:
I20260810 19:47:58.326730 10371 log.cc:1199] T 11272d47d96f443187d63c184049871f P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/11272d47d96f443187d63c184049871f
I20260810 19:47:58.327102 10371 ts_tablet_manager.cc:1950] T 11272d47d96f443187d63c184049871f P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:58.327090 11543 raft_consensus.cc:515] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.327126 10375 rpcz_store.cc:276] 0810 19:47:54.496189 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:54.496503 (+ 314us) service_pool.cc:224] Handling call
0810 19:47:58.326517 (+3830014us) ts_tablet_manager.cc:1151] Deleting tablet da3d8ade850c4d36bd2756c36706195d
0810 19:47:58.326528 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.326613 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3802774}
I20260810 19:47:58.327862 11543 leader_election.cc:290] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:58.327968 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 488) took 1520 ms. Trace:
I20260810 19:47:58.328080 10375 tablet_replica.cc:333] T 25e15a8d1e7d41e68eef25d30d668e61 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:58.328061 10371 rpcz_store.cc:276] 0810 19:47:56.807136 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.807400 (+ 264us) service_pool.cc:224] Handling call
0810 19:47:58.288743 (+1481343us) ts_tablet_manager.cc:1151] Deleting tablet 11272d47d96f443187d63c184049871f
0810 19:47:58.288756 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.309926 (+ 21170us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.326110 (+ 16184us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.327907 (+ 1797us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1481063}
I20260810 19:47:58.328589 10375 raft_consensus.cc:2243] T 25e15a8d1e7d41e68eef25d30d668e61 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:58.328552 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 11272d47d96f443187d63c184049871f (table default.Table_b8c16d5ca4ee41fbaf84f9e6e6fbb3bd [id=6e9c569b1e104415ba75fb011a08a6d9]) successfully deleted
I20260810 19:47:58.329078 10375 raft_consensus.cc:2272] T 25e15a8d1e7d41e68eef25d30d668e61 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:58.330943 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 485) took 1561 ms. Trace:
I20260810 19:47:58.331050 10371 rpcz_store.cc:276] 0810 19:47:56.769629 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.810007 (+ 40378us) service_pool.cc:224] Handling call
0810 19:47:58.330745 (+1520738us) ts_tablet_manager.cc:1151] Deleting tablet 749cea5cd8f842b891f4e2cab07c054e
0810 19:47:58.330756 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.330885 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1405266}
W20260810 19:47:58.331590 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 749cea5cd8f842b891f4e2cab07c054e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 749cea5cd8f842b891f4e2cab07c054e already in progress: creating tablet
I20260810 19:47:58.331712 10375 ts_tablet_manager.cc:1916] T 25e15a8d1e7d41e68eef25d30d668e61 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:58.332921 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 496) took 1396 ms. Trace:
I20260810 19:47:58.333354 10371 rpcz_store.cc:276] 0810 19:47:56.936429 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.936483 (+ 54us) service_pool.cc:224] Handling call
0810 19:47:58.332749 (+1396266us) ts_tablet_manager.cc:1151] Deleting tablet 9b40fd0d57ea4b71aeef2d66f4958ac8
0810 19:47:58.332760 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.332866 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1395213}
W20260810 19:47:58.334079 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 9b40fd0d57ea4b71aeef2d66f4958ac8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b40fd0d57ea4b71aeef2d66f4958ac8 already in progress: creating tablet
I20260810 19:47:58.334265 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc3164c171b84b04bc67c0218ece7e99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.334563 10371 tablet_replica.cc:333] T ffc4466b82bd49fcaad30e4d5325c7db P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:58.335074 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 240b2ae8a1484de998d3ea972bc74cfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.335052 10371 raft_consensus.cc:2243] T ffc4466b82bd49fcaad30e4d5325c7db P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:58.335546 10370 tablet_bootstrap.cc:492] T 3916a976efef43428942135e777edcec P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:58.335719 10370 ts_tablet_manager.cc:1403] T 3916a976efef43428942135e777edcec P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.001s
I20260810 19:47:58.335947 10371 raft_consensus.cc:2272] T ffc4466b82bd49fcaad30e4d5325c7db P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:58.336350 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e73953ad6e148749163ebeaa24ee6e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.336561 10370 raft_consensus.cc:359] T 3916a976efef43428942135e777edcec P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.336774 10370 raft_consensus.cc:385] T 3916a976efef43428942135e777edcec P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:58.336843 10370 raft_consensus.cc:740] T 3916a976efef43428942135e777edcec P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:58.337157 10370 consensus_queue.cc:260] T 3916a976efef43428942135e777edcec P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.337620 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81e61197234642468b4723518c72ec95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.337721 10371 ts_tablet_manager.cc:1916] T ffc4466b82bd49fcaad30e4d5325c7db P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:58.340521 10370 ts_tablet_manager.cc:1434] T 3916a976efef43428942135e777edcec P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 19:47:58.341620 9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07fca1f298e4473aca7e9813bdd11d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.343849 10370 tablet_bootstrap.cc:492] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:58.344579 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2335ff2297624b53873738380abd07f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.345709 9887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6b705416997444485dc187e11a25c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.345933 10370 tablet_bootstrap.cc:654] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:58.346679 10367 tablet_bootstrap.cc:492] T bc753970b2464e38b03e377551276343 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:58.346946 10367 ts_tablet_manager.cc:1403] T bc753970b2464e38b03e377551276343 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.002s
I20260810 19:47:58.347569 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4abd3c95aa394e1cad066d49d22b5764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.348078 10367 raft_consensus.cc:359] T bc753970b2464e38b03e377551276343 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:58.348392 10367 raft_consensus.cc:385] T bc753970b2464e38b03e377551276343 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:58.348520 10367 raft_consensus.cc:740] T bc753970b2464e38b03e377551276343 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:58.348881 10367 consensus_queue.cc:260] T bc753970b2464e38b03e377551276343 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:58.349673 10367 ts_tablet_manager.cc:1434] T bc753970b2464e38b03e377551276343 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:47:58.350054 10367 tablet_bootstrap.cc:492] T c8602b7360b747a3af756b139635d95c P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:58.351935 10367 tablet_bootstrap.cc:654] T c8602b7360b747a3af756b139635d95c P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:58.349454 10371 ts_tablet_manager.cc:1929] T ffc4466b82bd49fcaad30e4d5325c7db P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:58.354236 10371 log.cc:1199] T ffc4466b82bd49fcaad30e4d5325c7db P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/ffc4466b82bd49fcaad30e4d5325c7db
I20260810 19:47:58.354681 10371 ts_tablet_manager.cc:1950] T ffc4466b82bd49fcaad30e4d5325c7db P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:58.361965 10370 tablet_bootstrap.cc:492] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:58.362166 10370 ts_tablet_manager.cc:1403] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.001s
I20260810 19:47:58.363032 10370 raft_consensus.cc:359] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.363243 10370 raft_consensus.cc:385] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:58.363343 10370 raft_consensus.cc:740] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:58.363665 10370 consensus_queue.cc:260] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.365149 9905 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 496) took 1122 ms. Trace:
I20260810 19:47:58.367151 10370 ts_tablet_manager.cc:1434] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260810 19:47:58.370573 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 497) took 1424 ms. Trace:
I20260810 19:47:58.370827 10371 rpcz_store.cc:276] 0810 19:47:56.945623 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.945694 (+ 71us) service_pool.cc:224] Handling call
0810 19:47:58.334466 (+1388772us) ts_tablet_manager.cc:1151] Deleting tablet ffc4466b82bd49fcaad30e4d5325c7db
0810 19:47:58.334476 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.343874 (+ 9398us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.349342 (+ 5468us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.370508 (+ 21166us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1382882}
I20260810 19:47:58.371408 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet ffc4466b82bd49fcaad30e4d5325c7db (table default.Table_8680fc2abacb464c8d39fae15165ea39 [id=6d8b87531495425da6e953f4e5c2fb08]) successfully deleted
I20260810 19:47:58.371973 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 504) took 1225 ms. Trace:
I20260810 19:47:58.372143 10371 rpcz_store.cc:276] 0810 19:47:57.146715 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.146794 (+ 79us) service_pool.cc:224] Handling call
0810 19:47:58.371783 (+1224989us) ts_tablet_manager.cc:1151] Deleting tablet b54feebc7c9841d89808054602be7913
0810 19:47:58.371798 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.371933 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1222684}
W20260810 19:47:58.372733 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet b54feebc7c9841d89808054602be7913 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b54feebc7c9841d89808054602be7913 already in progress: creating tablet
I20260810 19:47:58.373219 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 503) took 1228 ms. Trace:
I20260810 19:47:58.373214 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc4466b82bd49fcaad30e4d5325c7db" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:58.373449 10371 rpcz_store.cc:276] 0810 19:47:57.144654 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.144804 (+ 150us) service_pool.cc:224] Handling call
0810 19:47:58.373057 (+1228253us) ts_tablet_manager.cc:1151] Deleting tablet b5f30148b5c84f7cbdfabd0186611cc4
0810 19:47:58.373068 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.373181 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1222288}
I20260810 19:47:58.373633 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0150de0d60425b807be532ce0ba6c3" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:58.373812 10166 raft_consensus.cc:2468] T 6f0150de0d60425b807be532ce0ba6c3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
W20260810 19:47:58.374020 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet b5f30148b5c84f7cbdfabd0186611cc4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5f30148b5c84f7cbdfabd0186611cc4 already in progress: creating tablet
I20260810 19:47:58.368754 10370 tablet_bootstrap.cc:492] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:58.374599 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 505) took 1223 ms. Trace:
I20260810 19:47:58.375308 10371 rpcz_store.cc:276] 0810 19:47:57.151593 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.156287 (+ 4694us) service_pool.cc:224] Handling call
0810 19:47:58.374378 (+1218091us) ts_tablet_manager.cc:1151] Deleting tablet 3520274768ed41abb010bb109127affa
0810 19:47:58.374388 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.374562 (+ 174us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1217861}
W20260810 19:47:58.376089 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 3520274768ed41abb010bb109127affa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3520274768ed41abb010bb109127affa already in progress: creating tablet
I20260810 19:47:58.376633 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 506) took 1109 ms. Trace:
I20260810 19:47:58.376951 10370 tablet_bootstrap.cc:654] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:58.377171 10371 rpcz_store.cc:276] 0810 19:47:57.267043 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.315950 (+ 48907us) service_pool.cc:224] Handling call
0810 19:47:58.376475 (+1060525us) ts_tablet_manager.cc:1151] Deleting tablet f5fa6060b9ef48cea6830cd9d19424ea
0810 19:47:58.376486 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.376596 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1060215}
W20260810 19:47:58.378033 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet f5fa6060b9ef48cea6830cd9d19424ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5fa6060b9ef48cea6830cd9d19424ea already in progress: creating tablet
I20260810 19:47:58.378666 10371 tablet_replica.cc:333] T 06af03c8a87141febef768bd56c72c39 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:58.379104 10375 ts_tablet_manager.cc:1929] T 25e15a8d1e7d41e68eef25d30d668e61 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:58.379206 10371 raft_consensus.cc:2243] T 06af03c8a87141febef768bd56c72c39 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:58.379266 10367 tablet_bootstrap.cc:492] T c8602b7360b747a3af756b139635d95c P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:58.379396 10375 log.cc:1199] T 25e15a8d1e7d41e68eef25d30d668e61 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/25e15a8d1e7d41e68eef25d30d668e61
I20260810 19:47:58.379431 10371 raft_consensus.cc:2272] T 06af03c8a87141febef768bd56c72c39 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:58.379498 10367 ts_tablet_manager.cc:1403] T c8602b7360b747a3af756b139635d95c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.004s
I20260810 19:47:58.380002 10375 ts_tablet_manager.cc:1950] T 25e15a8d1e7d41e68eef25d30d668e61 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:58.380062 10371 ts_tablet_manager.cc:1916] T 06af03c8a87141febef768bd56c72c39 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:58.380592 10367 raft_consensus.cc:359] T c8602b7360b747a3af756b139635d95c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:58.380872 10367 raft_consensus.cc:385] T c8602b7360b747a3af756b139635d95c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:58.381012 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 365) took 3576 ms. Trace:
I20260810 19:47:58.381052 10367 raft_consensus.cc:740] T c8602b7360b747a3af756b139635d95c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:58.381207 10375 rpcz_store.cc:276] 0810 19:47:54.804171 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:54.804234 (+ 63us) service_pool.cc:224] Handling call
0810 19:47:58.327999 (+3523765us) ts_tablet_manager.cc:1151] Deleting tablet 25e15a8d1e7d41e68eef25d30d668e61
0810 19:47:58.328008 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.350976 (+ 22968us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.377933 (+ 26957us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.380971 (+ 3038us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3520797}
I20260810 19:47:58.381372 10367 consensus_queue.cc:260] T c8602b7360b747a3af756b139635d95c P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:58.381803 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 25e15a8d1e7d41e68eef25d30d668e61 (table default.Table_6a56935e5e6145379899af090dfe23d4 [id=8c8a7865a0374b29a853783941137afb]) successfully deleted
I20260810 19:47:58.382087 10367 ts_tablet_manager.cc:1434] T c8602b7360b747a3af756b139635d95c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:47:58.382442 10367 tablet_bootstrap.cc:492] T e247ae3828e84092b836f3dd07b44bc6 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:58.382576 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 366) took 3556 ms. Trace:
I20260810 19:47:58.382817 10375 rpcz_store.cc:276] 0810 19:47:54.825657 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:54.825721 (+ 64us) service_pool.cc:224] Handling call
0810 19:47:58.382409 (+3556688us) ts_tablet_manager.cc:1151] Deleting tablet 8fce298689e9415a8860b8734d73b10a
0810 19:47:58.382420 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.382539 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3549738}
I20260810 19:47:58.384490 10367 tablet_bootstrap.cc:654] T e247ae3828e84092b836f3dd07b44bc6 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:58.384662 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 8fce298689e9415a8860b8734d73b10a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fce298689e9415a8860b8734d73b10a already in progress: creating tablet
I20260810 19:47:58.385072 10375 tablet_replica.cc:333] T 34fdc03b114b405da9e3a17ef1ad87c4 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:58.385340 10375 raft_consensus.cc:2243] T 34fdc03b114b405da9e3a17ef1ad87c4 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:58.390496 10375 raft_consensus.cc:2272] T 34fdc03b114b405da9e3a17ef1ad87c4 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:58.391333 10375 ts_tablet_manager.cc:1916] T 34fdc03b114b405da9e3a17ef1ad87c4 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:58.397552 10371 ts_tablet_manager.cc:1929] T 06af03c8a87141febef768bd56c72c39 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:58.397730 10371 log.cc:1199] T 06af03c8a87141febef768bd56c72c39 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/06af03c8a87141febef768bd56c72c39
I20260810 19:47:58.398177 10371 ts_tablet_manager.cc:1950] T 06af03c8a87141febef768bd56c72c39 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:58.399120 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 06af03c8a87141febef768bd56c72c39 (table default.Table_3517015cddb644a28150bb4f6f7c3187 [id=aa329023fb1a498cb6dc964edbaccb77]) successfully deleted
I20260810 19:47:58.401677 10371 tablet_replica.cc:333] T d99b34f901484fad87cff4bb9ab56fc8 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:58.402241 10371 raft_consensus.cc:2243] T d99b34f901484fad87cff4bb9ab56fc8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:58.402841 10371 raft_consensus.cc:2272] T d99b34f901484fad87cff4bb9ab56fc8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:58.403764 10371 ts_tablet_manager.cc:1916] T d99b34f901484fad87cff4bb9ab56fc8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:58.405828 10375 ts_tablet_manager.cc:1929] T 34fdc03b114b405da9e3a17ef1ad87c4 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:58.406664 10370 tablet_bootstrap.cc:492] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:58.406977 10370 ts_tablet_manager.cc:1403] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.038s user 0.006s sys 0.001s
I20260810 19:47:58.407847 10370 raft_consensus.cc:359] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.408171 10370 raft_consensus.cc:385] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:58.408288 10370 raft_consensus.cc:740] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:58.408658 10370 consensus_queue.cc:260] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.412451 10370 ts_tablet_manager.cc:1434] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260810 19:47:58.413827 10370 tablet_bootstrap.cc:492] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:58.415693 10370 tablet_bootstrap.cc:654] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:58.416770 10375 log.cc:1199] T 34fdc03b114b405da9e3a17ef1ad87c4 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/34fdc03b114b405da9e3a17ef1ad87c4
I20260810 19:47:58.417310 10375 ts_tablet_manager.cc:1950] T 34fdc03b114b405da9e3a17ef1ad87c4 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:58.419346 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 367) took 3590 ms. Trace:
I20260810 19:47:58.420439 10367 tablet_bootstrap.cc:492] T e247ae3828e84092b836f3dd07b44bc6 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:58.420818 10367 ts_tablet_manager.cc:1403] T e247ae3828e84092b836f3dd07b44bc6 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.003s
I20260810 19:47:58.421778 10367 raft_consensus.cc:359] T e247ae3828e84092b836f3dd07b44bc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:58.422101 10367 raft_consensus.cc:385] T e247ae3828e84092b836f3dd07b44bc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:58.422222 10367 raft_consensus.cc:740] T e247ae3828e84092b836f3dd07b44bc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:58.422602 10367 consensus_queue.cc:260] T e247ae3828e84092b836f3dd07b44bc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:58.423379 10367 ts_tablet_manager.cc:1434] T e247ae3828e84092b836f3dd07b44bc6 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:47:58.423274 10375 rpcz_store.cc:276] 0810 19:47:54.828342 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:54.828406 (+ 64us) service_pool.cc:224] Handling call
0810 19:47:58.384993 (+3556587us) ts_tablet_manager.cc:1151] Deleting tablet 34fdc03b114b405da9e3a17ef1ad87c4
0810 19:47:58.385005 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.396952 (+ 11947us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.405745 (+ 8793us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.419240 (+ 13495us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3552241}
I20260810 19:47:58.423843 10367 tablet_bootstrap.cc:492] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:58.424057 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 34fdc03b114b405da9e3a17ef1ad87c4 (table default.Table_943801654ea043f1b8740ea0215abc35 [id=5cf32f9df60d4b04a704522da9f7973d]) successfully deleted
I20260810 19:47:58.424736 11440 raft_consensus.cc:493] T 7d3395886420455d9bdaf816c19ebae2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:58.424926 11440 raft_consensus.cc:515] T 7d3395886420455d9bdaf816c19ebae2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.425625 11440 leader_election.cc:290] T 7d3395886420455d9bdaf816c19ebae2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:58.425783 10367 tablet_bootstrap.cc:654] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:58.426419 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 368) took 3584 ms. Trace:
I20260810 19:47:58.426574 10375 rpcz_store.cc:276] 0810 19:47:54.839747 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:54.839810 (+ 63us) service_pool.cc:224] Handling call
0810 19:47:58.424424 (+3584614us) ts_tablet_manager.cc:1151] Deleting tablet 827dce05c192467589e2692fabd2a84e
0810 19:47:58.424437 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.424563 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3551528}
W20260810 19:47:58.427249 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 827dce05c192467589e2692fabd2a84e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 827dce05c192467589e2692fabd2a84e already in progress: creating tablet
I20260810 19:47:58.427711 10375 tablet_replica.cc:333] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
W20260810 19:47:58.428086 10068 leader_election.cc:343] T 7d3395886420455d9bdaf816c19ebae2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 7d3395886420455d9bdaf816c19ebae2
I20260810 19:47:58.428324 10375 raft_consensus.cc:2243] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:58.428889 10375 raft_consensus.cc:2272] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:58.429943 10375 ts_tablet_manager.cc:1916] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:58.440888 10371 ts_tablet_manager.cc:1929] T d99b34f901484fad87cff4bb9ab56fc8 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:58.441054 10371 log.cc:1199] T d99b34f901484fad87cff4bb9ab56fc8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/d99b34f901484fad87cff4bb9ab56fc8
I20260810 19:47:58.441606 10371 ts_tablet_manager.cc:1950] T d99b34f901484fad87cff4bb9ab56fc8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:58.442183 10370 tablet_bootstrap.cc:492] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:58.442469 10370 ts_tablet_manager.cc:1403] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.002s
I20260810 19:47:58.442921 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet d99b34f901484fad87cff4bb9ab56fc8 (table default.Table_7b492dac7ea64246abf9488fd4dbc8b1 [id=8fac27396c0e45458c9f668d6349fc03]) successfully deleted
I20260810 19:47:58.443473 10370 raft_consensus.cc:359] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.443994 10370 raft_consensus.cc:385] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:58.444130 10370 raft_consensus.cc:740] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:58.444471 10370 consensus_queue.cc:260] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.444787 10371 tablet_replica.cc:333] T dd632a01fe424a3a956d445ce01e31d2 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:58.445037 10371 raft_consensus.cc:2243] T dd632a01fe424a3a956d445ce01e31d2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:58.445205 10371 raft_consensus.cc:2272] T dd632a01fe424a3a956d445ce01e31d2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:58.445835 10371 ts_tablet_manager.cc:1916] T dd632a01fe424a3a956d445ce01e31d2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:58.446622 10370 ts_tablet_manager.cc:1434] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 19:47:58.448110 10370 tablet_bootstrap.cc:492] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:58.449965 10370 tablet_bootstrap.cc:654] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:58.455905 10375 ts_tablet_manager.cc:1929] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:58.457937 10375 log.cc:1199] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/7b995f3c3bca4501a6c62cf9025051b2
I20260810 19:47:58.458758 10375 ts_tablet_manager.cc:1950] T 7b995f3c3bca4501a6c62cf9025051b2 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:58.460095 10371 ts_tablet_manager.cc:1929] T dd632a01fe424a3a956d445ce01e31d2 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:58.460266 10371 log.cc:1199] T dd632a01fe424a3a956d445ce01e31d2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/dd632a01fe424a3a956d445ce01e31d2
I20260810 19:47:58.462407 11440 raft_consensus.cc:493] T 81720b897a674b5380c6469d1600a979 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:58.462582 11440 raft_consensus.cc:515] T 81720b897a674b5380c6469d1600a979 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.463331 11440 leader_election.cc:290] T 81720b897a674b5380c6469d1600a979 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:58.464064 10371 ts_tablet_manager.cc:1950] T dd632a01fe424a3a956d445ce01e31d2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:58.464473 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81720b897a674b5380c6469d1600a979" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:58.465837 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 369) took 3303 ms. Trace:
I20260810 19:47:58.466344 10371 tablet_replica.cc:333] T c7235af514fa47d899d7e38ee5662f6c P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:58.466568 10371 raft_consensus.cc:2243] T c7235af514fa47d899d7e38ee5662f6c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:58.466554 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet dd632a01fe424a3a956d445ce01e31d2 (table default.Table_8398701ecb954c5c833b81f075d2c23a [id=2358cd5d19d24c88803e7861bcfec22c]) successfully deleted
I20260810 19:47:58.466759 10371 raft_consensus.cc:2272] T c7235af514fa47d899d7e38ee5662f6c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:58.467293 10371 ts_tablet_manager.cc:1916] T c7235af514fa47d899d7e38ee5662f6c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:58.468523 10370 tablet_bootstrap.cc:492] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:58.469105 10370 ts_tablet_manager.cc:1403] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.000s
I20260810 19:47:58.369378 11543 consensus_queue.cc:1048] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:58.469990 10370 raft_consensus.cc:359] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.470196 10370 raft_consensus.cc:385] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:58.470265 10370 raft_consensus.cc:740] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:58.470594 10370 consensus_queue.cc:260] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.472508 10370 ts_tablet_manager.cc:1434] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 19:47:58.473783 10370 tablet_bootstrap.cc:492] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:58.475713 10370 tablet_bootstrap.cc:654] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:58.476686 10375 rpcz_store.cc:276] 0810 19:47:55.162868 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.163252 (+ 384us) service_pool.cc:224] Handling call
0810 19:47:58.427615 (+3264363us) ts_tablet_manager.cc:1151] Deleting tablet 7b995f3c3bca4501a6c62cf9025051b2
0810 19:47:58.427628 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.434129 (+ 6501us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.455798 (+ 21669us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.465793 (+ 9995us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3264088}
I20260810 19:47:58.477301 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 7b995f3c3bca4501a6c62cf9025051b2 (table default.Table_4b39478b329141c790e4b1160cd6ffc2 [id=b05460b1d468433f9a6501203eb5f4ec]) successfully deleted
I20260810 19:47:58.478094 10371 ts_tablet_manager.cc:1929] T c7235af514fa47d899d7e38ee5662f6c P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:58.478230 10371 log.cc:1199] T c7235af514fa47d899d7e38ee5662f6c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/c7235af514fa47d899d7e38ee5662f6c
I20260810 19:47:58.478659 10371 ts_tablet_manager.cc:1950] T c7235af514fa47d899d7e38ee5662f6c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:58.477902 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 371) took 3192 ms. Trace:
I20260810 19:47:58.480201 10375 rpcz_store.cc:276] 0810 19:47:55.285007 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.285081 (+ 74us) service_pool.cc:224] Handling call
0810 19:47:58.477676 (+3192595us) ts_tablet_manager.cc:1151] Deleting tablet 444b49a69c8245b6944a76d53041154c
0810 19:47:58.477689 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.477847 (+ 158us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3192326}
W20260810 19:47:58.480921 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 444b49a69c8245b6944a76d53041154c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 444b49a69c8245b6944a76d53041154c already in progress: creating tablet
I20260810 19:47:58.377928 10366 tablet_bootstrap.cc:654] T 6992e7ef8e794ddc879ae04f9f78b8bd P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:58.412412 9885 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 497) took 1169 ms. Trace:
I20260810 19:47:58.426429 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3395886420455d9bdaf816c19ebae2" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:58.481514 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 374) took 3099 ms. Trace:
I20260810 19:47:58.482601 10375 rpcz_store.cc:276] 0810 19:47:55.382182 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.389246 (+ 7064us) service_pool.cc:224] Handling call
0810 19:47:58.481331 (+3092085us) ts_tablet_manager.cc:1151] Deleting tablet 5654c48929564a96a55ed0444c9e1a04
0810 19:47:58.481344 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.481468 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3091773}
W20260810 19:47:58.483196 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 5654c48929564a96a55ed0444c9e1a04 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5654c48929564a96a55ed0444c9e1a04 already in progress: creating tablet
I20260810 19:47:58.483649 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 376) took 3059 ms. Trace:
I20260810 19:47:58.486747 9408 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d (table default.Table_5e6891ff4aa040be8b327aafa596bc7e [id=fd840f00bdc5477aaad0b7fa114870dd]). Expected version 1 got 0
I20260810 19:47:58.487006 10375 rpcz_store.cc:276] 0810 19:47:55.424482 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.424537 (+ 55us) service_pool.cc:224] Handling call
0810 19:47:58.483512 (+3058975us) ts_tablet_manager.cc:1151] Deleting tablet 59a767c91abf45e79cebab582525ad2e
0810 19:47:58.483522 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.483616 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3058733}
W20260810 19:47:58.487331 9408 catalog_manager.cc:5911] Failed to send AlterTable RPC for tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d (table default.Table_5e6891ff4aa040be8b327aafa596bc7e [id=fd840f00bdc5477aaad0b7fa114870dd], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d consensus state has no leader
W20260810 19:47:58.487742 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 59a767c91abf45e79cebab582525ad2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59a767c91abf45e79cebab582525ad2e already in progress: creating tablet
I20260810 19:47:58.488298 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 378) took 3037 ms. Trace:
I20260810 19:47:58.488462 10375 rpcz_store.cc:276] 0810 19:47:55.450888 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.450943 (+ 55us) service_pool.cc:224] Handling call
0810 19:47:58.488138 (+3037195us) ts_tablet_manager.cc:1151] Deleting tablet 823bcbb987374ab4b9b0fc3d9d79b571
0810 19:47:58.488150 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.488264 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3036918}
I20260810 19:47:58.489224 10375 tablet_replica.cc:333] T 46005eead530459eb2b636ae0a6767ad P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:58.489537 10375 raft_consensus.cc:2243] T 46005eead530459eb2b636ae0a6767ad P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:58.489795 10375 raft_consensus.cc:2272] T 46005eead530459eb2b636ae0a6767ad P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:58.490506 10375 ts_tablet_manager.cc:1916] T 46005eead530459eb2b636ae0a6767ad P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:47:58.488993 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 823bcbb987374ab4b9b0fc3d9d79b571 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 823bcbb987374ab4b9b0fc3d9d79b571 already in progress: creating tablet
I20260810 19:47:58.488786 9408 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 10617bdf2eed4dbd8d13ea1821443863 (table default.Table_4502b22ebf5b47e5a0c8e0c3027e3251 [id=f1973d72068847eaabc823653402d194]). Expected version 2 got 0
I20260810 19:47:58.494493 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 3582ed23ffdf4ff089952e29083e5425
I20260810 19:47:58.495544 9412 catalog_manager.cc:6807] ReplaceTablet: tablet 3582ed23ffdf4ff089952e29083e5425 deleted and replaced by tablet 8503d5162548463bae22402fdc4c502a
I20260810 19:47:58.495765 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet 3582ed23ffdf4ff089952e29083e5425 with delete_type TABLET_DATA_DELETED (replaced by tablet 8503d5162548463bae22402fdc4c502a) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:58.496245 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 3582ed23ffdf4ff089952e29083e5425 with delete_type TABLET_DATA_DELETED (replaced by tablet 8503d5162548463bae22402fdc4c502a) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:58.496356 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf4a37857a944a7493ee13a6356b72ed consensus state has no leader
I20260810 19:47:58.497990 10370 tablet_bootstrap.cc:492] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:58.498239 10370 ts_tablet_manager.cc:1403] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.000s
I20260810 19:47:58.499153 10370 raft_consensus.cc:359] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.499411 10370 raft_consensus.cc:385] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:58.499641 10370 raft_consensus.cc:740] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:58.499990 10370 consensus_queue.cc:260] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.501924 10370 ts_tablet_manager.cc:1434] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 19:47:58.504215 11440 raft_consensus.cc:493] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:58.504398 11440 raft_consensus.cc:515] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.505023 11440 leader_election.cc:290] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:47:58.506268 10068 leader_election.cc:343] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: ffc4466b82bd49fcaad30e4d5325c7db
I20260810 19:47:58.507201 10370 tablet_bootstrap.cc:492] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:58.508384 9944 raft_consensus.cc:2393] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eadde59fd6504d679e47f03a60c64bb0 in current term 1: Already voted for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in this term.
I20260810 19:47:58.509016 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc4466b82bd49fcaad30e4d5325c7db" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:58.509423 10067 leader_election.cc:304] T 7d3395886420455d9bdaf816c19ebae2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:58.509879 11440 raft_consensus.cc:3060] T 7d3395886420455d9bdaf816c19ebae2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:58.513073 11440 raft_consensus.cc:2749] T 7d3395886420455d9bdaf816c19ebae2 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:58.514586 10370 tablet_bootstrap.cc:654] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:58.516134 9905 rpcz_store.cc:276] 0810 19:47:57.242795 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.991435 (+748640us) service_pool.cc:224] Handling call
0810 19:47:57.996118 (+ 4683us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:58.003414 (+ 7296us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:58.249181 (+245767us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.364905 (+115724us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:58.365087 (+ 182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:58.517254 9890 tablet_service.cc:1511] Processing CreateTablet for tablet 0a3f0e184b7a472bb7ae2bea8db000ad (DEFAULT_TABLE table=default.Table_562588ac5f0a40bb9639dc6131e4f151 [id=9d71d073281846a181e5194bb8fff8a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.518862 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 985440898cc04a98877c15a5122a7dd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:58.521241 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 9e37ab519ffe4791ab276a9fc0d96ead (DEFAULT_TABLE table=default.Table_97b0b4e69a6a4a56bf37ba9561c5271e [id=93837e7d4dd346e9b6399dadea5e72a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.521399 11426 raft_consensus.cc:493] T 6af6dd8913f44e7f966ed2a128ae4fbf P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:58.521584 11426 raft_consensus.cc:515] T 6af6dd8913f44e7f966ed2a128ae4fbf P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:58.522040 9885 rpcz_store.cc:276] 0810 19:47:57.242889 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.004932 (+762043us) service_pool.cc:224] Handling call
0810 19:47:58.084225 (+ 79293us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:58.084265 (+ 40us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:58.312975 (+228710us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.412204 (+ 99229us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:58.412366 (+ 162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:58.522416 11426 leader_election.cc:290] T 6af6dd8913f44e7f966ed2a128ae4fbf P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:58.522873 9944 raft_consensus.cc:2468] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:47:58.518460 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 33f2ea0d46f44fca88e16ea83ad67bc2 (DEFAULT_TABLE table=default.Table_68efca25ddd74752b30341b528693d1f [id=9601a761027047a2bbd739f0a1f86cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.523576 10067 leader_election.cc:304] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:58.523658 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af6dd8913f44e7f966ed2a128ae4fbf" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:58.524185 11440 raft_consensus.cc:2804] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:58.524290 11440 raft_consensus.cc:493] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260810 19:47:58.524325 9611 leader_election.cc:343] T 6af6dd8913f44e7f966ed2a128ae4fbf P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:58.524379 11440 raft_consensus.cc:3060] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:58.528048 11440 raft_consensus.cc:515] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.528955 9408 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d (table default.Table_5e6891ff4aa040be8b327aafa596bc7e [id=fd840f00bdc5477aaad0b7fa114870dd]). Expected version 1 got 0
I20260810 19:47:58.529390 9408 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet bc753970b2464e38b03e377551276343 (table default.Table_87ca145e91d149a68ef630e3a29795b4 [id=fd9deda7275b423b9f9c85aa22dde728]). Expected version 2 got 0
I20260810 19:47:58.529750 11440 leader_election.cc:290] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:47:58.530105 10068 leader_election.cc:343] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: ffc4466b82bd49fcaad30e4d5325c7db
I20260810 19:47:58.530174 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet f8e4de89977b4caf91b2c0a49d147d17
I20260810 19:47:58.531040 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet f8e4de89977b4caf91b2c0a49d147d17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:58.531144 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ab458c1caf1645df820d9833b5e005ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:58.531778 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab458c1caf1645df820d9833b5e005ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:58.533600 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet f8e4de89977b4caf91b2c0a49d147d17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:58.535854 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1aa658c1c6e94a0d8a3b20673d137896" } new_table_name: "default.Table_2050cbafb9a44f30b46f397b825f7231" modify_external_catalogs: true
I20260810 19:47:58.538796 10375 ts_tablet_manager.cc:1929] T 46005eead530459eb2b636ae0a6767ad P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:58.539278 10375 log.cc:1199] T 46005eead530459eb2b636ae0a6767ad P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/46005eead530459eb2b636ae0a6767ad
I20260810 19:47:58.540134 10370 tablet_bootstrap.cc:492] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:58.540387 10370 ts_tablet_manager.cc:1403] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.000s
I20260810 19:47:58.541242 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet e247ae3828e84092b836f3dd07b44bc6 with delete_type TABLET_DATA_DELETED (replaced by tablet 839dcdb448d14a8f8e452145ccf41263) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:58.541361 10370 raft_consensus.cc:359] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.541615 10370 raft_consensus.cc:385] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:58.541693 10370 raft_consensus.cc:740] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:58.542104 10370 consensus_queue.cc:260] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.542264 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 6af6dd8913f44e7f966ed2a128ae4fbf with delete_type TABLET_DATA_DELETED (replaced by tablet 320e42f6de6c4452adb7bbb379a156e6) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:58.543112 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet e959898b2c4c4173aea107d3f090ca07 with delete_type TABLET_DATA_DELETED (replaced by tablet e68916e2568f4527a181342cdc728001) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:58.543859 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet c8602b7360b747a3af756b139635d95c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:58.544369 10370 ts_tablet_manager.cc:1434] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260810 19:47:58.545648 10370 tablet_bootstrap.cc:492] T 45194cae6ea44d9d8cf856d256fd534f P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:58.546996 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc4466b82bd49fcaad30e4d5325c7db" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:58.522545 9885 tablet_service.cc:1511] Processing CreateTablet for tablet 348fcf52fe1f4a3f9931487ebeba9311 (DEFAULT_TABLE table=default.Table_0b398355dcf74f128f892997a49fd5af [id=08114732be4641eba23deac686c7e853]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.551194 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2ab0dfc23b1c4fc883c423a527d7cbfd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:58.558507 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ab0dfc23b1c4fc883c423a527d7cbfd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:58.559283 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet c7235af514fa47d899d7e38ee5662f6c (table default.Table_5bdde0f42da34c6f99e8462d17affb30 [id=7c6a3df13ef44571a127a5ef2e73683a]) successfully deleted
I20260810 19:47:58.561684 10371 tablet_replica.cc:333] T 6992e7ef8e794ddc879ae04f9f78b8bd P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:58.564770 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 8a9df6ac5a474724b113c1b3cd2b85dd (DEFAULT_TABLE table=default.Table_ec077aa44c9b4a918aef07f417121c14 [id=233590c34b8441a78a176ab27fba43cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.565321 9897 tablet_service.cc:1511] Processing CreateTablet for tablet e18d0da099b749f1bc9d9d276277b68f (DEFAULT_TABLE table=default.Table_225d70cd8d7c4166ac7b297939047aed [id=56f2a1d4ac0049f39f2a33bf837477b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.564708 10371 raft_consensus.cc:2243] T 6992e7ef8e794ddc879ae04f9f78b8bd P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:58.568347 10371 raft_consensus.cc:2272] T 6992e7ef8e794ddc879ae04f9f78b8bd P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:58.570472 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet e18d0da099b749f1bc9d9d276277b68f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:58.571669 10375 ts_tablet_manager.cc:1950] T 46005eead530459eb2b636ae0a6767ad P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:58.576381 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 18be14d8081c42129deb33897ab6433b (DEFAULT_TABLE table=default.Table_090260a0afce4bb5aaf644216af35443 [id=3d782ec093e74749b741df087f141ea4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.585927 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 548a6996692549df8087393ccef7b4a2 (DEFAULT_TABLE table=default.Table_b58c92af875943db8e95a856d198aa99 [id=dc7531f9091e40939e35a34e6a14a666]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.588791 11440 raft_consensus.cc:493] T 3916a976efef43428942135e777edcec P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:58.589221 11440 raft_consensus.cc:515] T 3916a976efef43428942135e777edcec P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.587831 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81720b897a674b5380c6469d1600a979" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:58.590039 11440 leader_election.cc:290] T 3916a976efef43428942135e777edcec P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:58.590380 9892 tablet_service.cc:1511] Processing CreateTablet for tablet cbc3d8b7b1b8488597b707d3343818b5 (DEFAULT_TABLE table=default.Table_aa202a92fde548cabef2ed26a3f65999 [id=3a075a443a0546e7af6d54e2ed2b3a75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.587653 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 381) took 3094 ms. Trace:
I20260810 19:47:58.591985 10067 leader_election.cc:304] T 81720b897a674b5380c6469d1600a979 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:58.592532 11440 raft_consensus.cc:2749] T 81720b897a674b5380c6469d1600a979 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:58.591572 10375 rpcz_store.cc:276] 0810 19:47:55.492447 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.492511 (+ 64us) service_pool.cc:224] Handling call
0810 19:47:58.489149 (+2996638us) ts_tablet_manager.cc:1151] Deleting tablet 46005eead530459eb2b636ae0a6767ad
0810 19:47:58.489161 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.516010 (+ 26849us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.538690 (+ 22680us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.586935 (+ 48245us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2996396}
I20260810 19:47:58.594156 10370 tablet_bootstrap.cc:654] T 45194cae6ea44d9d8cf856d256fd534f P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:58.596733 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b6187dbe1ca42f79bf3eddd5475b929 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:58.597342 9944 raft_consensus.cc:3060] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:58.597251 9898 tablet_service.cc:1511] Processing CreateTablet for tablet f8cfda17c3434e73b8c37b8e6fd73bf7 (DEFAULT_TABLE table=default.Table_11cc4f48379a47908e779ed3c995376a [id=b6ceccc0fd2d42c3a63ce6a27df45452]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:58.597457 9831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 432028us
I20260810 19:47:58.597263 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3f0e184b7a472bb7ae2bea8db000ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.598042 10375 tablet_replica.cc:333] T e4a92eb8626f465caf563b72598a685f P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
W20260810 19:47:58.599311 10068 leader_election.cc:343] T 3916a976efef43428942135e777edcec P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 3916a976efef43428942135e777edcec
I20260810 19:47:58.595176 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 46005eead530459eb2b636ae0a6767ad (table default.Table_2a994cac12d24a589728d6edb766c2af [id=098d4c95bab142c2b56fecac4113a429]) successfully deleted
I20260810 19:47:58.600250 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3916a976efef43428942135e777edcec" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:58.601274 10371 ts_tablet_manager.cc:1916] T 6992e7ef8e794ddc879ae04f9f78b8bd P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:58.602056 10375 raft_consensus.cc:2243] T e4a92eb8626f465caf563b72598a685f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:58.560737 9412 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 10617bdf2eed4dbd8d13ea1821443863 (table default.Table_4502b22ebf5b47e5a0c8e0c3027e3251 [id=f1973d72068847eaabc823653402d194]). Expected version 2 got 0
I20260810 19:47:58.603914 10375 raft_consensus.cc:2272] T e4a92eb8626f465caf563b72598a685f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:58.604563 11440 raft_consensus.cc:493] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:58.604772 11440 raft_consensus.cc:515] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.605435 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet bafc42f0cdf94ebd823dfb678df8a83b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:58.605712 11440 leader_election.cc:290] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:58.606262 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 86203f7a635d406c95ed1d08cfc22400 (DEFAULT_TABLE table=default.Table_0bb7c2bf3cb64b988e69e769ce83ff41 [id=c5f77852ffd74cd2945869d890a66dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.607571 10367 tablet_bootstrap.cc:492] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:58.607848 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7737acd216204209ba0327e26e85cfe6" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:58.608219 9715 raft_consensus.cc:2468] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:47:58.608255 10367 ts_tablet_manager.cc:1403] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.184s user 0.016s sys 0.042s
I20260810 19:47:58.608816 10068 leader_election.cc:304] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:58.609287 11440 raft_consensus.cc:2804] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:58.609537 11440 raft_consensus.cc:493] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:58.609706 11440 raft_consensus.cc:3060] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:58.611001 10367 raft_consensus.cc:359] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:58.611971 10367 raft_consensus.cc:385] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:58.612720 10367 raft_consensus.cc:740] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
W20260810 19:47:58.613986 9830 leader_election.cc:343] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:58.614176 9830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.195:43797, user_credentials={real_user=slave}} blocked reactor thread for 46656.2us
I20260810 19:47:58.614463 9830 leader_election.cc:304] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:58.614513 11440 raft_consensus.cc:515] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.614601 10367 consensus_queue.cc:260] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:58.617362 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7737acd216204209ba0327e26e85cfe6" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:58.617589 9715 raft_consensus.cc:3060] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:58.620904 9715 raft_consensus.cc:2468] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:47:58.621765 10068 leader_election.cc:304] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:47:58.621793 9412 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 81720b897a674b5380c6469d1600a979 (table default.Table_e4aeb59e91c24097bac9517b3c62b75a [id=8d7f043045ff44cd886367b5860f8433]). Expected version 1 got 0
I20260810 19:47:58.622164 11518 raft_consensus.cc:2804] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:58.622303 11518 raft_consensus.cc:697] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:47:58.622643 11518 consensus_queue.cc:237] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.646637 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet 11272d47d96f443187d63c184049871f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:58.650808 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet 6992e7ef8e794ddc879ae04f9f78b8bd with delete_type TABLET_DATA_DELETED (replaced by tablet a2fe67e8bd014acaa202c022c193cdc6) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:58.651203 10377 ts_tablet_manager.cc:1929] T 5f560ed7ea0c4075bad1375d86738861 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:58.652668 11440 leader_election.cc:290] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:58.653394 11410 raft_consensus.cc:2804] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:58.656726 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 983adb7af7954ac0a2807cb75d531a5a (DEFAULT_TABLE table=default.Table_9747046448e44dc4ab648e6759baad73 [id=e460539cc73c4fa59757b6b683e59530]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.659338 10375 ts_tablet_manager.cc:1916] T e4a92eb8626f465caf563b72598a685f P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:58.662834 9908 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 504) took 1393 ms. Trace:
I20260810 19:47:58.667536 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet 7737acd216204209ba0327e26e85cfe6 with delete_type TABLET_DATA_DELETED (replaced by tablet 5654c48929564a96a55ed0444c9e1a04) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:58.668398 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9714a8a1eeaf41d2bb01d3fa3ff7181d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:58.670702 10377 log.cc:1199] T 5f560ed7ea0c4075bad1375d86738861 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/5f560ed7ea0c4075bad1375d86738861
I20260810 19:47:58.670589 9913 tablet_service.cc:1511] Processing CreateTablet for tablet a8963894d23348d3844ab5377762d249 (DEFAULT_TABLE table=default.Table_66575d35b8014f0bbbceffff435faf55 [id=51849f14a84a4ea885e0a4f848b23b8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.672495 9894 tablet_service.cc:1511] Processing CreateTablet for tablet ec7e3cfb4dcb4aa68f1f2263dbdf67de (DEFAULT_TABLE table=default.Table_a8c87cbca48447fb8212f3f19946380f [id=6ef926d6305249bea2cb79c809852b7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:58.674750 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 548a6996692549df8087393ccef7b4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.667961 9899 tablet_service.cc:1558] Processing DeleteTablet for tablet 3582ed23ffdf4ff089952e29083e5425 with delete_type TABLET_DATA_DELETED (replaced by tablet 8503d5162548463bae22402fdc4c502a) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:58.678398 9951 raft_consensus.cc:2393] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eadde59fd6504d679e47f03a60c64bb0 in current term 1: Already voted for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in this term.
I20260810 19:47:58.678754 9887 tablet_service.cc:1558] Processing DeleteTablet for tablet f8e4de89977b4caf91b2c0a49d147d17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:58.679201 10067 leader_election.cc:304] T 3916a976efef43428942135e777edcec P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:58.679955 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 348fcf52fe1f4a3f9931487ebeba9311 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:58.680578 9946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7737acd216204209ba0327e26e85cfe6" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:47:58.681960 10067 leader_election.cc:343] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:58.682736 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7737acd216204209ba0327e26e85cfe6" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
W20260810 19:47:58.683408 11572 log.cc:927] Time spent T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
W20260810 19:47:58.684942 10067 leader_election.cc:343] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:58.685446 11599 log.cc:927] Time spent T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
I20260810 19:47:58.686479 11410 raft_consensus.cc:493] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:58.686625 11410 raft_consensus.cc:3060] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:58.686555 11440 raft_consensus.cc:3060] T 3916a976efef43428942135e777edcec P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:58.689971 11410 raft_consensus.cc:515] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.694325 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet 3916a976efef43428942135e777edcec with delete_type TABLET_DATA_DELETED (replaced by tablet 988d87b2b00a459d9afc44ba0ae1961e) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:58.696611 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 55fb03a8dd3b40f5ba3de41fa7c01f5d
I20260810 19:47:58.698663 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 55fb03a8dd3b40f5ba3de41fa7c01f5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:58.698720 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet 55fb03a8dd3b40f5ba3de41fa7c01f5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:58.700750 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d3395886420455d9bdaf816c19ebae2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:58.704007 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f0150de0d60425b807be532ce0ba6c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:58.708463 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 0bddaf5b5fc1404e83b079ffa97e7321
I20260810 19:47:58.709354 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bddaf5b5fc1404e83b079ffa97e7321 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:58.709517 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 7de27c3442584746b76ea838d38f0b9b
I20260810 19:47:58.710251 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 7de27c3442584746b76ea838d38f0b9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:58.712210 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet 7de27c3442584746b76ea838d38f0b9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:58.712702 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bddaf5b5fc1404e83b079ffa97e7321 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:58.724280 11606 raft_consensus.cc:493] T e959898b2c4c4173aea107d3f090ca07 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:58.724697 11606 raft_consensus.cc:515] T e959898b2c4c4173aea107d3f090ca07 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.727891 10167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e959898b2c4c4173aea107d3f090ca07" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:58.728597 9611 leader_election.cc:343] T e959898b2c4c4173aea107d3f090ca07 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:58.729140 11606 leader_election.cc:290] T e959898b2c4c4173aea107d3f090ca07 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:58.735962 11529 tablet.cc:1724] T 10617bdf2eed4dbd8d13ea1821443863 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:47:58.737433 9908 rpcz_store.cc:276] 0810 19:47:57.269625 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.087276 (+817651us) service_pool.cc:224] Handling call
0810 19:47:58.116662 (+ 29386us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:58.118390 (+ 1728us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:58.303806 (+185416us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.662596 (+358790us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:58.662792 (+ 196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:58.737841 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet ffc4466b82bd49fcaad30e4d5325c7db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:58.738520 9941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45194cae6ea44d9d8cf856d256fd534f" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:47:58.738982 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6f4b5c6d5bd14c59b3cd3f8ee00a3301 consensus state has no leader
I20260810 19:47:58.743325 9944 raft_consensus.cc:2468] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:47:58.744050 10067 leader_election.cc:304] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:58.744758 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 55fb03a8dd3b40f5ba3de41fa7c01f5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:58.745230 11518 raft_consensus.cc:2804] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:58.745451 11518 raft_consensus.cc:697] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:47:58.745970 11518 consensus_queue.cc:237] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.745774 10371 ts_tablet_manager.cc:1929] T 6992e7ef8e794ddc879ae04f9f78b8bd P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:58.748643 10371 log.cc:1199] T 6992e7ef8e794ddc879ae04f9f78b8bd P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/6992e7ef8e794ddc879ae04f9f78b8bd
W20260810 19:47:58.751472 9611 leader_election.cc:343] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:58.751773 9611 leader_election.cc:304] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:58.754521 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e959898b2c4c4173aea107d3f090ca07" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:58.755393 11410 leader_election.cc:290] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:58.756090 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 7de27c3442584746b76ea838d38f0b9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:58.757712 10371 ts_tablet_manager.cc:1950] T 6992e7ef8e794ddc879ae04f9f78b8bd P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:58.759022 9413 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 81720b897a674b5380c6469d1600a979 (table default.Table_e4aeb59e91c24097bac9517b3c62b75a [id=8d7f043045ff44cd886367b5860f8433]). Expected version 1 got 0
I20260810 19:47:58.761060 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9a949158a5f2417ea8f015281b20659a" } modify_external_catalogs: true
I20260810 19:47:58.761286 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9a949158a5f2417ea8f015281b20659a" } modify_external_catalogs: true
I20260810 19:47:58.762358 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_acf87d58880b426aa890dbf88e46a540"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:58.762494 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_fda8b43621384fe1b1891232334742f7" } new_table_name: "default.Table_2b20dee66e634a07bc9f2e2de90e8529" modify_external_catalogs: true
W20260810 19:47:58.763011 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_acf87d58880b426aa890dbf88e46a540 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:58.764394 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1eab0f9ec4eb4314a4fb38f1b443d465" } new_table_name: "default.Table_83e700e09b2a43c3b2133def7eb871bc" modify_external_catalogs: true
I20260810 19:47:58.765687 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e51b38a7ab0c47ce830475f655cb0519"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:58.766227 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e51b38a7ab0c47ce830475f655cb0519 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:58.771034 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet db2b8038ee9747109b42510bba02faa9 consensus state has no leader
I20260810 19:47:58.778163 10366 tablet_bootstrap.cc:492] T 6992e7ef8e794ddc879ae04f9f78b8bd P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:58.778455 10366 ts_tablet_manager.cc:1403] T 6992e7ef8e794ddc879ae04f9f78b8bd P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.470s user 0.003s sys 0.004s
I20260810 19:47:58.778716 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7235af514fa47d899d7e38ee5662f6c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:58.779130 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86203f7a635d406c95ed1d08cfc22400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.780748 9885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 348fcf52fe1f4a3f9931487ebeba9311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.781008 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18d0da099b749f1bc9d9d276277b68f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.782513 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8963894d23348d3844ab5377762d249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.782872 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e37ab519ffe4791ab276a9fc0d96ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.783058 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec7e3cfb4dcb4aa68f1f2263dbdf67de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.783172 9911 tablet_service.cc:1558] Processing DeleteTablet for tablet 971e9abee86444a7a9e923b0962ae751 with delete_type TABLET_DATA_DELETED (replaced by tablet d0f9a22f81894a829fcb350001fc532b) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:58.783128 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06af03c8a87141febef768bd56c72c39" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:58.783407 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af6dd8913f44e7f966ed2a128ae4fbf" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:58.783805 9887 tablet_service.cc:1558] Processing DeleteTablet for tablet 11272d47d96f443187d63c184049871f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:58.783994 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc3d8b7b1b8488597b707d3343818b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.784214 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a9df6ac5a474724b113c1b3cd2b85dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.784987 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8cfda17c3434e73b8c37b8e6fd73bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.786782 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet ffc4466b82bd49fcaad30e4d5325c7db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:47:58.787807 9611 leader_election.cc:343] T 45194cae6ea44d9d8cf856d256fd534f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:58.788007 9611 leader_election.cc:304] T 45194cae6ea44d9d8cf856d256fd534f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:58.783030 10377 ts_tablet_manager.cc:1950] T 5f560ed7ea0c4075bad1375d86738861 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:58.789753 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 433) took 2681 ms. Trace:
I20260810 19:47:58.789898 10377 rpcz_store.cc:276] 0810 19:47:56.108164 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.592022 (+483858us) service_pool.cc:224] Handling call
0810 19:47:57.992128 (+1400106us) ts_tablet_manager.cc:1151] Deleting tablet 5f560ed7ea0c4075bad1375d86738861
0810 19:47:57.992138 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.298872 (+306734us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.511838 (+212966us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.789715 (+277877us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1375033}
I20260810 19:47:58.790383 10377 tablet_replica.cc:333] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:58.790602 10377 raft_consensus.cc:2243] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:58.790783 10377 raft_consensus.cc:2272] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:58.791044 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 6992e7ef8e794ddc879ae04f9f78b8bd (table default.Table_9374c1b5d0ce4ebc9ca6f086b49f9778 [id=3b14f80137654337b24c2bb4131e58d3]) successfully deleted
I20260810 19:47:58.791489 10377 ts_tablet_manager.cc:1916] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:58.793687 10371 tablet_replica.cc:333] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:58.793922 10371 raft_consensus.cc:2243] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:58.794086 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 5f560ed7ea0c4075bad1375d86738861 (table default.Table_0de524b66ecf4dea8ab5e6b87c4f6261 [id=4de43e2ae0424104aa75c5d872b72d3a]) successfully deleted
I20260810 19:47:58.794145 10371 raft_consensus.cc:2272] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:58.794754 10371 ts_tablet_manager.cc:1916] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:47:58.796025 9831 leader_election.cc:343] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 6f0150de0d60425b807be532ce0ba6c3
I20260810 19:47:58.806397 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0150de0d60425b807be532ce0ba6c3" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:47:58.806811 10165 raft_consensus.cc:3060] T 6f0150de0d60425b807be532ce0ba6c3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:58.812436 11644 raft_consensus.cc:2749] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:58.812978 11644 raft_consensus.cc:493] T f8e4de89977b4caf91b2c0a49d147d17 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:58.813095 9413 master_service.cc:960] ReplaceTablet: received request to replace tablet 2b2b20dc77954af7a203f357c746be29 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:58.814736 9418 master_service.cc:960] ReplaceTablet: received request to replace tablet 6ea318eddd8349a79d27ce5746f03798 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:58.815488 11644 raft_consensus.cc:515] T f8e4de89977b4caf91b2c0a49d147d17 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.816377 9901 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 505) took 1399 ms. Trace:
I20260810 19:47:58.816521 9901 rpcz_store.cc:276] 0810 19:47:57.269722 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.089442 (+819720us) service_pool.cc:224] Handling call
0810 19:47:58.131027 (+ 41585us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:58.131055 (+ 28us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:58.457364 (+326309us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.656691 (+199327us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:58.669029 (+ 12338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7552}
I20260810 19:47:58.817595 11644 leader_election.cc:290] T f8e4de89977b4caf91b2c0a49d147d17 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:58.822188 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bddaf5b5fc1404e83b079ffa97e7321 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:58.823714 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 983adb7af7954ac0a2807cb75d531a5a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:58.823909 9831 leader_election.cc:343] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: ffc4466b82bd49fcaad30e4d5325c7db
I20260810 19:47:58.827199 10366 raft_consensus.cc:359] T 6992e7ef8e794ddc879ae04f9f78b8bd P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.818065 11426 raft_consensus.cc:493] T bc753970b2464e38b03e377551276343 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:58.828107 11426 raft_consensus.cc:515] T bc753970b2464e38b03e377551276343 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:58.829401 11426 leader_election.cc:290] T bc753970b2464e38b03e377551276343 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:58.821549 11606 raft_consensus.cc:2749] T 45194cae6ea44d9d8cf856d256fd534f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:47:58.838884 9611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 51100us
I20260810 19:47:58.844451 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_85870c032faa47d5946b1523ec0ce3d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:58.845960 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85870c032faa47d5946b1523ec0ce3d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:58.848986 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d72c72f90964f34bbc2232118dc5172 consensus state has no leader
I20260810 19:47:58.849462 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4f9606f9dd734d9c9ef67a3e0eafbdac" } modify_external_catalogs: true
I20260810 19:47:58.849562 10367 ts_tablet_manager.cc:1434] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.241s user 0.025s sys 0.038s
I20260810 19:47:58.849669 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4f9606f9dd734d9c9ef67a3e0eafbdac" } modify_external_catalogs: true
I20260810 19:47:58.850869 10367 tablet_bootstrap.cc:492] T ee65b2c9980d4c77af8c68bf2f5c5f92 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:58.850975 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_cfeef51f25594045916e90c140464db0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:58.851538 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cfeef51f25594045916e90c140464db0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:58.846508 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_05bfdf726be7422081506c051724ef2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:58.854785 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_05bfdf726be7422081506c051724ef2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:58.860950 10367 tablet_bootstrap.cc:654] T ee65b2c9980d4c77af8c68bf2f5c5f92 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:58.848042 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2d2422f738fe43f5aac8adbdaac041cb" } new_table_name: "default.Table_eddf073f68c04d138bbf4c794437ac02" modify_external_catalogs: true
I20260810 19:47:58.874994 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_715dd716d75d4284a963bf2a74ab9294"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:58.875881 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_715dd716d75d4284a963bf2a74ab9294 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:58.876248 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9374c1b5d0ce4ebc9ca6f086b49f9778" } new_table_name: "default.Table_abc13875e0d6429897eb19f7117e00f5" modify_external_catalogs: true
W20260810 19:47:58.885252 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 674b44f34b2042d3aac0b399fada795e consensus state has no leader
I20260810 19:47:58.886688 9831 leader_election.cc:304] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:58.887997 10366 raft_consensus.cc:385] T 6992e7ef8e794ddc879ae04f9f78b8bd P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:58.891016 10367 tablet_bootstrap.cc:492] T ee65b2c9980d4c77af8c68bf2f5c5f92 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:58.891243 10367 ts_tablet_manager.cc:1403] T ee65b2c9980d4c77af8c68bf2f5c5f92 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.041s user 0.009s sys 0.001s
I20260810 19:47:58.891434 10371 ts_tablet_manager.cc:1929] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:58.891592 10371 log.cc:1199] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/7737acd216204209ba0327e26e85cfe6
I20260810 19:47:58.892047 10371 ts_tablet_manager.cc:1950] T 7737acd216204209ba0327e26e85cfe6 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:58.892302 10367 raft_consensus.cc:359] T ee65b2c9980d4c77af8c68bf2f5c5f92 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:58.892549 10367 raft_consensus.cc:385] T ee65b2c9980d4c77af8c68bf2f5c5f92 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:58.892637 10367 raft_consensus.cc:740] T ee65b2c9980d4c77af8c68bf2f5c5f92 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:58.893034 10367 consensus_queue.cc:260] T ee65b2c9980d4c77af8c68bf2f5c5f92 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:58.893644 10367 ts_tablet_manager.cc:1434] T ee65b2c9980d4c77af8c68bf2f5c5f92 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 19:47:58.894032 10367 tablet_bootstrap.cc:492] T 3f18c24b01384299a4f941d7fb840032 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:58.897254 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33f2ea0d46f44fca88e16ea83ad67bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:58.899551 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b15ce9ec2404408f8f8e74743a8cce0d" } modify_external_catalogs: true
I20260810 19:47:58.893030 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 527) took 1084 ms. Trace:
I20260810 19:47:58.900086 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b15ce9ec2404408f8f8e74743a8cce0d" } modify_external_catalogs: true
I20260810 19:47:58.900014 10371 rpcz_store.cc:276] 0810 19:47:57.808926 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.810439 (+ 1513us) service_pool.cc:224] Handling call
0810 19:47:58.793567 (+983128us) ts_tablet_manager.cc:1151] Deleting tablet 7737acd216204209ba0327e26e85cfe6
0810 19:47:58.793580 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.820302 (+ 26722us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.891307 (+ 71005us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.892932 (+ 1625us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":982939}
I20260810 19:47:58.900556 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 7737acd216204209ba0327e26e85cfe6 (table default.Table_f90f1a0c22fa4781812518f44c9d7b17 [id=d12cb82567fd409988672b04a2e05a5b]) successfully deleted
I20260810 19:47:58.902776 10367 tablet_bootstrap.cc:654] T 3f18c24b01384299a4f941d7fb840032 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:58.903206 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 538) took 1016 ms. Trace:
I20260810 19:47:58.903481 11631 tablet.cc:1724] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 19:47:58.904368 10366 raft_consensus.cc:740] T 6992e7ef8e794ddc879ae04f9f78b8bd P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:58.904579 10371 rpcz_store.cc:276] 0810 19:47:57.886503 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.886555 (+ 52us) service_pool.cc:224] Handling call
0810 19:47:58.902722 (+1016167us) ts_tablet_manager.cc:1151] Deleting tablet bafc42f0cdf94ebd823dfb678df8a83b
0810 19:47:58.902735 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.903156 (+ 421us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1015940}
I20260810 19:47:58.904712 10366 consensus_queue.cc:260] T 6992e7ef8e794ddc879ae04f9f78b8bd P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:58.905141 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet bafc42f0cdf94ebd823dfb678df8a83b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bafc42f0cdf94ebd823dfb678df8a83b already in progress: creating tablet
I20260810 19:47:58.905336 10366 ts_tablet_manager.cc:1434] T 6992e7ef8e794ddc879ae04f9f78b8bd P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.127s user 0.002s sys 0.001s
I20260810 19:47:58.905710 10366 tablet_bootstrap.cc:492] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:58.905834 10371 tablet_replica.cc:333] T 45194cae6ea44d9d8cf856d256fd534f P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:58.906064 10371 raft_consensus.cc:2243] T 45194cae6ea44d9d8cf856d256fd534f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:58.906252 10371 raft_consensus.cc:2272] T 45194cae6ea44d9d8cf856d256fd534f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:58.906440 11588 raft_consensus.cc:2749] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:58.906901 10371 ts_tablet_manager.cc:1916] T 45194cae6ea44d9d8cf856d256fd534f P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:58.915612 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_8c32f29153754352872be52763234ceb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:58.916324 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c32f29153754352872be52763234ceb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:58.917881 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b3ebb4935f244802a7b2b6e1a33cb904" } modify_external_catalogs: true
I20260810 19:47:58.918095 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b3ebb4935f244802a7b2b6e1a33cb904" } modify_external_catalogs: true
I20260810 19:47:58.918883 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_05b1dcc5bf9f412c87505d19c57d7025" } modify_external_catalogs: true
I20260810 19:47:58.919121 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_05b1dcc5bf9f412c87505d19c57d7025" } modify_external_catalogs: true
W20260810 19:47:58.920135 9831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 99010.6us
I20260810 19:47:58.911330 11638 tablet.cc:1724] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:47:58.922956 10367 tablet_bootstrap.cc:492] T 3f18c24b01384299a4f941d7fb840032 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:58.923332 10367 ts_tablet_manager.cc:1403] T 3f18c24b01384299a4f941d7fb840032 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.029s user 0.007s sys 0.000s
I20260810 19:47:58.924609 10367 raft_consensus.cc:359] T 3f18c24b01384299a4f941d7fb840032 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:58.924821 10367 raft_consensus.cc:385] T 3f18c24b01384299a4f941d7fb840032 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:58.924916 10367 raft_consensus.cc:740] T 3f18c24b01384299a4f941d7fb840032 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:58.925222 10367 consensus_queue.cc:260] T 3f18c24b01384299a4f941d7fb840032 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:58.926030 10367 ts_tablet_manager.cc:1434] T 3f18c24b01384299a4f941d7fb840032 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:47:58.926755 10367 tablet_bootstrap.cc:492] T 08e29e23d54f47968a06be98b313918d P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:58.931459 10367 tablet_bootstrap.cc:654] T 08e29e23d54f47968a06be98b313918d P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:58.932348 9831 leader_election.cc:343] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 6f0150de0d60425b807be532ce0ba6c3
I20260810 19:47:58.941094 10371 ts_tablet_manager.cc:1929] T 45194cae6ea44d9d8cf856d256fd534f P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:58.941294 10371 log.cc:1199] T 45194cae6ea44d9d8cf856d256fd534f P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/45194cae6ea44d9d8cf856d256fd534f
I20260810 19:47:58.941696 10371 ts_tablet_manager.cc:1950] T 45194cae6ea44d9d8cf856d256fd534f P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:58.944386 11529 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:38276 (request call id 509) took 1143 ms. Trace:
I20260810 19:47:58.944514 11529 rpcz_store.cc:276] 0810 19:47:57.800983 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.095490 (+294507us) service_pool.cc:224] Handling call
0810 19:47:58.944320 (+848830us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:47:58.286683 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 19:47:58.286877 (+ 194us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 19:47:58.286887 (+ 10us) alter_schema_op.cc:66] Acquired schema lock
0810 19:47:58.286894 (+ 7us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 19:47:58.286948 (+ 54us) alter_schema_op.cc:128] START. Timestamp: 1786391278286891
0810 19:47:58.286951 (+ 3us) op_driver.cc:348] REPLICATION: starting
0810 19:47:58.287245 (+ 294us) log.cc:844] Serialized 173 byte log entry
0810 19:47:58.683946 (+396701us) op_driver.cc:464] REPLICATION: finished
0810 19:47:58.684685 (+ 739us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 19:47:58.779446 (+ 94761us) log.cc:844] Serialized 5 byte log entry
0810 19:47:58.943915 (+164469us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.944211 (+ 296us) log.cc:844] Serialized 14 byte log entry
0810 19:47:58.944249 (+ 38us) alter_schema_op.cc:73] Released schema lock
0810 19:47:58.944253 (+ 4us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":658,"prepare.queue_time_us":190885,"prepare.run_cpu_time_us":9121,"prepare.run_wall_time_us":283017,"raft.queue_time_us":143,"raft.run_cpu_time_us":423,"raft.run_wall_time_us":423,"replication_time_us":396960,"thread_start_us":472104,"threads_started":2,"wal-append.queue_time_us":300755}]]}
I20260810 19:47:58.949223 10367 tablet_bootstrap.cc:492] T 08e29e23d54f47968a06be98b313918d P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:58.949455 10367 ts_tablet_manager.cc:1403] T 08e29e23d54f47968a06be98b313918d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.000s
I20260810 19:47:58.950474 10367 raft_consensus.cc:359] T 08e29e23d54f47968a06be98b313918d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.950754 10367 raft_consensus.cc:385] T 08e29e23d54f47968a06be98b313918d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:58.950829 10367 raft_consensus.cc:740] T 08e29e23d54f47968a06be98b313918d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:58.951449 10367 consensus_queue.cc:260] T 08e29e23d54f47968a06be98b313918d P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:58.951864 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 536) took 1076 ms. Trace:
I20260810 19:47:58.952468 10367 ts_tablet_manager.cc:1434] T 08e29e23d54f47968a06be98b313918d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 19:47:58.952872 10367 tablet_bootstrap.cc:492] T 0c0a1e360ac648eeb0c734215bc200f6 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:58.951977 10371 rpcz_store.cc:276] 0810 19:47:57.875540 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.891192 (+ 15652us) service_pool.cc:224] Handling call
0810 19:47:58.905751 (+1014559us) ts_tablet_manager.cc:1151] Deleting tablet 45194cae6ea44d9d8cf856d256fd534f
0810 19:47:58.905764 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.930645 (+ 24881us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.941004 (+ 10359us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:58.951786 (+ 10782us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1014276}
I20260810 19:47:58.958896 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 45194cae6ea44d9d8cf856d256fd534f (table default.Table_77e7389c3161415c96dd7dcbe6b2a829 [id=cf61b40b912d40368890dc6dfc5d1162]) successfully deleted
I20260810 19:47:58.959189 10367 tablet_bootstrap.cc:654] T 0c0a1e360ac648eeb0c734215bc200f6 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:58.959874 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 540) took 1062 ms. Trace:
I20260810 19:47:58.960481 10371 rpcz_store.cc:276] 0810 19:47:57.897696 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.897750 (+ 54us) service_pool.cc:224] Handling call
0810 19:47:58.959640 (+1061890us) ts_tablet_manager.cc:1151] Deleting tablet 3b6187dbe1ca42f79bf3eddd5475b929
0810 19:47:58.959655 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.959799 (+ 144us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1061599}
W20260810 19:47:58.961401 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 3b6187dbe1ca42f79bf3eddd5475b929 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b6187dbe1ca42f79bf3eddd5475b929 already in progress: creating tablet
I20260810 19:47:58.962144 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 539) took 1064 ms. Trace:
I20260810 19:47:58.965776 10371 rpcz_store.cc:276] 0810 19:47:57.897245 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.899031 (+ 1786us) service_pool.cc:224] Handling call
0810 19:47:58.961811 (+1062780us) ts_tablet_manager.cc:1151] Deleting tablet e18d0da099b749f1bc9d9d276277b68f
0810 19:47:58.961824 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.961942 (+ 118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1062514}
W20260810 19:47:58.966907 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet e18d0da099b749f1bc9d9d276277b68f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e18d0da099b749f1bc9d9d276277b68f already in progress: creating tablet
I20260810 19:47:58.967633 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 537) took 1081 ms. Trace:
I20260810 19:47:58.968236 10371 rpcz_store.cc:276] 0810 19:47:57.886359 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.901161 (+ 14802us) service_pool.cc:224] Handling call
0810 19:47:58.967383 (+1066222us) ts_tablet_manager.cc:1151] Deleting tablet 985440898cc04a98877c15a5122a7dd3
0810 19:47:58.967397 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.967567 (+ 170us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1066009}
W20260810 19:47:58.969116 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 985440898cc04a98877c15a5122a7dd3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 985440898cc04a98877c15a5122a7dd3 already in progress: creating tablet
W20260810 19:47:58.970151 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 348fcf52fe1f4a3f9931487ebeba9311 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 348fcf52fe1f4a3f9931487ebeba9311 already in progress: creating tablet
W20260810 19:47:58.971292 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 971e9abee86444a7a9e923b0962ae751 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 971e9abee86444a7a9e923b0962ae751 already in progress: creating tablet
W20260810 19:47:58.972949 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 3582ed23ffdf4ff089952e29083e5425 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3582ed23ffdf4ff089952e29083e5425 already in progress: creating tablet
W20260810 19:47:58.973552 9611 leader_election.cc:343] T e959898b2c4c4173aea107d3f090ca07 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:58.973695 10371 tablet_replica.cc:333] T f8e4de89977b4caf91b2c0a49d147d17 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:58.973737 9611 leader_election.cc:304] T e959898b2c4c4173aea107d3f090ca07 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:58.973922 10371 raft_consensus.cc:2243] T f8e4de89977b4caf91b2c0a49d147d17 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:58.974138 10371 raft_consensus.cc:2272] T f8e4de89977b4caf91b2c0a49d147d17 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:58.974960 11607 raft_consensus.cc:2749] T e959898b2c4c4173aea107d3f090ca07 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:47:58.975615 9611 leader_election.cc:343] T c7235af514fa47d899d7e38ee5662f6c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:58.975867 9611 leader_election.cc:304] T c7235af514fa47d899d7e38ee5662f6c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
W20260810 19:47:58.976101 9611 raft_consensus.cc:2686] T c7235af514fa47d899d7e38ee5662f6c P fcd31b1bbb0340cbacfce652b4ad8da4: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260810 19:47:58.977380 9611 leader_election.cc:343] T 06af03c8a87141febef768bd56c72c39 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:58.977543 9611 leader_election.cc:304] T 06af03c8a87141febef768bd56c72c39 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
W20260810 19:47:58.977734 9611 raft_consensus.cc:2686] T 06af03c8a87141febef768bd56c72c39 P fcd31b1bbb0340cbacfce652b4ad8da4: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260810 19:47:58.979256 9611 leader_election.cc:343] T 6af6dd8913f44e7f966ed2a128ae4fbf P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:58.979478 9611 leader_election.cc:304] T 6af6dd8913f44e7f966ed2a128ae4fbf P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:58.979808 11607 raft_consensus.cc:2749] T 6af6dd8913f44e7f966ed2a128ae4fbf P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:58.982934 10371 ts_tablet_manager.cc:1916] T f8e4de89977b4caf91b2c0a49d147d17 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:58.985664 11529 tablet.cc:1724] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:47:58.996656 10371 ts_tablet_manager.cc:1929] T f8e4de89977b4caf91b2c0a49d147d17 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:58.996841 10371 log.cc:1199] T f8e4de89977b4caf91b2c0a49d147d17 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/f8e4de89977b4caf91b2c0a49d147d17
I20260810 19:47:58.997288 10371 ts_tablet_manager.cc:1950] T f8e4de89977b4caf91b2c0a49d147d17 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:58.998071 10371 tablet_replica.cc:333] T e247ae3828e84092b836f3dd07b44bc6 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:58.999209 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet f8e4de89977b4caf91b2c0a49d147d17 (table default.Table_7b186c06f7bd4a98937d92630880d907 [id=aaa80fee4a8b4bed8ca573347cd60268]) successfully deleted
I20260810 19:47:59.011065 10371 raft_consensus.cc:2243] T e247ae3828e84092b836f3dd07b44bc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:59.011372 10371 raft_consensus.cc:2272] T e247ae3828e84092b836f3dd07b44bc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:59.013316 10371 ts_tablet_manager.cc:1916] T e247ae3828e84092b836f3dd07b44bc6 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:59.017397 11638 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:38276 (request call id 507) took 1270 ms. Trace:
I20260810 19:47:59.024413 11607 raft_consensus.cc:493] T c8602b7360b747a3af756b139635d95c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:59.024600 11607 raft_consensus.cc:515] T c8602b7360b747a3af756b139635d95c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:59.025570 11607 leader_election.cc:290] T c8602b7360b747a3af756b139635d95c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:59.026070 11631 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:38276 (request call id 498) took 1783 ms. Trace:
I20260810 19:47:59.029450 11656 tablet.cc:1724] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:47:59.032049 10367 tablet_bootstrap.cc:492] T 0c0a1e360ac648eeb0c734215bc200f6 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:59.032220 10367 ts_tablet_manager.cc:1403] T 0c0a1e360ac648eeb0c734215bc200f6 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.079s user 0.014s sys 0.002s
I20260810 19:47:59.033243 10367 raft_consensus.cc:359] T 0c0a1e360ac648eeb0c734215bc200f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.033470 10367 raft_consensus.cc:385] T 0c0a1e360ac648eeb0c734215bc200f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:59.033573 10367 raft_consensus.cc:740] T 0c0a1e360ac648eeb0c734215bc200f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:59.033838 10367 consensus_queue.cc:260] T 0c0a1e360ac648eeb0c734215bc200f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.034618 10367 ts_tablet_manager.cc:1434] T 0c0a1e360ac648eeb0c734215bc200f6 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260810 19:47:59.034986 10367 tablet_bootstrap.cc:492] T 28c9eecacc6540ac82ac7faabceec788 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:59.036981 10367 tablet_bootstrap.cc:654] T 28c9eecacc6540ac82ac7faabceec788 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:59.019593 11638 rpcz_store.cc:276] 0810 19:47:57.739605 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.089777 (+350172us) service_pool.cc:224] Handling call
0810 19:47:59.010232 (+920455us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:47:58.408513 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 19:47:58.408743 (+ 230us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 19:47:58.408753 (+ 10us) alter_schema_op.cc:66] Acquired schema lock
0810 19:47:58.408760 (+ 7us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 19:47:58.408829 (+ 69us) alter_schema_op.cc:128] START. Timestamp: 1786391278408751
0810 19:47:58.408832 (+ 3us) op_driver.cc:348] REPLICATION: starting
0810 19:47:58.517000 (+108168us) spinlock_profiling.cc:243] Waited 62.2 ms on lock 0x6160002ed5b8. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd472f38715 00007fd47301d4bb 00007fd472ff84b8 00007fd472ff7d65 00007fd4744139f5 00007fd474412519 00007fd47441a940 00007fd47441a74d 0000000000aaf86c 00007fd466f6784f
0810 19:47:58.523091 (+ 6091us) log.cc:844] Serialized 173 byte log entry
0810 19:47:58.685928 (+162837us) op_driver.cc:464] REPLICATION: finished
0810 19:47:58.825821 (+139893us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 19:47:58.926189 (+100368us) log.cc:844] Serialized 5 byte log entry
0810 19:47:58.998506 (+ 72317us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.009850 (+ 11344us) log.cc:844] Serialized 14 byte log entry
0810 19:47:59.010172 (+ 322us) alter_schema_op.cc:73] Released schema lock
0810 19:47:59.010179 (+ 7us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":139777,"prepare.queue_time_us":300644,"prepare.run_cpu_time_us":10471,"prepare.run_wall_time_us":169070,"raft.queue_time_us":170,"raft.run_cpu_time_us":11357,"raft.run_wall_time_us":142437,"replication_time_us":277065,"spinlock_wait_cycles":142993792,"thread_start_us":496246,"threads_started":3,"wal-append.queue_time_us":74607}]]}
I20260810 19:47:59.043723 10366 tablet_bootstrap.cc:654] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:59.042234 10371 ts_tablet_manager.cc:1929] T e247ae3828e84092b836f3dd07b44bc6 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:59.044885 10371 log.cc:1199] T e247ae3828e84092b836f3dd07b44bc6 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/e247ae3828e84092b836f3dd07b44bc6
I20260810 19:47:59.045305 10371 ts_tablet_manager.cc:1950] T e247ae3828e84092b836f3dd07b44bc6 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:59.045435 11607 raft_consensus.cc:493] T 08e29e23d54f47968a06be98b313918d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:59.045643 11607 raft_consensus.cc:515] T 08e29e23d54f47968a06be98b313918d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.046411 11607 leader_election.cc:290] T 08e29e23d54f47968a06be98b313918d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:59.046509 10371 tablet_replica.cc:333] T 6af6dd8913f44e7f966ed2a128ae4fbf P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:59.046599 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet e247ae3828e84092b836f3dd07b44bc6 (table default.Table_745ec8d1fd994242990bec7acd5bd9cd [id=435f41d3a7ba4f03a738cdb2272f759e]) successfully deleted
I20260810 19:47:59.046722 10371 raft_consensus.cc:2243] T 6af6dd8913f44e7f966ed2a128ae4fbf P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:59.046916 10371 raft_consensus.cc:2272] T 6af6dd8913f44e7f966ed2a128ae4fbf P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:59.047488 10371 ts_tablet_manager.cc:1916] T 6af6dd8913f44e7f966ed2a128ae4fbf P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:59.026290 11631 rpcz_store.cc:276] 0810 19:47:57.242979 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.007308 (+764329us) service_pool.cc:224] Handling call
0810 19:47:59.026027 (+1018719us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:47:58.273137 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 19:47:58.273310 (+ 173us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 19:47:58.273319 (+ 9us) alter_schema_op.cc:66] Acquired schema lock
0810 19:47:58.273327 (+ 8us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 19:47:58.273385 (+ 58us) alter_schema_op.cc:128] START. Timestamp: 1786391278273330
0810 19:47:58.273388 (+ 3us) op_driver.cc:348] REPLICATION: starting
0810 19:47:58.273652 (+ 264us) log.cc:844] Serialized 173 byte log entry
0810 19:47:58.757206 (+483554us) op_driver.cc:464] REPLICATION: finished
0810 19:47:58.887558 (+130352us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 19:47:58.904014 (+ 16456us) log.cc:844] Serialized 5 byte log entry
0810 19:47:59.025144 (+121130us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.025714 (+ 570us) log.cc:844] Serialized 14 byte log entry
0810 19:47:59.025974 (+ 260us) alter_schema_op.cc:73] Released schema lock
0810 19:47:59.025979 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":130242,"prepare.queue_time_us":221595,"prepare.run_cpu_time_us":10622,"prepare.run_wall_time_us":325644,"raft.queue_time_us":627,"raft.run_cpu_time_us":935,"raft.run_wall_time_us":84752,"replication_time_us":483782,"spinlock_wait_cycles":1280,"thread_start_us":733369,"threads_started":3,"wal-append.queue_time_us":327694}]]}
I20260810 19:47:59.055303 10367 tablet_bootstrap.cc:492] T 28c9eecacc6540ac82ac7faabceec788 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:59.055508 10367 ts_tablet_manager.cc:1403] T 28c9eecacc6540ac82ac7faabceec788 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.000s
I20260810 19:47:59.056366 10367 raft_consensus.cc:359] T 28c9eecacc6540ac82ac7faabceec788 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:59.056594 10367 raft_consensus.cc:385] T 28c9eecacc6540ac82ac7faabceec788 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:59.056674 10367 raft_consensus.cc:740] T 28c9eecacc6540ac82ac7faabceec788 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:59.056954 10367 consensus_queue.cc:260] T 28c9eecacc6540ac82ac7faabceec788 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:59.057719 10367 ts_tablet_manager.cc:1434] T 28c9eecacc6540ac82ac7faabceec788 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:47:59.058147 10367 tablet_bootstrap.cc:492] T 6355c14e38b3446493f7bd5e2a717341 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:59.060580 10367 tablet_bootstrap.cc:654] T 6355c14e38b3446493f7bd5e2a717341 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:59.067430 11656 tablet.cc:1724] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 19:47:59.069753 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e4de89977b4caf91b2c0a49d147d17" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:59.072211 11656 tablet.cc:1724] T 10617bdf2eed4dbd8d13ea1821443863 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:47:59.080258 10367 tablet_bootstrap.cc:492] T 6355c14e38b3446493f7bd5e2a717341 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:59.080473 10367 ts_tablet_manager.cc:1403] T 6355c14e38b3446493f7bd5e2a717341 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.000s
I20260810 19:47:59.081569 10367 raft_consensus.cc:359] T 6355c14e38b3446493f7bd5e2a717341 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:59.081761 10367 raft_consensus.cc:385] T 6355c14e38b3446493f7bd5e2a717341 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:59.081848 10367 raft_consensus.cc:740] T 6355c14e38b3446493f7bd5e2a717341 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:59.081877 11490 raft_consensus.cc:493] T 4f2d7c165d2c465d9080b927d54807f7 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:59.082058 11490 raft_consensus.cc:515] T 4f2d7c165d2c465d9080b927d54807f7 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.082070 10367 consensus_queue.cc:260] T 6355c14e38b3446493f7bd5e2a717341 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
W20260810 19:47:59.082305 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a2fe67e8bd014acaa202c022c193cdc6 consensus state has no leader
I20260810 19:47:59.082746 10367 ts_tablet_manager.cc:1434] T 6355c14e38b3446493f7bd5e2a717341 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:47:59.083050 10367 tablet_bootstrap.cc:492] T 0d79ef93c5bf4ac9895e594198edb251 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:59.083022 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_454f93562c2f41c7b990019efd3329b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:59.083631 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_454f93562c2f41c7b990019efd3329b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:59.084719 9412 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 81720b897a674b5380c6469d1600a979 (table default.Table_e4aeb59e91c24097bac9517b3c62b75a [id=8d7f043045ff44cd886367b5860f8433]). Expected version 1 got 0
I20260810 19:47:59.084813 10367 tablet_bootstrap.cc:654] T 0d79ef93c5bf4ac9895e594198edb251 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:59.085073 9412 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5 (table default.Table_b46992ec81974f6caad1ea769640dcf1 [id=d6d2d95e5e9f4e10a7d5a8153e66e4b6]). Expected version 2 got 0
I20260810 19:47:59.085331 9412 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 31c8699875b54be888b3128df1b673aa (table default.Table_c35c3a44fcc44bba8a8c334292245b49 [id=5abc1f7beec444a4a988fbfcb8b45623]). Expected version 1 got 0
I20260810 19:47:59.085886 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18be14d8081c42129deb33897ab6433b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.088264 10165 raft_consensus.cc:2468] T 6f0150de0d60425b807be532ce0ba6c3 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:47:59.088656 11440 raft_consensus.cc:2749] T 3916a976efef43428942135e777edcec P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:59.090873 9830 leader_election.cc:304] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:59.091781 11490 leader_election.cc:290] T 4f2d7c165d2c465d9080b927d54807f7 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:59.091954 11490 raft_consensus.cc:493] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:59.092599 10366 tablet_bootstrap.cc:492] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:59.092552 11490 raft_consensus.cc:515] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.093235 11490 leader_election.cc:290] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:59.093389 10366 ts_tablet_manager.cc:1403] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.187s user 0.005s sys 0.000s
I20260810 19:47:59.094197 11490 raft_consensus.cc:493] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:59.094367 11490 raft_consensus.cc:515] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.094878 10371 ts_tablet_manager.cc:1929] T 6af6dd8913f44e7f966ed2a128ae4fbf P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:59.094960 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8602b7360b747a3af756b139635d95c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:59.095029 10371 log.cc:1199] T 6af6dd8913f44e7f966ed2a128ae4fbf P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/6af6dd8913f44e7f966ed2a128ae4fbf
I20260810 19:47:59.095384 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e4de89977b4caf91b2c0a49d147d17" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:59.095525 10371 ts_tablet_manager.cc:1950] T 6af6dd8913f44e7f966ed2a128ae4fbf P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:59.096787 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc753970b2464e38b03e377551276343" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:59.098609 10371 tablet_replica.cc:333] T e959898b2c4c4173aea107d3f090ca07 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:59.098690 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9714a8a1eeaf41d2bb01d3fa3ff7181d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:59.098860 10371 raft_consensus.cc:2243] T e959898b2c4c4173aea107d3f090ca07 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:59.099049 10371 raft_consensus.cc:2272] T e959898b2c4c4173aea107d3f090ca07 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:59.099575 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e29e23d54f47968a06be98b313918d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:59.099728 10371 ts_tablet_manager.cc:1916] T e959898b2c4c4173aea107d3f090ca07 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:59.099654 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 6af6dd8913f44e7f966ed2a128ae4fbf (table default.Table_ae6b06e8ae0c4fd19fe26b1b08db672a [id=5354f5d091794b14806dd9bc872da0ae]) successfully deleted
I20260810 19:47:59.099946 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d7c165d2c465d9080b927d54807f7" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:59.100365 11607 raft_consensus.cc:493] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:59.100410 11410 raft_consensus.cc:2804] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:59.100546 11607 raft_consensus.cc:515] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:59.101259 9944 raft_consensus.cc:2393] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eadde59fd6504d679e47f03a60c64bb0 in current term 1: Already voted for candidate 6986ed920dcb4af29a5eeeda6f671691 in this term.
I20260810 19:47:59.101274 11607 leader_election.cc:290] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:59.097550 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99b34f901484fad87cff4bb9ab56fc8" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:59.102581 10367 tablet_bootstrap.cc:492] T 0d79ef93c5bf4ac9895e594198edb251 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:59.102775 10367 ts_tablet_manager.cc:1403] T 0d79ef93c5bf4ac9895e594198edb251 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.000s
I20260810 19:47:59.103912 10367 raft_consensus.cc:359] T 0d79ef93c5bf4ac9895e594198edb251 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:59.104118 10367 raft_consensus.cc:385] T 0d79ef93c5bf4ac9895e594198edb251 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:59.104190 10367 raft_consensus.cc:740] T 0d79ef93c5bf4ac9895e594198edb251 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:59.104456 10367 consensus_queue.cc:260] T 0d79ef93c5bf4ac9895e594198edb251 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:59.105175 10367 ts_tablet_manager.cc:1434] T 0d79ef93c5bf4ac9895e594198edb251 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:47:59.105566 10367 tablet_bootstrap.cc:492] T 3b6187dbe1ca42f79bf3eddd5475b929 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:59.107478 10367 tablet_bootstrap.cc:654] T 3b6187dbe1ca42f79bf3eddd5475b929 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:59.108002 9611 leader_election.cc:343] T f8e4de89977b4caf91b2c0a49d147d17 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:59.108285 9611 leader_election.cc:343] T c8602b7360b747a3af756b139635d95c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.110100 10377 ts_tablet_manager.cc:1929] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:59.111231 10377 log.cc:1199] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/3916a976efef43428942135e777edcec
I20260810 19:47:59.111425 11623 tablet.cc:1724] T 10617bdf2eed4dbd8d13ea1821443863 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:47:59.111704 10377 ts_tablet_manager.cc:1950] T 3916a976efef43428942135e777edcec P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:59.113235 11410 raft_consensus.cc:697] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
W20260810 19:47:59.113245 10067 leader_election.cc:343] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:59.113574 10067 leader_election.cc:343] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.113830 11490 leader_election.cc:290] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:59.114243 10375 ts_tablet_manager.cc:1929] T e4a92eb8626f465caf563b72598a685f P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:59.116762 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 435) took 3003 ms. Trace:
I20260810 19:47:59.116932 10377 rpcz_store.cc:276] 0810 19:47:56.108324 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.615489 (+507165us) service_pool.cc:224] Handling call
0810 19:47:58.790291 (+2174802us) ts_tablet_manager.cc:1151] Deleting tablet 3916a976efef43428942135e777edcec
0810 19:47:58.790303 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.908856 (+118553us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.110020 (+201164us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.112018 (+ 1998us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2150640}
I20260810 19:47:59.117755 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 3916a976efef43428942135e777edcec (table default.Table_3e50c2a587f045f090cdb0a281a1267f [id=f881fab647be45f786665629ab8baaee]) successfully deleted
I20260810 19:47:59.118307 10377 tablet_replica.cc:333] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:59.118641 10377 raft_consensus.cc:2243] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:59.119900 10377 raft_consensus.cc:2272] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:59.120674 10377 ts_tablet_manager.cc:1916] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:59.121402 10366 raft_consensus.cc:359] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.122911 10367 tablet_bootstrap.cc:492] T 3b6187dbe1ca42f79bf3eddd5475b929 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:59.123086 10367 ts_tablet_manager.cc:1403] T 3b6187dbe1ca42f79bf3eddd5475b929 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.003s
I20260810 19:47:59.123370 10371 ts_tablet_manager.cc:1929] T e959898b2c4c4173aea107d3f090ca07 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:59.123548 10371 log.cc:1199] T e959898b2c4c4173aea107d3f090ca07 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/e959898b2c4c4173aea107d3f090ca07
I20260810 19:47:59.124032 10371 ts_tablet_manager.cc:1950] T e959898b2c4c4173aea107d3f090ca07 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:59.124061 10367 raft_consensus.cc:359] T 3b6187dbe1ca42f79bf3eddd5475b929 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.124290 10367 raft_consensus.cc:385] T 3b6187dbe1ca42f79bf3eddd5475b929 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:59.124408 10367 raft_consensus.cc:740] T 3b6187dbe1ca42f79bf3eddd5475b929 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:59.124699 10367 consensus_queue.cc:260] T 3b6187dbe1ca42f79bf3eddd5475b929 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.125159 10371 tablet_replica.cc:333] T c8602b7360b747a3af756b139635d95c P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:59.125687 10367 ts_tablet_manager.cc:1434] T 3b6187dbe1ca42f79bf3eddd5475b929 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 19:47:59.126037 10367 tablet_bootstrap.cc:492] T 63b649cbc1d141d8bb438105b8e8537c P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:59.126662 10375 log.cc:1199] T e4a92eb8626f465caf563b72598a685f P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/e4a92eb8626f465caf563b72598a685f
I20260810 19:47:59.127120 10375 ts_tablet_manager.cc:1950] T e4a92eb8626f465caf563b72598a685f P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:59.127857 10367 tablet_bootstrap.cc:654] T 63b649cbc1d141d8bb438105b8e8537c P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:59.127836 11410 consensus_queue.cc:237] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.127983 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 380) took 3635 ms. Trace:
I20260810 19:47:59.128098 10375 rpcz_store.cc:276] 0810 19:47:55.492269 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.492790 (+ 521us) service_pool.cc:224] Handling call
0810 19:47:58.596226 (+3103436us) ts_tablet_manager.cc:1151] Deleting tablet e4a92eb8626f465caf563b72598a685f
0810 19:47:58.596481 (+ 255us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:58.835467 (+238986us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.086647 (+251180us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.127938 (+ 41291us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3103109}
I20260810 19:47:59.114687 11636 tablet.cc:1724] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 19:47:59.131367 10371 raft_consensus.cc:2243] T c8602b7360b747a3af756b139635d95c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:59.131610 10371 raft_consensus.cc:2272] T c8602b7360b747a3af756b139635d95c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:47:59.131583 9611 leader_election.cc:343] T bc753970b2464e38b03e377551276343 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:59.132035 9611 leader_election.cc:343] T 08e29e23d54f47968a06be98b313918d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.133137 10371 ts_tablet_manager.cc:1916] T c8602b7360b747a3af756b139635d95c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:59.133937 11656 tablet.cc:1724] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:47:59.134477 11518 raft_consensus.cc:493] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:59.134650 11518 raft_consensus.cc:515] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.136168 11518 leader_election.cc:290] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:59.137272 10366 raft_consensus.cc:385] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:59.137382 10366 raft_consensus.cc:740] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:59.138536 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet e4a92eb8626f465caf563b72598a685f (table default.Table_688c01e53a344393b3471974bad3b972 [id=7112ce97719c47919a3d24d1af7d07cd]) successfully deleted
I20260810 19:47:59.139365 10375 tablet_replica.cc:333] T 5d3598b5743244e39efd12703ec15aea P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:59.139685 10375 raft_consensus.cc:2243] T 5d3598b5743244e39efd12703ec15aea P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:59.140009 10375 raft_consensus.cc:2272] T 5d3598b5743244e39efd12703ec15aea P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:59.140780 10375 ts_tablet_manager.cc:1916] T 5d3598b5743244e39efd12703ec15aea P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:59.142576 10366 consensus_queue.cc:260] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.149973 10371 ts_tablet_manager.cc:1929] T c8602b7360b747a3af756b139635d95c P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:59.150457 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet e959898b2c4c4173aea107d3f090ca07 (table default.Table_e2e810e459f24d0b9d348d428782a761 [id=3babf53bc29e4d4f9be8b2c19be6e2bd]) successfully deleted
I20260810 19:47:59.156500 9415 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d (table default.Table_5e6891ff4aa040be8b327aafa596bc7e [id=fd840f00bdc5477aaad0b7fa114870dd]). Expected version 1 got 0
I20260810 19:47:59.156810 9415 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 31c8699875b54be888b3128df1b673aa (table default.Table_c35c3a44fcc44bba8a8c334292245b49 [id=5abc1f7beec444a4a988fbfcb8b45623]). Expected version 1 got 0
W20260810 19:47:59.157356 10370 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.551s user 0.012s sys 0.030s
W20260810 19:47:59.157797 10370 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.552s user 0.012s sys 0.030s
I20260810 19:47:59.159157 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c79485070ea445268631af7e706e5061" } new_table_name: "default.Table_d1e72b2bbecd434e9ff0c7eaf6201b42" modify_external_catalogs: true
I20260810 19:47:59.159401 10370 tablet_bootstrap.cc:492] T 45194cae6ea44d9d8cf856d256fd534f P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:59.159571 10370 ts_tablet_manager.cc:1403] T 45194cae6ea44d9d8cf856d256fd534f P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.614s user 0.017s sys 0.030s
I20260810 19:47:59.161525 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_5fd992f1afe5496eb8ca25a8409e3348"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:59.162086 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5fd992f1afe5496eb8ca25a8409e3348 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:47:59.165491 9400 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 7d93fd6556b146ca8933a6dc0a2357e8 (table default.Table_908acdc21674469e937e4539876e0267 [id=de4d62ebb8c440a1a71ed57ac4f3c530], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7d93fd6556b146ca8933a6dc0a2357e8 consensus state has no leader
W20260810 19:47:59.174125 9611 leader_election.cc:343] T f8e4de89977b4caf91b2c0a49d147d17 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.174304 9611 leader_election.cc:304] T f8e4de89977b4caf91b2c0a49d147d17 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
W20260810 19:47:59.174556 9611 raft_consensus.cc:2686] T f8e4de89977b4caf91b2c0a49d147d17 P fcd31b1bbb0340cbacfce652b4ad8da4: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 19:47:59.177088 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11272d47d96f443187d63c184049871f" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:59.177359 9948 raft_consensus.cc:2468] T 11272d47d96f443187d63c184049871f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
W20260810 19:47:59.178596 9400 consensus_peers.cc:597] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a -> Peer f52c40e347e24ab4b3129e7064f4a43e (127.8.235.253:37397): Couldn't send request to peer f52c40e347e24ab4b3129e7064f4a43e. Status: Network error: Client connection negotiation failed: client connection to 127.8.235.253:37397: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260810 19:47:59.181643 9885 tablet_service.cc:1511] Processing CreateTablet for tablet 60c45125545340059d49b5faa8025c73 (DEFAULT_TABLE table=default.Table_6bacbec2a69f41549e72fa5a46246b11 [id=f206ffac27d3465f8c8fce659d40f89c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.183925 11529 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:38276 (request call id 510) took 1266 ms. Trace:
I20260810 19:47:59.186641 11656 tablet.cc:1719] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P fcd31b1bbb0340cbacfce652b4ad8da4: Skipping requested alter to schema version 3, tablet already version 3
I20260810 19:47:59.165660 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 2186b5b292ef4a04b63c1d37f2afc078 (DEFAULT_TABLE table=default.Table_1422ee4f50d147659ee2338071831d14 [id=5b0de5b30619417db8f4d4a16e8d4718]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.186971 9885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60c45125545340059d49b5faa8025c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.187206 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2186b5b292ef4a04b63c1d37f2afc078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.167814 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 3ddc1bc292a243338235ea1396cc08f8 (DEFAULT_TABLE table=default.Table_667a9496a2f84ffdb4a98329b167c827 [id=e5a040b1b4694f25ad2bd9b1213a30e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.190929 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ddc1bc292a243338235ea1396cc08f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.192803 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b737b216646a4c5baecb88d59bcce4df" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:59.193414 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 3ddc1bc292a243338235ea1396cc08f8 (DEFAULT_TABLE table=default.Table_667a9496a2f84ffdb4a98329b167c827 [id=e5a040b1b4694f25ad2bd9b1213a30e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.193852 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ddc1bc292a243338235ea1396cc08f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.194367 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 39a28ed6886741c2b8fe8dce628911bc (DEFAULT_TABLE table=default.Table_6a0b31ab2f594e4885ce04f95c8b7854 [id=bc6524db0020417ca48d6b08d9b35dd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.168596 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 39a28ed6886741c2b8fe8dce628911bc (DEFAULT_TABLE table=default.Table_6a0b31ab2f594e4885ce04f95c8b7854 [id=bc6524db0020417ca48d6b08d9b35dd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.194842 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39a28ed6886741c2b8fe8dce628911bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.195267 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 2186b5b292ef4a04b63c1d37f2afc078 (DEFAULT_TABLE table=default.Table_1422ee4f50d147659ee2338071831d14 [id=5b0de5b30619417db8f4d4a16e8d4718]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.196275 10366 ts_tablet_manager.cc:1434] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.077s user 0.003s sys 0.000s
I20260810 19:47:59.197293 9913 tablet_service.cc:1511] Processing CreateTablet for tablet f9bcb6c71d384f758e1e44137612fe21 (DEFAULT_TABLE table=default.Table_a70b9fa6ee4b4696b9f30fcfd17a3505 [id=f34eb1782f654f9f9214ccd88b01abfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.198045 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39a28ed6886741c2b8fe8dce628911bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.172389 10144 tablet_service.cc:1558] Processing DeleteTablet for tablet d99b34f901484fad87cff4bb9ab56fc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:59.172403 11636 tablet.cc:1724] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:47:59.198655 11631 tablet.cc:1719] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691: Skipping requested alter to schema version 3, tablet already version 3
I20260810 19:47:59.199007 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 5d2103bbb48f4ff196b61406896df656 (DEFAULT_TABLE table=default.Table_89c56d57fc044981b88f6709942097d7 [id=bc68be3108f54aa6868f0614c0bbe1b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.172716 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc753970b2464e38b03e377551276343" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:59.173166 10168 raft_consensus.cc:3060] T 81720b897a674b5380c6469d1600a979 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:59.200491 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 48fa5f075d2749dc80ad5594746d7564 (DEFAULT_TABLE table=default.Table_1a90c42d93434c0ab29e50e010af4212 [id=0883d4468d994ee7a0babcb46aa4dfe0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.201100 11631 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:38276 (request call id 508) took 1412 ms. Trace:
I20260810 19:47:59.201202 11631 rpcz_store.cc:276] 0810 19:47:57.787128 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.094967 (+307839us) service_pool.cc:224] Handling call
0810 19:47:59.199892 (+1104925us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:47:58.602421 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 19:47:58.604275 (+ 1854us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 19:47:59.070558 (+466283us) alter_schema_op.cc:66] Acquired schema lock
0810 19:47:59.070569 (+ 11us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 19:47:59.070617 (+ 48us) alter_schema_op.cc:128] START. Timestamp: 1786391279070517
0810 19:47:59.070620 (+ 3us) op_driver.cc:348] REPLICATION: starting
0810 19:47:59.070842 (+ 222us) log.cc:844] Serialized 173 byte log entry
0810 19:47:59.184965 (+114123us) op_driver.cc:464] REPLICATION: finished
0810 19:47:59.185072 (+ 107us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 19:47:59.199578 (+ 14506us) log.cc:844] Serialized 94 byte log entry
0810 19:47:59.199847 (+ 269us) alter_schema_op.cc:73] Released schema lock
0810 19:47:59.199852 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":57,"prepare.queue_time_us":504952,"prepare.run_cpu_time_us":5886,"prepare.run_wall_time_us":469482,"replication_time_us":114307}]]}
I20260810 19:47:59.173239 10164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8602b7360b747a3af756b139635d95c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:59.173578 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e29e23d54f47968a06be98b313918d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:59.175442 11623 tablet.cc:1724] T 31c8699875b54be888b3128df1b673aa P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:47:59.203670 9709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9714a8a1eeaf41d2bb01d3fa3ff7181d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:47:59.203948 9709 raft_consensus.cc:2468] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:47:59.178045 10067 leader_election.cc:304] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:59.204475 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 2186b5b292ef4a04b63c1d37f2afc078 (DEFAULT_TABLE table=default.Table_1422ee4f50d147659ee2338071831d14 [id=5b0de5b30619417db8f4d4a16e8d4718]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.180809 10119 tablet_service.cc:1511] Processing CreateTablet for tablet e6ae4df29db74085849d82cf2529ac51 (DEFAULT_TABLE table=default.Table_fd5af78e376540b2be18db6a65953a46 [id=f031f3e064114474bbb69fd48bb92a41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.204919 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2186b5b292ef4a04b63c1d37f2afc078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.204936 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6ae4df29db74085849d82cf2529ac51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.166380 10115 tablet_service.cc:1511] Processing CreateTablet for tablet 5d2103bbb48f4ff196b61406896df656 (DEFAULT_TABLE table=default.Table_89c56d57fc044981b88f6709942097d7 [id=bc68be3108f54aa6868f0614c0bbe1b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.206769 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d2103bbb48f4ff196b61406896df656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.170506 10128 tablet_service.cc:1511] Processing CreateTablet for tablet f9bcb6c71d384f758e1e44137612fe21 (DEFAULT_TABLE table=default.Table_a70b9fa6ee4b4696b9f30fcfd17a3505 [id=f34eb1782f654f9f9214ccd88b01abfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.210753 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9bcb6c71d384f758e1e44137612fe21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.212323 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 5d2103bbb48f4ff196b61406896df656 (DEFAULT_TABLE table=default.Table_89c56d57fc044981b88f6709942097d7 [id=bc68be3108f54aa6868f0614c0bbe1b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.173317 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 48fa5f075d2749dc80ad5594746d7564 (DEFAULT_TABLE table=default.Table_1a90c42d93434c0ab29e50e010af4212 [id=0883d4468d994ee7a0babcb46aa4dfe0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.173738 10162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b737b216646a4c5baecb88d59bcce4df" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:59.214812 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48fa5f075d2749dc80ad5594746d7564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.225255 11663 raft_consensus.cc:493] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:59.226397 11663 raft_consensus.cc:515] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.228017 11663 leader_election.cc:290] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:59.229187 11663 raft_consensus.cc:2804] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:59.229590 11663 raft_consensus.cc:493] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:59.229944 11663 raft_consensus.cc:3060] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:59.234074 9665 tablet_service.cc:1511] Processing CreateTablet for tablet 39a28ed6886741c2b8fe8dce628911bc (DEFAULT_TABLE table=default.Table_6a0b31ab2f594e4885ce04f95c8b7854 [id=bc6524db0020417ca48d6b08d9b35dd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.234388 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 60c45125545340059d49b5faa8025c73 (DEFAULT_TABLE table=default.Table_6bacbec2a69f41549e72fa5a46246b11 [id=f206ffac27d3465f8c8fce659d40f89c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.234642 9667 tablet_service.cc:1511] Processing CreateTablet for tablet f9bcb6c71d384f758e1e44137612fe21 (DEFAULT_TABLE table=default.Table_a70b9fa6ee4b4696b9f30fcfd17a3505 [id=f34eb1782f654f9f9214ccd88b01abfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.234856 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60c45125545340059d49b5faa8025c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.160475 10370 raft_consensus.cc:359] T 45194cae6ea44d9d8cf856d256fd534f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.235083 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9bcb6c71d384f758e1e44137612fe21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.235081 10370 raft_consensus.cc:385] T 45194cae6ea44d9d8cf856d256fd534f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:59.235181 10370 raft_consensus.cc:740] T 45194cae6ea44d9d8cf856d256fd534f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:59.235435 10370 consensus_queue.cc:260] T 45194cae6ea44d9d8cf856d256fd534f P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.238812 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 48fa5f075d2749dc80ad5594746d7564 (DEFAULT_TABLE table=default.Table_1a90c42d93434c0ab29e50e010af4212 [id=0883d4468d994ee7a0babcb46aa4dfe0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.239302 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48fa5f075d2749dc80ad5594746d7564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.242663 9688 tablet_service.cc:1511] Processing CreateTablet for tablet e6ae4df29db74085849d82cf2529ac51 (DEFAULT_TABLE table=default.Table_fd5af78e376540b2be18db6a65953a46 [id=f031f3e064114474bbb69fd48bb92a41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.243129 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6ae4df29db74085849d82cf2529ac51. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:59.243314 9611 leader_election.cc:343] T bc753970b2464e38b03e377551276343 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.243498 9611 leader_election.cc:304] T bc753970b2464e38b03e377551276343 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:59.243844 11607 raft_consensus.cc:2749] T bc753970b2464e38b03e377551276343 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:47:59.244343 9611 leader_election.cc:343] T c8602b7360b747a3af756b139635d95c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.244503 9611 leader_election.cc:304] T c8602b7360b747a3af756b139635d95c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
W20260810 19:47:59.244716 9611 raft_consensus.cc:2686] T c8602b7360b747a3af756b139635d95c P fcd31b1bbb0340cbacfce652b4ad8da4: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260810 19:47:59.245019 9611 leader_election.cc:343] T 08e29e23d54f47968a06be98b313918d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.245138 9611 leader_election.cc:304] T 08e29e23d54f47968a06be98b313918d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:59.245385 11607 raft_consensus.cc:2749] T 08e29e23d54f47968a06be98b313918d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:47:59.245797 9611 leader_election.cc:343] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.246254 11607 raft_consensus.cc:493] T ee65b2c9980d4c77af8c68bf2f5c5f92 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:59.246491 11607 raft_consensus.cc:515] T ee65b2c9980d4c77af8c68bf2f5c5f92 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:59.247174 11607 leader_election.cc:290] T ee65b2c9980d4c77af8c68bf2f5c5f92 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:59.247298 9412 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_4502b22ebf5b47e5a0c8e0c3027e3251 [id=f1973d72068847eaabc823653402d194] alter complete (version 2)
I20260810 19:47:59.251029 10370 ts_tablet_manager.cc:1434] T 45194cae6ea44d9d8cf856d256fd534f P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.091s user 0.003s sys 0.000s
I20260810 19:47:59.251391 10370 tablet_bootstrap.cc:492] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:59.254463 11623 tablet.cc:1719] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0: Skipping requested alter to schema version 3, tablet already version 3
I20260810 19:47:59.257879 11607 raft_consensus.cc:493] T 3f18c24b01384299a4f941d7fb840032 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:59.258091 11607 raft_consensus.cc:515] T 3f18c24b01384299a4f941d7fb840032 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:59.258813 11607 leader_election.cc:290] T 3f18c24b01384299a4f941d7fb840032 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:59.259951 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 4a7ca999f502495fbc56bb6fc4e5c711 (DEFAULT_TABLE table=default.Table_5518a17337794a478179be2f1e73ed88 [id=e11b1391f1e24ddf81c037d401ab6a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.260476 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a7ca999f502495fbc56bb6fc4e5c711. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.242667 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 3ddc1bc292a243338235ea1396cc08f8 (DEFAULT_TABLE table=default.Table_667a9496a2f84ffdb4a98329b167c827 [id=e5a040b1b4694f25ad2bd9b1213a30e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.266055 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ddc1bc292a243338235ea1396cc08f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.266538 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6992e7ef8e794ddc879ae04f9f78b8bd" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:59.271044 10367 tablet_bootstrap.cc:492] T 63b649cbc1d141d8bb438105b8e8537c P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:59.271926 10367 ts_tablet_manager.cc:1403] T 63b649cbc1d141d8bb438105b8e8537c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.146s user 0.012s sys 0.016s
I20260810 19:47:59.272863 10367 raft_consensus.cc:359] T 63b649cbc1d141d8bb438105b8e8537c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.273082 10367 raft_consensus.cc:385] T 63b649cbc1d141d8bb438105b8e8537c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:59.273180 10367 raft_consensus.cc:740] T 63b649cbc1d141d8bb438105b8e8537c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:59.273474 10367 consensus_queue.cc:260] T 63b649cbc1d141d8bb438105b8e8537c P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.275851 9890 tablet_service.cc:1511] Processing CreateTablet for tablet 83f54310f9ca42a58b5ccb7adb3f41e8 (DEFAULT_TABLE table=default.Table_020c6c0883f242f7968d900aaa1f0f68 [id=7e360d9d0bf447db8a259c44fe7bb2c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.278456 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 90b6f76f0cec4f33879030958cbe89bf (DEFAULT_TABLE table=default.Table_84ec8686acb8432fb832c484aab7c394 [id=9a98f64aa4d744578d0cd817f95f3fea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.278944 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90b6f76f0cec4f33879030958cbe89bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.279520 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 10dd7891d4d844fc8f7a8674ee57627f (DEFAULT_TABLE table=default.Table_84322bc8610f43e086b0d790bd3e153f [id=bc72b9deacdc46ca8511517d103a8fb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.279953 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10dd7891d4d844fc8f7a8674ee57627f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.278092 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 83f54310f9ca42a58b5ccb7adb3f41e8 (DEFAULT_TABLE table=default.Table_020c6c0883f242f7968d900aaa1f0f68 [id=7e360d9d0bf447db8a259c44fe7bb2c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.281991 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83f54310f9ca42a58b5ccb7adb3f41e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.282763 9667 tablet_service.cc:1511] Processing CreateTablet for tablet a4cba9e5cd44474cbcdceea01d2a9aca (DEFAULT_TABLE table=default.Table_97a0d74bc8984c71bcbfe393520ae3ab [id=b4e0e2ff589541069e17b3b6c85728f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.283663 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4cba9e5cd44474cbcdceea01d2a9aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.285033 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 10dd7891d4d844fc8f7a8674ee57627f (DEFAULT_TABLE table=default.Table_84322bc8610f43e086b0d790bd3e153f [id=bc72b9deacdc46ca8511517d103a8fb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.285238 10367 ts_tablet_manager.cc:1434] T 63b649cbc1d141d8bb438105b8e8537c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260810 19:47:59.285650 10367 tablet_bootstrap.cc:492] T a5625dc6303d44c6be28abd6278ce034 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:59.286186 9906 tablet_service.cc:1511] Processing CreateTablet for tablet a4cba9e5cd44474cbcdceea01d2a9aca (DEFAULT_TABLE table=default.Table_97a0d74bc8984c71bcbfe393520ae3ab [id=b4e0e2ff589541069e17b3b6c85728f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.290889 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 90b6f76f0cec4f33879030958cbe89bf (DEFAULT_TABLE table=default.Table_84ec8686acb8432fb832c484aab7c394 [id=9a98f64aa4d744578d0cd817f95f3fea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.291294 11607 raft_consensus.cc:493] T 6355c14e38b3446493f7bd5e2a717341 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:59.291518 11607 raft_consensus.cc:515] T 6355c14e38b3446493f7bd5e2a717341 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:59.292256 11607 leader_election.cc:290] T 6355c14e38b3446493f7bd5e2a717341 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:59.292356 9898 tablet_service.cc:1511] Processing CreateTablet for tablet e6ae4df29db74085849d82cf2529ac51 (DEFAULT_TABLE table=default.Table_fd5af78e376540b2be18db6a65953a46 [id=f031f3e064114474bbb69fd48bb92a41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.293653 9948 raft_consensus.cc:2468] T 6992e7ef8e794ddc879ae04f9f78b8bd P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:47:59.294480 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2186b5b292ef4a04b63c1d37f2afc078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.294916 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4cba9e5cd44474cbcdceea01d2a9aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.298853 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90b6f76f0cec4f33879030958cbe89bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.301566 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 016b91706e1543c289d44fcf48caed9d (DEFAULT_TABLE table=default.Table_252f2578ecab482bb7255aa483e17833 [id=5ae847e26bb348299900468a5c44df51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.306571 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10dd7891d4d844fc8f7a8674ee57627f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.313282 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 4e9feae2570443afa3dec76975493487 (DEFAULT_TABLE table=default.Table_7eb33a7d7f654d9ba03184e013797f6b [id=a832e921b3f647c8811c794506f134da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.314096 9668 tablet_service.cc:1511] Processing CreateTablet for tablet 09a8da9ecf1042bfae5d34e263f501d6 (DEFAULT_TABLE table=default.Table_e94bbfae043b4fcf8004b5fdd86ac3f7 [id=e1f5d87187ca45ea98fa32351e6a0e11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.314101 9681 tablet_service.cc:1511] Processing CreateTablet for tablet d0f9a22f81894a829fcb350001fc532b (DEFAULT_TABLE table=default.Table_64e5558a29af405b85912f54bebdf3be [id=f3f4d6ebcacf43489369bd8f742a0631]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.326818 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83f54310f9ca42a58b5ccb7adb3f41e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.329886 9894 tablet_service.cc:1511] Processing CreateTablet for tablet 4a7ca999f502495fbc56bb6fc4e5c711 (DEFAULT_TABLE table=default.Table_5518a17337794a478179be2f1e73ed88 [id=e11b1391f1e24ddf81c037d401ab6a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.331184 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a7ca999f502495fbc56bb6fc4e5c711. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.336090 11607 raft_consensus.cc:493] T 0d79ef93c5bf4ac9895e594198edb251 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:59.336318 11607 raft_consensus.cc:515] T 0d79ef93c5bf4ac9895e594198edb251 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:59.337157 11607 leader_election.cc:290] T 0d79ef93c5bf4ac9895e594198edb251 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:59.338604 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6ae4df29db74085849d82cf2529ac51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.347649 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9bcb6c71d384f758e1e44137612fe21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.351997 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d2103bbb48f4ff196b61406896df656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.367658 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48fa5f075d2749dc80ad5594746d7564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.390009 9902 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 526) took 1320 ms. Trace:
I20260810 19:47:59.390134 9902 rpcz_store.cc:276] 0810 19:47:58.069211 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.509885 (+440674us) service_pool.cc:224] Handling call
0810 19:47:58.523363 (+ 13478us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:58.523397 (+ 34us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:59.065021 (+541624us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.389748 (+324727us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:59.389965 (+ 217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:59.390626 10366 tablet_bootstrap.cc:492] T 7737acd216204209ba0327e26e85cfe6 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:59.392608 10366 tablet_bootstrap.cc:654] T 7737acd216204209ba0327e26e85cfe6 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:59.399330 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09a8da9ecf1042bfae5d34e263f501d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.399643 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e9feae2570443afa3dec76975493487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.399930 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 016b91706e1543c289d44fcf48caed9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.402585 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0f9a22f81894a829fcb350001fc532b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.403658 9897 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 530) took 1047 ms. Trace:
I20260810 19:47:59.403769 9897 rpcz_store.cc:276] 0810 19:47:58.080256 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.510265 (+430009us) service_pool.cc:224] Handling call
0810 19:47:58.565498 (+ 55233us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:58.565520 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:58.967452 (+401932us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.127569 (+160117us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:59.127736 (+ 167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:59.404198 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d2103bbb48f4ff196b61406896df656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.404596 10367 tablet_bootstrap.cc:654] T a5625dc6303d44c6be28abd6278ce034 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:59.410501 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39a28ed6886741c2b8fe8dce628911bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.410880 11607 raft_consensus.cc:493] T 0c0a1e360ac648eeb0c734215bc200f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:59.411027 11607 raft_consensus.cc:515] T 0c0a1e360ac648eeb0c734215bc200f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.411799 11607 leader_election.cc:290] T 0c0a1e360ac648eeb0c734215bc200f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:59.413352 9881 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:38260 (request call id 122) took 1008 ms. Trace:
I20260810 19:47:59.413470 9881 rpcz_store.cc:276] 0810 19:47:58.404403 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.404477 (+ 74us) service_pool.cc:224] Handling call
0810 19:47:58.573006 (+168529us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x6160001c1554. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd472ff1860 00007fd476ee009f 00007fd4712b1bd6 00007fd4712b1905 00007fd46e06461e 00007fd46e0634fe 00007fd46e069738 00007fd46e06a09f 00007fd46e069ec8 0000000000aaf86c
0810 19:47:58.823138 (+250132us) spinlock_profiling.cc:243] Waited 40.9 ms on lock 0x6160000e2d30. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd4743b2d63 00007fd476edfea8 00007fd4712b1bd6 00007fd4712b1905 00007fd46e06461e 00007fd46e0634fe 00007fd46e069738 00007fd46e06a09f 00007fd46e069ec8 0000000000aaf86c
0810 19:47:59.413295 (+590157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":466263680}
W20260810 19:47:59.423481 9611 leader_election.cc:343] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.423648 9611 leader_election.cc:304] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:59.424288 11607 raft_consensus.cc:2749] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:59.425105 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee65b2c9980d4c77af8c68bf2f5c5f92" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:59.426502 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18c24b01384299a4f941d7fb840032" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:59.427022 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6355c14e38b3446493f7bd5e2a717341" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:59.427527 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d79ef93c5bf4ac9895e594198edb251" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:59.428023 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c0a1e360ac648eeb0c734215bc200f6" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:47:59.429212 9611 leader_election.cc:343] T ee65b2c9980d4c77af8c68bf2f5c5f92 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:59.430090 9611 leader_election.cc:343] T 3f18c24b01384299a4f941d7fb840032 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:59.430613 9611 leader_election.cc:343] T 6355c14e38b3446493f7bd5e2a717341 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:59.431015 9611 leader_election.cc:343] T 0d79ef93c5bf4ac9895e594198edb251 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:47:59.431381 9611 leader_election.cc:343] T 0c0a1e360ac648eeb0c734215bc200f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.434588 10377 ts_tablet_manager.cc:1929] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:59.434775 10377 log.cc:1199] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/7d3395886420455d9bdaf816c19ebae2
I20260810 19:47:59.435204 10377 ts_tablet_manager.cc:1950] T 7d3395886420455d9bdaf816c19ebae2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:59.435657 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 437) took 3327 ms. Trace:
I20260810 19:47:59.435949 9895 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38276 (request call id 531) took 1355 ms. Trace:
I20260810 19:47:59.435832 10377 rpcz_store.cc:276] 0810 19:47:56.108517 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.627784 (+519267us) service_pool.cc:224] Handling call
0810 19:47:59.117502 (+2489718us) ts_tablet_manager.cc:1151] Deleting tablet 7d3395886420455d9bdaf816c19ebae2
0810 19:47:59.117514 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.430966 (+313452us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.434524 (+ 3558us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.435637 (+ 1113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2455357}
I20260810 19:47:59.436442 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 439) took 3327 ms. Trace:
I20260810 19:47:59.436582 10377 rpcz_store.cc:276] 0810 19:47:56.108695 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.662192 (+553497us) service_pool.cc:224] Handling call
0810 19:47:59.436302 (+2774110us) ts_tablet_manager.cc:1151] Deleting tablet 2b2b20dc77954af7a203f357c746be29
0810 19:47:59.436313 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.436425 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2773827}
I20260810 19:47:59.436990 10377 tablet_replica.cc:333] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:47:59.437225 10377 raft_consensus.cc:2243] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:59.437448 10377 raft_consensus.cc:2272] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:59.438083 10377 ts_tablet_manager.cc:1916] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:59.291487 11529 rpcz_store.cc:276] 0810 19:47:57.884076 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.106611 (+222535us) service_pool.cc:224] Handling call
0810 19:47:59.150624 (+1044013us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:47:58.508222 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 19:47:58.520968 (+ 12746us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 19:47:58.520980 (+ 12us) alter_schema_op.cc:66] Acquired schema lock
0810 19:47:58.520989 (+ 9us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 19:47:58.521056 (+ 67us) alter_schema_op.cc:128] START. Timestamp: 1786391278521018
0810 19:47:58.521059 (+ 3us) op_driver.cc:348] REPLICATION: starting
0810 19:47:58.676406 (+155347us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x6160002eb7b8. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd472f38715 00007fd47301d4bb 00007fd472ff84b8 00007fd472ff7d65 00007fd4744139f5 00007fd474412519 00007fd47441a940 00007fd47441a74d 0000000000aaf86c 00007fd466f6784f
0810 19:47:58.690518 (+ 14112us) log.cc:844] Serialized 173 byte log entry
0810 19:47:58.983451 (+292933us) op_driver.cc:464] REPLICATION: finished
0810 19:47:58.984530 (+ 1079us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 19:47:58.986282 (+ 1752us) log.cc:844] Serialized 5 byte log entry
0810 19:47:59.080556 (+ 94274us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.150247 (+ 69691us) log.cc:844] Serialized 14 byte log entry
0810 19:47:59.150572 (+ 325us) alter_schema_op.cc:73] Released schema lock
0810 19:47:59.150578 (+ 6us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":997,"prepare.queue_time_us":390244,"prepare.run_cpu_time_us":22311,"prepare.run_wall_time_us":388173,"raft.queue_time_us":1625,"raft.run_cpu_time_us":936,"raft.run_wall_time_us":934,"replication_time_us":462346,"spinlock_wait_cycles":344843008,"thread_start_us":371713,"threads_started":2,"wal-append.queue_time_us":231832}]]}
I20260810 19:47:59.443097 10375 ts_tablet_manager.cc:1929] T 5d3598b5743244e39efd12703ec15aea P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:59.443663 10067 leader_election.cc:304] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:59.443974 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 4a7ca999f502495fbc56bb6fc4e5c711 (DEFAULT_TABLE table=default.Table_5518a17337794a478179be2f1e73ed88 [id=e11b1391f1e24ddf81c037d401ab6a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.444519 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a7ca999f502495fbc56bb6fc4e5c711. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.445161 10377 ts_tablet_manager.cc:1929] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:59.445288 10377 log.cc:1199] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/4f2d7c165d2c465d9080b927d54807f7
I20260810 19:47:59.446045 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 60c45125545340059d49b5faa8025c73 (DEFAULT_TABLE table=default.Table_6bacbec2a69f41549e72fa5a46246b11 [id=f206ffac27d3465f8c8fce659d40f89c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.448930 10367 tablet_bootstrap.cc:492] T a5625dc6303d44c6be28abd6278ce034 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:59.449083 10367 ts_tablet_manager.cc:1403] T a5625dc6303d44c6be28abd6278ce034 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.164s user 0.007s sys 0.003s
I20260810 19:47:59.450109 10367 raft_consensus.cc:359] T a5625dc6303d44c6be28abd6278ce034 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.450299 10367 raft_consensus.cc:385] T a5625dc6303d44c6be28abd6278ce034 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:59.450368 10367 raft_consensus.cc:740] T a5625dc6303d44c6be28abd6278ce034 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:59.450583 10367 consensus_queue.cc:260] T a5625dc6303d44c6be28abd6278ce034 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.451216 10367 ts_tablet_manager.cc:1434] T a5625dc6303d44c6be28abd6278ce034 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 19:47:59.451556 10367 tablet_bootstrap.cc:492] T 971e9abee86444a7a9e923b0962ae751 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:59.451682 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 6ea318eddd8349a79d27ce5746f03798
I20260810 19:47:59.452253 9418 catalog_manager.cc:6807] ReplaceTablet: tablet 6ea318eddd8349a79d27ce5746f03798 deleted and replaced by tablet e7ea2f50f9f9423b99af3bd190cfd5a5
I20260810 19:47:59.452361 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet cb2c9782c034435088f991bef8edf288
I20260810 19:47:59.452425 9418 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:56048 (request call id 735) took 1040 ms. Trace:
I20260810 19:47:59.452893 9421 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:56048 (request call id 728) took 1302 ms. Trace:
I20260810 19:47:59.453145 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet b2034784996149158c10b868f61ff418
I20260810 19:47:59.453001 9421 rpcz_store.cc:276] 0810 19:47:58.150271 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.710535 (+560264us) service_pool.cc:224] Handling call
0810 19:47:58.760987 (+ 50452us) spinlock_profiling.cc:243] Waited 50.2 ms on lock 0x616000041b54. stack: 00007f50aec1d326 00007f50aec1d0e0 00007f50adc4734d 00000000009a5774 00000000009a573d 00007f50be19c65d 00007f50be19c753 00007f50bad21ac1 00007f50c2afb40d 00007f50c2c8ab06 00007f50b96739d6 00007f50b9673705 00007f50b5d6061e 00007f50b5d5f4fe 00007f50b5d65738 00007f50b5d6609f
0810 19:47:58.761398 (+ 411us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 19:47:58.761541 (+ 143us) catalog_manager.cc:2841] Modifying in-memory table state
0810 19:47:58.761618 (+ 77us) catalog_manager.cc:2850] Locking tablets
0810 19:47:59.153630 (+392012us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 19:47:59.452184 (+298554us) catalog_manager.cc:2882] Removing table from by-name map
0810 19:47:59.452269 (+ 85us) catalog_manager.cc:2898] Committing in-memory state
0810 19:47:59.452310 (+ 41us) catalog_manager.cc:2902] Aborting table tasks
0810 19:47:59.452833 (+ 523us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:47:59.160322 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 19:47:59.160412 (+ 90us) write_op.cc:432] Acquiring schema lock in shared mode
0810 19:47:59.160418 (+ 6us) write_op.cc:435] Acquired schema lock
0810 19:47:59.160420 (+ 2us) tablet.cc:662] Decoding operations
0810 19:47:59.160535 (+ 115us) write_op.cc:620] Acquiring the partition lock for write op
0810 19:47:59.160547 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0810 19:47:59.160553 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0810 19:47:59.160661 (+ 108us) tablet.cc:701] Row locks acquired
0810 19:47:59.160663 (+ 2us) write_op.cc:260] PREPARE: finished
0810 19:47:59.160712 (+ 49us) write_op.cc:270] Start()
0810 19:47:59.160748 (+ 36us) write_op.cc:276] Timestamp: P: 1786391279160670 usec, L: 0
0810 19:47:59.160752 (+ 4us) op_driver.cc:348] REPLICATION: starting
0810 19:47:59.160927 (+ 175us) log.cc:844] Serialized 731 byte log entry
0810 19:47:59.449307 (+288380us) op_driver.cc:464] REPLICATION: finished
0810 19:47:59.449801 (+ 494us) write_op.cc:301] APPLY: starting
0810 19:47:59.449823 (+ 22us) tablet.cc:1367] starting BulkCheckPresence
0810 19:47:59.449875 (+ 52us) tablet.cc:1370] finished BulkCheckPresence
0810 19:47:59.449915 (+ 40us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 19:47:59.449995 (+ 80us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 19:47:59.450035 (+ 40us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 19:47:59.450043 (+ 8us) write_op.cc:312] APPLY: finished
0810 19:47:59.450135 (+ 92us) log.cc:844] Serialized 29 byte log entry
0810 19:47:59.450212 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:47:59.450236 (+ 24us) write_op.cc:454] Released schema lock
0810 19:47:59.450255 (+ 19us) write_op.cc:341] FINISH: Updating metrics
0810 19:47:59.450361 (+ 106us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:47:59.450366 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":115412736,"child_traces":[["op",{"apply.queue_time_us":418,"apply.run_cpu_time_us":555,"apply.run_wall_time_us":556,"num_ops":2,"prepare.queue_time_us":6008,"prepare.run_cpu_time_us":712,"prepare.run_wall_time_us":713,"raft.queue_time_us":2728,"raft.run_cpu_time_us":7,"raft.run_wall_time_us":7,"replication_time_us":288516}]]}
I20260810 19:47:59.453850 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet b2034784996149158c10b868f61ff418 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:59.452508 9418 rpcz_store.cc:276] 0810 19:47:58.411505 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.814656 (+403151us) service_pool.cc:224] Handling call
0810 19:47:58.842652 (+ 27996us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x616000041b54. stack: 00007f50aec1d326 00007f50aec1d0e0 00007f50adc4734d 00000000009a5774 00000000009a573d 00007f50be19c65d 00007f50be19c753 00007f50bad21ac1 00007f50c2afb40d 00007f50c2c9699b 00007f50b967e657 00007f50b967e385 00007f50b5d6061e 00007f50b5d5f4fe 00007f50b5d65738 00007f50b5d6609f
0810 19:47:59.452357 (+609705us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:47:59.161067 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 19:47:59.161151 (+ 84us) write_op.cc:432] Acquiring schema lock in shared mode
0810 19:47:59.161155 (+ 4us) write_op.cc:435] Acquired schema lock
0810 19:47:59.161157 (+ 2us) tablet.cc:662] Decoding operations
0810 19:47:59.161261 (+ 104us) write_op.cc:620] Acquiring the partition lock for write op
0810 19:47:59.161270 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0810 19:47:59.161274 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0810 19:47:59.161381 (+ 107us) tablet.cc:701] Row locks acquired
0810 19:47:59.161383 (+ 2us) write_op.cc:260] PREPARE: finished
0810 19:47:59.161418 (+ 35us) write_op.cc:270] Start()
0810 19:47:59.161447 (+ 29us) write_op.cc:276] Timestamp: P: 1786391279161378 usec, L: 0
0810 19:47:59.161450 (+ 3us) op_driver.cc:348] REPLICATION: starting
0810 19:47:59.161616 (+ 166us) log.cc:844] Serialized 628 byte log entry
0810 19:47:59.449396 (+287780us) op_driver.cc:464] REPLICATION: finished
0810 19:47:59.450449 (+ 1053us) write_op.cc:301] APPLY: starting
0810 19:47:59.450464 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0810 19:47:59.450506 (+ 42us) tablet.cc:1370] finished BulkCheckPresence
0810 19:47:59.450539 (+ 33us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 19:47:59.450666 (+ 127us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 19:47:59.450718 (+ 52us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 19:47:59.450725 (+ 7us) write_op.cc:312] APPLY: finished
0810 19:47:59.450794 (+ 69us) log.cc:844] Serialized 29 byte log entry
0810 19:47:59.450845 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:47:59.450860 (+ 15us) write_op.cc:454] Released schema lock
0810 19:47:59.450866 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0810 19:47:59.450935 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:47:59.450938 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":63406976,"child_traces":[["op",{"apply.queue_time_us":1016,"apply.run_cpu_time_us":481,"apply.run_wall_time_us":481,"num_ops":2,"prepare.queue_time_us":5882,"prepare.run_cpu_time_us":640,"prepare.run_wall_time_us":638,"raft.queue_time_us":2092,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":3,"replication_time_us":287928,"spinlock_wait_cycles":42880}]]}
I20260810 19:47:59.456122 10367 tablet_bootstrap.cc:654] T 971e9abee86444a7a9e923b0962ae751 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:59.456758 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet cb2c9782c034435088f991bef8edf288 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:59.457214 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ea318eddd8349a79d27ce5746f03798 with delete_type TABLET_DATA_DELETED (replaced by tablet e7ea2f50f9f9423b99af3bd190cfd5a5) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:59.457831 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 8a7212453dab49fa9372c628b80219c9 (DEFAULT_TABLE table=default.Table_ec7e4f3e68244e369e1ec60ad7e3fbee [id=2d4ecf69971c455bb8264864132fc2cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.458132 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 83f54310f9ca42a58b5ccb7adb3f41e8 (DEFAULT_TABLE table=default.Table_020c6c0883f242f7968d900aaa1f0f68 [id=7e360d9d0bf447db8a259c44fe7bb2c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.458478 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a7212453dab49fa9372c628b80219c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.459139 10130 tablet_service.cc:1511] Processing CreateTablet for tablet a4cba9e5cd44474cbcdceea01d2a9aca (DEFAULT_TABLE table=default.Table_97a0d74bc8984c71bcbfe393520ae3ab [id=b4e0e2ff589541069e17b3b6c85728f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.465332 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60c45125545340059d49b5faa8025c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.465852 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4cba9e5cd44474cbcdceea01d2a9aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.470355 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 90b6f76f0cec4f33879030958cbe89bf (DEFAULT_TABLE table=default.Table_84ec8686acb8432fb832c484aab7c394 [id=9a98f64aa4d744578d0cd817f95f3fea]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:59.470409 10067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 165172us
W20260810 19:47:59.471871 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4b2b0f2fc93647f3bc1d79b4132c3703 consensus state has no leader
I20260810 19:47:59.471884 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 3109703c51e54af78b58e9bbca50af33
I20260810 19:47:59.472230 9416 master_service.cc:960] ReplaceTablet: received request to replace tablet 11272d47d96f443187d63c184049871f from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:59.472585 11649 raft_consensus.cc:2804] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:59.472699 11649 raft_consensus.cc:493] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:59.472922 11649 raft_consensus.cc:3060] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:59.473302 10375 log.cc:1199] T 5d3598b5743244e39efd12703ec15aea P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/5d3598b5743244e39efd12703ec15aea
I20260810 19:47:59.474174 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_da85c56b8ad948aaadc0fb377d5c89ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:59.474444 10115 tablet_service.cc:1511] Processing CreateTablet for tablet 10dd7891d4d844fc8f7a8674ee57627f (DEFAULT_TABLE table=default.Table_84322bc8610f43e086b0d790bd3e153f [id=bc72b9deacdc46ca8511517d103a8fb4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:59.474859 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da85c56b8ad948aaadc0fb377d5c89ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:59.475047 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83f54310f9ca42a58b5ccb7adb3f41e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.475420 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10dd7891d4d844fc8f7a8674ee57627f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.475942 10370 tablet_bootstrap.cc:654] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:59.476801 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90b6f76f0cec4f33879030958cbe89bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.477488 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0b65da1621cf4a15bbb947263cbef587" } new_table_name: "default.Table_9e9b6375d5a644c2b031f68e51f013df" modify_external_catalogs: true
I20260810 19:47:59.478150 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_280138e880a1458097134a0bbe980773"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:59.479588 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2b91ab11caf848a3844e81653da4e93e" } new_table_name: "default.Table_a2eeaf19864943728adb31a3605f7550" modify_external_catalogs: true
I20260810 19:47:59.480607 11649 raft_consensus.cc:515] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:59.480736 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_280138e880a1458097134a0bbe980773 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:59.481148 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f5350bb5f02d47f2b9736182f22ec088"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:59.481693 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f5350bb5f02d47f2b9736182f22ec088 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:59.482008 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6992e7ef8e794ddc879ae04f9f78b8bd" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:59.482216 9948 raft_consensus.cc:3060] T 6992e7ef8e794ddc879ae04f9f78b8bd P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:59.484165 9408 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 81720b897a674b5380c6469d1600a979 (table default.Table_e4aeb59e91c24097bac9517b3c62b75a [id=8d7f043045ff44cd886367b5860f8433]). Expected version 1 got 0
I20260810 19:47:59.484592 9408 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 0c0a1e360ac648eeb0c734215bc200f6 (table default.Table_03fbd70a4ed44530a3fab8f17c0769db [id=09fa54104d0f46dbb3f19138bfa2313d]). Expected version 1 got 0
I20260810 19:47:59.485373 9948 raft_consensus.cc:2468] T 6992e7ef8e794ddc879ae04f9f78b8bd P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:47:59.474212 11663 raft_consensus.cc:515] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.486354 11663 leader_election.cc:290] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:59.487215 11607 raft_consensus.cc:493] T 3b6187dbe1ca42f79bf3eddd5475b929 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:59.487417 11607 raft_consensus.cc:515] T 3b6187dbe1ca42f79bf3eddd5475b929 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.488118 11607 leader_election.cc:290] T 3b6187dbe1ca42f79bf3eddd5475b929 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:59.490689 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet 3109703c51e54af78b58e9bbca50af33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:59.492347 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 31c2b9a4b8334e678b4632fc2f58dd0c
I20260810 19:47:59.493409 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 4c75af1e592042f5a4d442b82a539c94
I20260810 19:47:59.494410 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c75af1e592042f5a4d442b82a539c94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:59.494702 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 016b91706e1543c289d44fcf48caed9d (DEFAULT_TABLE table=default.Table_252f2578ecab482bb7255aa483e17833 [id=5ae847e26bb348299900468a5c44df51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.495251 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 016b91706e1543c289d44fcf48caed9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.505708 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 4e9feae2570443afa3dec76975493487 (DEFAULT_TABLE table=default.Table_7eb33a7d7f654d9ba03184e013797f6b [id=a832e921b3f647c8811c794506f134da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.506242 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e9feae2570443afa3dec76975493487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.510594 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet 31c2b9a4b8334e678b4632fc2f58dd0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:59.514659 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 09a8da9ecf1042bfae5d34e263f501d6 (DEFAULT_TABLE table=default.Table_e94bbfae043b4fcf8004b5fdd86ac3f7 [id=e1f5d87187ca45ea98fa32351e6a0e11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.514708 10127 tablet_service.cc:1511] Processing CreateTablet for tablet d0f9a22f81894a829fcb350001fc532b (DEFAULT_TABLE table=default.Table_64e5558a29af405b85912f54bebdf3be [id=f3f4d6ebcacf43489369bd8f742a0631]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.515250 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0f9a22f81894a829fcb350001fc532b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.516091 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09a8da9ecf1042bfae5d34e263f501d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.518340 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_03af1ed093464e9584fda04a56a9d164"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:59.518978 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03af1ed093464e9584fda04a56a9d164 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:59.520804 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3ccf56c919e14ad8a02a00cccab81de9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:59.521389 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ccf56c919e14ad8a02a00cccab81de9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:59.525486 11649 leader_election.cc:290] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:59.528668 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_77e9c60c358548bcae55a37d2cd94658"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:59.529290 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77e9c60c358548bcae55a37d2cd94658 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:59.488435 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11272d47d96f443187d63c184049871f" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:47:59.533480 9944 raft_consensus.cc:3060] T 11272d47d96f443187d63c184049871f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:59.534433 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 7d3395886420455d9bdaf816c19ebae2 (table default.Table_da2146aa6d244f3f892e8cf1c68bda8f [id=febfd4d57fd54ce0bd4a406cc965303f]) successfully deleted
W20260810 19:47:59.534785 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 2b2b20dc77954af7a203f357c746be29 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b2b20dc77954af7a203f357c746be29 already in progress: creating tablet
I20260810 19:47:59.535066 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ea318eddd8349a79d27ce5746f03798 with delete_type TABLET_DATA_DELETED (replaced by tablet e7ea2f50f9f9423b99af3bd190cfd5a5) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:59.535529 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet b2034784996149158c10b868f61ff418 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:59.535662 10136 tablet_service.cc:1558] Processing DeleteTablet for tablet cb2c9782c034435088f991bef8edf288 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:59.535807 10067 leader_election.cc:304] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:59.538059 10136 tablet_service.cc:1558] Processing DeleteTablet for tablet 3109703c51e54af78b58e9bbca50af33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:59.542682 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b6187dbe1ca42f79bf3eddd5475b929" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:47:59.543321 9611 leader_election.cc:343] T 3b6187dbe1ca42f79bf3eddd5475b929 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.543561 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 4e9feae2570443afa3dec76975493487 (DEFAULT_TABLE table=default.Table_7eb33a7d7f654d9ba03184e013797f6b [id=a832e921b3f647c8811c794506f134da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.543995 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e9feae2570443afa3dec76975493487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.546169 9885 tablet_service.cc:1511] Processing CreateTablet for tablet 8a7212453dab49fa9372c628b80219c9 (DEFAULT_TABLE table=default.Table_ec7e4f3e68244e369e1ec60ad7e3fbee [id=2d4ecf69971c455bb8264864132fc2cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.546610 9885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a7212453dab49fa9372c628b80219c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.547590 9944 raft_consensus.cc:2468] T 11272d47d96f443187d63c184049871f P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:47:59.548187 10067 leader_election.cc:304] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:47:59.548568 11663 raft_consensus.cc:2804] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:59.548763 11663 raft_consensus.cc:697] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:47:59.549108 11663 consensus_queue.cc:237] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.550136 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet 3109703c51e54af78b58e9bbca50af33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:59.550596 10366 tablet_bootstrap.cc:492] T 7737acd216204209ba0327e26e85cfe6 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:59.551002 10366 ts_tablet_manager.cc:1403] T 7737acd216204209ba0327e26e85cfe6 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.354s user 0.004s sys 0.000s
I20260810 19:47:59.551291 11649 raft_consensus.cc:2804] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:59.552831 10375 ts_tablet_manager.cc:1950] T 5d3598b5743244e39efd12703ec15aea P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:59.552870 10366 raft_consensus.cc:359] T 7737acd216204209ba0327e26e85cfe6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.553143 10366 raft_consensus.cc:385] T 7737acd216204209ba0327e26e85cfe6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:59.553241 10366 raft_consensus.cc:740] T 7737acd216204209ba0327e26e85cfe6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:59.553509 10366 consensus_queue.cc:260] T 7737acd216204209ba0327e26e85cfe6 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.553807 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet cb2c9782c034435088f991bef8edf288 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:59.554057 9897 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ea318eddd8349a79d27ce5746f03798 with delete_type TABLET_DATA_DELETED (replaced by tablet e7ea2f50f9f9423b99af3bd190cfd5a5) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:59.554454 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet b2034784996149158c10b868f61ff418 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:59.554921 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 09a8da9ecf1042bfae5d34e263f501d6 (DEFAULT_TABLE table=default.Table_e94bbfae043b4fcf8004b5fdd86ac3f7 [id=e1f5d87187ca45ea98fa32351e6a0e11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.555418 9905 tablet_service.cc:1511] Processing CreateTablet for tablet d0f9a22f81894a829fcb350001fc532b (DEFAULT_TABLE table=default.Table_64e5558a29af405b85912f54bebdf3be [id=f3f4d6ebcacf43489369bd8f742a0631]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.510848 9895 rpcz_store.cc:276] 0810 19:47:58.080333 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.510574 (+430241us) service_pool.cc:224] Handling call
0810 19:47:58.576626 (+ 66052us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 19:47:58.576655 (+ 29us) ts_tablet_manager.cc:682] Creating new metadata...
0810 19:47:59.141699 (+565044us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.435699 (+294000us) tablet_replica.cc:206] Creating consensus instance
0810 19:47:59.435934 (+ 235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:47:59.555774 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09a8da9ecf1042bfae5d34e263f501d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.557986 10366 ts_tablet_manager.cc:1434] T 7737acd216204209ba0327e26e85cfe6 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260810 19:47:59.560372 10366 tablet_bootstrap.cc:492] T 06af03c8a87141febef768bd56c72c39 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:59.558288 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0f9a22f81894a829fcb350001fc532b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.496603 9894 tablet_service.cc:1511] Processing CreateTablet for tablet 016b91706e1543c289d44fcf48caed9d (DEFAULT_TABLE table=default.Table_252f2578ecab482bb7255aa483e17833 [id=5ae847e26bb348299900468a5c44df51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.562191 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 016b91706e1543c289d44fcf48caed9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.569339 10377 ts_tablet_manager.cc:1950] T 4f2d7c165d2c465d9080b927d54807f7 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:59.569351 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 8a7212453dab49fa9372c628b80219c9 (DEFAULT_TABLE table=default.Table_ec7e4f3e68244e369e1ec60ad7e3fbee [id=2d4ecf69971c455bb8264864132fc2cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.569830 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a7212453dab49fa9372c628b80219c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.571288 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet 31c2b9a4b8334e678b4632fc2f58dd0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:47:59.582121 10068 leader_election.cc:343] T 4f2d7c165d2c465d9080b927d54807f7 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 4f2d7c165d2c465d9080b927d54807f7
I20260810 19:47:59.582584 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c75af1e592042f5a4d442b82a539c94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:47:59.586859 10367 tablet_bootstrap.cc:492] T 971e9abee86444a7a9e923b0962ae751 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:59.587035 10367 ts_tablet_manager.cc:1403] T 971e9abee86444a7a9e923b0962ae751 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.136s user 0.018s sys 0.024s
I20260810 19:47:59.586999 9412 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_85e674f117d5404eb01680b66429bc7b [id=a837d5f74eac4f74b2029f46d73acc93] alter complete (version 3)
I20260810 19:47:59.587862 10367 raft_consensus.cc:359] T 971e9abee86444a7a9e923b0962ae751 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.588052 10367 raft_consensus.cc:385] T 971e9abee86444a7a9e923b0962ae751 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:59.588105 10367 raft_consensus.cc:740] T 971e9abee86444a7a9e923b0962ae751 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:59.588326 10367 consensus_queue.cc:260] T 971e9abee86444a7a9e923b0962ae751 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:59.588630 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a07fca1f298e4473aca7e9813bdd11d6 consensus state has no leader
I20260810 19:47:59.590569 10367 ts_tablet_manager.cc:1434] T 971e9abee86444a7a9e923b0962ae751 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:47:59.590891 10367 tablet_bootstrap.cc:492] T d2c77a8ac1614bb286e4e168bcf999f3 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:59.596103 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_471bc99d3aa9446c8a287a8ae160d06d" } new_table_name: "default.Table_99130c853a87452b82439a60971c2d1b" modify_external_catalogs: true
I20260810 19:47:59.596776 10367 tablet_bootstrap.cc:654] T d2c77a8ac1614bb286e4e168bcf999f3 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:59.596103 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_80a86eb986c5424fb1702c55beb124c1" } new_table_name: "default.Table_5601ab64fee640919e67eafbccf346bc" modify_external_catalogs: true
I20260810 19:47:59.598347 11649 raft_consensus.cc:697] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:47:59.599874 10068 leader_election.cc:304] T 4f2d7c165d2c465d9080b927d54807f7 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:59.599211 11649 consensus_queue.cc:237] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:59.602459 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f6b705416997444485dc187e11a25c34 consensus state has no leader
W20260810 19:47:59.602825 10068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 160574us
W20260810 19:47:59.603084 10068 leader_election.cc:343] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: d99b34f901484fad87cff4bb9ab56fc8
I20260810 19:47:59.603219 10068 leader_election.cc:304] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:59.603471 11665 raft_consensus.cc:2749] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:47:59.603914 10068 leader_election.cc:343] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 11272d47d96f443187d63c184049871f
I20260810 19:47:59.604378 10068 leader_election.cc:304] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691
I20260810 19:47:59.604522 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f6bf38e92579459db083cba7999bb1ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:59.605115 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f6bf38e92579459db083cba7999bb1ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:59.605496 11665 raft_consensus.cc:2804] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:59.605600 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 383) took 4057 ms. Trace:
I20260810 19:47:59.605672 11518 raft_consensus.cc:3060] T 4f2d7c165d2c465d9080b927d54807f7 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:59.606645 11665 raft_consensus.cc:493] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:59.606786 11665 raft_consensus.cc:3060] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:59.608229 10375 rpcz_store.cc:276] 0810 19:47:55.524973 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.525033 (+ 60us) service_pool.cc:224] Handling call
0810 19:47:59.139274 (+3614241us) ts_tablet_manager.cc:1151] Deleting tablet 5d3598b5743244e39efd12703ec15aea
0810 19:47:59.139289 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.144741 (+ 5452us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.253297 (+108556us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.581908 (+328611us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3613992}
I20260810 19:47:59.611369 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_949a9afb4edf45919e8e02945ab84d4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:59.611986 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_949a9afb4edf45919e8e02945ab84d4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:59.612388 11665 raft_consensus.cc:515] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.613301 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 5d3598b5743244e39efd12703ec15aea (table default.Table_798bf26932ec4547b2ed311ccba8467b [id=72812b2c16734101b42ea305500c759c]) successfully deleted
I20260810 19:47:59.614192 11665 leader_election.cc:290] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:59.614454 10367 tablet_bootstrap.cc:492] T d2c77a8ac1614bb286e4e168bcf999f3 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:59.614612 10367 ts_tablet_manager.cc:1403] T d2c77a8ac1614bb286e4e168bcf999f3 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20260810 19:47:59.615137 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 384) took 4078 ms. Trace:
I20260810 19:47:59.615290 10375 rpcz_store.cc:276] 0810 19:47:55.535774 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.536739 (+ 965us) service_pool.cc:224] Handling call
0810 19:47:59.611988 (+4075249us) ts_tablet_manager.cc:1151] Deleting tablet dcb3660108094399b36d19ea8e6b8308
0810 19:47:59.612001 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.614586 (+ 2585us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4074973}
I20260810 19:47:59.615406 10367 raft_consensus.cc:359] T d2c77a8ac1614bb286e4e168bcf999f3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.615581 10367 raft_consensus.cc:385] T d2c77a8ac1614bb286e4e168bcf999f3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:59.615638 10367 raft_consensus.cc:740] T d2c77a8ac1614bb286e4e168bcf999f3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:59.615854 9416 master_service.cc:960] ReplaceTablet: received request to replace tablet 3b6187dbe1ca42f79bf3eddd5475b929 from {username='slave'} at 127.0.0.1:56048
I20260810 19:47:59.615902 10367 consensus_queue.cc:260] T d2c77a8ac1614bb286e4e168bcf999f3 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.616622 10375 tablet_replica.cc:333] T 5f560ed7ea0c4075bad1375d86738861 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:59.618249 10367 ts_tablet_manager.cc:1434] T d2c77a8ac1614bb286e4e168bcf999f3 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 19:47:59.618255 10375 raft_consensus.cc:2243] T 5f560ed7ea0c4075bad1375d86738861 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:59.618630 10367 tablet_bootstrap.cc:492] T 21208dd824fe432fa307cbb88d37aaa2 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:59.620441 10367 tablet_bootstrap.cc:654] T 21208dd824fe432fa307cbb88d37aaa2 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:59.620484 10068 leader_election.cc:343] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 6992e7ef8e794ddc879ae04f9f78b8bd
I20260810 19:47:59.623641 10162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee65b2c9980d4c77af8c68bf2f5c5f92" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:59.624564 10375 raft_consensus.cc:2272] T 5f560ed7ea0c4075bad1375d86738861 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:59.626793 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_8c96e0380fc64018ad77605ab117ca1b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:47:59.627470 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c96e0380fc64018ad77605ab117ca1b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:59.629163 11518 raft_consensus.cc:2749] T 4f2d7c165d2c465d9080b927d54807f7 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:59.629472 10375 ts_tablet_manager.cc:1916] T 5f560ed7ea0c4075bad1375d86738861 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:59.630591 10367 tablet_bootstrap.cc:492] T 21208dd824fe432fa307cbb88d37aaa2 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:59.630741 10367 ts_tablet_manager.cc:1403] T 21208dd824fe432fa307cbb88d37aaa2 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260810 19:47:59.631568 10367 raft_consensus.cc:359] T 21208dd824fe432fa307cbb88d37aaa2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.631759 10367 raft_consensus.cc:385] T 21208dd824fe432fa307cbb88d37aaa2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:59.631812 10367 raft_consensus.cc:740] T 21208dd824fe432fa307cbb88d37aaa2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:59.632035 10367 consensus_queue.cc:260] T 21208dd824fe432fa307cbb88d37aaa2 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.636050 10162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18c24b01384299a4f941d7fb840032" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:59.636541 10367 ts_tablet_manager.cc:1434] T 21208dd824fe432fa307cbb88d37aaa2 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260810 19:47:59.640337 10367 tablet_bootstrap.cc:492] T 3c828ae089774fb9b0582141f4b99313 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:59.642182 10367 tablet_bootstrap.cc:654] T 3c828ae089774fb9b0582141f4b99313 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:59.644717 10162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6355c14e38b3446493f7bd5e2a717341" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:59.645596 10162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d79ef93c5bf4ac9895e594198edb251" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:59.646193 10162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c0a1e360ac648eeb0c734215bc200f6" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:59.646785 10162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b6187dbe1ca42f79bf3eddd5475b929" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:59.648219 9611 leader_election.cc:343] T ee65b2c9980d4c77af8c68bf2f5c5f92 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.648355 9611 leader_election.cc:304] T ee65b2c9980d4c77af8c68bf2f5c5f92 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:59.648662 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9714a8a1eeaf41d2bb01d3fa3ff7181d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:47:59.648813 11607 raft_consensus.cc:2749] T ee65b2c9980d4c77af8c68bf2f5c5f92 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:59.648836 9711 raft_consensus.cc:3060] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:59.649077 11607 raft_consensus.cc:493] T 28c9eecacc6540ac82ac7faabceec788 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:59.649181 11607 raft_consensus.cc:515] T 28c9eecacc6540ac82ac7faabceec788 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:47:59.649785 11607 leader_election.cc:290] T 28c9eecacc6540ac82ac7faabceec788 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:59.652006 9711 raft_consensus.cc:2468] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:47:59.653154 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 436) took 3544 ms. Trace:
I20260810 19:47:59.653322 10377 rpcz_store.cc:276] 0810 19:47:56.108419 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.623922 (+515503us) service_pool.cc:224] Handling call
0810 19:47:59.436941 (+2813019us) ts_tablet_manager.cc:1151] Deleting tablet 4f2d7c165d2c465d9080b927d54807f7
0810 19:47:59.436951 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.441996 (+ 5045us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.445103 (+ 3107us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.653129 (+208026us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2769606}
I20260810 19:47:59.653880 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 440) took 3545 ms. Trace:
I20260810 19:47:59.653993 10370 tablet_bootstrap.cc:492] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:59.654023 10377 rpcz_store.cc:276] 0810 19:47:56.108795 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.662504 (+553709us) service_pool.cc:224] Handling call
0810 19:47:59.653741 (+2991237us) ts_tablet_manager.cc:1151] Deleting tablet a78960e1f2164c848297411b9273ac64
0810 19:47:59.653753 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.653860 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2840059}
I20260810 19:47:59.654188 10370 ts_tablet_manager.cc:1403] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.403s user 0.008s sys 0.007s
I20260810 19:47:59.654870 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c9eecacc6540ac82ac7faabceec788" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:59.655158 10370 raft_consensus.cc:359] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.655283 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet 31c2b9a4b8334e678b4632fc2f58dd0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:59.655390 10370 raft_consensus.cc:385] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:59.655470 10370 raft_consensus.cc:740] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:59.655616 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 441) took 3546 ms. Trace:
I20260810 19:47:59.655684 10377 rpcz_store.cc:276] 0810 19:47:56.108872 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.667384 (+558512us) service_pool.cc:224] Handling call
0810 19:47:59.655502 (+2988118us) ts_tablet_manager.cc:1151] Deleting tablet 87bbcc651d034e2a826478b805792e48
0810 19:47:59.655511 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.655599 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11488,"tablet-delete.queue_time_us":2841708}
I20260810 19:47:59.655952 10377 tablet_replica.cc:333] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
W20260810 19:47:59.656649 9611 leader_election.cc:343] T 3f18c24b01384299a4f941d7fb840032 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.656780 9611 leader_election.cc:304] T 3f18c24b01384299a4f941d7fb840032 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:59.656787 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5323ce7ca7d04a90811d8058dc7b08ea" } modify_external_catalogs: true
I20260810 19:47:59.657019 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5323ce7ca7d04a90811d8058dc7b08ea" } modify_external_catalogs: true
I20260810 19:47:59.657178 11607 raft_consensus.cc:2749] T 3f18c24b01384299a4f941d7fb840032 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:59.657594 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_03860438702347aba8b5460c42468832" } modify_external_catalogs: true
I20260810 19:47:59.657740 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_03860438702347aba8b5460c42468832" } modify_external_catalogs: true
I20260810 19:47:59.658221 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c75af1e592042f5a4d442b82a539c94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:59.659377 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9714a8a1eeaf41d2bb01d3fa3ff7181d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
W20260810 19:47:59.659705 9611 leader_election.cc:343] T 6355c14e38b3446493f7bd5e2a717341 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.659845 9611 leader_election.cc:304] T 6355c14e38b3446493f7bd5e2a717341 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
W20260810 19:47:59.660265 9611 leader_election.cc:343] T 28c9eecacc6540ac82ac7faabceec788 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.660277 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 4f2d7c165d2c465d9080b927d54807f7 (table default.Table_35ada13f5f5a41b0a93a57276b7756d9 [id=fa3844f34a5b4d55b6e87ec2164eb8fb]) successfully deleted
I20260810 19:47:59.660457 11607 raft_consensus.cc:2749] T 6355c14e38b3446493f7bd5e2a717341 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:47:59.660570 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet a78960e1f2164c848297411b9273ac64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a78960e1f2164c848297411b9273ac64 already in progress: creating tablet
W20260810 19:47:59.660836 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 87bbcc651d034e2a826478b805792e48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87bbcc651d034e2a826478b805792e48 already in progress: creating tablet
W20260810 19:47:59.660842 9611 leader_election.cc:343] T 0d79ef93c5bf4ac9895e594198edb251 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.660929 9611 leader_election.cc:304] T 0d79ef93c5bf4ac9895e594198edb251 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:59.661288 11607 raft_consensus.cc:2749] T 0d79ef93c5bf4ac9895e594198edb251 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:47:59.661656 9611 leader_election.cc:343] T 0c0a1e360ac648eeb0c734215bc200f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.661742 9611 leader_election.cc:304] T 0c0a1e360ac648eeb0c734215bc200f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:59.662055 11607 raft_consensus.cc:2749] T 0c0a1e360ac648eeb0c734215bc200f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:47:59.666424 10067 leader_election.cc:343] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.667546 11410 raft_consensus.cc:493] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eadde59fd6504d679e47f03a60c64bb0)
W20260810 19:47:59.668046 9611 leader_election.cc:343] T 3b6187dbe1ca42f79bf3eddd5475b929 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.668177 9611 leader_election.cc:304] T 3b6187dbe1ca42f79bf3eddd5475b929 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:59.668574 11607 raft_consensus.cc:2749] T 3b6187dbe1ca42f79bf3eddd5475b929 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:59.667729 11410 raft_consensus.cc:515] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.673775 10377 raft_consensus.cc:2243] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:59.674942 11410 leader_election.cc:290] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:47:59.679572 9831 leader_election.cc:343] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 2d90d9c9f6524859a0e33e649dd80f7c
W20260810 19:47:59.681785 10068 leader_election.cc:343] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 6992e7ef8e794ddc879ae04f9f78b8bd
I20260810 19:47:59.682469 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c9eecacc6540ac82ac7faabceec788" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:59.685631 10375 ts_tablet_manager.cc:1929] T 5f560ed7ea0c4075bad1375d86738861 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:59.686192 10375 log.cc:1199] T 5f560ed7ea0c4075bad1375d86738861 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/5f560ed7ea0c4075bad1375d86738861
I20260810 19:47:59.686754 10375 ts_tablet_manager.cc:1950] T 5f560ed7ea0c4075bad1375d86738861 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:59.687541 10377 raft_consensus.cc:2272] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:59.692420 10366 tablet_bootstrap.cc:654] T 06af03c8a87141febef768bd56c72c39 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:59.695413 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 387) took 4119 ms. Trace:
I20260810 19:47:59.695469 10377 ts_tablet_manager.cc:1916] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:47:59.686024 10068 leader_election.cc:343] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 11272d47d96f443187d63c184049871f
W20260810 19:47:59.703102 10068 consensus_peers.cc:597] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7737acd216204209ba0327e26e85cfe6. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:47:59.703473 10068 leader_election.cc:304] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691
I20260810 19:47:59.685846 10370 consensus_queue.cc:260] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.703837 9415 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 81720b897a674b5380c6469d1600a979 (table default.Table_e4aeb59e91c24097bac9517b3c62b75a [id=8d7f043045ff44cd886367b5860f8433]). Expected version 1 got 0
I20260810 19:47:59.704111 11649 raft_consensus.cc:2804] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:59.704262 11649 raft_consensus.cc:697] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:47:59.704564 11649 consensus_queue.cc:237] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.708528 10370 ts_tablet_manager.cc:1434] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.054s user 0.003s sys 0.000s
I20260810 19:47:59.709764 9408 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_b46992ec81974f6caad1ea769640dcf1 [id=d6d2d95e5e9f4e10a7d5a8153e66e4b6] alter complete (version 2)
I20260810 19:47:59.711596 9421 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_c35c3a44fcc44bba8a8c334292245b49 [id=5abc1f7beec444a4a988fbfcb8b45623] alter complete (version 1)
I20260810 19:47:59.712088 10370 tablet_bootstrap.cc:492] T e959898b2c4c4173aea107d3f090ca07 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:47:59.714418 9408 catalog_manager.cc:5911] Failed to send AlterTable RPC for tablet 0c0a1e360ac648eeb0c734215bc200f6 (table default.Table_03fbd70a4ed44530a3fab8f17c0769db [id=09fa54104d0f46dbb3f19138bfa2313d], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 0c0a1e360ac648eeb0c734215bc200f6 consensus state has no leader
I20260810 19:47:59.714852 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 08e29e23d54f47968a06be98b313918d with delete_type TABLET_DATA_DELETED (replaced by tablet 19e2bf7b7d254894a07c5a75bf24e742) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:59.712656 10068 consensus_peers.cc:597] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ffc4466b82bd49fcaad30e4d5325c7db. This is attempt 1: this message will repeat every 5th retry.
W20260810 19:47:59.715487 9611 leader_election.cc:343] T 28c9eecacc6540ac82ac7faabceec788 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.715616 9611 leader_election.cc:304] T 28c9eecacc6540ac82ac7faabceec788 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:59.716133 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 6992e7ef8e794ddc879ae04f9f78b8bd with delete_type TABLET_DATA_DELETED (replaced by tablet a2fe67e8bd014acaa202c022c193cdc6) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:59.716328 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d79ef93c5bf4ac9895e594198edb251 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:59.716347 11607 raft_consensus.cc:2749] T 28c9eecacc6540ac82ac7faabceec788 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:59.717160 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet ee65b2c9980d4c77af8c68bf2f5c5f92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:59.717705 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f18c24b01384299a4f941d7fb840032 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e967384768b4ec7956f1b508e8ab2af) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:59.718604 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b6187dbe1ca42f79bf3eddd5475b929 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:59.719601 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 28c9eecacc6540ac82ac7faabceec788 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:47:59.719825 9830 leader_election.cc:343] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Not found: Tablet not found: 2d90d9c9f6524859a0e33e649dd80f7c
I20260810 19:47:59.719961 9830 leader_election.cc:304] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:59.720204 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 6355c14e38b3446493f7bd5e2a717341 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:59.720741 10370 tablet_bootstrap.cc:654] T e959898b2c4c4173aea107d3f090ca07 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:59.721078 9830 raft_consensus.cc:2686] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 19:47:59.723448 11663 consensus_queue.cc:1048] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:47:59.724082 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7bc93cc546f64bbb96c6c526f87fad54" } modify_external_catalogs: true
I20260810 19:47:59.724325 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7bc93cc546f64bbb96c6c526f87fad54" } modify_external_catalogs: true
I20260810 19:47:59.725026 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_06a146e0e459439cba25bc9eaf210b12" } modify_external_catalogs: true
I20260810 19:47:59.725005 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_715dd716d75d4284a963bf2a74ab9294" } new_table_name: "default.Table_85723f2593004e11acac17f40c9868e0" modify_external_catalogs: true
I20260810 19:47:59.725567 10375 rpcz_store.cc:276] 0810 19:47:55.576209 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:55.576270 (+ 61us) service_pool.cc:224] Handling call
0810 19:47:59.616038 (+4039768us) ts_tablet_manager.cc:1151] Deleting tablet 5f560ed7ea0c4075bad1375d86738861
0810 19:47:59.616050 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.639373 (+ 23323us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.685474 (+ 46101us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.695361 (+ 9887us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1534,"tablet-delete.queue_time_us":4039436}
I20260810 19:47:59.725726 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_06a146e0e459439cba25bc9eaf210b12" } modify_external_catalogs: true
I20260810 19:47:59.726859 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 424) took 3603 ms. Trace:
I20260810 19:47:59.726979 10375 rpcz_store.cc:276] 0810 19:47:56.123525 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.866167 (+742642us) service_pool.cc:224] Handling call
0810 19:47:59.726667 (+2860500us) ts_tablet_manager.cc:1151] Deleting tablet 2b2b20dc77954af7a203f357c746be29
0810 19:47:59.726680 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.726818 (+ 138us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2852843}
W20260810 19:47:59.727476 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 2b2b20dc77954af7a203f357c746be29 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b2b20dc77954af7a203f357c746be29 already in progress: creating tablet
I20260810 19:47:59.729202 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 426) took 3599 ms. Trace:
I20260810 19:47:59.730340 10375 rpcz_store.cc:276] 0810 19:47:56.130091 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.873872 (+743781us) service_pool.cc:224] Handling call
0810 19:47:59.729047 (+2855175us) ts_tablet_manager.cc:1151] Deleting tablet 87bbcc651d034e2a826478b805792e48
0810 19:47:59.729059 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.729165 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2830650}
W20260810 19:47:59.731389 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 87bbcc651d034e2a826478b805792e48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87bbcc651d034e2a826478b805792e48 already in progress: creating tablet
I20260810 19:47:59.731937 10375 tablet_replica.cc:333] T dad16ea0f82942de8587dd7c98c0d2df P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:59.731766 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet d99b34f901484fad87cff4bb9ab56fc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:59.732640 10375 raft_consensus.cc:2243] T dad16ea0f82942de8587dd7c98c0d2df P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:59.732849 10375 raft_consensus.cc:2272] T dad16ea0f82942de8587dd7c98c0d2df P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:59.733492 10375 ts_tablet_manager.cc:1916] T dad16ea0f82942de8587dd7c98c0d2df P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:59.752866 10370 tablet_bootstrap.cc:492] T e959898b2c4c4173aea107d3f090ca07 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:59.752974 10367 tablet_bootstrap.cc:492] T 3c828ae089774fb9b0582141f4b99313 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:59.753069 10370 ts_tablet_manager.cc:1403] T e959898b2c4c4173aea107d3f090ca07 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.041s user 0.007s sys 0.002s
I20260810 19:47:59.753115 10367 ts_tablet_manager.cc:1403] T 3c828ae089774fb9b0582141f4b99313 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.113s user 0.015s sys 0.008s
I20260810 19:47:59.753353 10371 log.cc:1199] T c8602b7360b747a3af756b139635d95c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/c8602b7360b747a3af756b139635d95c
I20260810 19:47:59.753723 10371 ts_tablet_manager.cc:1950] T c8602b7360b747a3af756b139635d95c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:59.753968 10367 raft_consensus.cc:359] T 3c828ae089774fb9b0582141f4b99313 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.754172 10367 raft_consensus.cc:385] T 3c828ae089774fb9b0582141f4b99313 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:59.754226 10367 raft_consensus.cc:740] T 3c828ae089774fb9b0582141f4b99313 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:59.754501 10367 consensus_queue.cc:260] T 3c828ae089774fb9b0582141f4b99313 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.754652 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 555) took 1210 ms. Trace:
I20260810 19:47:59.754753 10371 rpcz_store.cc:276] 0810 19:47:58.543753 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.543799 (+ 46us) service_pool.cc:224] Handling call
0810 19:47:59.125037 (+581238us) ts_tablet_manager.cc:1151] Deleting tablet c8602b7360b747a3af756b139635d95c
0810 19:47:59.125048 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.146868 (+ 21820us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.149871 (+ 3003us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.754602 (+604731us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5938,"tablet-delete.queue_time_us":581054}
I20260810 19:47:59.755863 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet c8602b7360b747a3af756b139635d95c (table default.Table_e2c3250ad65342b6b93438349218f41a [id=043b4921c17c438db20e082f44e88787]) successfully deleted
I20260810 19:47:59.756592 10367 ts_tablet_manager.cc:1434] T 3c828ae089774fb9b0582141f4b99313 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:47:59.756887 10367 tablet_bootstrap.cc:492] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:59.756559 10370 raft_consensus.cc:359] T e959898b2c4c4173aea107d3f090ca07 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.758733 10367 tablet_bootstrap.cc:654] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:59.760722 10375 ts_tablet_manager.cc:1929] T dad16ea0f82942de8587dd7c98c0d2df P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:59.760875 10370 raft_consensus.cc:385] T e959898b2c4c4173aea107d3f090ca07 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:59.761011 10375 log.cc:1199] T dad16ea0f82942de8587dd7c98c0d2df P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/dad16ea0f82942de8587dd7c98c0d2df
I20260810 19:47:59.761377 10375 ts_tablet_manager.cc:1950] T dad16ea0f82942de8587dd7c98c0d2df P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:59.761360 10377 ts_tablet_manager.cc:1929] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:47:59.761471 10377 log.cc:1199] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/2d90d9c9f6524859a0e33e649dd80f7c
I20260810 19:47:59.761708 10370 raft_consensus.cc:740] T e959898b2c4c4173aea107d3f090ca07 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:59.761831 10377 ts_tablet_manager.cc:1950] T 2d90d9c9f6524859a0e33e649dd80f7c P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:59.762159 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 438) took 3653 ms. Trace:
I20260810 19:47:59.762243 10377 rpcz_store.cc:276] 0810 19:47:56.108607 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.639691 (+531084us) service_pool.cc:224] Handling call
0810 19:47:59.655906 (+3016215us) ts_tablet_manager.cc:1151] Deleting tablet 2d90d9c9f6524859a0e33e649dd80f7c
0810 19:47:59.655915 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.684841 (+ 28926us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x6160000e1d54. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd473022780 00007fd4743a9023 00007fd476f6ec67 00007fd476fa1d34 00007fd476f82750 00007fd476f824dd 0000000000aaf86c 00007fd466f6784f 00007fd466f6ab4b 00007fd466f6a9c8
0810 19:47:59.747127 (+ 62286us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.761290 (+ 14163us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.762139 (+ 849us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40549760,"tablet-delete.queue_time_us":2818380}
I20260810 19:47:59.762791 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 442) took 3653 ms. Trace:
I20260810 19:47:59.762877 10377 rpcz_store.cc:276] 0810 19:47:56.108942 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.823961 (+715019us) service_pool.cc:224] Handling call
0810 19:47:59.762633 (+2938672us) ts_tablet_manager.cc:1151] Deleting tablet 4198f46be0194875aea6a7952321bc69
0810 19:47:59.762645 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.762772 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2903882}
I20260810 19:47:59.762987 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 2d90d9c9f6524859a0e33e649dd80f7c (table default.Table_4d9757a90ce34541a2c047891e32a42c [id=cec00e7815514025aee218d41250d360]) successfully deleted
I20260810 19:47:59.763238 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 444) took 3654 ms. Trace:
I20260810 19:47:59.763304 10377 rpcz_store.cc:276] 0810 19:47:56.109147 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.837561 (+728414us) service_pool.cc:224] Handling call
0810 19:47:59.763126 (+2925565us) ts_tablet_manager.cc:1151] Deleting tablet 82c3f619c76e40c583bfcdf2bb77fe42
0810 19:47:59.763135 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.763220 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2893851}
I20260810 19:47:59.763610 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 443) took 3654 ms. Trace:
I20260810 19:47:59.763675 10377 rpcz_store.cc:276] 0810 19:47:56.109027 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.825341 (+716314us) service_pool.cc:224] Handling call
0810 19:47:59.763496 (+2938155us) ts_tablet_manager.cc:1151] Deleting tablet 45194cae6ea44d9d8cf856d256fd534f
0810 19:47:59.763505 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.763594 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2849658}
W20260810 19:47:59.763888 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 4198f46be0194875aea6a7952321bc69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4198f46be0194875aea6a7952321bc69 already in progress: creating tablet
I20260810 19:47:59.764019 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 453) took 3149 ms. Trace:
I20260810 19:47:59.764079 10377 rpcz_store.cc:276] 0810 19:47:56.614157 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.048529 (+434372us) service_pool.cc:224] Handling call
0810 19:47:59.763918 (+2715389us) ts_tablet_manager.cc:1151] Deleting tablet 05059ef70a8e440ca2988bfeb610645d
0810 19:47:59.763928 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.764004 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2715151}
W20260810 19:47:59.764189 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 82c3f619c76e40c583bfcdf2bb77fe42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82c3f619c76e40c583bfcdf2bb77fe42 already in progress: creating tablet
I20260810 19:47:59.764379 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 454) took 3142 ms. Trace:
I20260810 19:47:59.764442 10377 rpcz_store.cc:276] 0810 19:47:56.622207 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.048791 (+426584us) service_pool.cc:224] Handling call
0810 19:47:59.764283 (+2715492us) ts_tablet_manager.cc:1151] Deleting tablet 1f895bcd21f647f2ab813903d600a31a
0810 19:47:59.764291 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.764363 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2715309}
I20260810 19:47:59.764479 10370 consensus_queue.cc:260] T e959898b2c4c4173aea107d3f090ca07 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:47:59.764674 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 45194cae6ea44d9d8cf856d256fd534f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45194cae6ea44d9d8cf856d256fd534f already in progress: creating tablet
I20260810 19:47:59.764762 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 455) took 3137 ms. Trace:
I20260810 19:47:59.764822 10377 rpcz_store.cc:276] 0810 19:47:56.627099 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.048986 (+421887us) service_pool.cc:224] Handling call
0810 19:47:59.764650 (+2715664us) ts_tablet_manager.cc:1151] Deleting tablet eb3e7d34b5314bc7a7c5ed53792728ca
0810 19:47:59.764659 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.764745 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2715518}
W20260810 19:47:59.764935 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 05059ef70a8e440ca2988bfeb610645d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05059ef70a8e440ca2988bfeb610645d already in progress: creating tablet
I20260810 19:47:59.765127 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 463) took 3132 ms. Trace:
I20260810 19:47:59.765192 10377 rpcz_store.cc:276] 0810 19:47:56.632765 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.330077 (+697312us) service_pool.cc:224] Handling call
0810 19:47:59.765028 (+2434951us) ts_tablet_manager.cc:1151] Deleting tablet 0e967384768b4ec7956f1b508e8ab2af
0810 19:47:59.765037 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.765111 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2434724}
W20260810 19:47:59.765394 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 1f895bcd21f647f2ab813903d600a31a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f895bcd21f647f2ab813903d600a31a already in progress: creating tablet
I20260810 19:47:59.765491 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 464) took 3132 ms. Trace:
I20260810 19:47:59.765551 10377 rpcz_store.cc:276] 0810 19:47:56.632864 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.330402 (+697538us) service_pool.cc:224] Handling call
0810 19:47:59.765393 (+2434991us) ts_tablet_manager.cc:1151] Deleting tablet ae3e151180ae4d258d18365770acaaad
0810 19:47:59.765401 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.765475 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2409014}
W20260810 19:47:59.765645 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet eb3e7d34b5314bc7a7c5ed53792728ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb3e7d34b5314bc7a7c5ed53792728ca already in progress: creating tablet
I20260810 19:47:59.765864 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 472) took 3132 ms. Trace:
I20260810 19:47:59.765930 10377 rpcz_store.cc:276] 0810 19:47:56.633700 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.455501 (+821801us) service_pool.cc:224] Handling call
0810 19:47:59.765764 (+2310263us) ts_tablet_manager.cc:1151] Deleting tablet 39885c3e0adb4132945d507628f4f082
0810 19:47:59.765774 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.765848 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2309980}
W20260810 19:47:59.766077 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 0e967384768b4ec7956f1b508e8ab2af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e967384768b4ec7956f1b508e8ab2af already in progress: creating tablet
I20260810 19:47:59.766180 10377 tablet_replica.cc:333] T 4d654dada92a4939914d26ab72a5f5e8 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
W20260810 19:47:59.766508 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet ae3e151180ae4d258d18365770acaaad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae3e151180ae4d258d18365770acaaad already in progress: creating tablet
I20260810 19:47:59.766623 11607 raft_consensus.cc:493] T 21208dd824fe432fa307cbb88d37aaa2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 19:47:59.766775 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 39885c3e0adb4132945d507628f4f082 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39885c3e0adb4132945d507628f4f082 already in progress: creating tablet
I20260810 19:47:59.766774 11607 raft_consensus.cc:515] T 21208dd824fe432fa307cbb88d37aaa2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.767457 11607 leader_election.cc:290] T 21208dd824fe432fa307cbb88d37aaa2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:59.768235 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21208dd824fe432fa307cbb88d37aaa2" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:47:59.768908 9611 leader_election.cc:343] T 21208dd824fe432fa307cbb88d37aaa2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.769613 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21208dd824fe432fa307cbb88d37aaa2" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:59.770128 9611 leader_election.cc:343] T 21208dd824fe432fa307cbb88d37aaa2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.770239 9611 leader_election.cc:304] T 21208dd824fe432fa307cbb88d37aaa2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:59.770646 11607 raft_consensus.cc:2749] T 21208dd824fe432fa307cbb88d37aaa2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:59.771055 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 556) took 1072 ms. Trace:
I20260810 19:47:59.771150 10371 rpcz_store.cc:276] 0810 19:47:58.698495 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.698560 (+ 65us) service_pool.cc:224] Handling call
0810 19:47:59.755139 (+1056579us) ts_tablet_manager.cc:1151] Deleting tablet 55fb03a8dd3b40f5ba3de41fa7c01f5d
0810 19:47:59.755149 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.771032 (+ 15883us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1056304}
I20260810 19:47:59.771557 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 557) took 1062 ms. Trace:
I20260810 19:47:59.771646 10371 rpcz_store.cc:276] 0810 19:47:58.709169 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.709234 (+ 65us) service_pool.cc:224] Handling call
0810 19:47:59.771432 (+1062198us) ts_tablet_manager.cc:1151] Deleting tablet 0bddaf5b5fc1404e83b079ffa97e7321
0810 19:47:59.771445 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.771540 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1061914}
I20260810 19:47:59.772002 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 558) took 1061 ms. Trace:
I20260810 19:47:59.772073 10370 ts_tablet_manager.cc:1434] T e959898b2c4c4173aea107d3f090ca07 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20260810 19:47:59.772081 10371 rpcz_store.cc:276] 0810 19:47:58.710113 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.710165 (+ 52us) service_pool.cc:224] Handling call
0810 19:47:59.771901 (+1061736us) ts_tablet_manager.cc:1151] Deleting tablet 7de27c3442584746b76ea838d38f0b9b
0810 19:47:59.771911 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.771986 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1061476}
I20260810 19:47:59.773393 10371 tablet_replica.cc:333] T 08e29e23d54f47968a06be98b313918d P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:59.773586 10370 tablet_bootstrap.cc:492] T c7235af514fa47d899d7e38ee5662f6c P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:59.773592 10371 raft_consensus.cc:2243] T 08e29e23d54f47968a06be98b313918d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:59.773761 10371 raft_consensus.cc:2272] T 08e29e23d54f47968a06be98b313918d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:47:59.773726 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 55fb03a8dd3b40f5ba3de41fa7c01f5d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 55fb03a8dd3b40f5ba3de41fa7c01f5d already in progress: creating tablet
W20260810 19:47:59.774003 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 0bddaf5b5fc1404e83b079ffa97e7321 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0bddaf5b5fc1404e83b079ffa97e7321 already in progress: creating tablet
W20260810 19:47:59.774359 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 7de27c3442584746b76ea838d38f0b9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7de27c3442584746b76ea838d38f0b9b already in progress: creating tablet
I20260810 19:47:59.774470 10367 tablet_bootstrap.cc:492] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:59.774614 10367 ts_tablet_manager.cc:1403] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.001s
W20260810 19:47:59.774753 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet b2034784996149158c10b868f61ff418 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2034784996149158c10b868f61ff418 already in progress: creating tablet
W20260810 19:47:59.775040 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet cb2c9782c034435088f991bef8edf288 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb2c9782c034435088f991bef8edf288 already in progress: creating tablet
W20260810 19:47:59.775310 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 6ea318eddd8349a79d27ce5746f03798 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ea318eddd8349a79d27ce5746f03798 already in progress: creating tablet
W20260810 19:47:59.775599 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 3109703c51e54af78b58e9bbca50af33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3109703c51e54af78b58e9bbca50af33 already in progress: creating tablet
I20260810 19:47:59.775575 10367 raft_consensus.cc:359] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.775755 10367 raft_consensus.cc:385] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:59.775813 10367 raft_consensus.cc:740] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
W20260810 19:47:59.776065 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 4c75af1e592042f5a4d442b82a539c94 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4c75af1e592042f5a4d442b82a539c94 already in progress: creating tablet
I20260810 19:47:59.776019 10367 consensus_queue.cc:260] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.776611 10367 ts_tablet_manager.cc:1434] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:47:59.776902 10367 tablet_bootstrap.cc:492] T 4e80e2327c394612bffc51f38798dac3 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
W20260810 19:47:59.776429 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 31c2b9a4b8334e678b4632fc2f58dd0c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31c2b9a4b8334e678b4632fc2f58dd0c already in progress: creating tablet
I20260810 19:47:59.778796 10367 tablet_bootstrap.cc:654] T 4e80e2327c394612bffc51f38798dac3 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:59.780936 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cbcaa7106df24aaeb07428b7b590e282 consensus state has no leader
I20260810 19:47:59.782258 10371 ts_tablet_manager.cc:1916] T 08e29e23d54f47968a06be98b313918d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:59.785204 10366 tablet_bootstrap.cc:492] T 06af03c8a87141febef768bd56c72c39 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:59.785487 10366 ts_tablet_manager.cc:1403] T 06af03c8a87141febef768bd56c72c39 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.225s user 0.005s sys 0.005s
I20260810 19:47:59.788386 10377 raft_consensus.cc:2243] T 4d654dada92a4939914d26ab72a5f5e8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:59.788655 10377 raft_consensus.cc:2272] T 4d654dada92a4939914d26ab72a5f5e8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:59.789311 10377 ts_tablet_manager.cc:1916] T 4d654dada92a4939914d26ab72a5f5e8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:59.789645 10366 raft_consensus.cc:359] T 06af03c8a87141febef768bd56c72c39 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.791296 10366 raft_consensus.cc:385] T 06af03c8a87141febef768bd56c72c39 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:59.791421 10366 raft_consensus.cc:740] T 06af03c8a87141febef768bd56c72c39 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:47:59.798516 10366 consensus_queue.cc:260] T 06af03c8a87141febef768bd56c72c39 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.801445 10370 tablet_bootstrap.cc:654] T c7235af514fa47d899d7e38ee5662f6c P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:59.803115 10366 ts_tablet_manager.cc:1434] T 06af03c8a87141febef768bd56c72c39 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260810 19:47:59.803644 10366 tablet_bootstrap.cc:492] T f8e4de89977b4caf91b2c0a49d147d17 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:47:59.807561 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 423) took 3660 ms. Trace:
I20260810 19:47:59.807708 10375 rpcz_store.cc:276] 0810 19:47:56.116498 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.853174 (+736676us) service_pool.cc:224] Handling call
0810 19:47:59.731863 (+2878689us) ts_tablet_manager.cc:1151] Deleting tablet dad16ea0f82942de8587dd7c98c0d2df
0810 19:47:59.731875 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.752172 (+ 20297us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.760637 (+ 8465us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.777130 (+ 16493us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2832215}
I20260810 19:47:59.808411 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet dad16ea0f82942de8587dd7c98c0d2df (table default.Table_59b5d4d82ac044e0a101d8f598a44e43 [id=4fde0c720763432cac09c13172372936]) successfully deleted
I20260810 19:47:59.811462 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 428) took 3677 ms. Trace:
I20260810 19:47:59.812425 10375 rpcz_store.cc:276] 0810 19:47:56.134442 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.899685 (+765243us) service_pool.cc:224] Handling call
0810 19:47:59.811242 (+2911557us) ts_tablet_manager.cc:1151] Deleting tablet 4198f46be0194875aea6a7952321bc69
0810 19:47:59.811255 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.811410 (+ 155us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2911353}
W20260810 19:47:59.813409 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 4198f46be0194875aea6a7952321bc69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4198f46be0194875aea6a7952321bc69 already in progress: creating tablet
I20260810 19:47:59.813627 10375 tablet_replica.cc:333] T 45194cae6ea44d9d8cf856d256fd534f P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:59.813880 10375 raft_consensus.cc:2243] T 45194cae6ea44d9d8cf856d256fd534f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:59.814101 10375 raft_consensus.cc:2272] T 45194cae6ea44d9d8cf856d256fd534f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:59.814702 10375 ts_tablet_manager.cc:1916] T 45194cae6ea44d9d8cf856d256fd534f P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:47:59.822254 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 81f0f3f88d26432fbadc5e90aaa5d158 consensus state has no leader
I20260810 19:47:59.824216 10371 ts_tablet_manager.cc:1929] T 08e29e23d54f47968a06be98b313918d P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:59.824379 10371 log.cc:1199] T 08e29e23d54f47968a06be98b313918d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/08e29e23d54f47968a06be98b313918d
I20260810 19:47:59.824725 10371 ts_tablet_manager.cc:1950] T 08e29e23d54f47968a06be98b313918d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:59.824935 10370 tablet_bootstrap.cc:492] T c7235af514fa47d899d7e38ee5662f6c P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:59.825137 10370 ts_tablet_manager.cc:1403] T c7235af514fa47d899d7e38ee5662f6c P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.052s user 0.005s sys 0.000s
I20260810 19:47:59.825814 10371 tablet_replica.cc:333] T 0d79ef93c5bf4ac9895e594198edb251 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:59.826016 10371 raft_consensus.cc:2243] T 0d79ef93c5bf4ac9895e594198edb251 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:59.826181 10371 raft_consensus.cc:2272] T 0d79ef93c5bf4ac9895e594198edb251 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:59.826481 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 08e29e23d54f47968a06be98b313918d (table default.Table_688c01e53a344393b3471974bad3b972 [id=7112ce97719c47919a3d24d1af7d07cd]) successfully deleted
I20260810 19:47:59.829303 10377 ts_tablet_manager.cc:1929] T 4d654dada92a4939914d26ab72a5f5e8 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260810 19:47:59.829705 10377 log.cc:1199] T 4d654dada92a4939914d26ab72a5f5e8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/4d654dada92a4939914d26ab72a5f5e8
I20260810 19:47:59.830348 10377 ts_tablet_manager.cc:1950] T 4d654dada92a4939914d26ab72a5f5e8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:59.832439 10370 raft_consensus.cc:359] T c7235af514fa47d899d7e38ee5662f6c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.832712 10370 raft_consensus.cc:385] T c7235af514fa47d899d7e38ee5662f6c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:59.832819 10370 raft_consensus.cc:740] T c7235af514fa47d899d7e38ee5662f6c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:59.833173 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 473) took 2592 ms. Trace:
I20260810 19:47:59.833520 10377 rpcz_store.cc:276] 0810 19:47:57.240673 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.460979 (+220306us) service_pool.cc:224] Handling call
0810 19:47:59.766134 (+2305155us) ts_tablet_manager.cc:1151] Deleting tablet 4d654dada92a4939914d26ab72a5f5e8
0810 19:47:59.766143 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.796840 (+ 30697us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.828836 (+ 31996us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.833149 (+ 4313us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2304386}
I20260810 19:47:59.834345 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 471) took 3200 ms. Trace:
I20260810 19:47:59.834829 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 4d654dada92a4939914d26ab72a5f5e8 (table default.Table_551b211882fd4d67ba96228b8f0826e1 [id=a8bdf6ea608f4279971af4c9eff71db6]) successfully deleted
I20260810 19:47:59.834565 10370 consensus_queue.cc:260] T c7235af514fa47d899d7e38ee5662f6c P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.837149 10370 ts_tablet_manager.cc:1434] T c7235af514fa47d899d7e38ee5662f6c P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20260810 19:47:59.837752 10377 rpcz_store.cc:276] 0810 19:47:56.633617 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.405051 (+771434us) service_pool.cc:224] Handling call
0810 19:47:59.834186 (+2429135us) ts_tablet_manager.cc:1151] Deleting tablet 3680db3f1a5945a89c1198eb4849e58c
0810 19:47:59.834198 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.834303 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2337342}
I20260810 19:47:59.838744 10370 tablet_bootstrap.cc:492] T f8e4de89977b4caf91b2c0a49d147d17 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:47:59.838759 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 3680db3f1a5945a89c1198eb4849e58c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3680db3f1a5945a89c1198eb4849e58c already in progress: creating tablet
I20260810 19:47:59.839392 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 481) took 2597 ms. Trace:
I20260810 19:47:59.839929 10377 rpcz_store.cc:276] 0810 19:47:57.241453 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.496891 (+255438us) service_pool.cc:224] Handling call
0810 19:47:59.839239 (+2342348us) ts_tablet_manager.cc:1151] Deleting tablet 8d93821ff46a4096a8ebbac83faabed7
0810 19:47:59.839254 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.839371 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2303501}
W20260810 19:47:59.840814 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 8d93821ff46a4096a8ebbac83faabed7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d93821ff46a4096a8ebbac83faabed7 already in progress: creating tablet
I20260810 19:47:59.840970 10370 tablet_bootstrap.cc:654] T f8e4de89977b4caf91b2c0a49d147d17 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:59.841440 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 482) took 2599 ms. Trace:
I20260810 19:47:59.841917 10377 rpcz_store.cc:276] 0810 19:47:57.241513 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.516064 (+274551us) service_pool.cc:224] Handling call
0810 19:47:59.841289 (+2325225us) ts_tablet_manager.cc:1151] Deleting tablet 48eee4ce10114021855075812e356652
0810 19:47:59.841303 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.841417 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2280563}
W20260810 19:47:59.847081 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 48eee4ce10114021855075812e356652 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 48eee4ce10114021855075812e356652 already in progress: creating tablet
I20260810 19:47:59.851188 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 483) took 2609 ms. Trace:
I20260810 19:47:59.851436 10377 rpcz_store.cc:276] 0810 19:47:57.241574 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.535814 (+294240us) service_pool.cc:224] Handling call
0810 19:47:59.851049 (+2315235us) ts_tablet_manager.cc:1151] Deleting tablet 749cea5cd8f842b891f4e2cab07c054e
0810 19:47:59.851060 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.851163 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2202192}
I20260810 19:47:59.852070 10366 tablet_bootstrap.cc:654] T f8e4de89977b4caf91b2c0a49d147d17 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:47:59.852201 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 749cea5cd8f842b891f4e2cab07c054e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 749cea5cd8f842b891f4e2cab07c054e already in progress: creating tablet
I20260810 19:47:59.852744 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 484) took 2611 ms. Trace:
I20260810 19:47:59.855547 10377 rpcz_store.cc:276] 0810 19:47:57.241707 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.546307 (+304600us) service_pool.cc:224] Handling call
0810 19:47:59.852622 (+2306315us) ts_tablet_manager.cc:1151] Deleting tablet ee5f38d91bb349a9ae1da8ba69d2ddbc
0810 19:47:59.852634 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.852725 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2155701}
I20260810 19:47:59.856046 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 493) took 2613 ms. Trace:
I20260810 19:47:59.856194 10377 rpcz_store.cc:276] 0810 19:47:57.242553 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.937247 (+694694us) service_pool.cc:224] Handling call
0810 19:47:59.855920 (+1918673us) ts_tablet_manager.cc:1151] Deleting tablet 9b40fd0d57ea4b71aeef2d66f4958ac8
0810 19:47:59.855930 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.856026 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1903886}
I20260810 19:47:59.856308 10367 tablet_bootstrap.cc:492] T 4e80e2327c394612bffc51f38798dac3 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:59.856489 10367 ts_tablet_manager.cc:1403] T 4e80e2327c394612bffc51f38798dac3 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.080s user 0.009s sys 0.000s
I20260810 19:47:59.856715 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 499) took 2613 ms. Trace:
I20260810 19:47:59.856838 10377 rpcz_store.cc:276] 0810 19:47:57.243123 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.072385 (+829262us) service_pool.cc:224] Handling call
0810 19:47:59.856599 (+1784214us) ts_tablet_manager.cc:1151] Deleting tablet b5f30148b5c84f7cbdfabd0186611cc4
0810 19:47:59.856610 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.856696 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1749978}
I20260810 19:47:59.857478 10367 raft_consensus.cc:359] T 4e80e2327c394612bffc51f38798dac3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.857692 10367 raft_consensus.cc:385] T 4e80e2327c394612bffc51f38798dac3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 19:47:59.857686 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet ee5f38d91bb349a9ae1da8ba69d2ddbc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee5f38d91bb349a9ae1da8ba69d2ddbc already in progress: creating tablet
I20260810 19:47:59.857762 10367 raft_consensus.cc:740] T 4e80e2327c394612bffc51f38798dac3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:59.857846 10377 tablet_replica.cc:333] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
W20260810 19:47:59.858029 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 9b40fd0d57ea4b71aeef2d66f4958ac8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b40fd0d57ea4b71aeef2d66f4958ac8 already in progress: creating tablet
I20260810 19:47:59.858078 10377 raft_consensus.cc:2243] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:59.858017 10367 consensus_queue.cc:260] T 4e80e2327c394612bffc51f38798dac3 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.858338 10377 pending_rounds.cc:70] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691: Trying to abort 1 pending ops.
W20260810 19:47:59.858340 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet b5f30148b5c84f7cbdfabd0186611cc4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5f30148b5c84f7cbdfabd0186611cc4 already in progress: creating tablet
I20260810 19:47:59.858393 10377 pending_rounds.cc:77] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058679310397440 op_type: NO_OP noop_request { }
I20260810 19:47:59.858489 10377 raft_consensus.cc:2889] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:47:59.858573 10377 raft_consensus.cc:2272] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:59.859447 10377 ts_tablet_manager.cc:1916] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:59.860211 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9209b00d101f4479bd6324c62bff3a29" } modify_external_catalogs: true
I20260810 19:47:59.860414 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9209b00d101f4479bd6324c62bff3a29" } modify_external_catalogs: true
I20260810 19:47:59.860884 10375 ts_tablet_manager.cc:1929] T 45194cae6ea44d9d8cf856d256fd534f P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:59.861033 9894 tablet_service.cc:1558] Processing DeleteTablet for tablet 7737acd216204209ba0327e26e85cfe6 with delete_type TABLET_DATA_DELETED (replaced by tablet 5654c48929564a96a55ed0444c9e1a04) from {username='slave'} at 127.0.0.1:38276
I20260810 19:47:59.861150 10375 log.cc:1199] T 45194cae6ea44d9d8cf856d256fd534f P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/45194cae6ea44d9d8cf856d256fd534f
I20260810 19:47:59.861758 10375 ts_tablet_manager.cc:1950] T 45194cae6ea44d9d8cf856d256fd534f P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:47:59.862833 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 429) took 3719 ms. Trace:
I20260810 19:47:59.863029 10375 rpcz_store.cc:276] 0810 19:47:56.144041 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.899902 (+755861us) service_pool.cc:224] Handling call
0810 19:47:59.813516 (+2913614us) ts_tablet_manager.cc:1151] Deleting tablet 45194cae6ea44d9d8cf856d256fd534f
0810 19:47:59.813530 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.830289 (+ 16759us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.860742 (+ 30453us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.862784 (+ 2042us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2912599}
I20260810 19:47:59.863704 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 45194cae6ea44d9d8cf856d256fd534f (table default.Table_77e7389c3161415c96dd7dcbe6b2a829 [id=cf61b40b912d40368890dc6dfc5d1162]) successfully deleted
I20260810 19:47:59.864282 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 430) took 3719 ms. Trace:
I20260810 19:47:59.864455 10371 ts_tablet_manager.cc:1916] T 0d79ef93c5bf4ac9895e594198edb251 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:59.867173 10375 rpcz_store.cc:276] 0810 19:47:56.145506 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.900938 (+755432us) service_pool.cc:224] Handling call
0810 19:47:59.864087 (+2963149us) ts_tablet_manager.cc:1151] Deleting tablet 82c3f619c76e40c583bfcdf2bb77fe42
0810 19:47:59.864101 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.864243 (+ 142us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2962984}
W20260810 19:47:59.867909 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 82c3f619c76e40c583bfcdf2bb77fe42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82c3f619c76e40c583bfcdf2bb77fe42 already in progress: creating tablet
I20260810 19:47:59.868501 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 425) took 3739 ms. Trace:
I20260810 19:47:59.868680 10375 rpcz_store.cc:276] 0810 19:47:56.129523 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.866492 (+736969us) service_pool.cc:224] Handling call
0810 19:47:59.868299 (+3001807us) ts_tablet_manager.cc:1151] Deleting tablet a78960e1f2164c848297411b9273ac64
0810 19:47:59.868313 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.868458 (+ 145us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2944400}
W20260810 19:47:59.869374 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet a78960e1f2164c848297411b9273ac64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a78960e1f2164c848297411b9273ac64 already in progress: creating tablet
I20260810 19:47:59.869961 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 438) took 3625 ms. Trace:
I20260810 19:47:59.870146 10375 rpcz_store.cc:276] 0810 19:47:56.244186 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.927945 (+683759us) service_pool.cc:224] Handling call
0810 19:47:59.869786 (+2941841us) ts_tablet_manager.cc:1151] Deleting tablet 05059ef70a8e440ca2988bfeb610645d
0810 19:47:59.869800 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.869921 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2941530}
W20260810 19:47:59.870824 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 05059ef70a8e440ca2988bfeb610645d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05059ef70a8e440ca2988bfeb610645d already in progress: creating tablet
I20260810 19:47:59.871399 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 439) took 3627 ms. Trace:
I20260810 19:47:59.871503 10370 tablet_bootstrap.cc:492] T f8e4de89977b4caf91b2c0a49d147d17 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:59.871690 10370 ts_tablet_manager.cc:1403] T f8e4de89977b4caf91b2c0a49d147d17 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.002s
I20260810 19:47:59.871753 10371 ts_tablet_manager.cc:1929] T 0d79ef93c5bf4ac9895e594198edb251 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:59.871902 10371 log.cc:1199] T 0d79ef93c5bf4ac9895e594198edb251 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/0d79ef93c5bf4ac9895e594198edb251
I20260810 19:47:59.872192 10371 ts_tablet_manager.cc:1950] T 0d79ef93c5bf4ac9895e594198edb251 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:59.872711 10370 raft_consensus.cc:359] T f8e4de89977b4caf91b2c0a49d147d17 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.872972 10370 raft_consensus.cc:385] T f8e4de89977b4caf91b2c0a49d147d17 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:59.873085 10370 raft_consensus.cc:740] T f8e4de89977b4caf91b2c0a49d147d17 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:59.873185 10371 tablet_replica.cc:333] T ee65b2c9980d4c77af8c68bf2f5c5f92 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:47:59.873404 10371 raft_consensus.cc:2243] T ee65b2c9980d4c77af8c68bf2f5c5f92 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:47:59.873559 10371 raft_consensus.cc:2272] T ee65b2c9980d4c77af8c68bf2f5c5f92 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:59.873381 10370 consensus_queue.cc:260] T f8e4de89977b4caf91b2c0a49d147d17 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.874732 11607 raft_consensus.cc:493] T a5625dc6303d44c6be28abd6278ce034 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:59.874876 11607 raft_consensus.cc:515] T a5625dc6303d44c6be28abd6278ce034 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.876086 10370 ts_tablet_manager.cc:1434] T f8e4de89977b4caf91b2c0a49d147d17 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260810 19:47:59.876322 10371 ts_tablet_manager.cc:1916] T ee65b2c9980d4c77af8c68bf2f5c5f92 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:59.876442 10370 tablet_bootstrap.cc:492] T dd632a01fe424a3a956d445ce01e31d2 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:47:59.878625 10370 tablet_bootstrap.cc:654] T dd632a01fe424a3a956d445ce01e31d2 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:59.881313 10370 tablet_bootstrap.cc:492] T dd632a01fe424a3a956d445ce01e31d2 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:47:59.881520 10370 ts_tablet_manager.cc:1403] T dd632a01fe424a3a956d445ce01e31d2 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260810 19:47:59.882576 10370 raft_consensus.cc:359] T dd632a01fe424a3a956d445ce01e31d2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.882836 10370 raft_consensus.cc:385] T dd632a01fe424a3a956d445ce01e31d2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:59.882926 10370 raft_consensus.cc:740] T dd632a01fe424a3a956d445ce01e31d2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:47:59.883246 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5625dc6303d44c6be28abd6278ce034" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:59.883769 11607 leader_election.cc:290] T a5625dc6303d44c6be28abd6278ce034 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:47:59.883947 9611 leader_election.cc:343] T a5625dc6303d44c6be28abd6278ce034 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.883949 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5625dc6303d44c6be28abd6278ce034" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:59.884449 9611 leader_election.cc:343] T a5625dc6303d44c6be28abd6278ce034 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.884560 9611 leader_election.cc:304] T a5625dc6303d44c6be28abd6278ce034 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:59.884603 10367 ts_tablet_manager.cc:1434] T 4e80e2327c394612bffc51f38798dac3 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.028s user 0.000s sys 0.003s
I20260810 19:47:59.884986 10367 tablet_bootstrap.cc:492] T 476e762e46c04ae6bfef5e14df2d16e2 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:59.871621 10375 rpcz_store.cc:276] 0810 19:47:56.244265 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.928275 (+684010us) service_pool.cc:224] Handling call
0810 19:47:59.871228 (+2942953us) ts_tablet_manager.cc:1151] Deleting tablet 1f895bcd21f647f2ab813903d600a31a
0810 19:47:59.871240 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.871354 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2942688}
W20260810 19:47:59.886581 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 1f895bcd21f647f2ab813903d600a31a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f895bcd21f647f2ab813903d600a31a already in progress: creating tablet
I20260810 19:47:59.886991 10367 tablet_bootstrap.cc:654] T 476e762e46c04ae6bfef5e14df2d16e2 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:59.887487 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 441) took 3618 ms. Trace:
I20260810 19:47:59.888084 11724 raft_consensus.cc:2749] T a5625dc6303d44c6be28abd6278ce034 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:59.888445 10375 rpcz_store.cc:276] 0810 19:47:56.269365 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:56.939132 (+669767us) service_pool.cc:224] Handling call
0810 19:47:59.887286 (+2948154us) ts_tablet_manager.cc:1151] Deleting tablet eb3e7d34b5314bc7a7c5ed53792728ca
0810 19:47:59.887303 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.887445 (+ 142us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2947808}
W20260810 19:47:59.889982 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet eb3e7d34b5314bc7a7c5ed53792728ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb3e7d34b5314bc7a7c5ed53792728ca already in progress: creating tablet
I20260810 19:47:59.890401 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 0d79ef93c5bf4ac9895e594198edb251 (table default.Table_949bcc619f4b45189db61b24b5598e66 [id=ed1551c0accc41eead911b83ee4c0a6f]) successfully deleted
I20260810 19:47:59.890848 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 448) took 3373 ms. Trace:
I20260810 19:47:59.894640 10375 rpcz_store.cc:276] 0810 19:47:56.517114 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.059438 (+542324us) service_pool.cc:224] Handling call
0810 19:47:59.890658 (+2831220us) ts_tablet_manager.cc:1151] Deleting tablet 0e967384768b4ec7956f1b508e8ab2af
0810 19:47:59.890673 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.890809 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2816890}
W20260810 19:47:59.895690 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 0e967384768b4ec7956f1b508e8ab2af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e967384768b4ec7956f1b508e8ab2af already in progress: creating tablet
I20260810 19:47:59.896356 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 449) took 3379 ms. Trace:
I20260810 19:47:59.896639 10371 ts_tablet_manager.cc:1929] T ee65b2c9980d4c77af8c68bf2f5c5f92 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:47:59.896780 10371 log.cc:1199] T ee65b2c9980d4c77af8c68bf2f5c5f92 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/ee65b2c9980d4c77af8c68bf2f5c5f92
I20260810 19:47:59.897121 10371 ts_tablet_manager.cc:1950] T ee65b2c9980d4c77af8c68bf2f5c5f92 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:47:59.897027 10375 rpcz_store.cc:276] 0810 19:47:56.517269 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.072073 (+554804us) service_pool.cc:224] Handling call
0810 19:47:59.896174 (+2824101us) ts_tablet_manager.cc:1151] Deleting tablet ae3e151180ae4d258d18365770acaaad
0810 19:47:59.896190 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.896316 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2775832}
W20260810 19:47:59.897933 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet ae3e151180ae4d258d18365770acaaad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae3e151180ae4d258d18365770acaaad already in progress: creating tablet
I20260810 19:47:59.898599 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 457) took 3380 ms. Trace:
I20260810 19:47:59.899183 10375 rpcz_store.cc:276] 0810 19:47:56.517933 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.131306 (+613373us) service_pool.cc:224] Handling call
0810 19:47:59.898430 (+2767124us) ts_tablet_manager.cc:1151] Deleting tablet 3680db3f1a5945a89c1198eb4849e58c
0810 19:47:59.898444 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.898559 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2749654}
W20260810 19:47:59.900064 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 3680db3f1a5945a89c1198eb4849e58c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3680db3f1a5945a89c1198eb4849e58c already in progress: creating tablet
I20260810 19:47:59.900640 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 458) took 3382 ms. Trace:
I20260810 19:47:59.901190 10375 rpcz_store.cc:276] 0810 19:47:56.518065 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.133677 (+615612us) service_pool.cc:224] Handling call
0810 19:47:59.900466 (+2766789us) ts_tablet_manager.cc:1151] Deleting tablet 39885c3e0adb4132945d507628f4f082
0810 19:47:59.900480 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.900603 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2723892}
I20260810 19:47:59.903676 9420 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 63b649cbc1d141d8bb438105b8e8537c (table default.Table_b059137abb0e458bbadca41a2f2e8b50 [id=9eaa5e14e854425e8971160c64ee97cf]). Expected version 1 got 0
I20260810 19:47:59.904515 11724 raft_consensus.cc:493] T d2c77a8ac1614bb286e4e168bcf999f3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:59.904685 11724 raft_consensus.cc:515] T d2c77a8ac1614bb286e4e168bcf999f3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.905439 11724 leader_election.cc:290] T d2c77a8ac1614bb286e4e168bcf999f3 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:59.905783 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_19afc4f535124fd2bfe0e8a019a8a86e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:47:59.909904 10377 ts_tablet_manager.cc:1929] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260810 19:47:59.910171 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 39885c3e0adb4132945d507628f4f082 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39885c3e0adb4132945d507628f4f082 already in progress: creating tablet
I20260810 19:47:59.910431 11518 raft_consensus.cc:493] T f8e4de89977b4caf91b2c0a49d147d17 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:59.910638 11518 raft_consensus.cc:515] T f8e4de89977b4caf91b2c0a49d147d17 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.910835 10377 log.cc:1199] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/6f0150de0d60425b807be532ce0ba6c3
I20260810 19:47:59.910912 10375 tablet_replica.cc:333] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:47:59.911171 10375 raft_consensus.cc:2243] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:47:59.911258 10377 ts_tablet_manager.cc:1950] T 6f0150de0d60425b807be532ce0ba6c3 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:47:59.911509 11518 leader_election.cc:290] T f8e4de89977b4caf91b2c0a49d147d17 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:59.911597 10375 raft_consensus.cc:2272] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:47:59.911623 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 506) took 2582 ms. Trace:
I20260810 19:47:59.912250 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2c77a8ac1614bb286e4e168bcf999f3" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:47:59.913684 9611 leader_election.cc:343] T d2c77a8ac1614bb286e4e168bcf999f3 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.915114 10375 ts_tablet_manager.cc:1916] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:47:59.916380 10367 tablet_bootstrap.cc:492] T 476e762e46c04ae6bfef5e14df2d16e2 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:59.916550 10367 ts_tablet_manager.cc:1403] T 476e762e46c04ae6bfef5e14df2d16e2 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.000s
I20260810 19:47:59.917151 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 4b1224d4d9ed48f2806ec353f1e59de9 (DEFAULT_TABLE table=default.Table_5fd992f1afe5496eb8ca25a8409e3348 [id=1a682e5ba0f144e6bd5ec42e1a1677f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.917622 10367 raft_consensus.cc:359] T 476e762e46c04ae6bfef5e14df2d16e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.917826 10367 raft_consensus.cc:385] T 476e762e46c04ae6bfef5e14df2d16e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:59.917891 10367 raft_consensus.cc:740] T 476e762e46c04ae6bfef5e14df2d16e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:59.918151 10367 consensus_queue.cc:260] T 476e762e46c04ae6bfef5e14df2d16e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.918807 10367 ts_tablet_manager.cc:1434] T 476e762e46c04ae6bfef5e14df2d16e2 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 19:47:59.919166 10367 tablet_bootstrap.cc:492] T 9fb544dff4eb4642b7e282657ae15d19 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:59.920565 9412 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 81720b897a674b5380c6469d1600a979 (table default.Table_e4aeb59e91c24097bac9517b3c62b75a [id=8d7f043045ff44cd886367b5860f8433]). Expected version 1 got 0
I20260810 19:47:59.921134 10367 tablet_bootstrap.cc:654] T 9fb544dff4eb4642b7e282657ae15d19 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:59.920925 9412 catalog_manager.cc:5719] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195). New cstate: current_term: 1 leader_uuid: "eadde59fd6504d679e47f03a60c64bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: HEALTHY } } }
I20260810 19:47:59.921346 9412 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d (table default.Table_5e6891ff4aa040be8b327aafa596bc7e [id=fd840f00bdc5477aaad0b7fa114870dd]). Expected version 1 got 0
W20260810 19:47:59.922518 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19afc4f535124fd2bfe0e8a019a8a86e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:47:59.912221 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2c77a8ac1614bb286e4e168bcf999f3" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:59.923164 10377 rpcz_store.cc:276] 0810 19:47:57.339428 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.089670 (+750242us) service_pool.cc:224] Handling call
0810 19:47:59.857137 (+1767467us) ts_tablet_manager.cc:1151] Deleting tablet 6f0150de0d60425b807be532ce0ba6c3
0810 19:47:59.857792 (+ 655us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.906274 (+ 48482us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.909822 (+ 3548us) tablet_metadata.cc:665] Metadata flushed
0810 19:47:59.911604 (+ 1782us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1749182}
I20260810 19:47:59.913534 11561 raft_consensus.cc:493] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:59.923563 11561 raft_consensus.cc:515] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.923791 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 6f0150de0d60425b807be532ce0ba6c3 (table default.Table_336441014db542c6ba0f204ef41d4747 [id=c9d6f79ab23248c69ee6d6984f6fd55c]) successfully deleted
I20260810 19:47:59.924333 11561 leader_election.cc:290] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:59.924491 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 502) took 2681 ms. Trace:
I20260810 19:47:59.924562 10377 rpcz_store.cc:276] 0810 19:47:57.243503 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.085215 (+841712us) service_pool.cc:224] Handling call
0810 19:47:59.924352 (+1839137us) ts_tablet_manager.cc:1151] Deleting tablet 3520274768ed41abb010bb109127affa
0810 19:47:59.924366 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.924472 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1815716}
I20260810 19:47:59.924913 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 503) took 2655 ms. Trace:
I20260810 19:47:59.924988 10377 rpcz_store.cc:276] 0810 19:47:57.269406 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.085595 (+816189us) service_pool.cc:224] Handling call
0810 19:47:59.924794 (+1839199us) ts_tablet_manager.cc:1151] Deleting tablet f5fa6060b9ef48cea6830cd9d19424ea
0810 19:47:59.924806 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.924896 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1815996}
W20260810 19:47:59.925273 9611 leader_election.cc:343] T d2c77a8ac1614bb286e4e168bcf999f3 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.925400 9611 leader_election.cc:304] T d2c77a8ac1614bb286e4e168bcf999f3 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:59.925665 11724 raft_consensus.cc:2749] T d2c77a8ac1614bb286e4e168bcf999f3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:47:59.925941 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 3520274768ed41abb010bb109127affa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3520274768ed41abb010bb109127affa already in progress: creating tablet
W20260810 19:47:59.926237 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet f5fa6060b9ef48cea6830cd9d19424ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5fa6060b9ef48cea6830cd9d19424ea already in progress: creating tablet
I20260810 19:47:59.914739 10366 tablet_bootstrap.cc:492] T f8e4de89977b4caf91b2c0a49d147d17 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:47:59.914772 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e4de89977b4caf91b2c0a49d147d17" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:59.927940 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 500) took 2684 ms. Trace:
I20260810 19:47:59.928020 10366 ts_tablet_manager.cc:1403] T f8e4de89977b4caf91b2c0a49d147d17 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.124s user 0.003s sys 0.002s
I20260810 19:47:59.916071 9894 tablet_service.cc:1511] Processing CreateTablet for tablet 4b1224d4d9ed48f2806ec353f1e59de9 (DEFAULT_TABLE table=default.Table_5fd992f1afe5496eb8ca25a8409e3348 [id=1a682e5ba0f144e6bd5ec42e1a1677f2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:59.928525 9831 leader_election.cc:343] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: d99b34f901484fad87cff4bb9ab56fc8
I20260810 19:47:59.928943 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b1224d4d9ed48f2806ec353f1e59de9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.929602 11726 raft_consensus.cc:493] T 971e9abee86444a7a9e923b0962ae751 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:59.929755 11726 raft_consensus.cc:515] T 971e9abee86444a7a9e923b0962ae751 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.929827 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 0df786b887de4d7dbf1881e4944e3b68 (DEFAULT_TABLE table=default.Table_9209b00d101f4479bd6324c62bff3a29 [id=bd31a4d390594b77aa46929c4799231a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.930234 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0df786b887de4d7dbf1881e4944e3b68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.930356 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet ee65b2c9980d4c77af8c68bf2f5c5f92 (table default.Table_2784ff35cf7944ada0cefff31407d65d [id=77e412a6dedf44a3a69b72b6a9d017aa]) successfully deleted
I20260810 19:47:59.930868 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971e9abee86444a7a9e923b0962ae751" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:47:59.931460 9611 leader_election.cc:343] T 971e9abee86444a7a9e923b0962ae751 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.931960 11726 leader_election.cc:290] T 971e9abee86444a7a9e923b0962ae751 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:59.932276 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b1224d4d9ed48f2806ec353f1e59de9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.918264 9907 tablet_service.cc:1511] Processing CreateTablet for tablet b8ad239a5d4a410581d93b66d3982120 (DEFAULT_TABLE table=default.Table_454f93562c2f41c7b990019efd3329b8 [id=7ac554af109f4125b86a0884049d5fbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.934631 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8ad239a5d4a410581d93b66d3982120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.935495 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 84df4485b42a46cea7b3be4524cca6af (DEFAULT_TABLE table=default.Table_ab458c1caf1645df820d9833b5e005ca [id=7928656b3b1a4088aff4e97028903b4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.935874 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84df4485b42a46cea7b3be4524cca6af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.936010 9898 tablet_service.cc:1511] Processing CreateTablet for tablet a099e4cc255c4502b745a1e29cbd4c42 (DEFAULT_TABLE table=default.Table_da85c56b8ad948aaadc0fb377d5c89ea [id=22a58516f9ac46478706f0f8a9285f65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.936324 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a099e4cc255c4502b745a1e29cbd4c42. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:59.936957 10068 leader_election.cc:343] T f8e4de89977b4caf91b2c0a49d147d17 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: f8e4de89977b4caf91b2c0a49d147d17
I20260810 19:47:59.919266 9906 tablet_service.cc:1511] Processing CreateTablet for tablet f4a7579cf1af43159bba3686228b5983 (DEFAULT_TABLE table=default.Table_85870c032faa47d5946b1523ec0ce3d8 [id=525826e73b0c4dcc93761fb4460c76b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.937808 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a7579cf1af43159bba3686228b5983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.938629 9902 tablet_service.cc:1511] Processing CreateTablet for tablet ff3478f19b14418a876b668bd03125ba (DEFAULT_TABLE table=default.Table_b65ffd5f22ef4b92ac73d90d4d1d682a [id=8145c08ee6354dd3923c4c9d70b44c1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.938956 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff3478f19b14418a876b668bd03125ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.919266 9883 tablet_service.cc:1511] Processing CreateTablet for tablet e750622b406c4783adf01bb1af6895de (DEFAULT_TABLE table=default.Table_cfeef51f25594045916e90c140464db0 [id=b852f2174c0c489faa0ab7481fe62a01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.942603 9897 tablet_service.cc:1511] Processing CreateTablet for tablet 6c1c556d269d477997ec3ffa852689ca (DEFAULT_TABLE table=default.Table_2ab0dfc23b1c4fc883c423a527d7cbfd [id=ee39b52c491f4f4080b4fc8f94d75bc4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:47:59.942778 10067 leader_election.cc:343] T f8e4de89977b4caf91b2c0a49d147d17 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.942625 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e750622b406c4783adf01bb1af6895de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.943254 10067 leader_election.cc:304] T f8e4de89977b4caf91b2c0a49d147d17 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:59.944126 11518 raft_consensus.cc:2749] T f8e4de89977b4caf91b2c0a49d147d17 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:59.944706 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 98c1a8c9946248b78e5b77ba8dfdb953 (DEFAULT_TABLE table=default.Table_05bfdf726be7422081506c051724ef2c [id=31f6358a140542a089ae6e5e9e5f2632]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.945029 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971e9abee86444a7a9e923b0962ae751" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:59.945261 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98c1a8c9946248b78e5b77ba8dfdb953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.945865 10125 tablet_service.cc:1511] Processing CreateTablet for tablet e750622b406c4783adf01bb1af6895de (DEFAULT_TABLE table=default.Table_cfeef51f25594045916e90c140464db0 [id=b852f2174c0c489faa0ab7481fe62a01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.946283 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e750622b406c4783adf01bb1af6895de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.946476 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c1c556d269d477997ec3ffa852689ca. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:47:59.948616 9611 leader_election.cc:343] T 971e9abee86444a7a9e923b0962ae751 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:47:59.948791 9611 leader_election.cc:304] T 971e9abee86444a7a9e923b0962ae751 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:47:59.949533 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99b34f901484fad87cff4bb9ab56fc8" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:47:59.949991 10119 tablet_service.cc:1511] Processing CreateTablet for tablet b8ad239a5d4a410581d93b66d3982120 (DEFAULT_TABLE table=default.Table_454f93562c2f41c7b990019efd3329b8 [id=7ac554af109f4125b86a0884049d5fbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.950846 11724 raft_consensus.cc:2749] T 971e9abee86444a7a9e923b0962ae751 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:47:59.951153 9948 raft_consensus.cc:3060] T 7737acd216204209ba0327e26e85cfe6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:59.952391 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 0df786b887de4d7dbf1881e4944e3b68 (DEFAULT_TABLE table=default.Table_9209b00d101f4479bd6324c62bff3a29 [id=bd31a4d390594b77aa46929c4799231a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.952746 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 971e9abee86444a7a9e923b0962ae751 with delete_type TABLET_DATA_DELETED (replaced by tablet d0f9a22f81894a829fcb350001fc532b) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:59.952800 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0df786b887de4d7dbf1881e4944e3b68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.952946 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 21208dd824fe432fa307cbb88d37aaa2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:59.953361 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet a5625dc6303d44c6be28abd6278ce034 with delete_type TABLET_DATA_DELETED (replaced by tablet 64470598ccec45a7ae3e3c77fe4b9518) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:59.953563 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet d2c77a8ac1614bb286e4e168bcf999f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:47:59.953894 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 4b1224d4d9ed48f2806ec353f1e59de9 (DEFAULT_TABLE table=default.Table_5fd992f1afe5496eb8ca25a8409e3348 [id=1a682e5ba0f144e6bd5ec42e1a1677f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.954233 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b1224d4d9ed48f2806ec353f1e59de9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.955113 10168 raft_consensus.cc:2468] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:47:59.955389 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 0df786b887de4d7dbf1881e4944e3b68 (DEFAULT_TABLE table=default.Table_9209b00d101f4479bd6324c62bff3a29 [id=bd31a4d390594b77aa46929c4799231a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.955767 11518 raft_consensus.cc:493] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:47:59.956425 9830 leader_election.cc:304] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:59.956468 11518 raft_consensus.cc:515] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.956895 11561 raft_consensus.cc:2804] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:59.956983 11561 raft_consensus.cc:493] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:59.957049 11561 raft_consensus.cc:3060] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:59.957248 11518 leader_election.cc:290] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:47:59.957394 11490 consensus_queue.cc:1048] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260810 19:47:59.958549 9668 tablet_service.cc:1511] Processing CreateTablet for tablet ff3478f19b14418a876b668bd03125ba (DEFAULT_TABLE table=default.Table_b65ffd5f22ef4b92ac73d90d4d1d682a [id=8145c08ee6354dd3923c4c9d70b44c1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.958969 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff3478f19b14418a876b668bd03125ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.958981 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8ad239a5d4a410581d93b66d3982120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.959197 9669 tablet_service.cc:1511] Processing CreateTablet for tablet e750622b406c4783adf01bb1af6895de (DEFAULT_TABLE table=default.Table_cfeef51f25594045916e90c140464db0 [id=b852f2174c0c489faa0ab7481fe62a01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.959535 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e750622b406c4783adf01bb1af6895de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.959792 11561 raft_consensus.cc:515] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.960515 11561 leader_election.cc:290] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:47:59.962625 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0df786b887de4d7dbf1881e4944e3b68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.962653 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 84df4485b42a46cea7b3be4524cca6af (DEFAULT_TABLE table=default.Table_ab458c1caf1645df820d9833b5e005ca [id=7928656b3b1a4088aff4e97028903b4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.963003 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84df4485b42a46cea7b3be4524cca6af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.958966 9675 tablet_service.cc:1511] Processing CreateTablet for tablet f4a7579cf1af43159bba3686228b5983 (DEFAULT_TABLE table=default.Table_85870c032faa47d5946b1523ec0ce3d8 [id=525826e73b0c4dcc93761fb4460c76b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.963400 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a7579cf1af43159bba3686228b5983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.958549 9665 tablet_service.cc:1511] Processing CreateTablet for tablet b8ad239a5d4a410581d93b66d3982120 (DEFAULT_TABLE table=default.Table_454f93562c2f41c7b990019efd3329b8 [id=7ac554af109f4125b86a0884049d5fbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.966645 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 6c1c556d269d477997ec3ffa852689ca (DEFAULT_TABLE table=default.Table_2ab0dfc23b1c4fc883c423a527d7cbfd [id=ee39b52c491f4f4080b4fc8f94d75bc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.966810 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8ad239a5d4a410581d93b66d3982120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.966959 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c1c556d269d477997ec3ffa852689ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.967702 10367 tablet_bootstrap.cc:492] T 9fb544dff4eb4642b7e282657ae15d19 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:47:59.967854 10367 ts_tablet_manager.cc:1403] T 9fb544dff4eb4642b7e282657ae15d19 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.001s
I20260810 19:47:59.967907 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 84df4485b42a46cea7b3be4524cca6af (DEFAULT_TABLE table=default.Table_ab458c1caf1645df820d9833b5e005ca [id=7928656b3b1a4088aff4e97028903b4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.968806 10367 raft_consensus.cc:359] T 9fb544dff4eb4642b7e282657ae15d19 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.968992 10367 raft_consensus.cc:385] T 9fb544dff4eb4642b7e282657ae15d19 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:47:59.969049 10367 raft_consensus.cc:740] T 9fb544dff4eb4642b7e282657ae15d19 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:47:59.969058 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84df4485b42a46cea7b3be4524cca6af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.969288 10367 consensus_queue.cc:260] T 9fb544dff4eb4642b7e282657ae15d19 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:47:59.970028 10367 ts_tablet_manager.cc:1434] T 9fb544dff4eb4642b7e282657ae15d19 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:47:59.970088 9687 tablet_service.cc:1511] Processing CreateTablet for tablet a099e4cc255c4502b745a1e29cbd4c42 (DEFAULT_TABLE table=default.Table_da85c56b8ad948aaadc0fb377d5c89ea [id=22a58516f9ac46478706f0f8a9285f65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.970065 10122 tablet_service.cc:1511] Processing CreateTablet for tablet ff3478f19b14418a876b668bd03125ba (DEFAULT_TABLE table=default.Table_b65ffd5f22ef4b92ac73d90d4d1d682a [id=8145c08ee6354dd3923c4c9d70b44c1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.970391 10367 tablet_bootstrap.cc:492] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:47:59.970466 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a099e4cc255c4502b745a1e29cbd4c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.972913 10367 tablet_bootstrap.cc:654] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:47:59.973578 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff3478f19b14418a876b668bd03125ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.974435 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06af03c8a87141febef768bd56c72c39" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:47:59.974677 9948 raft_consensus.cc:2468] T 06af03c8a87141febef768bd56c72c39 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:47:59.974757 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 98c1a8c9946248b78e5b77ba8dfdb953 (DEFAULT_TABLE table=default.Table_05bfdf726be7422081506c051724ef2c [id=31f6358a140542a089ae6e5e9e5f2632]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.975106 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98c1a8c9946248b78e5b77ba8dfdb953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.975199 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 6c1c556d269d477997ec3ffa852689ca (DEFAULT_TABLE table=default.Table_2ab0dfc23b1c4fc883c423a527d7cbfd [id=ee39b52c491f4f4080b4fc8f94d75bc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.975782 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99b34f901484fad87cff4bb9ab56fc8" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
W20260810 19:47:59.976233 10068 leader_election.cc:343] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 06af03c8a87141febef768bd56c72c39
I20260810 19:47:59.976405 10135 tablet_service.cc:1511] Processing CreateTablet for tablet a099e4cc255c4502b745a1e29cbd4c42 (DEFAULT_TABLE table=default.Table_da85c56b8ad948aaadc0fb377d5c89ea [id=22a58516f9ac46478706f0f8a9285f65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:47:59.979565 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a099e4cc255c4502b745a1e29cbd4c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.980312 10168 raft_consensus.cc:3060] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:47:59.981498 9831 leader_election.cc:343] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: d99b34f901484fad87cff4bb9ab56fc8
I20260810 19:47:59.981608 10067 leader_election.cc:304] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:47:59.982084 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c1c556d269d477997ec3ffa852689ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:47:59.983305 11490 raft_consensus.cc:2804] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:47:59.983448 11490 raft_consensus.cc:493] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:47:59.984658 11490 raft_consensus.cc:3060] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:47:59.985841 10370 consensus_queue.cc:260] T dd632a01fe424a3a956d445ce01e31d2 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.004513 10130 tablet_service.cc:1511] Processing CreateTablet for tablet f4a7579cf1af43159bba3686228b5983 (DEFAULT_TABLE table=default.Table_85870c032faa47d5946b1523ec0ce3d8 [id=525826e73b0c4dcc93761fb4460c76b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.012035 11490 raft_consensus.cc:515] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.012432 10366 raft_consensus.cc:359] T f8e4de89977b4caf91b2c0a49d147d17 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.012663 10366 raft_consensus.cc:385] T f8e4de89977b4caf91b2c0a49d147d17 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.012724 10366 raft_consensus.cc:740] T f8e4de89977b4caf91b2c0a49d147d17 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:00.012996 10366 consensus_queue.cc:260] T f8e4de89977b4caf91b2c0a49d147d17 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.014725 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06af03c8a87141febef768bd56c72c39" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:00.014916 9948 raft_consensus.cc:3060] T 06af03c8a87141febef768bd56c72c39 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:00.015007 10366 ts_tablet_manager.cc:1434] T f8e4de89977b4caf91b2c0a49d147d17 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.087s user 0.002s sys 0.000s
I20260810 19:48:00.015305 10366 tablet_bootstrap.cc:492] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:00.017078 10366 tablet_bootstrap.cc:654] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:00.017822 9948 raft_consensus.cc:2468] T 06af03c8a87141febef768bd56c72c39 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:00.032418 11490 leader_election.cc:290] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:00.033170 10371 tablet_replica.cc:333] T 3f18c24b01384299a4f941d7fb840032 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:00.033313 10067 leader_election.cc:304] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
W20260810 19:48:00.035560 10068 leader_election.cc:343] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 06af03c8a87141febef768bd56c72c39
I20260810 19:48:00.037352 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a7579cf1af43159bba3686228b5983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.037606 10371 raft_consensus.cc:2243] T 3f18c24b01384299a4f941d7fb840032 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:00.037860 10371 raft_consensus.cc:2272] T 3f18c24b01384299a4f941d7fb840032 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.038028 10168 raft_consensus.cc:2468] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:00.039048 10371 ts_tablet_manager.cc:1916] T 3f18c24b01384299a4f941d7fb840032 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.040510 11490 raft_consensus.cc:2804] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:47:59.928018 10377 rpcz_store.cc:276] 0810 19:47:57.243210 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.079723 (+836513us) service_pool.cc:224] Handling call
0810 19:47:59.927811 (+1848088us) ts_tablet_manager.cc:1151] Deleting tablet b54feebc7c9841d89808054602be7913
0810 19:47:59.927822 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:47:59.927920 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1809516}
I20260810 19:48:00.042304 10370 ts_tablet_manager.cc:1434] T dd632a01fe424a3a956d445ce01e31d2 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.124s user 0.003s sys 0.000s
I20260810 19:48:00.042788 11490 raft_consensus.cc:697] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:00.043223 11490 consensus_queue.cc:237] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.038602 9830 leader_election.cc:304] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:00.044670 11561 raft_consensus.cc:2804] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:00.044814 11561 raft_consensus.cc:697] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:00.045071 11561 consensus_queue.cc:237] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:00.046746 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet b54feebc7c9841d89808054602be7913 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b54feebc7c9841d89808054602be7913 already in progress: creating tablet
I20260810 19:48:00.047295 10370 tablet_bootstrap.cc:492] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:00.048520 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 532) took 1968 ms. Trace:
I20260810 19:48:00.048694 10377 rpcz_store.cc:276] 0810 19:47:58.080413 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.510785 (+430372us) service_pool.cc:224] Handling call
0810 19:48:00.041547 (+1530762us) ts_tablet_manager.cc:1151] Deleting tablet 985440898cc04a98877c15a5122a7dd3
0810 19:48:00.041562 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.048495 (+ 6933us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1522431}
I20260810 19:48:00.055567 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 534) took 1975 ms. Trace:
W20260810 19:48:00.057744 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ba6002f2cfa463882b793f8f5cb5f41 consensus state has no leader
I20260810 19:48:00.058640 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 0df786b887de4d7dbf1881e4944e3b68
I20260810 19:48:00.059443 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 7add2dae2d1b4e8b9b95348e0334ba03
I20260810 19:48:00.060488 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet 3159795344ae492fb099fca0e52fcf20 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:00.064281 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 0df786b887de4d7dbf1881e4944e3b68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:59 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:00.065862 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 2a1b1877c8bf4515a1c1f8c693bdae8e (DEFAULT_TABLE table=default.Table_8c32f29153754352872be52763234ceb [id=4d60107ab9e445e3ab6d592378b53b15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.066219 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet 7add2dae2d1b4e8b9b95348e0334ba03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:59 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:00.067054 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a1b1877c8bf4515a1c1f8c693bdae8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.068516 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 89fa072ad5f74ed9bdab2ca19e0522ac (DEFAULT_TABLE table=default.Table_602cb1451851485d819ae1c5853c46a3 [id=ac82cc5052ed4673bbe01384bc79bc2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.068965 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89fa072ad5f74ed9bdab2ca19e0522ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.071291 10127 tablet_service.cc:1558] Processing DeleteTablet for tablet 7add2dae2d1b4e8b9b95348e0334ba03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:59 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:00.072327 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet 0df786b887de4d7dbf1881e4944e3b68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:59 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:00.077693 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 2a1b1877c8bf4515a1c1f8c693bdae8e (DEFAULT_TABLE table=default.Table_8c32f29153754352872be52763234ceb [id=4d60107ab9e445e3ab6d592378b53b15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.079226 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 98c1a8c9946248b78e5b77ba8dfdb953 (DEFAULT_TABLE table=default.Table_05bfdf726be7422081506c051724ef2c [id=31f6358a140542a089ae6e5e9e5f2632]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.082780 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 49a73b0637664821bcb44ba463baac18 (DEFAULT_TABLE table=default.Table_3b8970ea8dcf44efa5779c1ce574f779 [id=f896ab2651154659a0e26a24d7745358]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.083276 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49a73b0637664821bcb44ba463baac18. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:00.085633 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 985440898cc04a98877c15a5122a7dd3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 985440898cc04a98877c15a5122a7dd3 already in progress: creating tablet
I20260810 19:48:00.056488 10377 rpcz_store.cc:276] 0810 19:47:58.080571 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.516541 (+435970us) service_pool.cc:224] Handling call
0810 19:48:00.055405 (+1538864us) ts_tablet_manager.cc:1151] Deleting tablet e18d0da099b749f1bc9d9d276277b68f
0810 19:48:00.055421 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.055541 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1484707}
I20260810 19:48:00.086616 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 89fa072ad5f74ed9bdab2ca19e0522ac (DEFAULT_TABLE table=default.Table_602cb1451851485d819ae1c5853c46a3 [id=ac82cc5052ed4673bbe01384bc79bc2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.086779 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 535) took 2006 ms. Trace:
I20260810 19:48:00.087045 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a1b1877c8bf4515a1c1f8c693bdae8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.087093 10377 rpcz_store.cc:276] 0810 19:47:58.080646 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.519148 (+438502us) service_pool.cc:224] Handling call
0810 19:48:00.086620 (+1567472us) ts_tablet_manager.cc:1151] Deleting tablet 3b6187dbe1ca42f79bf3eddd5475b929
0810 19:48:00.086634 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.086753 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1489702}
I20260810 19:48:00.087606 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 533) took 2007 ms. Trace:
I20260810 19:48:00.087733 10377 rpcz_store.cc:276] 0810 19:47:58.080482 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.512527 (+432045us) service_pool.cc:224] Handling call
0810 19:48:00.087483 (+1574956us) ts_tablet_manager.cc:1151] Deleting tablet bafc42f0cdf94ebd823dfb678df8a83b
0810 19:48:00.087494 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.087588 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1481836}
I20260810 19:48:00.088124 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 545) took 1537 ms. Trace:
I20260810 19:48:00.088613 10370 tablet_bootstrap.cc:654] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:00.090025 11724 raft_consensus.cc:493] T 9fb544dff4eb4642b7e282657ae15d19 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:00.090176 11724 raft_consensus.cc:515] T 9fb544dff4eb4642b7e282657ae15d19 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:00.090840 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet e18d0da099b749f1bc9d9d276277b68f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e18d0da099b749f1bc9d9d276277b68f already in progress: creating tablet
I20260810 19:48:00.090970 11724 leader_election.cc:290] T 9fb544dff4eb4642b7e282657ae15d19 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:00.091272 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 3b6187dbe1ca42f79bf3eddd5475b929 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b6187dbe1ca42f79bf3eddd5475b929 already in progress: creating tablet
W20260810 19:48:00.091611 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet bafc42f0cdf94ebd823dfb678df8a83b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bafc42f0cdf94ebd823dfb678df8a83b already in progress: creating tablet
I20260810 19:48:00.094676 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 4e871bfa4b734154aa9cfe76b0902dbf (DEFAULT_TABLE table=default.Table_acf87d58880b426aa890dbf88e46a540 [id=3e04f758d72a4dae800199adc156cd58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.095130 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98c1a8c9946248b78e5b77ba8dfdb953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.095165 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e871bfa4b734154aa9cfe76b0902dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.097752 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 49a73b0637664821bcb44ba463baac18 (DEFAULT_TABLE table=default.Table_3b8970ea8dcf44efa5779c1ce574f779 [id=f896ab2651154659a0e26a24d7745358]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.098817 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fb544dff4eb4642b7e282657ae15d19" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:00.099184 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89fa072ad5f74ed9bdab2ca19e0522ac. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:00.099681 9611 leader_election.cc:343] T 9fb544dff4eb4642b7e282657ae15d19 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:00.104497 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49a73b0637664821bcb44ba463baac18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.088994 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 7add2dae2d1b4e8b9b95348e0334ba03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:59 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:00.091616 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fb544dff4eb4642b7e282657ae15d19" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:00.092129 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 49a73b0637664821bcb44ba463baac18 (DEFAULT_TABLE table=default.Table_3b8970ea8dcf44efa5779c1ce574f779 [id=f896ab2651154659a0e26a24d7745358]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.109651 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49a73b0637664821bcb44ba463baac18. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:00.110601 9611 leader_election.cc:343] T 9fb544dff4eb4642b7e282657ae15d19 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:00.110733 9611 leader_election.cc:304] T 9fb544dff4eb4642b7e282657ae15d19 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:00.111014 11724 raft_consensus.cc:2749] T 9fb544dff4eb4642b7e282657ae15d19 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:00.092491 9897 tablet_service.cc:1511] Processing CreateTablet for tablet 89fa072ad5f74ed9bdab2ca19e0522ac (DEFAULT_TABLE table=default.Table_602cb1451851485d819ae1c5853c46a3 [id=ac82cc5052ed4673bbe01384bc79bc2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.114066 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89fa072ad5f74ed9bdab2ca19e0522ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.117712 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 7f4ca5a1ec3d4ca392f389f2dabae296
I20260810 19:48:00.092795 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 2a1b1877c8bf4515a1c1f8c693bdae8e (DEFAULT_TABLE table=default.Table_8c32f29153754352872be52763234ceb [id=4d60107ab9e445e3ab6d592378b53b15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.118155 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a1b1877c8bf4515a1c1f8c693bdae8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.118577 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 8e73953ad6e148749163ebeaa24ee6e4
I20260810 19:48:00.119452 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet a999e0d7e70e4b4fb53e17e51ab9b03a
I20260810 19:48:00.120044 9408 master_service.cc:960] ReplaceTablet: received request to replace tablet a5625dc6303d44c6be28abd6278ce034 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:00.120450 9416 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 4e80e2327c394612bffc51f38798dac3 (table default.Table_5005f8f74af74cad8c19a3c67e8f9fe9 [id=bd544994cecc42b2adc881ebfe318d7b]). Expected version 1 got 0
I20260810 19:48:00.120736 9416 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 81720b897a674b5380c6469d1600a979 (table default.Table_e4aeb59e91c24097bac9517b3c62b75a [id=8d7f043045ff44cd886367b5860f8433]). Expected version 1 got 0
I20260810 19:48:00.120981 9416 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 4b2b0f2fc93647f3bc1d79b4132c3703 (table default.Table_d1e72b2bbecd434e9ff0c7eaf6201b42 [id=64e1f507ae574ea6b7fa1627b8e7f4c3]). Expected version 3 got 0
I20260810 19:48:00.093945 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 4e871bfa4b734154aa9cfe76b0902dbf (DEFAULT_TABLE table=default.Table_acf87d58880b426aa890dbf88e46a540 [id=3e04f758d72a4dae800199adc156cd58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.121318 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e871bfa4b734154aa9cfe76b0902dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.124114 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_14279f7714694d48a551392ee498d02a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:00.124758 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_14279f7714694d48a551392ee498d02a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:00.125345 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_64d48c3a077c49c3a0bbb07824f34047"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:00.125949 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64d48c3a077c49c3a0bbb07824f34047 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:00.126240 9420 master_service.cc:960] ReplaceTablet: received request to replace tablet ca733de7babe4343ab26dbca2c9020b2 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:00.127211 9894 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e73953ad6e148749163ebeaa24ee6e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:59 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:00.127830 9894 tablet_service.cc:1558] Processing DeleteTablet for tablet a999e0d7e70e4b4fb53e17e51ab9b03a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:59 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:00.128180 9894 tablet_service.cc:1558] Processing DeleteTablet for tablet 06af03c8a87141febef768bd56c72c39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:00.128242 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ac3fc982487f4b0da46ba2d2fbf03f63" } new_table_name: "default.Table_a5aa062540ad4b02bf89b59e8ebc8cd7" modify_external_catalogs: true
I20260810 19:48:00.128654 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f4ca5a1ec3d4ca392f389f2dabae296 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:59 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:00.129031 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2b4a171707e745c0b06d669df83755fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:00.129598 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b4a171707e745c0b06d669df83755fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:00.135565 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0a37179e5d0843fdaaa45705f79fe9c8" } new_table_name: "default.Table_aa3fa23fa2314588ba6441c0f0dcbd9d" modify_external_catalogs: true
I20260810 19:48:00.136927 11663 raft_consensus.cc:493] T e959898b2c4c4173aea107d3f090ca07 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:00.137104 11663 raft_consensus.cc:515] T e959898b2c4c4173aea107d3f090ca07 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.137423 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_95034dc6eb7240a1ae855c8a159c6279"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:00.137946 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_95034dc6eb7240a1ae855c8a159c6279 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:00.139163 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a17890eaff5e43ae907d41f49b34d92f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:00.139667 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a17890eaff5e43ae907d41f49b34d92f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:00.100996 10366 tablet_bootstrap.cc:492] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:00.145582 10366 ts_tablet_manager.cc:1403] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.130s user 0.001s sys 0.005s
I20260810 19:48:00.146827 10366 raft_consensus.cc:359] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.146973 9665 tablet_service.cc:1558] Processing DeleteTablet for tablet a999e0d7e70e4b4fb53e17e51ab9b03a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:59 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:00.147022 10366 raft_consensus.cc:385] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.147073 10366 raft_consensus.cc:740] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:00.147291 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f4ca5a1ec3d4ca392f389f2dabae296 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:59 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:00.147336 10366 consensus_queue.cc:260] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.147724 9673 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e73953ad6e148749163ebeaa24ee6e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:59 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:00.147882 10366 ts_tablet_manager.cc:1434] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 19:48:00.148243 10366 tablet_bootstrap.cc:492] T 45194cae6ea44d9d8cf856d256fd534f P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:00.101140 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 0df786b887de4d7dbf1881e4944e3b68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:59 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:00.149044 11724 raft_consensus.cc:493] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:00.149194 11724 raft_consensus.cc:515] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.149796 10375 ts_tablet_manager.cc:1929] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260810 19:48:00.149860 11724 leader_election.cc:290] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:00.149960 10375 log.cc:1199] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/4d654dada92a4939914d26ab72a5f5e8
I20260810 19:48:00.151007 10377 rpcz_store.cc:276] 0810 19:47:58.550475 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.667487 (+117012us) service_pool.cc:224] Handling call
0810 19:48:00.088020 (+1420533us) ts_tablet_manager.cc:1151] Deleting tablet 3582ed23ffdf4ff089952e29083e5425
0810 19:48:00.088029 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.088108 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1411141}
W20260810 19:48:00.151893 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 3582ed23ffdf4ff089952e29083e5425 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3582ed23ffdf4ff089952e29083e5425 already in progress: creating tablet
I20260810 19:48:00.152076 10377 tablet_replica.cc:333] T f8e4de89977b4caf91b2c0a49d147d17 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:00.153709 10127 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f4ca5a1ec3d4ca392f389f2dabae296 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:59 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:00.154481 11663 leader_election.cc:290] T e959898b2c4c4173aea107d3f090ca07 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:00.154703 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e959898b2c4c4173aea107d3f090ca07" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:00.154789 10144 tablet_service.cc:1558] Processing DeleteTablet for tablet 06af03c8a87141febef768bd56c72c39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:00.155539 10067 leader_election.cc:343] T e959898b2c4c4173aea107d3f090ca07 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:00.157114 10367 tablet_bootstrap.cc:492] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:00.157301 10367 ts_tablet_manager.cc:1403] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.187s user 0.045s sys 0.054s
I20260810 19:48:00.158203 10367 raft_consensus.cc:359] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.158432 10367 raft_consensus.cc:385] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.158485 10367 raft_consensus.cc:740] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:00.158728 10367 consensus_queue.cc:260] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.159680 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba6002f2cfa463882b793f8f5cb5f41 (DEFAULT_TABLE table=default.Table_85723f2593004e11acac17f40c9868e0 [id=531084c413b14478b02c431ce1bf2680]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.160117 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba6002f2cfa463882b793f8f5cb5f41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.161455 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b2b0f2fc93647f3bc1d79b4132c3703" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:00.162004 9611 leader_election.cc:343] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:00.162465 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c828ae089774fb9b0582141f4b99313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:00.163872 10367 ts_tablet_manager.cc:1434] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260810 19:48:00.164331 10367 tablet_bootstrap.cc:492] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
W20260810 19:48:00.165575 9395 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 72b39babf851404c89adb317033015ec (table default.Table_2d7f246476ac4544a3fa089ec3c52657 [id=c681008d2b5f43a9b7b6ed2d72653b1b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 72b39babf851404c89adb317033015ec consensus state has no leader
I20260810 19:48:00.166056 10367 tablet_bootstrap.cc:654] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:00.171521 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet a999e0d7e70e4b4fb53e17e51ab9b03a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:59 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:00.144375 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2033c77d02d3472a99574dcb4c331377"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:00.173970 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2033c77d02d3472a99574dcb4c331377 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:00.174196 10377 raft_consensus.cc:2243] T f8e4de89977b4caf91b2c0a49d147d17 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:00.174489 10377 raft_consensus.cc:2272] T f8e4de89977b4caf91b2c0a49d147d17 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.175271 10377 ts_tablet_manager.cc:1916] T f8e4de89977b4caf91b2c0a49d147d17 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.175777 10367 tablet_bootstrap.cc:492] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:00.175935 10367 ts_tablet_manager.cc:1403] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.009s
I20260810 19:48:00.176795 10367 raft_consensus.cc:359] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.176975 10367 raft_consensus.cc:385] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.177039 10367 raft_consensus.cc:740] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:00.177157 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba6002f2cfa463882b793f8f5cb5f41 (DEFAULT_TABLE table=default.Table_85723f2593004e11acac17f40c9868e0 [id=531084c413b14478b02c431ce1bf2680]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.177271 10367 consensus_queue.cc:260] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.177583 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b2b0f2fc93647f3bc1d79b4132c3703" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:00.177723 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba6002f2cfa463882b793f8f5cb5f41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.178009 10367 ts_tablet_manager.cc:1434] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 19:48:00.178665 10367 tablet_bootstrap.cc:492] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:00.178901 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 476e762e46c04ae6bfef5e14df2d16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:00.181381 10068 leader_election.cc:343] T e959898b2c4c4173aea107d3f090ca07 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: e959898b2c4c4173aea107d3f090ca07
I20260810 19:48:00.181567 10068 leader_election.cc:304] T e959898b2c4c4173aea107d3f090ca07 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:00.181949 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 4e871bfa4b734154aa9cfe76b0902dbf (DEFAULT_TABLE table=default.Table_acf87d58880b426aa890dbf88e46a540 [id=3e04f758d72a4dae800199adc156cd58]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:00.182559 9611 leader_election.cc:343] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:00.182675 9611 leader_election.cc:304] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:00.182952 11724 raft_consensus.cc:2749] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:00.178264 10375 ts_tablet_manager.cc:1950] T 4d654dada92a4939914d26ab72a5f5e8 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:00.187050 11518 raft_consensus.cc:2749] T e959898b2c4c4173aea107d3f090ca07 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:00.187912 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba6002f2cfa463882b793f8f5cb5f41 (DEFAULT_TABLE table=default.Table_85723f2593004e11acac17f40c9868e0 [id=531084c413b14478b02c431ce1bf2680]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.189944 9895 tablet_service.cc:1511] Processing CreateTablet for tablet e28348b22e184b5993a4abc5859de6c3 (DEFAULT_TABLE table=default.Table_e51b38a7ab0c47ce830475f655cb0519 [id=7b48278aedfe473aa4f51fb93e52e991]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.190217 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e73953ad6e148749163ebeaa24ee6e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:59 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:00.190677 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e871bfa4b734154aa9cfe76b0902dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.191054 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 8503d5162548463bae22402fdc4c502a (DEFAULT_TABLE table=default.Table_25921125d38844c9aa2816c5a6c395d1 [id=c72c64a09f73486abc4b2c6a72271d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.191587 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 9fb544dff4eb4642b7e282657ae15d19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:00.192217 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba6002f2cfa463882b793f8f5cb5f41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.192747 10130 tablet_service.cc:1511] Processing CreateTablet for tablet e7ea2f50f9f9423b99af3bd190cfd5a5 (DEFAULT_TABLE table=default.Table_3d2a5a2863e24c4bb90af582b7f3a9bb [id=a8b0eeac86bf4ff5a8a71ca5432d07ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.193881 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e28348b22e184b5993a4abc5859de6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.194197 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8503d5162548463bae22402fdc4c502a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.194469 9897 tablet_service.cc:1511] Processing CreateTablet for tablet e7ea2f50f9f9423b99af3bd190cfd5a5 (DEFAULT_TABLE table=default.Table_3d2a5a2863e24c4bb90af582b7f3a9bb [id=a8b0eeac86bf4ff5a8a71ca5432d07ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.194876 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ea2f50f9f9423b99af3bd190cfd5a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.194909 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 8503d5162548463bae22402fdc4c502a (DEFAULT_TABLE table=default.Table_25921125d38844c9aa2816c5a6c395d1 [id=c72c64a09f73486abc4b2c6a72271d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.195336 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8503d5162548463bae22402fdc4c502a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.199215 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 459) took 3515 ms. Trace:
I20260810 19:48:00.200266 10375 rpcz_store.cc:276] 0810 19:47:56.674513 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.134598 (+460085us) service_pool.cc:224] Handling call
0810 19:47:59.910809 (+2776211us) ts_tablet_manager.cc:1151] Deleting tablet 4d654dada92a4939914d26ab72a5f5e8
0810 19:47:59.910826 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.107154 (+196328us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.149693 (+ 42539us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.190073 (+ 40380us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2717005}
I20260810 19:48:00.200896 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 4d654dada92a4939914d26ab72a5f5e8 (table default.Table_551b211882fd4d67ba96228b8f0826e1 [id=a8bdf6ea608f4279971af4c9eff71db6]) successfully deleted
I20260810 19:48:00.201176 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ea2f50f9f9423b99af3bd190cfd5a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.216107 9664 tablet_service.cc:1511] Processing CreateTablet for tablet e28348b22e184b5993a4abc5859de6c3 (DEFAULT_TABLE table=default.Table_e51b38a7ab0c47ce830475f655cb0519 [id=7b48278aedfe473aa4f51fb93e52e991]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.214166 9675 tablet_service.cc:1511] Processing CreateTablet for tablet e7ea2f50f9f9423b99af3bd190cfd5a5 (DEFAULT_TABLE table=default.Table_3d2a5a2863e24c4bb90af582b7f3a9bb [id=a8b0eeac86bf4ff5a8a71ca5432d07ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.221510 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 8503d5162548463bae22402fdc4c502a (DEFAULT_TABLE table=default.Table_25921125d38844c9aa2816c5a6c395d1 [id=c72c64a09f73486abc4b2c6a72271d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.221633 11724 raft_consensus.cc:493] T 63b649cbc1d141d8bb438105b8e8537c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:00.221819 11724 raft_consensus.cc:515] T 63b649cbc1d141d8bb438105b8e8537c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.222529 11724 leader_election.cc:290] T 63b649cbc1d141d8bb438105b8e8537c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:00.224018 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b649cbc1d141d8bb438105b8e8537c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:00.224671 9611 leader_election.cc:343] T 63b649cbc1d141d8bb438105b8e8537c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:00.225759 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b649cbc1d141d8bb438105b8e8537c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:00.226543 9611 leader_election.cc:343] T 63b649cbc1d141d8bb438105b8e8537c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:00.226672 9611 leader_election.cc:304] T 63b649cbc1d141d8bb438105b8e8537c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:00.227164 11724 raft_consensus.cc:2749] T 63b649cbc1d141d8bb438105b8e8537c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:00.233335 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4f21e03993e841ba901f1e9c176309b9 consensus state has no leader
I20260810 19:48:00.234459 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet ca733de7babe4343ab26dbca2c9020b2
I20260810 19:48:00.235128 9420 catalog_manager.cc:6807] ReplaceTablet: tablet ca733de7babe4343ab26dbca2c9020b2 deleted and replaced by tablet 264a65bd642648e59998fb55fb3c8de1
I20260810 19:48:00.235157 9416 master_service.cc:960] ReplaceTablet: received request to replace tablet 3159795344ae492fb099fca0e52fcf20 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:00.235670 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 3159795344ae492fb099fca0e52fcf20
I20260810 19:48:00.235816 10127 tablet_service.cc:1558] Processing DeleteTablet for tablet ca733de7babe4343ab26dbca2c9020b2 with delete_type TABLET_DATA_DELETED (replaced by tablet 264a65bd642648e59998fb55fb3c8de1) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:00.236032 10370 tablet_bootstrap.cc:492] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:00.236179 10370 ts_tablet_manager.cc:1403] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.194s user 0.013s sys 0.009s
I20260810 19:48:00.236212 9410 catalog_manager.cc:6807] ReplaceTablet: tablet 3159795344ae492fb099fca0e52fcf20 deleted and replaced by tablet 629cfbd55c0b4a2fbe43f41cdefa85f8
I20260810 19:48:00.236267 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet ca733de7babe4343ab26dbca2c9020b2 with delete_type TABLET_DATA_DELETED (replaced by tablet 264a65bd642648e59998fb55fb3c8de1) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:00.236939 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 3159795344ae492fb099fca0e52fcf20 with delete_type TABLET_DATA_DELETED (replaced by tablet 629cfbd55c0b4a2fbe43f41cdefa85f8) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:00.237617 10370 raft_consensus.cc:359] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.237799 10370 raft_consensus.cc:385] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.237844 10370 raft_consensus.cc:740] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:00.238070 10370 consensus_queue.cc:260] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.238616 10370 ts_tablet_manager.cc:1434] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:00.238914 10370 tablet_bootstrap.cc:492] T e247ae3828e84092b836f3dd07b44bc6 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:00.239689 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_cb11c1913c0a4ed18b7c62e1466292cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:00.240407 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb11c1913c0a4ed18b7c62e1466292cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:00.240725 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ee7dc02ca2694c60a65c9b96d4410000"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:00.241245 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee7dc02ca2694c60a65c9b96d4410000 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:00.242601 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 648ef608fa0c45cc8be4bad80c4200be consensus state has no leader
I20260810 19:48:00.242645 10370 tablet_bootstrap.cc:654] T e247ae3828e84092b836f3dd07b44bc6 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:00.243014 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f212e04efe29445f81d9ed385928b936"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:00.243544 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f212e04efe29445f81d9ed385928b936 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:00.244443 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet ca733de7babe4343ab26dbca2c9020b2 with delete_type TABLET_DATA_DELETED (replaced by tablet 264a65bd642648e59998fb55fb3c8de1) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:00.244560 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 467) took 3485 ms. Trace:
I20260810 19:48:00.244652 10375 rpcz_store.cc:276] 0810 19:47:56.759378 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.194951 (+435573us) service_pool.cc:224] Handling call
0810 19:48:00.200632 (+3005681us) ts_tablet_manager.cc:1151] Deleting tablet 8d93821ff46a4096a8ebbac83faabed7
0810 19:48:00.200642 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.244532 (+ 43890us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3005450}
W20260810 19:48:00.245879 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 8d93821ff46a4096a8ebbac83faabed7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d93821ff46a4096a8ebbac83faabed7 already in progress: creating tablet
I20260810 19:48:00.247721 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 468) took 3482 ms. Trace:
I20260810 19:48:00.247874 10375 rpcz_store.cc:276] 0810 19:47:56.764872 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.195203 (+430331us) service_pool.cc:224] Handling call
0810 19:48:00.246443 (+3051240us) ts_tablet_manager.cc:1151] Deleting tablet 48eee4ce10114021855075812e356652
0810 19:48:00.246454 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.247697 (+ 1243us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3051062}
I20260810 19:48:00.252121 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_84322bc8610f43e086b0d790bd3e153f" } new_table_name: "default.Table_183640cc5442498ebffedcc23416d8d1" modify_external_catalogs: true
I20260810 19:48:00.256493 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e51b38a7ab0c47ce830475f655cb0519" } new_table_name: "default.Table_829e0547546046f086c33c6c3b66fd3f" modify_external_catalogs: true
I20260810 19:48:00.257040 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 3159795344ae492fb099fca0e52fcf20 with delete_type TABLET_DATA_DELETED (replaced by tablet 629cfbd55c0b4a2fbe43f41cdefa85f8) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:00.257287 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet dd632a01fe424a3a956d445ce01e31d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:00.259927 10366 tablet_bootstrap.cc:654] T 45194cae6ea44d9d8cf856d256fd534f P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:00.260535 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a1fa6532e8104ca59b2dca19999e2e61" } modify_external_catalogs: true
I20260810 19:48:00.261276 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a5aa062540ad4b02bf89b59e8ebc8cd7" } modify_external_catalogs: true
I20260810 19:48:00.262668 11410 raft_consensus.cc:493] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:00.262807 11410 raft_consensus.cc:515] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.263451 11410 leader_election.cc:290] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:00.248631 10127 tablet_service.cc:1558] Processing DeleteTablet for tablet 3159795344ae492fb099fca0e52fcf20 with delete_type TABLET_DATA_DELETED (replaced by tablet 629cfbd55c0b4a2fbe43f41cdefa85f8) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:00.255009 11518 raft_consensus.cc:493] T c7235af514fa47d899d7e38ee5662f6c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:00.264110 11518 raft_consensus.cc:515] T c7235af514fa47d899d7e38ee5662f6c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.264828 11518 leader_election.cc:290] T c7235af514fa47d899d7e38ee5662f6c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:00.265417 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd632a01fe424a3a956d445ce01e31d2" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:00.265601 10168 raft_consensus.cc:2468] T dd632a01fe424a3a956d445ce01e31d2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:00.266072 9830 leader_election.cc:304] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:00.266158 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7235af514fa47d899d7e38ee5662f6c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:00.266363 9831 leader_election.cc:343] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: dd632a01fe424a3a956d445ce01e31d2
W20260810 19:48:00.266737 10067 leader_election.cc:343] T c7235af514fa47d899d7e38ee5662f6c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:00.266978 11410 raft_consensus.cc:2804] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:00.267060 11410 raft_consensus.cc:493] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:00.267122 11410 raft_consensus.cc:3060] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:00.259640 10144 tablet_service.cc:1511] Processing CreateTablet for tablet e28348b22e184b5993a4abc5859de6c3 (DEFAULT_TABLE table=default.Table_e51b38a7ab0c47ce830475f655cb0519 [id=7b48278aedfe473aa4f51fb93e52e991]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.267578 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e28348b22e184b5993a4abc5859de6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.269554 10377 ts_tablet_manager.cc:1929] T f8e4de89977b4caf91b2c0a49d147d17 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:00.269656 10377 log.cc:1199] T f8e4de89977b4caf91b2c0a49d147d17 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/f8e4de89977b4caf91b2c0a49d147d17
I20260810 19:48:00.269970 11410 raft_consensus.cc:515] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:00.270583 10068 leader_election.cc:343] T c7235af514fa47d899d7e38ee5662f6c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: c7235af514fa47d899d7e38ee5662f6c
I20260810 19:48:00.270711 11410 leader_election.cc:290] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:00.270706 10068 leader_election.cc:304] T c7235af514fa47d899d7e38ee5662f6c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:00.271333 11518 raft_consensus.cc:2749] T c7235af514fa47d899d7e38ee5662f6c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:00.272104 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 48eee4ce10114021855075812e356652 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 48eee4ce10114021855075812e356652 already in progress: creating tablet
I20260810 19:48:00.272280 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd632a01fe424a3a956d445ce01e31d2" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:00.272457 10168 raft_consensus.cc:3060] T dd632a01fe424a3a956d445ce01e31d2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:00.272583 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 472) took 3433 ms. Trace:
I20260810 19:48:00.272665 10375 rpcz_store.cc:276] 0810 19:47:56.839223 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.210197 (+370974us) service_pool.cc:224] Handling call
0810 19:48:00.272438 (+3062241us) ts_tablet_manager.cc:1151] Deleting tablet 749cea5cd8f842b891f4e2cab07c054e
0810 19:48:00.272452 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.272561 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3019347}
W20260810 19:48:00.273198 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 749cea5cd8f842b891f4e2cab07c054e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 749cea5cd8f842b891f4e2cab07c054e already in progress: creating tablet
I20260810 19:48:00.275457 10168 raft_consensus.cc:2468] T dd632a01fe424a3a956d445ce01e31d2 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:00.276795 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 473) took 3435 ms. Trace:
I20260810 19:48:00.276889 10375 rpcz_store.cc:276] 0810 19:47:56.841460 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.250424 (+408964us) service_pool.cc:224] Handling call
0810 19:48:00.276613 (+3026189us) ts_tablet_manager.cc:1151] Deleting tablet ee5f38d91bb349a9ae1da8ba69d2ddbc
0810 19:48:00.276626 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.276771 (+ 145us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2946965}
I20260810 19:48:00.277065 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_66575d35b8014f0bbbceffff435faf55" } new_table_name: "default.Table_fff297e0905545af8312917aed52cbc0" modify_external_catalogs: true
W20260810 19:48:00.277418 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet ee5f38d91bb349a9ae1da8ba69d2ddbc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee5f38d91bb349a9ae1da8ba69d2ddbc already in progress: creating tablet
I20260810 19:48:00.279075 10128 tablet_service.cc:1558] Processing DeleteTablet for tablet c7235af514fa47d899d7e38ee5662f6c with delete_type TABLET_DATA_DELETED (replaced by tablet 0bddaf5b5fc1404e83b079ffa97e7321) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:00.279316 10127 tablet_service.cc:1558] Processing DeleteTablet for tablet e959898b2c4c4173aea107d3f090ca07 with delete_type TABLET_DATA_DELETED (replaced by tablet e68916e2568f4527a181342cdc728001) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:00.280632 10375 tablet_replica.cc:333] T 3badc88d94a34ff7a053ed312f0dd646 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:00.285254 10375 raft_consensus.cc:2243] T 3badc88d94a34ff7a053ed312f0dd646 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:00.287134 10375 raft_consensus.cc:2272] T 3badc88d94a34ff7a053ed312f0dd646 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.287251 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet dd632a01fe424a3a956d445ce01e31d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:00.288277 10375 ts_tablet_manager.cc:1916] T 3badc88d94a34ff7a053ed312f0dd646 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.269960 10377 ts_tablet_manager.cc:1950] T f8e4de89977b4caf91b2c0a49d147d17 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:00.276023 9830 leader_election.cc:304] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
W20260810 19:48:00.291832 9831 leader_election.cc:343] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: dd632a01fe424a3a956d445ce01e31d2
I20260810 19:48:00.294229 11561 raft_consensus.cc:2804] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:00.296293 11561 raft_consensus.cc:697] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:00.303937 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a1fa6532e8104ca59b2dca19999e2e61" } modify_external_catalogs: true
I20260810 19:48:00.305665 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a5aa062540ad4b02bf89b59e8ebc8cd7" } modify_external_catalogs: true
I20260810 19:48:00.310561 9412 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet bc753970b2464e38b03e377551276343 (table default.Table_87ca145e91d149a68ef630e3a29795b4 [id=fd9deda7275b423b9f9c85aa22dde728]). Expected version 2 got 0
I20260810 19:48:00.314653 9421 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet d77785d9bde843bc8366fe15d1b4fa18 (table default.Table_3e78e13c8ecc464eb6af12a2bc3f2eba [id=1af2d06c44b643e28d28bb080cd5eef8]). Expected version 2 got 0
I20260810 19:48:00.317926 11561 consensus_queue.cc:237] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.324290 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b1dee343716e4e969055ae6ed5d93b60" } modify_external_catalogs: true
I20260810 19:48:00.324645 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b1dee343716e4e969055ae6ed5d93b60" } modify_external_catalogs: true
I20260810 19:48:00.326853 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_cc256890a9a1416588021bfab5b9ee71" } modify_external_catalogs: true
I20260810 19:48:00.327037 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_cc256890a9a1416588021bfab5b9ee71" } modify_external_catalogs: true
I20260810 19:48:00.329665 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2327dde0dc2d4073bda65e867c965c02"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:00.331429 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2327dde0dc2d4073bda65e867c965c02 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:00.335531 10366 tablet_bootstrap.cc:492] T 45194cae6ea44d9d8cf856d256fd534f P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:00.335700 10366 ts_tablet_manager.cc:1403] T 45194cae6ea44d9d8cf856d256fd534f P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.188s user 0.003s sys 0.001s
I20260810 19:48:00.336563 10366 raft_consensus.cc:359] T 45194cae6ea44d9d8cf856d256fd534f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.336748 10366 raft_consensus.cc:385] T 45194cae6ea44d9d8cf856d256fd534f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.336805 10366 raft_consensus.cc:740] T 45194cae6ea44d9d8cf856d256fd534f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:00.337011 10366 consensus_queue.cc:260] T 45194cae6ea44d9d8cf856d256fd534f P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.342598 10375 ts_tablet_manager.cc:1929] T 3badc88d94a34ff7a053ed312f0dd646 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:00.344029 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 546) took 1728 ms. Trace:
I20260810 19:48:00.344494 10370 tablet_bootstrap.cc:492] T e247ae3828e84092b836f3dd07b44bc6 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:00.344669 10370 ts_tablet_manager.cc:1403] T e247ae3828e84092b836f3dd07b44bc6 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.106s user 0.005s sys 0.000s
I20260810 19:48:00.344285 10377 rpcz_store.cc:276] 0810 19:47:58.615080 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.671964 (+ 56884us) service_pool.cc:224] Handling call
0810 19:48:00.151998 (+1480034us) ts_tablet_manager.cc:1151] Deleting tablet f8e4de89977b4caf91b2c0a49d147d17
0810 19:48:00.152016 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.265936 (+113920us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.269489 (+ 3553us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.343975 (+ 74486us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1473081}
I20260810 19:48:00.345352 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet f8e4de89977b4caf91b2c0a49d147d17 (table default.Table_7b186c06f7bd4a98937d92630880d907 [id=aaa80fee4a8b4bed8ca573347cd60268]) successfully deleted
I20260810 19:48:00.345587 10370 raft_consensus.cc:359] T e247ae3828e84092b836f3dd07b44bc6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.345806 10370 raft_consensus.cc:385] T e247ae3828e84092b836f3dd07b44bc6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.345865 10370 raft_consensus.cc:740] T e247ae3828e84092b836f3dd07b44bc6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:00.346118 10370 consensus_queue.cc:260] T e247ae3828e84092b836f3dd07b44bc6 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.346359 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 537) took 2238 ms. Trace:
I20260810 19:48:00.346797 10370 ts_tablet_manager.cc:1434] T e247ae3828e84092b836f3dd07b44bc6 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 19:48:00.347200 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_43667bdf61e944278a0faf9e66d7a1e4" } modify_external_catalogs: true
I20260810 19:48:00.347769 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_43667bdf61e944278a0faf9e66d7a1e4" } modify_external_catalogs: true
I20260810 19:48:00.349555 10370 tablet_bootstrap.cc:492] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:00.346536 10377 rpcz_store.cc:276] 0810 19:47:58.107421 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.566852 (+459431us) service_pool.cc:224] Handling call
0810 19:48:00.346004 (+1779152us) ts_tablet_manager.cc:1151] Deleting tablet 348fcf52fe1f4a3f9931487ebeba9311
0810 19:48:00.346017 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.346213 (+ 196us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1665645}
I20260810 19:48:00.352808 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 547) took 1647 ms. Trace:
I20260810 19:48:00.353585 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet e247ae3828e84092b836f3dd07b44bc6 with delete_type TABLET_DATA_DELETED (replaced by tablet 839dcdb448d14a8f8e452145ccf41263) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:00.353963 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 348fcf52fe1f4a3f9931487ebeba9311 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 348fcf52fe1f4a3f9931487ebeba9311 already in progress: creating tablet
I20260810 19:48:00.353072 10377 rpcz_store.cc:276] 0810 19:47:58.705184 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.705262 (+ 78us) service_pool.cc:224] Handling call
0810 19:48:00.352498 (+1647236us) ts_tablet_manager.cc:1151] Deleting tablet 55fb03a8dd3b40f5ba3de41fa7c01f5d
0810 19:48:00.352540 (+ 42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.352756 (+ 216us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1607453}
W20260810 19:48:00.356186 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 10dd7891d4d844fc8f7a8674ee57627f consensus state has no leader
I20260810 19:48:00.357836 10370 tablet_bootstrap.cc:654] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:00.358443 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 55fb03a8dd3b40f5ba3de41fa7c01f5d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 55fb03a8dd3b40f5ba3de41fa7c01f5d already in progress: creating tablet
W20260810 19:48:00.360023 10068 consensus_peers.cc:597] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6992e7ef8e794ddc879ae04f9f78b8bd. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:00.360353 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 549) took 1604 ms. Trace:
I20260810 19:48:00.360807 10377 rpcz_store.cc:276] 0810 19:47:58.755889 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.755996 (+ 107us) service_pool.cc:224] Handling call
0810 19:48:00.359682 (+1603686us) ts_tablet_manager.cc:1151] Deleting tablet 7de27c3442584746b76ea838d38f0b9b
0810 19:48:00.359703 (+ 21us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.360230 (+ 527us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1602960}
I20260810 19:48:00.343708 10375 log.cc:1199] T 3badc88d94a34ff7a053ed312f0dd646 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/3badc88d94a34ff7a053ed312f0dd646
W20260810 19:48:00.362279 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 7de27c3442584746b76ea838d38f0b9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7de27c3442584746b76ea838d38f0b9b already in progress: creating tablet
I20260810 19:48:00.364037 10375 ts_tablet_manager.cc:1950] T 3badc88d94a34ff7a053ed312f0dd646 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:00.367579 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 544) took 1843 ms. Trace:
I20260810 19:48:00.368096 10377 rpcz_store.cc:276] 0810 19:47:58.523775 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.664148 (+140373us) service_pool.cc:224] Handling call
0810 19:48:00.366920 (+1702772us) ts_tablet_manager.cc:1151] Deleting tablet 971e9abee86444a7a9e923b0962ae751
0810 19:48:00.366939 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.367499 (+ 560us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1583501}
W20260810 19:48:00.369628 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 971e9abee86444a7a9e923b0962ae751 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 971e9abee86444a7a9e923b0962ae751 already in progress: creating tablet
W20260810 19:48:00.370363 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e28348b22e184b5993a4abc5859de6c3 consensus state has no leader
I20260810 19:48:00.370579 10377 tablet_replica.cc:333] T 11272d47d96f443187d63c184049871f P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:00.370855 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 480) took 3373 ms. Trace:
I20260810 19:48:00.371891 10377 raft_consensus.cc:2243] T 11272d47d96f443187d63c184049871f P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:00.372656 10377 raft_consensus.cc:2272] T 11272d47d96f443187d63c184049871f P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.371625 10375 rpcz_store.cc:276] 0810 19:47:56.997153 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.495765 (+498612us) service_pool.cc:224] Handling call
0810 19:48:00.280573 (+2784808us) ts_tablet_manager.cc:1151] Deleting tablet 3badc88d94a34ff7a053ed312f0dd646
0810 19:48:00.280584 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.312294 (+ 31710us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.341323 (+ 29029us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.370658 (+ 29335us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2783726}
I20260810 19:48:00.374363 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 3badc88d94a34ff7a053ed312f0dd646 (table default.Table_aa9a8825478043949020967cf580deca [id=7a0ce9b2817b49649075fde8c8bf9070]) successfully deleted
I20260810 19:48:00.376031 10377 ts_tablet_manager.cc:1916] T 11272d47d96f443187d63c184049871f P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.376847 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 481) took 3377 ms. Trace:
I20260810 19:48:00.377712 10375 rpcz_store.cc:276] 0810 19:47:56.999515 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.496889 (+497374us) service_pool.cc:224] Handling call
0810 19:48:00.375126 (+2878237us) ts_tablet_manager.cc:1151] Deleting tablet 9b40fd0d57ea4b71aeef2d66f4958ac8
0810 19:48:00.375319 (+ 193us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.376647 (+ 1328us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2854588}
W20260810 19:48:00.381106 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 9b40fd0d57ea4b71aeef2d66f4958ac8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b40fd0d57ea4b71aeef2d66f4958ac8 already in progress: creating tablet
I20260810 19:48:00.383803 10370 tablet_bootstrap.cc:492] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:00.384097 10370 ts_tablet_manager.cc:1403] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.005s
I20260810 19:48:00.384878 10366 ts_tablet_manager.cc:1434] T 45194cae6ea44d9d8cf856d256fd534f P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.049s user 0.001s sys 0.001s
I20260810 19:48:00.385267 10366 tablet_bootstrap.cc:492] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:00.385869 10370 raft_consensus.cc:359] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.386258 10370 raft_consensus.cc:385] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.386531 10370 raft_consensus.cc:740] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:00.386935 10366 tablet_bootstrap.cc:654] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:00.387084 10370 consensus_queue.cc:260] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.388291 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 489) took 3258 ms. Trace:
I20260810 19:48:00.388844 10375 rpcz_store.cc:276] 0810 19:47:57.129780 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.604052 (+474272us) service_pool.cc:224] Handling call
0810 19:48:00.381569 (+2777517us) ts_tablet_manager.cc:1151] Deleting tablet b54feebc7c9841d89808054602be7913
0810 19:48:00.381823 (+ 254us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.388035 (+ 6212us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2770467}
I20260810 19:48:00.393364 10370 ts_tablet_manager.cc:1434] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.009s user 0.001s sys 0.002s
I20260810 19:48:00.394033 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 490) took 3224 ms. Trace:
W20260810 19:48:00.395099 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet b54feebc7c9841d89808054602be7913 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b54feebc7c9841d89808054602be7913 already in progress: creating tablet
I20260810 19:48:00.395689 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet 6af6dd8913f44e7f966ed2a128ae4fbf with delete_type TABLET_DATA_DELETED (replaced by tablet 320e42f6de6c4452adb7bbb379a156e6) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:00.396637 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet 38b0c6a017dc4afc849090cca7ee8b26 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:00.397086 10370 tablet_bootstrap.cc:492] T b737b216646a4c5baecb88d59bcce4df P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:00.395113 10375 rpcz_store.cc:276] 0810 19:47:57.169454 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.611128 (+441674us) service_pool.cc:224] Handling call
0810 19:48:00.392683 (+2781555us) ts_tablet_manager.cc:1151] Deleting tablet 3520274768ed41abb010bb109127affa
0810 19:48:00.392937 (+ 254us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.394012 (+ 1075us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2767152}
W20260810 19:48:00.399255 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 3520274768ed41abb010bb109127affa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3520274768ed41abb010bb109127affa already in progress: creating tablet
I20260810 19:48:00.399848 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 491) took 3205 ms. Trace:
I20260810 19:48:00.400656 10375 rpcz_store.cc:276] 0810 19:47:57.194523 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.624888 (+430365us) service_pool.cc:224] Handling call
0810 19:48:00.398380 (+2773492us) ts_tablet_manager.cc:1151] Deleting tablet f5fa6060b9ef48cea6830cd9d19424ea
0810 19:48:00.398629 (+ 249us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.399478 (+ 849us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2766350}
W20260810 19:48:00.402913 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet f5fa6060b9ef48cea6830cd9d19424ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5fa6060b9ef48cea6830cd9d19424ea already in progress: creating tablet
I20260810 19:48:00.403258 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 488) took 3286 ms. Trace:
I20260810 19:48:00.403944 10375 rpcz_store.cc:276] 0810 19:47:57.117243 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.596482 (+479239us) service_pool.cc:224] Handling call
0810 19:48:00.402483 (+2806001us) ts_tablet_manager.cc:1151] Deleting tablet b5f30148b5c84f7cbdfabd0186611cc4
0810 19:48:00.402497 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.403235 (+ 738us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2751744}
W20260810 19:48:00.405707 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet b5f30148b5c84f7cbdfabd0186611cc4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5f30148b5c84f7cbdfabd0186611cc4 already in progress: creating tablet
I20260810 19:48:00.406853 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 516) took 2524 ms. Trace:
I20260810 19:48:00.407527 10375 rpcz_store.cc:276] 0810 19:47:57.882195 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.882372 (+ 177us) service_pool.cc:224] Handling call
0810 19:48:00.405746 (+2523374us) ts_tablet_manager.cc:1151] Deleting tablet 985440898cc04a98877c15a5122a7dd3
0810 19:48:00.405940 (+ 194us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.406829 (+ 889us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2523129}
W20260810 19:48:00.409837 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 985440898cc04a98877c15a5122a7dd3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 985440898cc04a98877c15a5122a7dd3 already in progress: creating tablet
I20260810 19:48:00.410228 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 517) took 2527 ms. Trace:
I20260810 19:48:00.411269 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet bb1e4400ca684da7b3b5e6592e19b6e6
I20260810 19:48:00.410841 10375 rpcz_store.cc:276] 0810 19:47:57.882698 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.882752 (+ 54us) service_pool.cc:224] Handling call
0810 19:48:00.409380 (+2526628us) ts_tablet_manager.cc:1151] Deleting tablet bafc42f0cdf94ebd823dfb678df8a83b
0810 19:48:00.409392 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.410203 (+ 811us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2526260}
I20260810 19:48:00.411964 10370 tablet_bootstrap.cc:654] T b737b216646a4c5baecb88d59bcce4df P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:00.413529 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet bb1e4400ca684da7b3b5e6592e19b6e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:00.414783 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 519) took 2512 ms. Trace:
I20260810 19:48:00.415408 10375 rpcz_store.cc:276] 0810 19:47:57.902366 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.902429 (+ 63us) service_pool.cc:224] Handling call
0810 19:48:00.413748 (+2511319us) ts_tablet_manager.cc:1151] Deleting tablet 3b6187dbe1ca42f79bf3eddd5475b929
0810 19:48:00.413955 (+ 207us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.414580 (+ 625us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2509839}
W20260810 19:48:00.416733 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet bafc42f0cdf94ebd823dfb678df8a83b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bafc42f0cdf94ebd823dfb678df8a83b already in progress: creating tablet
I20260810 19:48:00.416672 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet bb1e4400ca684da7b3b5e6592e19b6e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:00.417716 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 3b6187dbe1ca42f79bf3eddd5475b929 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b6187dbe1ca42f79bf3eddd5475b929 already in progress: creating tablet
I20260810 19:48:00.417237 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet bb1e4400ca684da7b3b5e6592e19b6e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:00.418566 11724 raft_consensus.cc:493] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:00.418725 11724 raft_consensus.cc:515] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.419445 11724 leader_election.cc:290] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:00.419173 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 518) took 2517 ms. Trace:
I20260810 19:48:00.420058 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ae76035c86954fd0b296d6461d767a59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:00.420565 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b722c43ee4b8698b19b2b6c1b401d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:00.420774 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae76035c86954fd0b296d6461d767a59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:00.419613 10375 rpcz_store.cc:276] 0810 19:47:57.901923 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.905293 (+ 3370us) service_pool.cc:224] Handling call
0810 19:48:00.417992 (+2512699us) ts_tablet_manager.cc:1151] Deleting tablet e18d0da099b749f1bc9d9d276277b68f
0810 19:48:00.418185 (+ 193us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.418974 (+ 789us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2512210}
I20260810 19:48:00.421284 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b722c43ee4b8698b19b2b6c1b401d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:00.422132 9611 leader_election.cc:343] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:00.422207 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_5282e99c68244e1fa33fbe374acd2ea4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:00.422434 9611 leader_election.cc:343] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:00.422530 9611 leader_election.cc:304] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:00.422686 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 521) took 2470 ms. Trace:
W20260810 19:48:00.422936 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5282e99c68244e1fa33fbe374acd2ea4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:00.423538 11724 raft_consensus.cc:2749] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:00.422978 10375 rpcz_store.cc:276] 0810 19:47:57.952144 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.952201 (+ 57us) service_pool.cc:224] Handling call
0810 19:48:00.422003 (+2469802us) ts_tablet_manager.cc:1151] Deleting tablet 348fcf52fe1f4a3f9931487ebeba9311
0810 19:48:00.422116 (+ 113us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.422563 (+ 447us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2469584}
W20260810 19:48:00.424423 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet e18d0da099b749f1bc9d9d276277b68f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e18d0da099b749f1bc9d9d276277b68f already in progress: creating tablet
I20260810 19:48:00.424486 10375 tablet_replica.cc:333] T 4f2d7c165d2c465d9080b927d54807f7 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
W20260810 19:48:00.424742 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 348fcf52fe1f4a3f9931487ebeba9311 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 348fcf52fe1f4a3f9931487ebeba9311 already in progress: creating tablet
I20260810 19:48:00.425432 10375 raft_consensus.cc:2243] T 4f2d7c165d2c465d9080b927d54807f7 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:00.426162 10375 raft_consensus.cc:2272] T 4f2d7c165d2c465d9080b927d54807f7 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.429688 11724 raft_consensus.cc:493] T 3c828ae089774fb9b0582141f4b99313 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:00.429323 10375 ts_tablet_manager.cc:1916] T 4f2d7c165d2c465d9080b927d54807f7 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.429855 11724 raft_consensus.cc:515] T 3c828ae089774fb9b0582141f4b99313 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.430569 11724 leader_election.cc:290] T 3c828ae089774fb9b0582141f4b99313 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:00.431779 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c828ae089774fb9b0582141f4b99313" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:00.431953 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a8963894d23348d3844ab5377762d249 consensus state has no leader
I20260810 19:48:00.432382 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c828ae089774fb9b0582141f4b99313" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:00.433480 9611 leader_election.cc:343] T 3c828ae089774fb9b0582141f4b99313 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:00.433732 9611 leader_election.cc:343] T 3c828ae089774fb9b0582141f4b99313 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:00.433820 9611 leader_election.cc:304] T 3c828ae089774fb9b0582141f4b99313 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:00.434376 11724 raft_consensus.cc:2749] T 3c828ae089774fb9b0582141f4b99313 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:00.441779 10370 tablet_bootstrap.cc:492] T b737b216646a4c5baecb88d59bcce4df P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:00.442068 10370 ts_tablet_manager.cc:1403] T b737b216646a4c5baecb88d59bcce4df P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.046s user 0.008s sys 0.000s
I20260810 19:48:00.443832 10370 raft_consensus.cc:359] T b737b216646a4c5baecb88d59bcce4df P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.444191 10370 raft_consensus.cc:385] T b737b216646a4c5baecb88d59bcce4df P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.444317 10370 raft_consensus.cc:740] T b737b216646a4c5baecb88d59bcce4df P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:00.444732 10370 consensus_queue.cc:260] T b737b216646a4c5baecb88d59bcce4df P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.447973 10370 ts_tablet_manager.cc:1434] T b737b216646a4c5baecb88d59bcce4df P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260810 19:48:00.451014 10370 tablet_bootstrap.cc:492] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:48:00.458395 11541 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 19:48:00.458864 11541 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 19:48:00.458990 11541 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260810 19:48:00.461633 10370 tablet_bootstrap.cc:654] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:00.473816 11541 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 19:48:00.473955 11541 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 19:48:00.474048 11541 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 19:48:00.474116 11541 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260810 19:48:00.475795 10377 ts_tablet_manager.cc:1929] T 11272d47d96f443187d63c184049871f P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:00.476972 11724 raft_consensus.cc:493] T 4e80e2327c394612bffc51f38798dac3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:00.476656 10375 ts_tablet_manager.cc:1929] T 4f2d7c165d2c465d9080b927d54807f7 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:00.477152 11724 raft_consensus.cc:515] T 4e80e2327c394612bffc51f38798dac3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.477715 10375 log.cc:1199] T 4f2d7c165d2c465d9080b927d54807f7 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/4f2d7c165d2c465d9080b927d54807f7
I20260810 19:48:00.477926 11724 leader_election.cc:290] T 4e80e2327c394612bffc51f38798dac3 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:00.479249 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e80e2327c394612bffc51f38798dac3" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:00.479986 10375 ts_tablet_manager.cc:1950] T 4f2d7c165d2c465d9080b927d54807f7 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
W20260810 19:48:00.480068 9611 leader_election.cc:343] T 4e80e2327c394612bffc51f38798dac3 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:00.480778 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e80e2327c394612bffc51f38798dac3" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:00.481406 9611 leader_election.cc:343] T 4e80e2327c394612bffc51f38798dac3 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:00.481528 9611 leader_election.cc:304] T 4e80e2327c394612bffc51f38798dac3 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:00.482055 11724 raft_consensus.cc:2749] T 4e80e2327c394612bffc51f38798dac3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:00.486436 10370 tablet_bootstrap.cc:492] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:00.486841 10370 ts_tablet_manager.cc:1403] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.003s
I20260810 19:48:00.487569 10377 log.cc:1199] T 11272d47d96f443187d63c184049871f P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/11272d47d96f443187d63c184049871f
I20260810 19:48:00.488020 10377 ts_tablet_manager.cc:1950] T 11272d47d96f443187d63c184049871f P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:00.488534 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 551) took 1718 ms. Trace:
I20260810 19:48:00.488396 10370 raft_consensus.cc:359] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.488649 10377 rpcz_store.cc:276] 0810 19:47:58.769846 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.769927 (+ 81us) service_pool.cc:224] Handling call
0810 19:48:00.370355 (+1600428us) ts_tablet_manager.cc:1151] Deleting tablet 11272d47d96f443187d63c184049871f
0810 19:48:00.370373 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.427956 (+ 57583us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.475464 (+ 47508us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.488491 (+ 13027us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1584667}
I20260810 19:48:00.488780 10370 raft_consensus.cc:385] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.488867 10370 raft_consensus.cc:740] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:00.489073 10377 tablet_replica.cc:333] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:00.489272 10377 raft_consensus.cc:2243] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:00.489379 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 11272d47d96f443187d63c184049871f (table default.Table_b8c16d5ca4ee41fbaf84f9e6e6fbb3bd [id=6e9c569b1e104415ba75fb011a08a6d9]) successfully deleted
I20260810 19:48:00.489485 10377 raft_consensus.cc:2272] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.489341 10370 consensus_queue.cc:260] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.490651 10377 ts_tablet_manager.cc:1916] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.491389 11541 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.235.212:46393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.235.254:33891,127.8.235.253:37397,127.8.235.252:43301
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.235.253:37397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.235.253
--webserver_port=37717
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 19:43:23 UTC on bdcb31816ec0
build id 13278
ASAN enabled
I20260810 19:48:00.491526 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d1e72b2bbecd434e9ff0c7eaf6201b42" } new_table_name: "default.Table_d195688055bd4cfca1a9462585af71bc" modify_external_catalogs: true
I20260810 19:48:00.492031 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 523) took 2529 ms. Trace:
I20260810 19:48:00.492683 10370 ts_tablet_manager.cc:1434] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.006s user 0.001s sys 0.002s
I20260810 19:48:00.492615 10375 rpcz_store.cc:276] 0810 19:47:57.962532 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:57.962640 (+ 108us) service_pool.cc:224] Handling call
0810 19:48:00.424218 (+2461578us) ts_tablet_manager.cc:1151] Deleting tablet 4f2d7c165d2c465d9080b927d54807f7
0810 19:48:00.424232 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.459836 (+ 35604us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.476239 (+ 16403us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.491844 (+ 15605us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2460922}
I20260810 19:48:00.493818 11541 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 19:48:00.494752 10370 tablet_bootstrap.cc:492] T 3f18c24b01384299a4f941d7fb840032 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:00.495657 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 529) took 2332 ms. Trace:
I20260810 19:48:00.496253 10375 rpcz_store.cc:276] 0810 19:47:58.163529 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.163597 (+ 68us) service_pool.cc:224] Handling call
0810 19:48:00.494642 (+2331045us) ts_tablet_manager.cc:1151] Deleting tablet 971e9abee86444a7a9e923b0962ae751
0810 19:48:00.494827 (+ 185us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.495632 (+ 805us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2330611}
I20260810 19:48:00.497716 10366 tablet_bootstrap.cc:492] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:00.497874 10366 ts_tablet_manager.cc:1403] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.113s user 0.003s sys 0.000s
I20260810 19:48:00.498639 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 4f2d7c165d2c465d9080b927d54807f7 (table default.Table_35ada13f5f5a41b0a93a57276b7756d9 [id=fa3844f34a5b4d55b6e87ec2164eb8fb]) successfully deleted
I20260810 19:48:00.498807 10366 raft_consensus.cc:359] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:00.498974 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 971e9abee86444a7a9e923b0962ae751 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 971e9abee86444a7a9e923b0962ae751 already in progress: creating tablet
I20260810 19:48:00.498999 10366 raft_consensus.cc:385] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.499055 10366 raft_consensus.cc:740] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:00.499284 10366 consensus_queue.cc:260] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.499820 10366 ts_tablet_manager.cc:1434] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 19:48:00.499594 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 530) took 2003 ms. Trace:
I20260810 19:48:00.500190 10366 tablet_bootstrap.cc:492] T c7235af514fa47d899d7e38ee5662f6c P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:00.500432 11541 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260810 19:48:00.500207 10375 rpcz_store.cc:276] 0810 19:47:58.495623 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.495674 (+ 51us) service_pool.cc:224] Handling call
0810 19:48:00.498567 (+2002893us) ts_tablet_manager.cc:1151] Deleting tablet 3582ed23ffdf4ff089952e29083e5425
0810 19:48:00.498581 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.499402 (+ 821us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2002495}
I20260810 19:48:00.502282 10375 tablet_replica.cc:333] T f8e4de89977b4caf91b2c0a49d147d17 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:00.503698 10375 raft_consensus.cc:2243] T f8e4de89977b4caf91b2c0a49d147d17 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260810 19:48:00.505126 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 3582ed23ffdf4ff089952e29083e5425 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3582ed23ffdf4ff089952e29083e5425 already in progress: creating tablet
I20260810 19:48:00.505329 10375 raft_consensus.cc:2272] T f8e4de89977b4caf91b2c0a49d147d17 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.508558 10370 tablet_bootstrap.cc:654] T 3f18c24b01384299a4f941d7fb840032 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:00.510008 10375 ts_tablet_manager.cc:1916] T f8e4de89977b4caf91b2c0a49d147d17 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.518601 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet b91737c2129e4ca385b4e1c8999c62b4
I20260810 19:48:00.521908 9415 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d (table default.Table_5e6891ff4aa040be8b327aafa596bc7e [id=fd840f00bdc5477aaad0b7fa114870dd]). Expected version 1 got 0
I20260810 19:48:00.522149 10366 tablet_bootstrap.cc:654] T c7235af514fa47d899d7e38ee5662f6c P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:00.524015 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet b91737c2129e4ca385b4e1c8999c62b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:00.526229 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet b91737c2129e4ca385b4e1c8999c62b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:00.526425 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet b91737c2129e4ca385b4e1c8999c62b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:00.531424 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_d64b095dd9e84a8c974131583cd0df88"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:00.534873 10370 tablet_bootstrap.cc:492] T 3f18c24b01384299a4f941d7fb840032 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:00.535214 10370 ts_tablet_manager.cc:1403] T 3f18c24b01384299a4f941d7fb840032 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.005s
W20260810 19:48:00.535486 11786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 19:48:00.537358 10366 tablet_bootstrap.cc:492] T c7235af514fa47d899d7e38ee5662f6c P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:00.537547 10366 ts_tablet_manager.cc:1403] T c7235af514fa47d899d7e38ee5662f6c P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.037s user 0.011s sys 0.000s
I20260810 19:48:00.537415 10370 raft_consensus.cc:359] T 3f18c24b01384299a4f941d7fb840032 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.537827 10370 raft_consensus.cc:385] T 3f18c24b01384299a4f941d7fb840032 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.538028 10370 raft_consensus.cc:740] T 3f18c24b01384299a4f941d7fb840032 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:00.538453 10366 raft_consensus.cc:359] T c7235af514fa47d899d7e38ee5662f6c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.538640 10366 raft_consensus.cc:385] T c7235af514fa47d899d7e38ee5662f6c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.538697 10366 raft_consensus.cc:740] T c7235af514fa47d899d7e38ee5662f6c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:00.538965 10366 consensus_queue.cc:260] T c7235af514fa47d899d7e38ee5662f6c P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.539539 10366 ts_tablet_manager.cc:1434] T c7235af514fa47d899d7e38ee5662f6c P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:00.539070 10370 consensus_queue.cc:260] T 3f18c24b01384299a4f941d7fb840032 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.540953 10366 tablet_bootstrap.cc:492] T e959898b2c4c4173aea107d3f090ca07 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
W20260810 19:48:00.541318 11787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 19:48:00.545042 10370 ts_tablet_manager.cc:1434] T 3f18c24b01384299a4f941d7fb840032 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260810 19:48:00.547576 10370 tablet_bootstrap.cc:492] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:00.561271 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet 45194cae6ea44d9d8cf856d256fd534f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:00.561404 10370 tablet_bootstrap.cc:654] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:00.561745 10375 ts_tablet_manager.cc:1929] T f8e4de89977b4caf91b2c0a49d147d17 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:00.562352 10375 log.cc:1199] T f8e4de89977b4caf91b2c0a49d147d17 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/f8e4de89977b4caf91b2c0a49d147d17
I20260810 19:48:00.550127 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 9e861473094f42dfa22b9c00145ed1fe
I20260810 19:48:00.564800 10375 ts_tablet_manager.cc:1950] T f8e4de89977b4caf91b2c0a49d147d17 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:00.566567 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e861473094f42dfa22b9c00145ed1fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:00.566672 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e861473094f42dfa22b9c00145ed1fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:00.567581 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e861473094f42dfa22b9c00145ed1fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:00.540681 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d64b095dd9e84a8c974131583cd0df88 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:00.570288 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 531) took 2036 ms. Trace:
I20260810 19:48:00.570703 10375 rpcz_store.cc:276] 0810 19:47:58.533442 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.533510 (+ 68us) service_pool.cc:224] Handling call
0810 19:48:00.501882 (+1968372us) ts_tablet_manager.cc:1151] Deleting tablet f8e4de89977b4caf91b2c0a49d147d17
0810 19:48:00.502065 (+ 183us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.530632 (+ 28567us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.561354 (+ 30722us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.570167 (+ 8813us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1968118}
I20260810 19:48:00.572321 10375 tablet_replica.cc:333] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:00.572865 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet f8e4de89977b4caf91b2c0a49d147d17 (table default.Table_7b186c06f7bd4a98937d92630880d907 [id=aaa80fee4a8b4bed8ca573347cd60268]) successfully deleted
I20260810 19:48:00.573215 10375 raft_consensus.cc:2243] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:00.574296 10375 pending_rounds.cc:70] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:00.574559 10375 pending_rounds.cc:77] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058681035862016 op_type: NO_OP noop_request { }
I20260810 19:48:00.575096 10375 raft_consensus.cc:2889] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:00.575515 10375 raft_consensus.cc:2272] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.577168 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_667a9496a2f84ffdb4a98329b167c827" } new_table_name: "default.Table_8751cb940a0d4dc38a56b594b9d65519" modify_external_catalogs: true
I20260810 19:48:00.579378 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet c7235af514fa47d899d7e38ee5662f6c with delete_type TABLET_DATA_DELETED (replaced by tablet 0bddaf5b5fc1404e83b079ffa97e7321) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:00.580266 10375 ts_tablet_manager.cc:1916] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.580639 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_21bf5e30c22c40c4b6fa4c5ea7dbb0a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:00.586447 10370 tablet_bootstrap.cc:492] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:00.586789 10370 ts_tablet_manager.cc:1403] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.040s user 0.007s sys 0.001s
I20260810 19:48:00.587610 10377 ts_tablet_manager.cc:1929] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:00.587747 10377 log.cc:1199] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/ffc4466b82bd49fcaad30e4d5325c7db
I20260810 19:48:00.588145 10377 ts_tablet_manager.cc:1950] T ffc4466b82bd49fcaad30e4d5325c7db P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:00.588533 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 550) took 1818 ms. Trace:
I20260810 19:48:00.588624 10377 rpcz_store.cc:276] 0810 19:47:58.769688 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.770085 (+ 397us) service_pool.cc:224] Handling call
0810 19:48:00.488991 (+1718906us) ts_tablet_manager.cc:1151] Deleting tablet ffc4466b82bd49fcaad30e4d5325c7db
0810 19:48:00.489002 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.525754 (+ 36752us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.587525 (+ 61771us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.588509 (+ 984us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1702063}
I20260810 19:48:00.588531 10370 raft_consensus.cc:359] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.588922 10370 raft_consensus.cc:385] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.589059 10370 raft_consensus.cc:740] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:00.589092 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 548) took 1845 ms. Trace:
I20260810 19:48:00.589170 10377 rpcz_store.cc:276] 0810 19:47:58.755680 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.803119 (+ 47439us) service_pool.cc:224] Handling call
0810 19:48:00.588951 (+1785832us) ts_tablet_manager.cc:1151] Deleting tablet 0bddaf5b5fc1404e83b079ffa97e7321
0810 19:48:00.588961 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.589072 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1766273}
I20260810 19:48:00.589437 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet ffc4466b82bd49fcaad30e4d5325c7db (table default.Table_8680fc2abacb464c8d39fae15165ea39 [id=6d8b87531495425da6e953f4e5c2fb08]) successfully deleted
I20260810 19:48:00.589551 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 575) took 1043 ms. Trace:
I20260810 19:48:00.589612 10377 rpcz_store.cc:276] 0810 19:47:59.545782 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:59.550026 (+ 4244us) service_pool.cc:224] Handling call
0810 19:48:00.589433 (+1039407us) ts_tablet_manager.cc:1151] Deleting tablet 3109703c51e54af78b58e9bbca50af33
0810 19:48:00.589443 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.589535 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1039133}
I20260810 19:48:00.589598 10370 consensus_queue.cc:260] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:00.592975 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 0bddaf5b5fc1404e83b079ffa97e7321 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0bddaf5b5fc1404e83b079ffa97e7321 already in progress: creating tablet
W20260810 19:48:00.593431 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 3109703c51e54af78b58e9bbca50af33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3109703c51e54af78b58e9bbca50af33 already in progress: creating tablet
I20260810 19:48:00.595687 10370 ts_tablet_manager.cc:1434] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260810 19:48:00.596575 11561 raft_consensus.cc:493] T 45194cae6ea44d9d8cf856d256fd534f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:00.596791 11561 raft_consensus.cc:515] T 45194cae6ea44d9d8cf856d256fd534f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.597330 11541 server_base.cc:1061] running on GCE node
I20260810 19:48:00.598865 11561 leader_election.cc:290] T 45194cae6ea44d9d8cf856d256fd534f P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:00.599546 10366 tablet_bootstrap.cc:654] T e959898b2c4c4173aea107d3f090ca07 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:00.599893 9831 leader_election.cc:343] T 45194cae6ea44d9d8cf856d256fd534f P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 45194cae6ea44d9d8cf856d256fd534f
I20260810 19:48:00.599977 10370 tablet_bootstrap.cc:492] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:48:00.601089 9830 leader_election.cc:343] T 45194cae6ea44d9d8cf856d256fd534f P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Not found: Tablet not found: 45194cae6ea44d9d8cf856d256fd534f
W20260810 19:48:00.600364 11795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 19:48:00.601202 9830 leader_election.cc:304] T 45194cae6ea44d9d8cf856d256fd534f P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:00.601423 11769 raft_consensus.cc:2749] T 45194cae6ea44d9d8cf856d256fd534f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:00.603178 11541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 19:48:00.607231 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e750ff6052664ef696dccbd09d3ec5a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:00.608152 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e750ff6052664ef696dccbd09d3ec5a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:00.609483 11518 raft_consensus.cc:493] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:00.609659 11518 raft_consensus.cc:515] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.613838 10370 tablet_bootstrap.cc:654] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:00.614564 11518 leader_election.cc:290] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:00.615291 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc753970b2464e38b03e377551276343" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:00.615880 10067 leader_election.cc:343] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:00.619462 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_cdf7ea6b6e514a2fba968ac13ac259dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:00.620146 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cdf7ea6b6e514a2fba968ac13ac259dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:00.620132 11541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
W20260810 19:48:00.627740 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4b2b0f2fc93647f3bc1d79b4132c3703 consensus state has no leader
I20260810 19:48:00.628203 10366 tablet_bootstrap.cc:492] T e959898b2c4c4173aea107d3f090ca07 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:00.628204 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_da9cdd42af6a42868f3bae64af56f4b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:00.628362 10366 ts_tablet_manager.cc:1403] T e959898b2c4c4173aea107d3f090ca07 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.087s user 0.005s sys 0.008s
W20260810 19:48:00.628868 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da9cdd42af6a42868f3bae64af56f4b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:00.629276 10366 raft_consensus.cc:359] T e959898b2c4c4173aea107d3f090ca07 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.629470 10366 raft_consensus.cc:385] T e959898b2c4c4173aea107d3f090ca07 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.629524 10366 raft_consensus.cc:740] T e959898b2c4c4173aea107d3f090ca07 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:00.629783 10366 consensus_queue.cc:260] T e959898b2c4c4173aea107d3f090ca07 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.633103 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc753970b2464e38b03e377551276343" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:00.633319 9711 raft_consensus.cc:2468] T bc753970b2464e38b03e377551276343 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:00.634557 10366 ts_tablet_manager.cc:1434] T e959898b2c4c4173aea107d3f090ca07 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260810 19:48:00.635210 10375 ts_tablet_manager.cc:1929] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:00.636271 10375 log.cc:1199] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/11272d47d96f443187d63c184049871f
I20260810 19:48:00.636819 11541 hybrid_clock.cc:648] HybridClock initialized: now 1786391280636693 us; error 112 us; skew 500 ppm
I20260810 19:48:00.637351 11541 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 19:48:00.636209 10366 tablet_bootstrap.cc:492] T bc753970b2464e38b03e377551276343 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:00.638154 10375 ts_tablet_manager.cc:1950] T 11272d47d96f443187d63c184049871f P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:00.640585 10068 leader_election.cc:304] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691
I20260810 19:48:00.641268 11663 raft_consensus.cc:2804] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:00.641358 11663 raft_consensus.cc:493] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:00.641434 11663 raft_consensus.cc:3060] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:00.641460 10366 tablet_bootstrap.cc:654] T bc753970b2464e38b03e377551276343 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:00.642416 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 532) took 1995 ms. Trace:
I20260810 19:48:00.642712 10375 rpcz_store.cc:276] 0810 19:47:58.646442 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.646511 (+ 69us) service_pool.cc:224] Handling call
0810 19:48:00.572063 (+1925552us) ts_tablet_manager.cc:1151] Deleting tablet 11272d47d96f443187d63c184049871f
0810 19:48:00.572173 (+ 110us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.613706 (+ 41533us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.634947 (+ 21241us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.642240 (+ 7293us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1925227}
I20260810 19:48:00.644187 10375 tablet_replica.cc:333] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:00.644367 11663 raft_consensus.cc:515] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.644968 10375 raft_consensus.cc:2243] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:00.646087 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc753970b2464e38b03e377551276343" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:00.646153 10375 pending_rounds.cc:70] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:00.646301 10375 pending_rounds.cc:77] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058681245519872 op_type: NO_OP noop_request { }
W20260810 19:48:00.646713 10067 leader_election.cc:343] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:00.646819 10375 raft_consensus.cc:2889] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:00.647222 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc753970b2464e38b03e377551276343" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:00.647130 10375 raft_consensus.cc:2272] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.647401 9711 raft_consensus.cc:3060] T bc753970b2464e38b03e377551276343 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:00.650430 11518 consensus_queue.cc:1048] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:00.650559 10375 ts_tablet_manager.cc:1916] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.645057 11663 leader_election.cc:290] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:00.651736 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21bf5e30c22c40c4b6fa4c5ea7dbb0a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:00.650305 9711 raft_consensus.cc:2468] T bc753970b2464e38b03e377551276343 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:00.654815 10068 leader_election.cc:304] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691
I20260810 19:48:00.655326 11663 raft_consensus.cc:2804] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:00.655462 11663 raft_consensus.cc:697] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:00.655740 11663 consensus_queue.cc:237] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.661918 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 11272d47d96f443187d63c184049871f (table default.Table_b8c16d5ca4ee41fbaf84f9e6e6fbb3bd [id=6e9c569b1e104415ba75fb011a08a6d9]) successfully deleted
I20260810 19:48:00.668289 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 573) took 1122 ms. Trace:
I20260810 19:48:00.672924 11541 webserver.cc:533] Webserver started at http://127.8.235.253:37717/ using document root <none> and password file <none>
I20260810 19:48:00.673377 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ea2f50f9f9423b99af3bd190cfd5a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.674175 11541 fs_manager.cc:362] Metadata directory not provided
I20260810 19:48:00.675072 10367 tablet_bootstrap.cc:654] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:00.676208 11541 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 19:48:00.676378 10371 ts_tablet_manager.cc:1929] T 3f18c24b01384299a4f941d7fb840032 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:00.676486 10371 log.cc:1199] T 3f18c24b01384299a4f941d7fb840032 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/3f18c24b01384299a4f941d7fb840032
I20260810 19:48:00.676775 10371 ts_tablet_manager.cc:1950] T 3f18c24b01384299a4f941d7fb840032 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:00.677074 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8503d5162548463bae22402fdc4c502a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.678447 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e28348b22e184b5993a4abc5859de6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.685200 9944 raft_consensus.cc:3060] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:00.687332 10371 tablet_replica.cc:333] T 3b6187dbe1ca42f79bf3eddd5475b929 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:00.687340 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 3f18c24b01384299a4f941d7fb840032 (table default.Table_5043edeafbb047c6a7619f91323879c2 [id=6287581e5dad45b4b7fd481e9ae5eae3]) successfully deleted
I20260810 19:48:00.687551 10371 raft_consensus.cc:2243] T 3b6187dbe1ca42f79bf3eddd5475b929 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:00.687685 10371 raft_consensus.cc:2272] T 3b6187dbe1ca42f79bf3eddd5475b929 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.688222 10371 ts_tablet_manager.cc:1916] T 3b6187dbe1ca42f79bf3eddd5475b929 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.689440 11518 consensus_queue.cc:1048] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:00.669747 10377 rpcz_store.cc:276] 0810 19:47:59.545594 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:59.553733 (+ 8139us) service_pool.cc:224] Handling call
0810 19:48:00.665958 (+1112225us) ts_tablet_manager.cc:1151] Deleting tablet cb2c9782c034435088f991bef8edf288
0810 19:48:00.666087 (+ 129us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.667891 (+ 1804us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1111728}
I20260810 19:48:00.690739 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 572) took 1145 ms. Trace:
I20260810 19:48:00.690871 10377 rpcz_store.cc:276] 0810 19:47:59.545500 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:59.554009 (+ 8509us) service_pool.cc:224] Handling call
0810 19:48:00.690586 (+1136577us) ts_tablet_manager.cc:1151] Deleting tablet 6ea318eddd8349a79d27ce5746f03798
0810 19:48:00.690601 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.690719 (+ 118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1136423}
W20260810 19:48:00.692051 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet cb2c9782c034435088f991bef8edf288 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb2c9782c034435088f991bef8edf288 already in progress: creating tablet
W20260810 19:48:00.692778 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 6ea318eddd8349a79d27ce5746f03798 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ea318eddd8349a79d27ce5746f03798 already in progress: creating tablet
I20260810 19:48:00.692858 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 574) took 1147 ms. Trace:
I20260810 19:48:00.692940 10377 rpcz_store.cc:276] 0810 19:47:59.545673 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:59.554403 (+ 8730us) service_pool.cc:224] Handling call
0810 19:48:00.692715 (+1138312us) ts_tablet_manager.cc:1151] Deleting tablet b2034784996149158c10b868f61ff418
0810 19:48:00.692728 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.692834 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1138150}
W20260810 19:48:00.693535 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet b2034784996149158c10b868f61ff418 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2034784996149158c10b868f61ff418 already in progress: creating tablet
I20260810 19:48:00.698407 11541 fs_manager.cc:714] Time spent opening directory manager: real 0.017s user 0.002s sys 0.004s
I20260810 19:48:00.700196 10375 ts_tablet_manager.cc:1929] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:00.700337 10375 log.cc:1199] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/6992e7ef8e794ddc879ae04f9f78b8bd
I20260810 19:48:00.700724 10375 ts_tablet_manager.cc:1950] T 6992e7ef8e794ddc879ae04f9f78b8bd P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:00.701689 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 533) took 2051 ms. Trace:
I20260810 19:48:00.701836 10375 rpcz_store.cc:276] 0810 19:47:58.650257 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.650680 (+ 423us) service_pool.cc:224] Handling call
0810 19:48:00.643929 (+1993249us) ts_tablet_manager.cc:1151] Deleting tablet 6992e7ef8e794ddc879ae04f9f78b8bd
0810 19:48:00.644040 (+ 111us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.665438 (+ 21398us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.700113 (+ 34675us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.701643 (+ 1530us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1992941}
I20260810 19:48:00.702246 10375 tablet_replica.cc:333] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:00.702486 10375 raft_consensus.cc:2243] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:00.703295 10375 raft_consensus.cc:2272] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.704644 10375 ts_tablet_manager.cc:1916] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.705036 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 576) took 1051 ms. Trace:
I20260810 19:48:00.705161 10377 rpcz_store.cc:276] 0810 19:47:59.653359 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:59.653801 (+ 442us) service_pool.cc:224] Handling call
0810 19:48:00.704869 (+1051068us) ts_tablet_manager.cc:1151] Deleting tablet 31c2b9a4b8334e678b4632fc2f58dd0c
0810 19:48:00.704884 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.705009 (+ 125us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1049452}
I20260810 19:48:00.705596 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 577) took 1051 ms. Trace:
I20260810 19:48:00.705698 10377 rpcz_store.cc:276] 0810 19:47:59.653720 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:59.654094 (+ 374us) service_pool.cc:224] Handling call
0810 19:48:00.705488 (+1051394us) ts_tablet_manager.cc:1151] Deleting tablet 4c75af1e592042f5a4d442b82a539c94
0810 19:48:00.705498 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.705580 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1047105}
I20260810 19:48:00.706090 10377 tablet_replica.cc:333] T 6992e7ef8e794ddc879ae04f9f78b8bd P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:00.706301 10377 raft_consensus.cc:2243] T 6992e7ef8e794ddc879ae04f9f78b8bd P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:00.706521 10377 raft_consensus.cc:2272] T 6992e7ef8e794ddc879ae04f9f78b8bd P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.707116 11724 raft_consensus.cc:493] T 476e762e46c04ae6bfef5e14df2d16e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:00.707278 11724 raft_consensus.cc:515] T 476e762e46c04ae6bfef5e14df2d16e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.707991 11724 leader_election.cc:290] T 476e762e46c04ae6bfef5e14df2d16e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:00.708211 10377 ts_tablet_manager.cc:1916] T 6992e7ef8e794ddc879ae04f9f78b8bd P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.708580 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476e762e46c04ae6bfef5e14df2d16e2" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:00.709169 9611 leader_election.cc:343] T 476e762e46c04ae6bfef5e14df2d16e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:00.710167 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 31c2b9a4b8334e678b4632fc2f58dd0c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31c2b9a4b8334e678b4632fc2f58dd0c already in progress: creating tablet
W20260810 19:48:00.710584 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 4c75af1e592042f5a4d442b82a539c94 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4c75af1e592042f5a4d442b82a539c94 already in progress: creating tablet
I20260810 19:48:00.710816 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 6992e7ef8e794ddc879ae04f9f78b8bd (table default.Table_abc13875e0d6429897eb19f7117e00f5 [id=3b14f80137654337b24c2bb4131e58d3]) successfully deleted
I20260810 19:48:00.723111 11824 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 19:48:00.723728 10375 ts_tablet_manager.cc:1929] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:00.723882 10375 log.cc:1199] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/7737acd216204209ba0327e26e85cfe6
I20260810 19:48:00.724325 10375 ts_tablet_manager.cc:1950] T 7737acd216204209ba0327e26e85cfe6 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:00.725360 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 534) took 2058 ms. Trace:
I20260810 19:48:00.725471 10375 rpcz_store.cc:276] 0810 19:47:58.667325 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.667405 (+ 80us) service_pool.cc:224] Handling call
0810 19:48:00.702190 (+2034785us) ts_tablet_manager.cc:1151] Deleting tablet 7737acd216204209ba0327e26e85cfe6
0810 19:48:00.702202 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.708181 (+ 5979us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.723633 (+ 15452us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.725329 (+ 1696us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":971136,"tablet-delete.queue_time_us":2034488}
I20260810 19:48:00.725986 10375 tablet_replica.cc:333] T 3916a976efef43428942135e777edcec P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:00.726169 10375 raft_consensus.cc:2243] T 3916a976efef43428942135e777edcec P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:00.726367 10375 raft_consensus.cc:2272] T 3916a976efef43428942135e777edcec P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.726802 10366 tablet_bootstrap.cc:492] T bc753970b2464e38b03e377551276343 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:00.726948 10375 ts_tablet_manager.cc:1916] T 3916a976efef43428942135e777edcec P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.727002 10366 ts_tablet_manager.cc:1403] T bc753970b2464e38b03e377551276343 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.091s user 0.004s sys 0.000s
I20260810 19:48:00.727087 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 7737acd216204209ba0327e26e85cfe6 (table default.Table_f90f1a0c22fa4781812518f44c9d7b17 [id=d12cb82567fd409988672b04a2e05a5b]) successfully deleted
I20260810 19:48:00.727222 11541 fs_manager.cc:730] Time spent opening block manager: real 0.026s user 0.005s sys 0.001s
I20260810 19:48:00.727883 10366 raft_consensus.cc:359] T bc753970b2464e38b03e377551276343 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.728078 10366 raft_consensus.cc:385] T bc753970b2464e38b03e377551276343 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.728133 10366 raft_consensus.cc:740] T bc753970b2464e38b03e377551276343 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:00.727450 11541 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/data,/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/wal
uuid: "f52c40e347e24ab4b3129e7064f4a43e"
format_stamp: "Formatted at 2026-08-10 19:47:42 on dist-test-slave-fgb3"
I20260810 19:48:00.728432 10366 consensus_queue.cc:260] T bc753970b2464e38b03e377551276343 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.728525 11541 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 19:48:00.730700 10366 ts_tablet_manager.cc:1434] T bc753970b2464e38b03e377551276343 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 19:48:00.732390 10366 tablet_bootstrap.cc:492] T c8602b7360b747a3af756b139635d95c P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:00.733664 10375 ts_tablet_manager.cc:1929] T 3916a976efef43428942135e777edcec P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:00.733795 10375 log.cc:1199] T 3916a976efef43428942135e777edcec P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/3916a976efef43428942135e777edcec
I20260810 19:48:00.743317 10366 tablet_bootstrap.cc:654] T c8602b7360b747a3af756b139635d95c P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:00.745862 10375 ts_tablet_manager.cc:1950] T 3916a976efef43428942135e777edcec P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:00.746861 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 535) took 2052 ms. Trace:
I20260810 19:48:00.747001 10375 rpcz_store.cc:276] 0810 19:47:58.694118 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.694195 (+ 77us) service_pool.cc:224] Handling call
0810 19:48:00.725934 (+2031739us) ts_tablet_manager.cc:1151] Deleting tablet 3916a976efef43428942135e777edcec
0810 19:48:00.725942 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.730153 (+ 4211us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.733586 (+ 3433us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.746831 (+ 13245us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2031423}
I20260810 19:48:00.747502 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 536) took 2049 ms. Trace:
I20260810 19:48:00.747592 10375 rpcz_store.cc:276] 0810 19:47:58.698446 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.698515 (+ 69us) service_pool.cc:224] Handling call
0810 19:48:00.747339 (+2048824us) ts_tablet_manager.cc:1151] Deleting tablet 55fb03a8dd3b40f5ba3de41fa7c01f5d
0810 19:48:00.747351 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.747482 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2048474}
I20260810 19:48:00.747645 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 3916a976efef43428942135e777edcec (table default.Table_3e50c2a587f045f090cdb0a281a1267f [id=f881fab647be45f786665629ab8baaee]) successfully deleted
I20260810 19:48:00.747900 10375 tablet_replica.cc:333] T 7d3395886420455d9bdaf816c19ebae2 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:00.748102 10375 raft_consensus.cc:2243] T 7d3395886420455d9bdaf816c19ebae2 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 19:48:00.748229 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 55fb03a8dd3b40f5ba3de41fa7c01f5d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 55fb03a8dd3b40f5ba3de41fa7c01f5d already in progress: creating tablet
I20260810 19:48:00.748266 10375 raft_consensus.cc:2272] T 7d3395886420455d9bdaf816c19ebae2 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.748839 10375 ts_tablet_manager.cc:1916] T 7d3395886420455d9bdaf816c19ebae2 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.749461 10371 ts_tablet_manager.cc:1929] T 3b6187dbe1ca42f79bf3eddd5475b929 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:00.750501 10371 log.cc:1199] T 3b6187dbe1ca42f79bf3eddd5475b929 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/3b6187dbe1ca42f79bf3eddd5475b929
I20260810 19:48:00.750939 10371 ts_tablet_manager.cc:1950] T 3b6187dbe1ca42f79bf3eddd5475b929 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:00.752405 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 587) took 1033 ms. Trace:
I20260810 19:48:00.756664 10377 ts_tablet_manager.cc:1929] T 6992e7ef8e794ddc879ae04f9f78b8bd P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:00.756887 10377 log.cc:1199] T 6992e7ef8e794ddc879ae04f9f78b8bd P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/6992e7ef8e794ddc879ae04f9f78b8bd
I20260810 19:48:00.757400 10377 ts_tablet_manager.cc:1950] T 6992e7ef8e794ddc879ae04f9f78b8bd P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:00.757532 10371 rpcz_store.cc:276] 0810 19:47:59.718518 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:59.718567 (+ 49us) service_pool.cc:224] Handling call
0810 19:48:00.687269 (+968702us) ts_tablet_manager.cc:1151] Deleting tablet 3b6187dbe1ca42f79bf3eddd5475b929
0810 19:48:00.687280 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.720443 (+ 33163us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.749385 (+ 28942us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.752373 (+ 2988us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":968496}
I20260810 19:48:00.758975 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 580) took 1043 ms. Trace:
I20260810 19:48:00.759626 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 3b6187dbe1ca42f79bf3eddd5475b929 (table default.Table_df0d4b51d323454e8afa1c87c993a1ed [id=ecadc549b3444735b6972f914f5b4e2d]) successfully deleted
I20260810 19:48:00.760257 10371 tablet_replica.cc:333] T 28c9eecacc6540ac82ac7faabceec788 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:00.760790 10371 raft_consensus.cc:2243] T 28c9eecacc6540ac82ac7faabceec788 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:00.761375 10371 raft_consensus.cc:2272] T 28c9eecacc6540ac82ac7faabceec788 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.762333 10371 ts_tablet_manager.cc:1916] T 28c9eecacc6540ac82ac7faabceec788 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.762583 10377 rpcz_store.cc:276] 0810 19:47:59.715974 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:59.716063 (+ 89us) service_pool.cc:224] Handling call
0810 19:48:00.706050 (+989987us) ts_tablet_manager.cc:1151] Deleting tablet 6992e7ef8e794ddc879ae04f9f78b8bd
0810 19:48:00.706058 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.711515 (+ 5457us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.756592 (+ 45077us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.758950 (+ 2358us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":989755}
I20260810 19:48:00.763422 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 6992e7ef8e794ddc879ae04f9f78b8bd (table default.Table_abc13875e0d6429897eb19f7117e00f5 [id=3b14f80137654337b24c2bb4131e58d3]) successfully deleted
I20260810 19:48:00.763576 10377 tablet_replica.cc:333] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:00.763607 10375 ts_tablet_manager.cc:1929] T 7d3395886420455d9bdaf816c19ebae2 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:00.763748 10375 log.cc:1199] T 7d3395886420455d9bdaf816c19ebae2 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/7d3395886420455d9bdaf816c19ebae2
I20260810 19:48:00.764109 10375 ts_tablet_manager.cc:1950] T 7d3395886420455d9bdaf816c19ebae2 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:00.764166 11823 raft_consensus.cc:493] T e247ae3828e84092b836f3dd07b44bc6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:00.764386 10377 raft_consensus.cc:2243] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:00.764360 11823 raft_consensus.cc:515] T e247ae3828e84092b836f3dd07b44bc6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.768630 9413 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d (table default.Table_5e6891ff4aa040be8b327aafa596bc7e [id=fd840f00bdc5477aaad0b7fa114870dd]). Expected version 1 got 0
I20260810 19:48:00.771019 9897 tablet_service.cc:1558] Processing DeleteTablet for tablet e959898b2c4c4173aea107d3f090ca07 with delete_type TABLET_DATA_DELETED (replaced by tablet e68916e2568f4527a181342cdc728001) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:00.782624 10377 pending_rounds.cc:70] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691: Trying to abort 1 pending ops.
I20260810 19:48:00.783085 10377 pending_rounds.cc:77] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058683067375616 op_type: NO_OP noop_request { }
I20260810 19:48:00.783525 10377 raft_consensus.cc:2889] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:00.783862 10377 raft_consensus.cc:2272] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.785123 10377 ts_tablet_manager.cc:1916] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.786948 10367 tablet_bootstrap.cc:492] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
W20260810 19:48:00.788503 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ddc1bc292a243338235ea1396cc08f8 consensus state has no leader
I20260810 19:48:00.764991 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 537) took 2064 ms. Trace:
W20260810 19:48:00.774031 10067 consensus_peers.cc:597] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ffc4466b82bd49fcaad30e4d5325c7db. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:00.793334 10375 rpcz_store.cc:276] 0810 19:47:58.700603 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.700659 (+ 56us) service_pool.cc:224] Handling call
0810 19:48:00.747841 (+2047182us) ts_tablet_manager.cc:1151] Deleting tablet 7d3395886420455d9bdaf816c19ebae2
0810 19:48:00.747851 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.760276 (+ 12425us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.763532 (+ 3256us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.764964 (+ 1432us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2046947}
I20260810 19:48:00.793742 10375 tablet_replica.cc:333] T 6f0150de0d60425b807be532ce0ba6c3 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:00.793972 10375 raft_consensus.cc:2243] T 6f0150de0d60425b807be532ce0ba6c3 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:00.794147 10375 raft_consensus.cc:2272] T 6f0150de0d60425b807be532ce0ba6c3 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.794437 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 7d3395886420455d9bdaf816c19ebae2 (table default.Table_da2146aa6d244f3f892e8cf1c68bda8f [id=febfd4d57fd54ce0bd4a406cc965303f]) successfully deleted
I20260810 19:48:00.773969 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476e762e46c04ae6bfef5e14df2d16e2" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:00.794749 10370 tablet_bootstrap.cc:492] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:00.794893 10370 ts_tablet_manager.cc:1403] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.196s user 0.020s sys 0.020s
I20260810 19:48:00.795715 10370 raft_consensus.cc:359] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.795899 10370 raft_consensus.cc:385] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.795966 10370 raft_consensus.cc:740] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:00.796165 10370 consensus_queue.cc:260] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.794749 10375 ts_tablet_manager.cc:1916] T 6f0150de0d60425b807be532ce0ba6c3 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.796661 10370 ts_tablet_manager.cc:1434] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:00.796682 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_d966138bce714a71aa8d47f109c66741"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:00.798911 10370 tablet_bootstrap.cc:492] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:48:00.795763 9611 leader_election.cc:343] T 476e762e46c04ae6bfef5e14df2d16e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:00.800350 9611 leader_election.cc:304] T 476e762e46c04ae6bfef5e14df2d16e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:00.800809 11724 raft_consensus.cc:2749] T 476e762e46c04ae6bfef5e14df2d16e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:00.801112 10367 ts_tablet_manager.cc:1403] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.623s user 0.015s sys 0.023s
I20260810 19:48:00.802109 10367 raft_consensus.cc:359] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.825656 10377 ts_tablet_manager.cc:1929] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:00.825865 10377 log.cc:1199] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/d99b34f901484fad87cff4bb9ab56fc8
I20260810 19:48:00.826267 10377 ts_tablet_manager.cc:1950] T d99b34f901484fad87cff4bb9ab56fc8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:00.827252 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 579) took 1114 ms. Trace:
I20260810 19:48:00.827366 10377 rpcz_store.cc:276] 0810 19:47:59.713205 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:59.720933 (+ 7728us) service_pool.cc:224] Handling call
0810 19:48:00.763515 (+1042582us) ts_tablet_manager.cc:1151] Deleting tablet d99b34f901484fad87cff4bb9ab56fc8
0810 19:48:00.763528 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.814604 (+ 51076us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.818234 (+ 3630us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.827222 (+ 8988us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1031070}
I20260810 19:48:00.827739 10377 tablet_replica.cc:333] T 7737acd216204209ba0327e26e85cfe6 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:00.827925 10377 raft_consensus.cc:2243] T 7737acd216204209ba0327e26e85cfe6 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:00.828114 10377 raft_consensus.cc:2272] T 7737acd216204209ba0327e26e85cfe6 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.828166 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet d99b34f901484fad87cff4bb9ab56fc8 (table default.Table_7b492dac7ea64246abf9488fd4dbc8b1 [id=8fac27396c0e45458c9f668d6349fc03]) successfully deleted
I20260810 19:48:00.834486 10377 ts_tablet_manager.cc:1916] T 7737acd216204209ba0327e26e85cfe6 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.834733 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_28b63802a88349e8a32c912d60173a77"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:00.835472 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28b63802a88349e8a32c912d60173a77 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:00.852571 10377 ts_tablet_manager.cc:1929] T 7737acd216204209ba0327e26e85cfe6 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:00.852718 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247ae3828e84092b836f3dd07b44bc6" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:00.853505 10377 log.cc:1199] T 7737acd216204209ba0327e26e85cfe6 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/7737acd216204209ba0327e26e85cfe6
I20260810 19:48:00.853900 10377 ts_tablet_manager.cc:1950] T 7737acd216204209ba0327e26e85cfe6 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
W20260810 19:48:00.854197 10067 leader_election.cc:343] T e247ae3828e84092b836f3dd07b44bc6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:00.855808 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 7737acd216204209ba0327e26e85cfe6 (table default.Table_f90f1a0c22fa4781812518f44c9d7b17 [id=d12cb82567fd409988672b04a2e05a5b]) successfully deleted
W20260810 19:48:00.855978 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d966138bce714a71aa8d47f109c66741 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:00.857666 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 7add2dae2d1b4e8b9b95348e0334ba03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7add2dae2d1b4e8b9b95348e0334ba03 already in progress: creating tablet
I20260810 19:48:00.858002 10370 tablet_bootstrap.cc:654] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:00.859198 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 8e73953ad6e148749163ebeaa24ee6e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8e73953ad6e148749163ebeaa24ee6e4 already in progress: creating tablet
W20260810 19:48:00.859827 10068 leader_election.cc:343] T e247ae3828e84092b836f3dd07b44bc6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: e247ae3828e84092b836f3dd07b44bc6
W20260810 19:48:00.860119 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet a999e0d7e70e4b4fb53e17e51ab9b03a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a999e0d7e70e4b4fb53e17e51ab9b03a already in progress: creating tablet
I20260810 19:48:00.860495 10068 leader_election.cc:304] T e247ae3828e84092b836f3dd07b44bc6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:00.860813 10377 tablet_replica.cc:333] T 06af03c8a87141febef768bd56c72c39 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:00.861287 10377 raft_consensus.cc:2243] T 06af03c8a87141febef768bd56c72c39 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:00.861745 10377 raft_consensus.cc:2272] T 06af03c8a87141febef768bd56c72c39 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.862637 10377 ts_tablet_manager.cc:1916] T 06af03c8a87141febef768bd56c72c39 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.867686 11663 raft_consensus.cc:2749] T e247ae3828e84092b836f3dd07b44bc6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:00.861145 11823 leader_election.cc:290] T e247ae3828e84092b836f3dd07b44bc6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:00.813164 10371 ts_tablet_manager.cc:1929] T 28c9eecacc6540ac82ac7faabceec788 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:00.868783 10367 raft_consensus.cc:385] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.868891 10367 raft_consensus.cc:740] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:00.868834 10371 log.cc:1199] T 28c9eecacc6540ac82ac7faabceec788 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/28c9eecacc6540ac82ac7faabceec788
I20260810 19:48:00.869338 10371 ts_tablet_manager.cc:1950] T 28c9eecacc6540ac82ac7faabceec788 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:00.869228 10367 consensus_queue.cc:260] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.870189 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 588) took 1150 ms. Trace:
I20260810 19:48:00.870271 10371 rpcz_store.cc:276] 0810 19:47:59.719512 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:59.719560 (+ 48us) service_pool.cc:224] Handling call
0810 19:48:00.760192 (+1040632us) ts_tablet_manager.cc:1151] Deleting tablet 28c9eecacc6540ac82ac7faabceec788
0810 19:48:00.760207 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.781640 (+ 21433us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.813079 (+ 31439us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.870163 (+ 57084us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1040448}
I20260810 19:48:00.870641 10371 tablet_replica.cc:333] T 6355c14e38b3446493f7bd5e2a717341 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:00.870831 10371 raft_consensus.cc:2243] T 6355c14e38b3446493f7bd5e2a717341 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:00.870986 10371 raft_consensus.cc:2272] T 6355c14e38b3446493f7bd5e2a717341 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.871166 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 28c9eecacc6540ac82ac7faabceec788 (table default.Table_6e4259d122294c46bd79d8abbb79c520 [id=2d19b64ee46e460e807325299f942e18]) successfully deleted
I20260810 19:48:00.871575 10371 ts_tablet_manager.cc:1916] T 6355c14e38b3446493f7bd5e2a717341 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.872047 10375 ts_tablet_manager.cc:1929] T 6f0150de0d60425b807be532ce0ba6c3 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:00.872169 10375 log.cc:1199] T 6f0150de0d60425b807be532ce0ba6c3 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/6f0150de0d60425b807be532ce0ba6c3
I20260810 19:48:00.872457 10375 ts_tablet_manager.cc:1950] T 6f0150de0d60425b807be532ce0ba6c3 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:00.873512 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 538) took 2169 ms. Trace:
I20260810 19:48:00.873979 10375 rpcz_store.cc:276] 0810 19:47:58.703731 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.703884 (+ 153us) service_pool.cc:224] Handling call
0810 19:48:00.793683 (+2089799us) ts_tablet_manager.cc:1151] Deleting tablet 6f0150de0d60425b807be532ce0ba6c3
0810 19:48:00.793694 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.851639 (+ 57945us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.871960 (+ 20321us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.873483 (+ 1523us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2089531}
I20260810 19:48:00.875102 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 540) took 2163 ms. Trace:
I20260810 19:48:00.875195 10375 rpcz_store.cc:276] 0810 19:47:58.711661 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.712118 (+ 457us) service_pool.cc:224] Handling call
0810 19:48:00.874934 (+2162816us) ts_tablet_manager.cc:1151] Deleting tablet 7de27c3442584746b76ea838d38f0b9b
0810 19:48:00.874946 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.875082 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2162585}
I20260810 19:48:00.875280 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 6f0150de0d60425b807be532ce0ba6c3 (table default.Table_336441014db542c6ba0f204ef41d4747 [id=c9d6f79ab23248c69ee6d6984f6fd55c]) successfully deleted
I20260810 19:48:00.875458 10377 ts_tablet_manager.cc:1929] T 06af03c8a87141febef768bd56c72c39 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:00.875574 10377 log.cc:1199] T 06af03c8a87141febef768bd56c72c39 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/06af03c8a87141febef768bd56c72c39
I20260810 19:48:00.875633 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 539) took 2164 ms. Trace:
I20260810 19:48:00.875701 10375 rpcz_store.cc:276] 0810 19:47:58.711462 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.712635 (+ 1173us) service_pool.cc:224] Handling call
0810 19:48:00.875476 (+2162841us) ts_tablet_manager.cc:1151] Deleting tablet 0bddaf5b5fc1404e83b079ffa97e7321
0810 19:48:00.875486 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.875613 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2162665}
I20260810 19:48:00.875991 10375 tablet_replica.cc:333] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
W20260810 19:48:00.876068 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 7de27c3442584746b76ea838d38f0b9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7de27c3442584746b76ea838d38f0b9b already in progress: creating tablet
I20260810 19:48:00.876194 10375 raft_consensus.cc:2243] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
W20260810 19:48:00.876482 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 0bddaf5b5fc1404e83b079ffa97e7321 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0bddaf5b5fc1404e83b079ffa97e7321 already in progress: creating tablet
I20260810 19:48:00.876518 10375 raft_consensus.cc:2272] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.876698 10366 tablet_bootstrap.cc:492] T c8602b7360b747a3af756b139635d95c P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:00.876897 10366 ts_tablet_manager.cc:1403] T c8602b7360b747a3af756b139635d95c P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.145s user 0.017s sys 0.016s
I20260810 19:48:00.877161 10375 ts_tablet_manager.cc:1916] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.877707 10366 raft_consensus.cc:359] T c8602b7360b747a3af756b139635d95c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.877877 10366 raft_consensus.cc:385] T c8602b7360b747a3af756b139635d95c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.877920 10366 raft_consensus.cc:740] T c8602b7360b747a3af756b139635d95c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:00.878451 10366 consensus_queue.cc:260] T c8602b7360b747a3af756b139635d95c P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.878539 10371 ts_tablet_manager.cc:1929] T 6355c14e38b3446493f7bd5e2a717341 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:00.878677 10371 log.cc:1199] T 6355c14e38b3446493f7bd5e2a717341 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/6355c14e38b3446493f7bd5e2a717341
I20260810 19:48:00.879312 10366 ts_tablet_manager.cc:1434] T c8602b7360b747a3af756b139635d95c P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:00.879743 10366 tablet_bootstrap.cc:492] T e247ae3828e84092b836f3dd07b44bc6 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:00.880690 10371 ts_tablet_manager.cc:1950] T 6355c14e38b3446493f7bd5e2a717341 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:00.881814 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 589) took 1161 ms. Trace:
I20260810 19:48:00.881984 10371 rpcz_store.cc:276] 0810 19:47:59.720042 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:59.720164 (+ 122us) service_pool.cc:224] Handling call
0810 19:48:00.870582 (+1150418us) ts_tablet_manager.cc:1151] Deleting tablet 6355c14e38b3446493f7bd5e2a717341
0810 19:48:00.870594 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.875412 (+ 4818us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.878473 (+ 3061us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.881763 (+ 3290us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1150214}
I20260810 19:48:00.882536 10366 tablet_bootstrap.cc:654] T e247ae3828e84092b836f3dd07b44bc6 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:00.882776 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 6355c14e38b3446493f7bd5e2a717341 (table default.Table_20332cc0e9df49adb98c82a60784c4bb [id=ba8ef3f482364fc081f8e796fdbdb076]) successfully deleted
I20260810 19:48:00.871583 10367 ts_tablet_manager.cc:1434] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.070s user 0.002s sys 0.000s
I20260810 19:48:00.884176 10371 tablet_replica.cc:333] T 971e9abee86444a7a9e923b0962ae751 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:00.884316 10377 ts_tablet_manager.cc:1950] T 06af03c8a87141febef768bd56c72c39 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:00.884537 10371 raft_consensus.cc:2243] T 971e9abee86444a7a9e923b0962ae751 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:00.884791 10371 raft_consensus.cc:2272] T 971e9abee86444a7a9e923b0962ae751 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.885442 10371 ts_tablet_manager.cc:1916] T 971e9abee86444a7a9e923b0962ae751 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.885594 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 06af03c8a87141febef768bd56c72c39 (table default.Table_3517015cddb644a28150bb4f6f7c3187 [id=aa329023fb1a498cb6dc964edbaccb77]) successfully deleted
I20260810 19:48:00.884308 10367 tablet_bootstrap.cc:492] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
W20260810 19:48:00.886452 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 7f4ca5a1ec3d4ca392f389f2dabae296 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f4ca5a1ec3d4ca392f389f2dabae296 already in progress: creating tablet
W20260810 19:48:00.887111 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 0df786b887de4d7dbf1881e4944e3b68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0df786b887de4d7dbf1881e4944e3b68 already in progress: creating tablet
W20260810 19:48:00.887745 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet ca733de7babe4343ab26dbca2c9020b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca733de7babe4343ab26dbca2c9020b2 already in progress: creating tablet
I20260810 19:48:00.888156 10367 tablet_bootstrap.cc:654] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:00.888386 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 3159795344ae492fb099fca0e52fcf20 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3159795344ae492fb099fca0e52fcf20 already in progress: creating tablet
I20260810 19:48:00.888803 10377 tablet_replica.cc:333] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:00.889361 10377 raft_consensus.cc:2243] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:00.889885 10377 pending_rounds.cc:70] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691: Trying to abort 1 pending ops.
I20260810 19:48:00.890175 10377 pending_rounds.cc:77] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058684198256640 op_type: NO_OP noop_request { }
I20260810 19:48:00.890462 10377 raft_consensus.cc:2889] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:00.890666 10377 raft_consensus.cc:2272] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.895390 10366 tablet_bootstrap.cc:492] T e247ae3828e84092b836f3dd07b44bc6 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:00.895633 10366 ts_tablet_manager.cc:1403] T e247ae3828e84092b836f3dd07b44bc6 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.007s
I20260810 19:48:00.895942 11828 raft_consensus.cc:493] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:00.896152 11828 raft_consensus.cc:515] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.896560 10366 raft_consensus.cc:359] T e247ae3828e84092b836f3dd07b44bc6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.896812 10366 raft_consensus.cc:385] T e247ae3828e84092b836f3dd07b44bc6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.896914 10366 raft_consensus.cc:740] T e247ae3828e84092b836f3dd07b44bc6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:00.897251 10366 consensus_queue.cc:260] T e247ae3828e84092b836f3dd07b44bc6 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.897447 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8602b7360b747a3af756b139635d95c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:00.897626 9944 raft_consensus.cc:2468] T c8602b7360b747a3af756b139635d95c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:00.898082 10366 ts_tablet_manager.cc:1434] T e247ae3828e84092b836f3dd07b44bc6 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:00.898144 10067 leader_election.cc:304] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:00.898492 11663 raft_consensus.cc:2804] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:00.898573 11663 raft_consensus.cc:493] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:00.898641 11663 raft_consensus.cc:3060] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:00.900257 10366 tablet_bootstrap.cc:492] T 6af6dd8913f44e7f966ed2a128ae4fbf P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:00.900676 10377 ts_tablet_manager.cc:1916] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.901417 11663 raft_consensus.cc:515] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.902151 10366 tablet_bootstrap.cc:654] T 6af6dd8913f44e7f966ed2a128ae4fbf P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:00.902683 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8602b7360b747a3af756b139635d95c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:00.902884 9944 raft_consensus.cc:3060] T c8602b7360b747a3af756b139635d95c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:00.905579 9944 raft_consensus.cc:2468] T c8602b7360b747a3af756b139635d95c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:00.906381 11663 leader_election.cc:290] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:00.907730 10067 leader_election.cc:304] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:00.908622 11663 raft_consensus.cc:2804] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:00.909060 11663 raft_consensus.cc:697] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:00.909446 11663 consensus_queue.cc:237] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.912007 10375 ts_tablet_manager.cc:1929] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:00.912134 10375 log.cc:1199] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/ffc4466b82bd49fcaad30e4d5325c7db
I20260810 19:48:00.912506 10375 ts_tablet_manager.cc:1950] T ffc4466b82bd49fcaad30e4d5325c7db P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:00.912938 10366 tablet_bootstrap.cc:492] T 6af6dd8913f44e7f966ed2a128ae4fbf P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:00.913160 10366 ts_tablet_manager.cc:1403] T 6af6dd8913f44e7f966ed2a128ae4fbf P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.007s
I20260810 19:48:00.913447 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 541) took 2176 ms. Trace:
I20260810 19:48:00.913543 10375 rpcz_store.cc:276] 0810 19:47:58.737025 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:58.737675 (+ 650us) service_pool.cc:224] Handling call
0810 19:48:00.875942 (+2138267us) ts_tablet_manager.cc:1151] Deleting tablet ffc4466b82bd49fcaad30e4d5325c7db
0810 19:48:00.875952 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.893733 (+ 17781us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.911932 (+ 18199us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.913421 (+ 1489us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2137913}
I20260810 19:48:00.913914 10375 tablet_replica.cc:333] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:00.914125 10375 raft_consensus.cc:2243] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:00.914155 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet ffc4466b82bd49fcaad30e4d5325c7db (table default.Table_8680fc2abacb464c8d39fae15165ea39 [id=6d8b87531495425da6e953f4e5c2fb08]) successfully deleted
I20260810 19:48:00.914286 10375 raft_consensus.cc:2272] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.914522 10366 raft_consensus.cc:359] T 6af6dd8913f44e7f966ed2a128ae4fbf P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.914779 10366 raft_consensus.cc:385] T 6af6dd8913f44e7f966ed2a128ae4fbf P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.914891 10366 raft_consensus.cc:740] T 6af6dd8913f44e7f966ed2a128ae4fbf P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
W20260810 19:48:00.914927 10068 leader_election.cc:343] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: c8602b7360b747a3af756b139635d95c
I20260810 19:48:00.915261 10366 consensus_queue.cc:260] T 6af6dd8913f44e7f966ed2a128ae4fbf P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.915516 10371 ts_tablet_manager.cc:1929] T 971e9abee86444a7a9e923b0962ae751 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:00.916076 10370 tablet_bootstrap.cc:492] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:00.916226 10370 ts_tablet_manager.cc:1403] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.119s user 0.003s sys 0.012s
I20260810 19:48:00.916258 10371 log.cc:1199] T 971e9abee86444a7a9e923b0962ae751 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/971e9abee86444a7a9e923b0962ae751
I20260810 19:48:00.916996 10366 ts_tablet_manager.cc:1434] T 6af6dd8913f44e7f966ed2a128ae4fbf P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260810 19:48:00.917099 10371 ts_tablet_manager.cc:1950] T 971e9abee86444a7a9e923b0962ae751 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:00.917057 10370 raft_consensus.cc:359] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.917238 10370 raft_consensus.cc:385] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.917299 10370 raft_consensus.cc:740] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:00.917519 10370 consensus_queue.cc:260] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.918068 10370 ts_tablet_manager.cc:1434] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:00.918385 10370 tablet_bootstrap.cc:492] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:00.918519 10366 tablet_bootstrap.cc:492] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:00.919665 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 971e9abee86444a7a9e923b0962ae751 (table default.Table_64e5558a29af405b85912f54bebdf3be [id=f3f4d6ebcacf43489369bd8f742a0631]) successfully deleted
I20260810 19:48:00.920435 10371 tablet_replica.cc:333] T 21208dd824fe432fa307cbb88d37aaa2 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:00.920480 10366 tablet_bootstrap.cc:654] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:00.920739 10375 ts_tablet_manager.cc:1916] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.920939 10371 raft_consensus.cc:2243] T 21208dd824fe432fa307cbb88d37aaa2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:00.921439 10371 raft_consensus.cc:2272] T 21208dd824fe432fa307cbb88d37aaa2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.922259 10371 ts_tablet_manager.cc:1916] T 21208dd824fe432fa307cbb88d37aaa2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.926831 10370 tablet_bootstrap.cc:654] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:00.928978 10366 tablet_bootstrap.cc:492] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:00.929232 10366 ts_tablet_manager.cc:1403] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.005s
I20260810 19:48:00.931221 10377 ts_tablet_manager.cc:1929] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:00.931701 10377 log.cc:1199] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/dd632a01fe424a3a956d445ce01e31d2
I20260810 19:48:00.931166 10366 raft_consensus.cc:359] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.931989 10366 raft_consensus.cc:385] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.932101 10366 raft_consensus.cc:740] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:00.932617 10366 consensus_queue.cc:260] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.932838 11828 leader_election.cc:290] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:00.932835 10370 tablet_bootstrap.cc:492] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:00.933612 10370 ts_tablet_manager.cc:1403] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
W20260810 19:48:00.915134 10068 leader_election.cc:343] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: c8602b7360b747a3af756b139635d95c
I20260810 19:48:00.934545 10366 ts_tablet_manager.cc:1434] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 19:48:00.934549 10370 raft_consensus.cc:359] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.934741 10370 raft_consensus.cc:385] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.934795 10370 raft_consensus.cc:740] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:00.935015 10370 consensus_queue.cc:260] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.935567 10370 ts_tablet_manager.cc:1434] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 19:48:00.935858 10366 tablet_bootstrap.cc:492] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:00.935873 10370 tablet_bootstrap.cc:492] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:00.937673 10370 tablet_bootstrap.cc:654] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:00.937903 10366 tablet_bootstrap.cc:654] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:00.940160 10377 ts_tablet_manager.cc:1950] T dd632a01fe424a3a956d445ce01e31d2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:00.941596 10377 tablet_replica.cc:333] T 45194cae6ea44d9d8cf856d256fd534f P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:00.941649 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet dd632a01fe424a3a956d445ce01e31d2 (table default.Table_8398701ecb954c5c833b81f075d2c23a [id=2358cd5d19d24c88803e7861bcfec22c]) successfully deleted
I20260810 19:48:00.941781 10377 raft_consensus.cc:2243] T 45194cae6ea44d9d8cf856d256fd534f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:00.941948 10377 raft_consensus.cc:2272] T 45194cae6ea44d9d8cf856d256fd534f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:00.942080 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet bb1e4400ca684da7b3b5e6592e19b6e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb1e4400ca684da7b3b5e6592e19b6e6 already in progress: creating tablet
I20260810 19:48:00.942381 10375 ts_tablet_manager.cc:1929] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:00.942505 10375 log.cc:1199] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/d99b34f901484fad87cff4bb9ab56fc8
I20260810 19:48:00.942821 10375 ts_tablet_manager.cc:1950] T d99b34f901484fad87cff4bb9ab56fc8 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
W20260810 19:48:00.942857 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet b91737c2129e4ca385b4e1c8999c62b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b91737c2129e4ca385b4e1c8999c62b4 already in progress: creating tablet
I20260810 19:48:00.943655 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 547) took 1771 ms. Trace:
I20260810 19:48:00.943758 10375 rpcz_store.cc:276] 0810 19:47:59.172213 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:59.172285 (+ 72us) service_pool.cc:224] Handling call
0810 19:48:00.913863 (+1741578us) ts_tablet_manager.cc:1151] Deleting tablet d99b34f901484fad87cff4bb9ab56fc8
0810 19:48:00.913874 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.924280 (+ 10406us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.942268 (+ 17988us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.943629 (+ 1361us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1715377}
I20260810 19:48:00.944236 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 561) took 1411 ms. Trace:
I20260810 19:48:00.944353 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet d99b34f901484fad87cff4bb9ab56fc8 (table default.Table_7b492dac7ea64246abf9488fd4dbc8b1 [id=8fac27396c0e45458c9f668d6349fc03]) successfully deleted
I20260810 19:48:00.944329 10375 rpcz_store.cc:276] 0810 19:47:59.532504 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:59.532762 (+ 258us) service_pool.cc:224] Handling call
0810 19:48:00.944082 (+1411320us) ts_tablet_manager.cc:1151] Deleting tablet 6ea318eddd8349a79d27ce5746f03798
0810 19:48:00.944094 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.944217 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1408855}
I20260810 19:48:00.944700 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 563) took 1412 ms. Trace:
I20260810 19:48:00.944772 10375 rpcz_store.cc:276] 0810 19:47:59.532710 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:59.532900 (+ 190us) service_pool.cc:224] Handling call
0810 19:48:00.944587 (+1411687us) ts_tablet_manager.cc:1151] Deleting tablet b2034784996149158c10b868f61ff418
0810 19:48:00.944597 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.944685 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1408951}
W20260810 19:48:00.944977 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 6ea318eddd8349a79d27ce5746f03798 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ea318eddd8349a79d27ce5746f03798 already in progress: creating tablet
I20260810 19:48:00.945107 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 562) took 1412 ms. Trace:
I20260810 19:48:00.945174 10375 rpcz_store.cc:276] 0810 19:47:59.532595 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:59.532876 (+ 281us) service_pool.cc:224] Handling call
0810 19:48:00.944984 (+1412108us) ts_tablet_manager.cc:1151] Deleting tablet cb2c9782c034435088f991bef8edf288
0810 19:48:00.944993 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.945092 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1409249}
I20260810 19:48:00.945498 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 564) took 1407 ms. Trace:
I20260810 19:48:00.945572 10375 rpcz_store.cc:276] 0810 19:47:59.537807 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:59.537859 (+ 52us) service_pool.cc:224] Handling call
0810 19:48:00.945381 (+1407522us) ts_tablet_manager.cc:1151] Deleting tablet 3109703c51e54af78b58e9bbca50af33
0810 19:48:00.945389 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.945483 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1407199}
W20260810 19:48:00.945633 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet b2034784996149158c10b868f61ff418 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2034784996149158c10b868f61ff418 already in progress: creating tablet
W20260810 19:48:00.945848 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet cb2c9782c034435088f991bef8edf288 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb2c9782c034435088f991bef8edf288 already in progress: creating tablet
I20260810 19:48:00.945878 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 565) took 1374 ms. Trace:
I20260810 19:48:00.945942 10375 rpcz_store.cc:276] 0810 19:47:59.571094 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:59.571200 (+ 106us) service_pool.cc:224] Handling call
0810 19:48:00.945774 (+1374574us) ts_tablet_manager.cc:1151] Deleting tablet 31c2b9a4b8334e678b4632fc2f58dd0c
0810 19:48:00.945784 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.945864 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1374339}
I20260810 19:48:00.946223 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 566) took 1374 ms. Trace:
W20260810 19:48:00.946666 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 3109703c51e54af78b58e9bbca50af33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3109703c51e54af78b58e9bbca50af33 already in progress: creating tablet
W20260810 19:48:00.946933 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 31c2b9a4b8334e678b4632fc2f58dd0c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31c2b9a4b8334e678b4632fc2f58dd0c already in progress: creating tablet
W20260810 19:48:00.948772 9400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.253:37397, user_credentials={real_user=slave}} blocked reactor thread for 81629.6us
I20260810 19:48:00.949268 11724 raft_consensus.cc:493] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:00.949456 11724 raft_consensus.cc:515] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.950145 11724 leader_election.cc:290] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:00.951017 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77785d9bde843bc8366fe15d1b4fa18" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:00.951767 9611 leader_election.cc:343] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:00.946285 10375 rpcz_store.cc:276] 0810 19:47:59.571984 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:59.572036 (+ 52us) service_pool.cc:224] Handling call
0810 19:48:00.946135 (+1374099us) ts_tablet_manager.cc:1151] Deleting tablet 4c75af1e592042f5a4d442b82a539c94
0810 19:48:00.946142 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.946210 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1363361}
W20260810 19:48:00.952746 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 4c75af1e592042f5a4d442b82a539c94 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4c75af1e592042f5a4d442b82a539c94 already in progress: creating tablet
I20260810 19:48:00.953094 10375 tablet_replica.cc:333] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:00.953326 10375 raft_consensus.cc:2243] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
W20260810 19:48:00.953372 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 7add2dae2d1b4e8b9b95348e0334ba03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7add2dae2d1b4e8b9b95348e0334ba03 already in progress: creating tablet
I20260810 19:48:00.953594 10375 pending_rounds.cc:70] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
W20260810 19:48:00.953604 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 0df786b887de4d7dbf1881e4944e3b68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0df786b887de4d7dbf1881e4944e3b68 already in progress: creating tablet
I20260810 19:48:00.953634 10375 pending_rounds.cc:77] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058683060887552 op_type: NO_OP noop_request { }
I20260810 19:48:00.953729 10375 raft_consensus.cc:2889] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260810 19:48:00.953797 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 7f4ca5a1ec3d4ca392f389f2dabae296 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f4ca5a1ec3d4ca392f389f2dabae296 already in progress: creating tablet
I20260810 19:48:00.953811 10375 raft_consensus.cc:2272] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.955528 10371 ts_tablet_manager.cc:1929] T 21208dd824fe432fa307cbb88d37aaa2 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:00.955681 10371 log.cc:1199] T 21208dd824fe432fa307cbb88d37aaa2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/21208dd824fe432fa307cbb88d37aaa2
I20260810 19:48:00.956073 10371 ts_tablet_manager.cc:1950] T 21208dd824fe432fa307cbb88d37aaa2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:00.956740 10375 ts_tablet_manager.cc:1916] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.956984 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 591) took 1005 ms. Trace:
I20260810 19:48:00.957090 10371 rpcz_store.cc:276] 0810 19:47:59.951283 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:59.952907 (+ 1624us) service_pool.cc:224] Handling call
0810 19:48:00.920354 (+967447us) ts_tablet_manager.cc:1151] Deleting tablet 21208dd824fe432fa307cbb88d37aaa2
0810 19:48:00.920367 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:00.944703 (+ 24336us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.955429 (+ 10726us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:00.956936 (+ 1507us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":967309}
I20260810 19:48:00.957548 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 21208dd824fe432fa307cbb88d37aaa2 (table default.Table_fc65a045265c494998007900c7ac9e01 [id=190f70ae5e5f44c294a4c0250fc7b08a]) successfully deleted
I20260810 19:48:00.959265 10377 ts_tablet_manager.cc:1916] T 45194cae6ea44d9d8cf856d256fd534f P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.963970 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ca73e90d364f4ec7af078b3d97c7cdcb" } new_table_name: "default.Table_da45ba37a0804616b521723bc724e0f0" modify_external_catalogs: true
I20260810 19:48:00.964325 10370 tablet_bootstrap.cc:492] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:00.964499 10370 ts_tablet_manager.cc:1403] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.029s user 0.006s sys 0.000s
I20260810 19:48:00.965516 10370 raft_consensus.cc:359] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.965713 10370 raft_consensus.cc:385] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.965822 10370 raft_consensus.cc:740] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:00.966066 10370 consensus_queue.cc:260] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:00.966667 10370 ts_tablet_manager.cc:1434] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 19:48:00.967391 10370 tablet_bootstrap.cc:492] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:00.969308 10370 tablet_bootstrap.cc:654] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:00.970724 9408 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet bc753970b2464e38b03e377551276343 (table default.Table_87ca145e91d149a68ef630e3a29795b4 [id=fd9deda7275b423b9f9c85aa22dde728]). Expected version 2 got 0
I20260810 19:48:00.971038 9408 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d (table default.Table_5e6891ff4aa040be8b327aafa596bc7e [id=fd840f00bdc5477aaad0b7fa114870dd]). Expected version 1 got 0
I20260810 19:48:00.972188 9408 master_service.cc:960] ReplaceTablet: received request to replace tablet 4e80e2327c394612bffc51f38798dac3 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:00.973054 10375 ts_tablet_manager.cc:1929] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:00.973194 10375 log.cc:1199] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/06af03c8a87141febef768bd56c72c39
I20260810 19:48:00.973505 9420 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d (table default.Table_5e6891ff4aa040be8b327aafa596bc7e [id=fd840f00bdc5477aaad0b7fa114870dd]). Expected version 1 got 0
I20260810 19:48:00.973627 10375 ts_tablet_manager.cc:1950] T 06af03c8a87141febef768bd56c72c39 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:00.974362 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7eb33a7d7f654d9ba03184e013797f6b" } modify_external_catalogs: true
I20260810 19:48:00.974560 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7eb33a7d7f654d9ba03184e013797f6b" } modify_external_catalogs: true
I20260810 19:48:00.975996 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f212e04efe29445f81d9ed385928b936" } new_table_name: "default.Table_601a5399171d49db90ca91584e73086c" modify_external_catalogs: true
I20260810 19:48:00.976967 10375 tablet_replica.cc:333] T c7235af514fa47d899d7e38ee5662f6c P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:00.977226 10375 raft_consensus.cc:2243] T c7235af514fa47d899d7e38ee5662f6c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:00.977417 10375 raft_consensus.cc:2272] T c7235af514fa47d899d7e38ee5662f6c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:00.978061 10375 ts_tablet_manager.cc:1916] T c7235af514fa47d899d7e38ee5662f6c P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.979271 9684 tablet_service.cc:1511] Processing CreateTablet for tablet dadf7bd8d63e413e98ad0ac3f6baa027 (DEFAULT_TABLE table=default.Table_95034dc6eb7240a1ae855c8a159c6279 [id=351f38b377b74334a6341a32b2d00b44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.979496 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 2ac59875628e40ffb1385dedea2f3b9d (DEFAULT_TABLE table=default.Table_19afc4f535124fd2bfe0e8a019a8a86e [id=2529b8703e484bf0ad591962295ef9fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.979751 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dadf7bd8d63e413e98ad0ac3f6baa027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.980120 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 60165d5c1664471fb665d1ed8bdda26d (DEFAULT_TABLE table=default.Table_8c96e0380fc64018ad77605ab117ca1b [id=001dab9496624153951d38cac8ade6d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.980508 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60165d5c1664471fb665d1ed8bdda26d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.980551 9677 tablet_service.cc:1511] Processing CreateTablet for tablet 43770a764bd24d3f9ec60a02dca083dc (DEFAULT_TABLE table=default.Table_949a9afb4edf45919e8e02945ab84d4b [id=862459a347a240acbf9a3cce722cf3c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.980801 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 1a87374c440c460ca506e71f8ab6b4ae (DEFAULT_TABLE table=default.Table_64d48c3a077c49c3a0bbb07824f34047 [id=3c3644ee665c4072999de525e3021d79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.980928 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43770a764bd24d3f9ec60a02dca083dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.981156 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a87374c440c460ca506e71f8ab6b4ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.980553 9669 tablet_service.cc:1511] Processing CreateTablet for tablet da08cce6487740649e20f452531cc403 (DEFAULT_TABLE table=default.Table_280138e880a1458097134a0bbe980773 [id=b765a963d9ff45089be5b947fdb81c2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.981654 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da08cce6487740649e20f452531cc403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.982450 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ac59875628e40ffb1385dedea2f3b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.982571 9658 tablet_service.cc:1511] Processing CreateTablet for tablet fe2c9ac78cf24d0e8140de31a2f977e2 (DEFAULT_TABLE table=default.Table_14279f7714694d48a551392ee498d02a [id=d8a11c3168484b83b87f6fafd79e0f83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.982915 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe2c9ac78cf24d0e8140de31a2f977e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.986563 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 264a65bd642648e59998fb55fb3c8de1 (DEFAULT_TABLE table=default.Table_73a9257f3a444ce6a1e35cf5b4cddbd9 [id=5aaa48a6a5d94fef89881115cdd023ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.986826 9665 tablet_service.cc:1511] Processing CreateTablet for tablet 8565cd6fc9e34c5fbabba6e573df9939 (DEFAULT_TABLE table=default.Table_3ccf56c919e14ad8a02a00cccab81de9 [id=307135c3631641988e1691abfda45fd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.987025 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 264a65bd642648e59998fb55fb3c8de1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.987324 9668 tablet_service.cc:1511] Processing CreateTablet for tablet 024e88bd7629436db4fb66c04e16fc97 (DEFAULT_TABLE table=default.Table_f6bf38e92579459db083cba7999bb1ea [id=fe0e496130db4895b5e63c0f923cd486]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.987713 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 024e88bd7629436db4fb66c04e16fc97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.989768 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 0b71af7492854f32b26887f8cbead122 (DEFAULT_TABLE table=default.Table_2b4a171707e745c0b06d669df83755fe [id=d7336827451d418cb9b85848d42dee69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.990140 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b71af7492854f32b26887f8cbead122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.990983 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8565cd6fc9e34c5fbabba6e573df9939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.994700 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 629cfbd55c0b4a2fbe43f41cdefa85f8 (DEFAULT_TABLE table=default.Table_d9ae7658a1f24bd8aa85ffbc2ac9ee0f [id=f13bcadbcbc14466907b2850e5dce367]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.995178 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 629cfbd55c0b4a2fbe43f41cdefa85f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.998243 10370 tablet_bootstrap.cc:492] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:00.998494 10370 ts_tablet_manager.cc:1403] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.001s
I20260810 19:48:00.998617 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 814babd6ae4748109b6caf1af54c2733 (DEFAULT_TABLE table=default.Table_03af1ed093464e9584fda04a56a9d164 [id=30c76322574344bebe27eed28df49547]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:00.999089 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814babd6ae4748109b6caf1af54c2733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:00.999500 10370 raft_consensus.cc:359] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:00.999758 10370 raft_consensus.cc:385] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:00.999840 10370 raft_consensus.cc:740] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.000108 10370 consensus_queue.cc:260] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.000685 10370 ts_tablet_manager.cc:1434] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:01.001080 10370 tablet_bootstrap.cc:492] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:01.002614 9666 tablet_service.cc:1511] Processing CreateTablet for tablet dfea56a2d5d847058bcf4f508f0778a1 (DEFAULT_TABLE table=default.Table_f5350bb5f02d47f2b9736182f22ec088 [id=648fb85d4e0b470a8695accdc8e897c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.002877 10370 tablet_bootstrap.cc:654] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:01.003029 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfea56a2d5d847058bcf4f508f0778a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.006371 10375 ts_tablet_manager.cc:1929] T c7235af514fa47d899d7e38ee5662f6c P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:01.006551 10375 log.cc:1199] T c7235af514fa47d899d7e38ee5662f6c P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/c7235af514fa47d899d7e38ee5662f6c
I20260810 19:48:01.006942 10375 ts_tablet_manager.cc:1950] T c7235af514fa47d899d7e38ee5662f6c P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:01.008018 10375 tablet_replica.cc:333] T e959898b2c4c4173aea107d3f090ca07 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:01.008234 10375 raft_consensus.cc:2243] T e959898b2c4c4173aea107d3f090ca07 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:01.008425 10375 raft_consensus.cc:2272] T e959898b2c4c4173aea107d3f090ca07 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:01.009004 10375 ts_tablet_manager.cc:1916] T e959898b2c4c4173aea107d3f090ca07 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:00.986591 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 89f3e57177014d6999ecf02eb2c07e8a (DEFAULT_TABLE table=default.Table_a17890eaff5e43ae907d41f49b34d92f [id=90faffc509c74ca1ad04f19b73d35cc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.011116 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89f3e57177014d6999ecf02eb2c07e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.012934 9883 tablet_service.cc:1511] Processing CreateTablet for tablet fe2c9ac78cf24d0e8140de31a2f977e2 (DEFAULT_TABLE table=default.Table_14279f7714694d48a551392ee498d02a [id=d8a11c3168484b83b87f6fafd79e0f83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.013381 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe2c9ac78cf24d0e8140de31a2f977e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.014629 9897 tablet_service.cc:1511] Processing CreateTablet for tablet dadf7bd8d63e413e98ad0ac3f6baa027 (DEFAULT_TABLE table=default.Table_95034dc6eb7240a1ae855c8a159c6279 [id=351f38b377b74334a6341a32b2d00b44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.015000 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dadf7bd8d63e413e98ad0ac3f6baa027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.018577 10370 tablet_bootstrap.cc:492] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:01.018764 10370 ts_tablet_manager.cc:1403] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.001s
I20260810 19:48:01.019490 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 2ac59875628e40ffb1385dedea2f3b9d (DEFAULT_TABLE table=default.Table_19afc4f535124fd2bfe0e8a019a8a86e [id=2529b8703e484bf0ad591962295ef9fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.019671 10370 raft_consensus.cc:359] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.019896 10370 raft_consensus.cc:385] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.019927 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ac59875628e40ffb1385dedea2f3b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.019992 10370 raft_consensus.cc:740] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.020458 10130 tablet_service.cc:1511] Processing CreateTablet for tablet dadf7bd8d63e413e98ad0ac3f6baa027 (DEFAULT_TABLE table=default.Table_95034dc6eb7240a1ae855c8a159c6279 [id=351f38b377b74334a6341a32b2d00b44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.020903 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dadf7bd8d63e413e98ad0ac3f6baa027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.020843 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 60165d5c1664471fb665d1ed8bdda26d (DEFAULT_TABLE table=default.Table_8c96e0380fc64018ad77605ab117ca1b [id=001dab9496624153951d38cac8ade6d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.021248 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60165d5c1664471fb665d1ed8bdda26d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.021574 10135 tablet_service.cc:1511] Processing CreateTablet for tablet fe2c9ac78cf24d0e8140de31a2f977e2 (DEFAULT_TABLE table=default.Table_14279f7714694d48a551392ee498d02a [id=d8a11c3168484b83b87f6fafd79e0f83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.022066 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe2c9ac78cf24d0e8140de31a2f977e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.022663 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 60165d5c1664471fb665d1ed8bdda26d (DEFAULT_TABLE table=default.Table_8c96e0380fc64018ad77605ab117ca1b [id=001dab9496624153951d38cac8ade6d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.023056 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60165d5c1664471fb665d1ed8bdda26d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.026082 9902 tablet_service.cc:1511] Processing CreateTablet for tablet da08cce6487740649e20f452531cc403 (DEFAULT_TABLE table=default.Table_280138e880a1458097134a0bbe980773 [id=b765a963d9ff45089be5b947fdb81c2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.026511 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da08cce6487740649e20f452531cc403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.027482 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 2ac59875628e40ffb1385dedea2f3b9d (DEFAULT_TABLE table=default.Table_19afc4f535124fd2bfe0e8a019a8a86e [id=2529b8703e484bf0ad591962295ef9fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.027886 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ac59875628e40ffb1385dedea2f3b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.027854 9894 tablet_service.cc:1511] Processing CreateTablet for tablet 89f3e57177014d6999ecf02eb2c07e8a (DEFAULT_TABLE table=default.Table_a17890eaff5e43ae907d41f49b34d92f [id=90faffc509c74ca1ad04f19b73d35cc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.028231 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89f3e57177014d6999ecf02eb2c07e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.030640 10122 tablet_service.cc:1511] Processing CreateTablet for tablet da08cce6487740649e20f452531cc403 (DEFAULT_TABLE table=default.Table_280138e880a1458097134a0bbe980773 [id=b765a963d9ff45089be5b947fdb81c2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.030649 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 1a87374c440c460ca506e71f8ab6b4ae (DEFAULT_TABLE table=default.Table_64d48c3a077c49c3a0bbb07824f34047 [id=3c3644ee665c4072999de525e3021d79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.030879 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 024e88bd7629436db4fb66c04e16fc97 (DEFAULT_TABLE table=default.Table_f6bf38e92579459db083cba7999bb1ea [id=fe0e496130db4895b5e63c0f923cd486]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.031036 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a87374c440c460ca506e71f8ab6b4ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.031208 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 024e88bd7629436db4fb66c04e16fc97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.031267 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 1a87374c440c460ca506e71f8ab6b4ae (DEFAULT_TABLE table=default.Table_64d48c3a077c49c3a0bbb07824f34047 [id=3c3644ee665c4072999de525e3021d79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.031865 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da08cce6487740649e20f452531cc403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.032171 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 264a65bd642648e59998fb55fb3c8de1 (DEFAULT_TABLE table=default.Table_73a9257f3a444ce6a1e35cf5b4cddbd9 [id=5aaa48a6a5d94fef89881115cdd023ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.033246 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 264a65bd642648e59998fb55fb3c8de1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.034251 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a87374c440c460ca506e71f8ab6b4ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.034636 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 8565cd6fc9e34c5fbabba6e573df9939 (DEFAULT_TABLE table=default.Table_3ccf56c919e14ad8a02a00cccab81de9 [id=307135c3631641988e1691abfda45fd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.035022 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8565cd6fc9e34c5fbabba6e573df9939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.035560 9415 master_service.cc:960] ReplaceTablet: received request to replace tablet 8503d5162548463bae22402fdc4c502a from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:01.034654 9885 tablet_service.cc:1511] Processing CreateTablet for tablet 264a65bd642648e59998fb55fb3c8de1 (DEFAULT_TABLE table=default.Table_73a9257f3a444ce6a1e35cf5b4cddbd9 [id=5aaa48a6a5d94fef89881115cdd023ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.038810 9885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 264a65bd642648e59998fb55fb3c8de1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.038882 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 8565cd6fc9e34c5fbabba6e573df9939 (DEFAULT_TABLE table=default.Table_3ccf56c919e14ad8a02a00cccab81de9 [id=307135c3631641988e1691abfda45fd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.039253 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8565cd6fc9e34c5fbabba6e573df9939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.042716 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 89f3e57177014d6999ecf02eb2c07e8a (DEFAULT_TABLE table=default.Table_a17890eaff5e43ae907d41f49b34d92f [id=90faffc509c74ca1ad04f19b73d35cc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.043139 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89f3e57177014d6999ecf02eb2c07e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.047528 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 06af03c8a87141febef768bd56c72c39 (table default.Table_3517015cddb644a28150bb4f6f7c3187 [id=aa329023fb1a498cb6dc964edbaccb77]) successfully deleted
I20260810 19:48:01.047598 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 43770a764bd24d3f9ec60a02dca083dc (DEFAULT_TABLE table=default.Table_949a9afb4edf45919e8e02945ab84d4b [id=862459a347a240acbf9a3cce722cf3c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.048023 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43770a764bd24d3f9ec60a02dca083dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.047956 10115 tablet_service.cc:1511] Processing CreateTablet for tablet 024e88bd7629436db4fb66c04e16fc97 (DEFAULT_TABLE table=default.Table_f6bf38e92579459db083cba7999bb1ea [id=fe0e496130db4895b5e63c0f923cd486]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.048406 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 024e88bd7629436db4fb66c04e16fc97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.051365 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 629cfbd55c0b4a2fbe43f41cdefa85f8 (DEFAULT_TABLE table=default.Table_d9ae7658a1f24bd8aa85ffbc2ac9ee0f [id=f13bcadbcbc14466907b2850e5dce367]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.051842 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 629cfbd55c0b4a2fbe43f41cdefa85f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.053107 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 629cfbd55c0b4a2fbe43f41cdefa85f8 (DEFAULT_TABLE table=default.Table_d9ae7658a1f24bd8aa85ffbc2ac9ee0f [id=f13bcadbcbc14466907b2850e5dce367]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.053670 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 814babd6ae4748109b6caf1af54c2733 (DEFAULT_TABLE table=default.Table_03af1ed093464e9584fda04a56a9d164 [id=30c76322574344bebe27eed28df49547]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.054638 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 0b71af7492854f32b26887f8cbead122 (DEFAULT_TABLE table=default.Table_2b4a171707e745c0b06d669df83755fe [id=d7336827451d418cb9b85848d42dee69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.054829 9894 tablet_service.cc:1511] Processing CreateTablet for tablet 814babd6ae4748109b6caf1af54c2733 (DEFAULT_TABLE table=default.Table_03af1ed093464e9584fda04a56a9d164 [id=30c76322574344bebe27eed28df49547]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.055058 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b71af7492854f32b26887f8cbead122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.055286 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814babd6ae4748109b6caf1af54c2733. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:01.055503 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet a999e0d7e70e4b4fb53e17e51ab9b03a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a999e0d7e70e4b4fb53e17e51ab9b03a already in progress: creating tablet
W20260810 19:48:01.055920 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 8e73953ad6e148749163ebeaa24ee6e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8e73953ad6e148749163ebeaa24ee6e4 already in progress: creating tablet
W20260810 19:48:01.056185 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet ca733de7babe4343ab26dbca2c9020b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca733de7babe4343ab26dbca2c9020b2 already in progress: creating tablet
W20260810 19:48:01.056434 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 3159795344ae492fb099fca0e52fcf20 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3159795344ae492fb099fca0e52fcf20 already in progress: creating tablet
I20260810 19:48:01.056618 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet c7235af514fa47d899d7e38ee5662f6c (table default.Table_5bdde0f42da34c6f99e8462d17affb30 [id=7c6a3df13ef44571a127a5ef2e73683a]) successfully deleted
I20260810 19:48:01.061599 10145 tablet_service.cc:1511] Processing CreateTablet for tablet dfea56a2d5d847058bcf4f508f0778a1 (DEFAULT_TABLE table=default.Table_f5350bb5f02d47f2b9736182f22ec088 [id=648fb85d4e0b470a8695accdc8e897c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.071743 9905 tablet_service.cc:1511] Processing CreateTablet for tablet dfea56a2d5d847058bcf4f508f0778a1 (DEFAULT_TABLE table=default.Table_f5350bb5f02d47f2b9736182f22ec088 [id=648fb85d4e0b470a8695accdc8e897c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.072849 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfea56a2d5d847058bcf4f508f0778a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.074450 10370 consensus_queue.cc:260] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.088181 11828 raft_consensus.cc:493] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:01.096359 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 629cfbd55c0b4a2fbe43f41cdefa85f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.096796 11852 tablet.cc:1724] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:01.099924 11861 tablet.cc:1724] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:01.101387 11518 raft_consensus.cc:493] T 3f18c24b01384299a4f941d7fb840032 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:01.102144 10375 ts_tablet_manager.cc:1929] T e959898b2c4c4173aea107d3f090ca07 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:01.102360 10375 log.cc:1199] T e959898b2c4c4173aea107d3f090ca07 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/e959898b2c4c4173aea107d3f090ca07
I20260810 19:48:01.105048 10370 ts_tablet_manager.cc:1434] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.057s user 0.003s sys 0.000s
I20260810 19:48:01.105093 11830 raft_consensus.cc:493] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:01.106178 10375 ts_tablet_manager.cc:1950] T e959898b2c4c4173aea107d3f090ca07 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:01.106778 10375 tablet_replica.cc:333] T dd632a01fe424a3a956d445ce01e31d2 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:01.107218 11518 raft_consensus.cc:515] T 3f18c24b01384299a4f941d7fb840032 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:01.107666 10367 tablet_bootstrap.cc:492] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:01.107954 10367 ts_tablet_manager.cc:1403] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.225s user 0.012s sys 0.004s
W20260810 19:48:01.109413 10068 leader_election.cc:343] T 3f18c24b01384299a4f941d7fb840032 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 3f18c24b01384299a4f941d7fb840032
I20260810 19:48:01.109427 10367 raft_consensus.cc:359] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.109944 10367 raft_consensus.cc:385] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.110100 10367 raft_consensus.cc:740] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.110601 10367 consensus_queue.cc:260] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.112167 10367 ts_tablet_manager.cc:1434] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 19:48:01.112917 10367 tablet_bootstrap.cc:492] T 5576e9087855441498904bc59685a442 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:01.115126 10371 tablet_replica.cc:333] T a5625dc6303d44c6be28abd6278ce034 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:01.115350 10371 raft_consensus.cc:2243] T a5625dc6303d44c6be28abd6278ce034 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:01.115291 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18c24b01384299a4f941d7fb840032" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:01.115543 10371 raft_consensus.cc:2272] T a5625dc6303d44c6be28abd6278ce034 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:01.115947 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet e959898b2c4c4173aea107d3f090ca07 (table default.Table_e2e810e459f24d0b9d348d428782a761 [id=3babf53bc29e4d4f9be8b2c19be6e2bd]) successfully deleted
I20260810 19:48:01.116184 10371 ts_tablet_manager.cc:1916] T a5625dc6303d44c6be28abd6278ce034 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:01.119925 10366 tablet_bootstrap.cc:492] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:01.121459 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 43770a764bd24d3f9ec60a02dca083dc (DEFAULT_TABLE table=default.Table_949a9afb4edf45919e8e02945ab84d4b [id=862459a347a240acbf9a3cce722cf3c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.108654 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 0b71af7492854f32b26887f8cbead122 (DEFAULT_TABLE table=default.Table_2b4a171707e745c0b06d669df83755fe [id=d7336827451d418cb9b85848d42dee69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.122887 10370 tablet_bootstrap.cc:492] T 4b2b0f2fc93647f3bc1d79b4132c3703 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:01.121160 10366 ts_tablet_manager.cc:1403] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.185s user 0.010s sys 0.000s
I20260810 19:48:01.126535 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7079614cda418583af74ae11a4d374 (DEFAULT_TABLE table=default.Table_77e9c60c358548bcae55a37d2cd94658 [id=269493a813774ed7a4dd4023b6a9159e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.128238 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7079614cda418583af74ae11a4d374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.129603 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7079614cda418583af74ae11a4d374 (DEFAULT_TABLE table=default.Table_77e9c60c358548bcae55a37d2cd94658 [id=269493a813774ed7a4dd4023b6a9159e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.130082 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7079614cda418583af74ae11a4d374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.139446 10371 ts_tablet_manager.cc:1929] T a5625dc6303d44c6be28abd6278ce034 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:01.139722 10371 log.cc:1199] T a5625dc6303d44c6be28abd6278ce034 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/a5625dc6303d44c6be28abd6278ce034
I20260810 19:48:01.140233 10371 ts_tablet_manager.cc:1950] T a5625dc6303d44c6be28abd6278ce034 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:01.148346 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 592) took 1196 ms. Trace:
I20260810 19:48:01.148594 10371 rpcz_store.cc:276] 0810 19:47:59.951400 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:59.953269 (+ 1869us) service_pool.cc:224] Handling call
0810 19:48:01.115049 (+1161780us) ts_tablet_manager.cc:1151] Deleting tablet a5625dc6303d44c6be28abd6278ce034
0810 19:48:01.115060 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:01.119591 (+ 4531us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:01.139340 (+ 19749us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:01.148287 (+ 8947us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1161585}
I20260810 19:48:01.149441 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet a5625dc6303d44c6be28abd6278ce034 (table default.Table_20489495f6794646b9eda0458ee58d91 [id=16ed3d0d9475472283f6d95c69c60f8d]) successfully deleted
I20260810 19:48:01.149991 10371 tablet_replica.cc:333] T d2c77a8ac1614bb286e4e168bcf999f3 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:01.150274 10371 raft_consensus.cc:2243] T d2c77a8ac1614bb286e4e168bcf999f3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:01.150565 10371 raft_consensus.cc:2272] T d2c77a8ac1614bb286e4e168bcf999f3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:01.151077 10367 tablet_bootstrap.cc:654] T 5576e9087855441498904bc59685a442 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:01.154379 10371 ts_tablet_manager.cc:1916] T d2c77a8ac1614bb286e4e168bcf999f3 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:01.154259 11541 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 19:48:01.156924 11541 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 19:48:01.157630 11541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 19:48:01.167019 10367 tablet_bootstrap.cc:492] T 5576e9087855441498904bc59685a442 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:01.167968 10367 ts_tablet_manager.cc:1403] T 5576e9087855441498904bc59685a442 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.055s user 0.010s sys 0.002s
I20260810 19:48:01.168217 10366 raft_consensus.cc:359] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:01.168511 10366 raft_consensus.cc:385] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.168593 10366 raft_consensus.cc:740] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.168902 10366 consensus_queue.cc:260] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:01.169517 10366 ts_tablet_manager.cc:1434] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.042s user 0.002s sys 0.000s
I20260810 19:48:01.169911 10366 tablet_bootstrap.cc:492] T 3f18c24b01384299a4f941d7fb840032 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:01.170518 10377 ts_tablet_manager.cc:1929] T 45194cae6ea44d9d8cf856d256fd534f P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:01.170660 10377 log.cc:1199] T 45194cae6ea44d9d8cf856d256fd534f P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/45194cae6ea44d9d8cf856d256fd534f
I20260810 19:48:01.171096 10377 ts_tablet_manager.cc:1950] T 45194cae6ea44d9d8cf856d256fd534f P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:01.172344 10377 tablet_replica.cc:333] T c7235af514fa47d899d7e38ee5662f6c P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:01.172410 11561 raft_consensus.cc:493] T bc753970b2464e38b03e377551276343 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:01.172583 11561 raft_consensus.cc:515] T bc753970b2464e38b03e377551276343 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:01.123032 11830 raft_consensus.cc:515] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.173238 11561 leader_election.cc:290] T bc753970b2464e38b03e377551276343 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:01.172592 10377 raft_consensus.cc:2243] T c7235af514fa47d899d7e38ee5662f6c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:01.173759 10377 raft_consensus.cc:2272] T c7235af514fa47d899d7e38ee5662f6c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:01.173993 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814babd6ae4748109b6caf1af54c2733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.174392 10377 ts_tablet_manager.cc:1916] T c7235af514fa47d899d7e38ee5662f6c P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:01.175146 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc753970b2464e38b03e377551276343" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:01.175421 9715 raft_consensus.cc:2393] T bc753970b2464e38b03e377551276343 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6986ed920dcb4af29a5eeeda6f671691 in current term 1: Already voted for candidate eadde59fd6504d679e47f03a60c64bb0 in this term.
I20260810 19:48:01.176429 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet c8602b7360b747a3af756b139635d95c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:01.178459 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 45194cae6ea44d9d8cf856d256fd534f (table default.Table_77e7389c3161415c96dd7dcbe6b2a829 [id=cf61b40b912d40368890dc6dfc5d1162]) successfully deleted
W20260810 19:48:01.178851 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 9e861473094f42dfa22b9c00145ed1fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e861473094f42dfa22b9c00145ed1fe already in progress: creating tablet
I20260810 19:48:01.180672 10377 ts_tablet_manager.cc:1929] T c7235af514fa47d899d7e38ee5662f6c P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:01.181411 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7079614cda418583af74ae11a4d374 (DEFAULT_TABLE table=default.Table_77e9c60c358548bcae55a37d2cd94658 [id=269493a813774ed7a4dd4023b6a9159e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.181759 10367 raft_consensus.cc:359] T 5576e9087855441498904bc59685a442 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.182175 10367 raft_consensus.cc:385] T 5576e9087855441498904bc59685a442 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.182351 10367 raft_consensus.cc:740] T 5576e9087855441498904bc59685a442 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.181957 10366 tablet_bootstrap.cc:654] T 3f18c24b01384299a4f941d7fb840032 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:01.181214 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77785d9bde843bc8366fe15d1b4fa18" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:01.183036 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43770a764bd24d3f9ec60a02dca083dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.182994 10367 consensus_queue.cc:260] T 5576e9087855441498904bc59685a442 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.183974 10367 ts_tablet_manager.cc:1434] T 5576e9087855441498904bc59685a442 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.016s user 0.001s sys 0.002s
I20260810 19:48:01.184365 10367 tablet_bootstrap.cc:492] T ebf33d82af9e494a8e85be8cba55d2c9 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:01.186668 10367 tablet_bootstrap.cc:654] T ebf33d82af9e494a8e85be8cba55d2c9 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:01.189320 10377 log.cc:1199] T c7235af514fa47d899d7e38ee5662f6c P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/c7235af514fa47d899d7e38ee5662f6c
I20260810 19:48:01.191740 10371 ts_tablet_manager.cc:1929] T d2c77a8ac1614bb286e4e168bcf999f3 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:01.191331 11561 raft_consensus.cc:493] T e959898b2c4c4173aea107d3f090ca07 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:01.192080 11561 raft_consensus.cc:515] T e959898b2c4c4173aea107d3f090ca07 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.192366 11518 leader_election.cc:290] T 3f18c24b01384299a4f941d7fb840032 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:01.192704 9397 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 56fa5de3bf7142b2b0978f9190091f33 (table default.Table_2ef5bea5eb994cf689de41a97d978b28 [id=87220e53176e4254a5238c988b6a7311], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 56fa5de3bf7142b2b0978f9190091f33 consensus state has no leader
I20260810 19:48:01.192869 11561 leader_election.cc:290] T e959898b2c4c4173aea107d3f090ca07 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:01.193991 10377 ts_tablet_manager.cc:1950] T c7235af514fa47d899d7e38ee5662f6c P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:01.194970 11828 raft_consensus.cc:515] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:01.195695 10377 tablet_replica.cc:333] T e959898b2c4c4173aea107d3f090ca07 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:01.195734 11828 leader_election.cc:290] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:01.195919 10377 raft_consensus.cc:2243] T e959898b2c4c4173aea107d3f090ca07 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:01.195928 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet c7235af514fa47d899d7e38ee5662f6c (table default.Table_5bdde0f42da34c6f99e8462d17affb30 [id=7c6a3df13ef44571a127a5ef2e73683a]) successfully deleted
I20260810 19:48:01.196089 10377 raft_consensus.cc:2272] T e959898b2c4c4173aea107d3f090ca07 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:01.196653 10377 ts_tablet_manager.cc:1916] T e959898b2c4c4173aea107d3f090ca07 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:01.197290 10367 tablet_bootstrap.cc:492] T ebf33d82af9e494a8e85be8cba55d2c9 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:01.200281 10367 ts_tablet_manager.cc:1403] T ebf33d82af9e494a8e85be8cba55d2c9 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.009s
W20260810 19:48:01.200312 10067 leader_election.cc:343] T 3f18c24b01384299a4f941d7fb840032 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:01.200471 10067 leader_election.cc:304] T 3f18c24b01384299a4f941d7fb840032 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:01.201197 10367 raft_consensus.cc:359] T ebf33d82af9e494a8e85be8cba55d2c9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.201397 10367 raft_consensus.cc:385] T ebf33d82af9e494a8e85be8cba55d2c9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.201478 10367 raft_consensus.cc:740] T ebf33d82af9e494a8e85be8cba55d2c9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
W20260810 19:48:01.201768 10067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 84906.2us
I20260810 19:48:01.201795 10367 consensus_queue.cc:260] T ebf33d82af9e494a8e85be8cba55d2c9 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.202540 10367 ts_tablet_manager.cc:1434] T ebf33d82af9e494a8e85be8cba55d2c9 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:01.202896 10367 tablet_bootstrap.cc:492] T 965395b5072e4d47adac504e22a8d484 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:01.202921 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af6dd8913f44e7f966ed2a128ae4fbf" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:01.203135 9948 raft_consensus.cc:2468] T 6af6dd8913f44e7f966ed2a128ae4fbf P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:01.204818 10367 tablet_bootstrap.cc:654] T 965395b5072e4d47adac504e22a8d484 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:01.205809 11830 leader_election.cc:290] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:01.207281 10068 leader_election.cc:343] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: a5625dc6303d44c6be28abd6278ce034
I20260810 19:48:01.208230 10375 raft_consensus.cc:2243] T dd632a01fe424a3a956d445ce01e31d2 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:01.208429 10371 log.cc:1199] T d2c77a8ac1614bb286e4e168bcf999f3 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/d2c77a8ac1614bb286e4e168bcf999f3
I20260810 19:48:01.208523 10375 raft_consensus.cc:2272] T dd632a01fe424a3a956d445ce01e31d2 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:01.208827 10371 ts_tablet_manager.cc:1950] T d2c77a8ac1614bb286e4e168bcf999f3 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
W20260810 19:48:01.209370 9830 leader_election.cc:343] T e959898b2c4c4173aea107d3f090ca07 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Not found: Tablet not found: e959898b2c4c4173aea107d3f090ca07
W20260810 19:48:01.209720 9611 leader_election.cc:343] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:01.209887 9611 leader_election.cc:304] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:01.210152 11724 raft_consensus.cc:2749] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:01.210457 10067 leader_election.cc:304] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:01.212445 10366 tablet_bootstrap.cc:492] T 3f18c24b01384299a4f941d7fb840032 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:01.212700 10366 ts_tablet_manager.cc:1403] T 3f18c24b01384299a4f941d7fb840032 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.043s user 0.006s sys 0.004s
I20260810 19:48:01.212770 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5625dc6303d44c6be28abd6278ce034" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:01.213706 10366 raft_consensus.cc:359] T 3f18c24b01384299a4f941d7fb840032 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:01.213999 10366 raft_consensus.cc:385] T 3f18c24b01384299a4f941d7fb840032 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.214131 10366 raft_consensus.cc:740] T 3f18c24b01384299a4f941d7fb840032 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.214408 10375 ts_tablet_manager.cc:1916] T dd632a01fe424a3a956d445ce01e31d2 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:01.214507 10366 consensus_queue.cc:260] T 3f18c24b01384299a4f941d7fb840032 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:01.218981 11830 raft_consensus.cc:493] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:01.219189 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc753970b2464e38b03e377551276343" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:01.219040 10370 tablet_bootstrap.cc:654] T 4b2b0f2fc93647f3bc1d79b4132c3703 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:01.219604 11830 raft_consensus.cc:515] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
W20260810 19:48:01.219237 10068 leader_election.cc:343] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 6af6dd8913f44e7f966ed2a128ae4fbf
I20260810 19:48:01.220124 10366 ts_tablet_manager.cc:1434] T 3f18c24b01384299a4f941d7fb840032 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260810 19:48:01.220686 11518 raft_consensus.cc:2804] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:01.221637 9830 leader_election.cc:304] T bc753970b2464e38b03e377551276343 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:48:01.222056 9831 leader_election.cc:343] T e959898b2c4c4173aea107d3f090ca07 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: e959898b2c4c4173aea107d3f090ca07
I20260810 19:48:01.222214 9831 leader_election.cc:304] T e959898b2c4c4173aea107d3f090ca07 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:01.222210 11561 raft_consensus.cc:3060] T bc753970b2464e38b03e377551276343 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:01.222460 9831 raft_consensus.cc:2686] T e959898b2c4c4173aea107d3f090ca07 P 6986ed920dcb4af29a5eeeda6f671691: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 19:48:01.224222 10366 tablet_bootstrap.cc:492] T ee65b2c9980d4c77af8c68bf2f5c5f92 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:01.225569 11561 raft_consensus.cc:2749] T bc753970b2464e38b03e377551276343 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:01.227671 11830 leader_election.cc:290] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:01.229313 10366 tablet_bootstrap.cc:654] T ee65b2c9980d4c77af8c68bf2f5c5f92 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:01.242277 10377 ts_tablet_manager.cc:1929] T e959898b2c4c4173aea107d3f090ca07 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:01.230952 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfea56a2d5d847058bcf4f508f0778a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.246816 10377 log.cc:1199] T e959898b2c4c4173aea107d3f090ca07 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/e959898b2c4c4173aea107d3f090ca07
I20260810 19:48:01.236816 11828 raft_consensus.cc:2749] T 3f18c24b01384299a4f941d7fb840032 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:01.247330 10377 ts_tablet_manager.cc:1950] T e959898b2c4c4173aea107d3f090ca07 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:01.237308 11518 raft_consensus.cc:493] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260810 19:48:01.245321 10068 leader_election.cc:343] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 6355c14e38b3446493f7bd5e2a717341
I20260810 19:48:01.236657 11663 raft_consensus.cc:493] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:01.248348 9412 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 9a13b0f5b6b14bb9b72740a8521e4ea5 (table default.Table_0844c946c41146f38e51790cd8baed2a [id=4830b444314a4bb6a605cb73432e772f]). Expected version 1 got 0
I20260810 19:48:01.248641 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet e959898b2c4c4173aea107d3f090ca07 (table default.Table_e2e810e459f24d0b9d348d428782a761 [id=3babf53bc29e4d4f9be8b2c19be6e2bd]) successfully deleted
I20260810 19:48:01.249300 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_65864a250646401984a7263cf477ab07" } new_table_name: "default.Table_a018c57628c543db9a258f393c98f931" modify_external_catalogs: true
W20260810 19:48:01.245375 11849 log.cc:927] Time spent T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0: Append to log took a long time: real 0.112s user 0.000s sys 0.000s
I20260810 19:48:01.252044 9413 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d (table default.Table_5e6891ff4aa040be8b327aafa596bc7e [id=fd840f00bdc5477aaad0b7fa114870dd]). Expected version 1 got 0
I20260810 19:48:01.253952 9413 master_service.cc:960] ReplaceTablet: received request to replace tablet d99b34f901484fad87cff4bb9ab56fc8 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:01.254207 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet c8602b7360b747a3af756b139635d95c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:01.254238 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet e247ae3828e84092b836f3dd07b44bc6 with delete_type TABLET_DATA_DELETED (replaced by tablet 839dcdb448d14a8f8e452145ccf41263) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:01.254679 10377 tablet_replica.cc:333] T c8602b7360b747a3af756b139635d95c P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:01.255988 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet 6af6dd8913f44e7f966ed2a128ae4fbf with delete_type TABLET_DATA_DELETED (replaced by tablet 320e42f6de6c4452adb7bbb379a156e6) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:01.256819 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e94bbfae043b4fcf8004b5fdd86ac3f7" } modify_external_catalogs: true
I20260810 19:48:01.257344 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e94bbfae043b4fcf8004b5fdd86ac3f7" } modify_external_catalogs: true
I20260810 19:48:01.257859 10377 raft_consensus.cc:2243] T c8602b7360b747a3af756b139635d95c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:01.258163 10377 raft_consensus.cc:2272] T c8602b7360b747a3af756b139635d95c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:01.259126 10377 ts_tablet_manager.cc:1916] T c8602b7360b747a3af756b139635d95c P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:01.259341 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f3e3dde1c29e4275bafb27df63b117be consensus state has no leader
I20260810 19:48:01.262413 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 36f01bdcf7b24a58b80b6ca9ba307113
I20260810 19:48:01.263624 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet 36f01bdcf7b24a58b80b6ca9ba307113 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:01.265888 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 38b0c6a017dc4afc849090cca7ee8b26
I20260810 19:48:01.266796 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet 38b0c6a017dc4afc849090cca7ee8b26 with delete_type TABLET_DATA_DELETED (replaced by tablet 47c54793369048fc874522388d08d3da) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:01.267928 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet 38b0c6a017dc4afc849090cca7ee8b26 with delete_type TABLET_DATA_DELETED (replaced by tablet 47c54793369048fc874522388d08d3da) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:01.269457 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 36f01bdcf7b24a58b80b6ca9ba307113 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:01.269671 10377 ts_tablet_manager.cc:1929] T c8602b7360b747a3af756b139635d95c P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:01.269949 10377 log.cc:1199] T c8602b7360b747a3af756b139635d95c P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/c8602b7360b747a3af756b139635d95c
I20260810 19:48:01.270431 10377 ts_tablet_manager.cc:1950] T c8602b7360b747a3af756b139635d95c P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:01.271922 10377 tablet_replica.cc:333] T e247ae3828e84092b836f3dd07b44bc6 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:01.274550 10377 raft_consensus.cc:2243] T e247ae3828e84092b836f3dd07b44bc6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:01.274855 10377 raft_consensus.cc:2272] T e247ae3828e84092b836f3dd07b44bc6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:01.274895 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7079614cda418583af74ae11a4d374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.275803 10377 ts_tablet_manager.cc:1916] T e247ae3828e84092b836f3dd07b44bc6 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:01.236601 10067 leader_election.cc:343] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:01.275960 10067 leader_election.cc:304] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:01.229568 11854 tablet.cc:1724] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:01.278434 11663 raft_consensus.cc:515] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.279583 11518 raft_consensus.cc:3060] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:01.282444 10068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 49275.8us
I20260810 19:48:01.282557 11561 raft_consensus.cc:493] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:01.282747 11561 raft_consensus.cc:515] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:01.282881 11828 raft_consensus.cc:2749] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:01.283519 11561 leader_election.cc:290] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:01.284384 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b737b216646a4c5baecb88d59bcce4df" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:01.284648 9715 raft_consensus.cc:2468] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:01.285224 9831 leader_election.cc:304] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:01.285742 11561 raft_consensus.cc:2804] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:01.285845 11561 raft_consensus.cc:493] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:01.285926 11561 raft_consensus.cc:3060] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:01.287892 10367 tablet_bootstrap.cc:492] T 965395b5072e4d47adac504e22a8d484 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:01.288084 10367 ts_tablet_manager.cc:1403] T 965395b5072e4d47adac504e22a8d484 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.085s user 0.000s sys 0.009s
I20260810 19:48:01.288945 10367 raft_consensus.cc:359] T 965395b5072e4d47adac504e22a8d484 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.289142 10367 raft_consensus.cc:385] T 965395b5072e4d47adac504e22a8d484 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.289215 10367 raft_consensus.cc:740] T 965395b5072e4d47adac504e22a8d484 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.289469 11561 raft_consensus.cc:515] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:01.289516 10367 consensus_queue.cc:260] T 965395b5072e4d47adac504e22a8d484 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.290118 10367 ts_tablet_manager.cc:1434] T 965395b5072e4d47adac504e22a8d484 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 19:48:01.290728 11663 leader_election.cc:290] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:01.291188 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b737b216646a4c5baecb88d59bcce4df" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:01.291411 9715 raft_consensus.cc:3060] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:01.291971 10367 tablet_bootstrap.cc:492] T dfea147ef3904ab49375def065c6f328 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:01.294356 10367 tablet_bootstrap.cc:654] T dfea147ef3904ab49375def065c6f328 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:01.295225 9715 raft_consensus.cc:2468] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:01.295884 9831 leader_election.cc:304] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:01.296463 11894 raft_consensus.cc:2804] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:01.296859 11561 leader_election.cc:290] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:01.297003 10377 ts_tablet_manager.cc:1929] T e247ae3828e84092b836f3dd07b44bc6 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 19:48:01.297178 10067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 59727us
I20260810 19:48:01.298225 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e29e23d54f47968a06be98b313918d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:01.298942 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6355c14e38b3446493f7bd5e2a717341" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:01.299556 10377 log.cc:1199] T e247ae3828e84092b836f3dd07b44bc6 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/e247ae3828e84092b836f3dd07b44bc6
I20260810 19:48:01.299988 11894 raft_consensus.cc:697] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:01.300117 10377 ts_tablet_manager.cc:1950] T e247ae3828e84092b836f3dd07b44bc6 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:01.300449 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b71af7492854f32b26887f8cbead122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.300379 11894 consensus_queue.cc:237] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:01.301620 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 36f01bdcf7b24a58b80b6ca9ba307113 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:01.302026 10377 tablet_replica.cc:333] T 6af6dd8913f44e7f966ed2a128ae4fbf P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:01.302254 10377 raft_consensus.cc:2243] T 6af6dd8913f44e7f966ed2a128ae4fbf P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260810 19:48:01.302218 10068 leader_election.cc:343] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 08e29e23d54f47968a06be98b313918d
I20260810 19:48:01.303179 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 38b0c6a017dc4afc849090cca7ee8b26 with delete_type TABLET_DATA_DELETED (replaced by tablet 47c54793369048fc874522388d08d3da) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:01.303586 10067 leader_election.cc:343] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:01.303653 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b737b216646a4c5baecb88d59bcce4df" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:01.303727 10162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b737b216646a4c5baecb88d59bcce4df" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:01.303867 10168 raft_consensus.cc:2468] T b737b216646a4c5baecb88d59bcce4df P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:01.307034 10377 raft_consensus.cc:2272] T 6af6dd8913f44e7f966ed2a128ae4fbf P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:01.308275 10377 ts_tablet_manager.cc:1916] T 6af6dd8913f44e7f966ed2a128ae4fbf P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:01.322283 10377 ts_tablet_manager.cc:1929] T 6af6dd8913f44e7f966ed2a128ae4fbf P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:01.329676 10377 log.cc:1199] T 6af6dd8913f44e7f966ed2a128ae4fbf P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/6af6dd8913f44e7f966ed2a128ae4fbf
I20260810 19:48:01.330049 10377 ts_tablet_manager.cc:1950] T 6af6dd8913f44e7f966ed2a128ae4fbf P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:01.342064 10067 leader_election.cc:304] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:01.342584 10375 ts_tablet_manager.cc:1929] T dd632a01fe424a3a956d445ce01e31d2 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:01.342927 11518 raft_consensus.cc:515] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:01.343899 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet c8602b7360b747a3af756b139635d95c (table default.Table_e2c3250ad65342b6b93438349218f41a [id=043b4921c17c438db20e082f44e88787]) successfully deleted
W20260810 19:48:01.344436 9395 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 72365.4us
I20260810 19:48:01.345031 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet e247ae3828e84092b836f3dd07b44bc6 (table default.Table_745ec8d1fd994242990bec7acd5bd9cd [id=435f41d3a7ba4f03a738cdb2272f759e]) successfully deleted
I20260810 19:48:01.345698 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 6af6dd8913f44e7f966ed2a128ae4fbf (table default.Table_ae6b06e8ae0c4fd19fe26b1b08db672a [id=5354f5d091794b14806dd9bc872da0ae]) successfully deleted
W20260810 19:48:01.346016 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 36f01bdcf7b24a58b80b6ca9ba307113 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36f01bdcf7b24a58b80b6ca9ba307113 already in progress: creating tablet
W20260810 19:48:01.346719 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 38b0c6a017dc4afc849090cca7ee8b26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38b0c6a017dc4afc849090cca7ee8b26 already in progress: creating tablet
I20260810 19:48:01.348300 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 4f21e03993e841ba901f1e9c176309b9
I20260810 19:48:01.348973 9407 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:56048 (request call id 788) took 1087 ms. Trace:
I20260810 19:48:01.349519 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 4e80e2327c394612bffc51f38798dac3
I20260810 19:48:01.349104 9407 rpcz_store.cc:276] 0810 19:48:00.260993 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:00.261080 (+ 87us) service_pool.cc:224] Handling call
0810 19:48:00.305836 (+ 44756us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 19:48:00.306020 (+ 184us) catalog_manager.cc:2841] Modifying in-memory table state
0810 19:48:00.306093 (+ 73us) catalog_manager.cc:2850] Locking tablets
0810 19:48:00.967275 (+661182us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 19:48:01.348073 (+380798us) catalog_manager.cc:2882] Removing table from by-name map
0810 19:48:01.348169 (+ 96us) catalog_manager.cc:2898] Committing in-memory state
0810 19:48:01.348215 (+ 46us) catalog_manager.cc:2902] Aborting table tasks
0810 19:48:01.348925 (+ 710us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:48:00.970085 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 19:48:00.970165 (+ 80us) write_op.cc:432] Acquiring schema lock in shared mode
0810 19:48:00.970170 (+ 5us) write_op.cc:435] Acquired schema lock
0810 19:48:00.970172 (+ 2us) tablet.cc:662] Decoding operations
0810 19:48:00.970261 (+ 89us) write_op.cc:620] Acquiring the partition lock for write op
0810 19:48:00.970269 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0810 19:48:00.970273 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0810 19:48:00.997028 (+ 26755us) tablet.cc:701] Row locks acquired
0810 19:48:00.997032 (+ 4us) write_op.cc:260] PREPARE: finished
0810 19:48:00.997096 (+ 64us) write_op.cc:270] Start()
0810 19:48:00.997145 (+ 49us) write_op.cc:276] Timestamp: P: 1786391280997062 usec, L: 0
0810 19:48:00.997149 (+ 4us) op_driver.cc:348] REPLICATION: starting
0810 19:48:00.997409 (+ 260us) log.cc:844] Serialized 762 byte log entry
0810 19:48:01.268286 (+270877us) op_driver.cc:464] REPLICATION: finished
0810 19:48:01.268488 (+ 202us) write_op.cc:301] APPLY: starting
0810 19:48:01.268506 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0810 19:48:01.268554 (+ 48us) tablet.cc:1370] finished BulkCheckPresence
0810 19:48:01.347519 (+ 78965us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 19:48:01.347642 (+ 123us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 19:48:01.347691 (+ 49us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 19:48:01.347706 (+ 15us) write_op.cc:312] APPLY: finished
0810 19:48:01.347833 (+ 127us) log.cc:844] Serialized 29 byte log entry
0810 19:48:01.347938 (+ 105us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:01.347967 (+ 29us) write_op.cc:454] Released schema lock
0810 19:48:01.347977 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0810 19:48:01.348074 (+ 97us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:01.348078 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":79,"apply.run_cpu_time_us":1336,"apply.run_wall_time_us":79578,"num_ops":2,"prepare.queue_time_us":2145,"prepare.run_cpu_time_us":893,"prepare.run_wall_time_us":27412,"replication_time_us":270983}]]}
I20260810 19:48:01.349962 9408 catalog_manager.cc:6807] ReplaceTablet: tablet 4e80e2327c394612bffc51f38798dac3 deleted and replaced by tablet 341220bd9f1b40d49ff360c2acc32339
I20260810 19:48:01.350222 9408 master_service.cc:960] ReplaceTablet: received request to replace tablet e28348b22e184b5993a4abc5859de6c3 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:01.350921 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 4e9feae2570443afa3dec76975493487
I20260810 19:48:01.352459 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e80e2327c394612bffc51f38798dac3 with delete_type TABLET_DATA_DELETED (replaced by tablet 341220bd9f1b40d49ff360c2acc32339) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:01.352725 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e9feae2570443afa3dec76975493487 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:01.352964 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f21e03993e841ba901f1e9c176309b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:01.354794 9410 catalog_manager.cc:6807] ReplaceTablet: tablet 38b0c6a017dc4afc849090cca7ee8b26 deleted and replaced by tablet 47c54793369048fc874522388d08d3da
I20260810 19:48:01.358585 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e9feae2570443afa3dec76975493487 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:01.358673 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e80e2327c394612bffc51f38798dac3 with delete_type TABLET_DATA_DELETED (replaced by tablet 341220bd9f1b40d49ff360c2acc32339) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:01.358585 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f21e03993e841ba901f1e9c176309b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:48:01.359570 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 4e9feae2570443afa3dec76975493487 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e9feae2570443afa3dec76975493487 already in progress: creating tablet
W20260810 19:48:01.360407 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 4e80e2327c394612bffc51f38798dac3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e80e2327c394612bffc51f38798dac3 already in progress: creating tablet
W20260810 19:48:01.360742 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 4f21e03993e841ba901f1e9c176309b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f21e03993e841ba901f1e9c176309b9 already in progress: creating tablet
W20260810 19:48:01.342702 10067 leader_election.cc:343] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:01.361315 11663 raft_consensus.cc:2749] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:01.361558 11518 leader_election.cc:290] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:01.363122 10068 leader_election.cc:343] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 6af6dd8913f44e7f966ed2a128ae4fbf
I20260810 19:48:01.368062 10375 log.cc:1199] T dd632a01fe424a3a956d445ce01e31d2 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/dd632a01fe424a3a956d445ce01e31d2
I20260810 19:48:01.368769 10375 ts_tablet_manager.cc:1950] T dd632a01fe424a3a956d445ce01e31d2 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:01.368894 10370 tablet_bootstrap.cc:492] T 4b2b0f2fc93647f3bc1d79b4132c3703 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:01.369674 10370 ts_tablet_manager.cc:1403] T 4b2b0f2fc93647f3bc1d79b4132c3703 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.264s user 0.012s sys 0.008s
I20260810 19:48:01.376106 11518 raft_consensus.cc:493] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:01.376302 11518 raft_consensus.cc:515] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:01.379271 10367 tablet_bootstrap.cc:492] T dfea147ef3904ab49375def065c6f328 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:01.379451 10367 ts_tablet_manager.cc:1403] T dfea147ef3904ab49375def065c6f328 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.088s user 0.001s sys 0.002s
I20260810 19:48:01.209722 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 593) took 1258 ms. Trace:
I20260810 19:48:01.380344 10367 raft_consensus.cc:359] T dfea147ef3904ab49375def065c6f328 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.380576 10367 raft_consensus.cc:385] T dfea147ef3904ab49375def065c6f328 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.380657 10367 raft_consensus.cc:740] T dfea147ef3904ab49375def065c6f328 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.380551 10371 rpcz_store.cc:276] 0810 19:47:59.951512 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:47:59.953500 (+ 1988us) service_pool.cc:224] Handling call
0810 19:48:01.149904 (+1196404us) ts_tablet_manager.cc:1151] Deleting tablet d2c77a8ac1614bb286e4e168bcf999f3
0810 19:48:01.149918 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:01.166583 (+ 16665us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:01.191647 (+ 25064us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:01.209669 (+ 18022us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1196252}
I20260810 19:48:01.380934 10367 consensus_queue.cc:260] T dfea147ef3904ab49375def065c6f328 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.381070 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 604) took 1318 ms. Trace:
I20260810 19:48:01.381173 10371 rpcz_store.cc:276] 0810 19:48:00.062911 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:00.064177 (+ 1266us) service_pool.cc:224] Handling call
0810 19:48:01.380888 (+1316711us) ts_tablet_manager.cc:1151] Deleting tablet 0df786b887de4d7dbf1881e4944e3b68
0810 19:48:01.380902 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:01.381021 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1315739}
I20260810 19:48:01.381562 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 605) took 1318 ms. Trace:
I20260810 19:48:01.381656 10367 ts_tablet_manager.cc:1434] T dfea147ef3904ab49375def065c6f328 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 19:48:01.382007 10367 tablet_bootstrap.cc:492] T 3e8ae48a2fb548358176abefe1ee3baa P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
W20260810 19:48:01.382030 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 956b5d18745f403aad67ec888fbbd379 has no consensus state
I20260810 19:48:01.382565 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0c32faaf2cc249e5aeb42ca18ba243bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:01.382725 10371 rpcz_store.cc:276] 0810 19:48:00.063091 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:00.066162 (+ 3071us) service_pool.cc:224] Handling call
0810 19:48:01.381414 (+1315252us) ts_tablet_manager.cc:1151] Deleting tablet 7add2dae2d1b4e8b9b95348e0334ba03
0810 19:48:01.381423 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:01.381513 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1314093}
I20260810 19:48:01.383152 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 612) took 1236 ms. Trace:
W20260810 19:48:01.383188 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c32faaf2cc249e5aeb42ca18ba243bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:01.383263 10371 rpcz_store.cc:276] 0810 19:48:00.146691 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:00.146895 (+ 204us) service_pool.cc:224] Handling call
0810 19:48:01.382998 (+1236103us) ts_tablet_manager.cc:1151] Deleting tablet a999e0d7e70e4b4fb53e17e51ab9b03a
0810 19:48:01.383009 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:01.383100 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1235878}
I20260810 19:48:01.383631 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 610) took 1237 ms. Trace:
I20260810 19:48:01.383718 10371 rpcz_store.cc:276] 0810 19:48:00.146422 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:00.147214 (+ 792us) service_pool.cc:224] Handling call
0810 19:48:01.383491 (+1236277us) ts_tablet_manager.cc:1151] Deleting tablet 7f4ca5a1ec3d4ca392f389f2dabae296
0810 19:48:01.383501 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:01.383585 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1236082}
I20260810 19:48:01.383997 10367 tablet_bootstrap.cc:654] T 3e8ae48a2fb548358176abefe1ee3baa P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:01.384073 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 611) took 1237 ms. Trace:
I20260810 19:48:01.384173 10371 rpcz_store.cc:276] 0810 19:48:00.146579 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:00.147668 (+ 1089us) service_pool.cc:224] Handling call
0810 19:48:01.383938 (+1236270us) ts_tablet_manager.cc:1151] Deleting tablet 8e73953ad6e148749163ebeaa24ee6e4
0810 19:48:01.383948 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:01.384029 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1236104}
I20260810 19:48:01.385690 10371 tablet_replica.cc:333] T 3c828ae089774fb9b0582141f4b99313 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:01.385833 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 8503d5162548463bae22402fdc4c502a
I20260810 19:48:01.386020 10371 raft_consensus.cc:2243] T 3c828ae089774fb9b0582141f4b99313 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:01.386545 9415 catalog_manager.cc:6807] ReplaceTablet: tablet 8503d5162548463bae22402fdc4c502a deleted and replaced by tablet 5b56fb5bed4b46a2a1fc0ab22379760b
I20260810 19:48:01.386598 10366 tablet_bootstrap.cc:492] T ee65b2c9980d4c77af8c68bf2f5c5f92 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:01.386745 10366 ts_tablet_manager.cc:1403] T ee65b2c9980d4c77af8c68bf2f5c5f92 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.163s user 0.027s sys 0.019s
I20260810 19:48:01.386981 10371 raft_consensus.cc:2272] T 3c828ae089774fb9b0582141f4b99313 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:01.386935 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_6c986245c9bc47b5a094b5f4fa6d1536"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:01.387490 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c986245c9bc47b5a094b5f4fa6d1536 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:01.387583 10371 ts_tablet_manager.cc:1916] T 3c828ae089774fb9b0582141f4b99313 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:01.387542 10366 raft_consensus.cc:359] T ee65b2c9980d4c77af8c68bf2f5c5f92 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:01.387712 10366 raft_consensus.cc:385] T ee65b2c9980d4c77af8c68bf2f5c5f92 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.387756 10366 raft_consensus.cc:740] T ee65b2c9980d4c77af8c68bf2f5c5f92 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.387990 10366 consensus_queue.cc:260] T ee65b2c9980d4c77af8c68bf2f5c5f92 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:01.388491 10366 ts_tablet_manager.cc:1434] T ee65b2c9980d4c77af8c68bf2f5c5f92 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:01.388779 10366 tablet_bootstrap.cc:492] T 0c0a1e360ac648eeb0c734215bc200f6 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:01.391211 10366 tablet_bootstrap.cc:654] T 0c0a1e360ac648eeb0c734215bc200f6 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:01.391582 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet d2c77a8ac1614bb286e4e168bcf999f3 (table default.Table_c2a3c3f509104c5cbeb2f53726021955 [id=8fddaf13b1664006ac4b4fc2dcd2e90c]) successfully deleted
W20260810 19:48:01.391851 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 0df786b887de4d7dbf1881e4944e3b68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0df786b887de4d7dbf1881e4944e3b68 already in progress: creating tablet
W20260810 19:48:01.392058 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 7add2dae2d1b4e8b9b95348e0334ba03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7add2dae2d1b4e8b9b95348e0334ba03 already in progress: creating tablet
W20260810 19:48:01.392225 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet a999e0d7e70e4b4fb53e17e51ab9b03a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a999e0d7e70e4b4fb53e17e51ab9b03a already in progress: creating tablet
W20260810 19:48:01.392410 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 7f4ca5a1ec3d4ca392f389f2dabae296 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f4ca5a1ec3d4ca392f389f2dabae296 already in progress: creating tablet
W20260810 19:48:01.392611 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 8e73953ad6e148749163ebeaa24ee6e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8e73953ad6e148749163ebeaa24ee6e4 already in progress: creating tablet
I20260810 19:48:01.393239 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 8503d5162548463bae22402fdc4c502a with delete_type TABLET_DATA_DELETED (replaced by tablet 5b56fb5bed4b46a2a1fc0ab22379760b) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:01.394482 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_07ad1f3e542846cebb4730066182432d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:01.395074 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07ad1f3e542846cebb4730066182432d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:01.398501 10367 tablet_bootstrap.cc:492] T 3e8ae48a2fb548358176abefe1ee3baa P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:01.398669 10367 ts_tablet_manager.cc:1403] T 3e8ae48a2fb548358176abefe1ee3baa P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.002s
I20260810 19:48:01.398815 10371 ts_tablet_manager.cc:1929] T 3c828ae089774fb9b0582141f4b99313 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:01.398991 10371 log.cc:1199] T 3c828ae089774fb9b0582141f4b99313 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/3c828ae089774fb9b0582141f4b99313
I20260810 19:48:01.399163 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a2eeaf19864943728adb31a3605f7550" } modify_external_catalogs: true
I20260810 19:48:01.399447 10371 ts_tablet_manager.cc:1950] T 3c828ae089774fb9b0582141f4b99313 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:01.399418 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a2eeaf19864943728adb31a3605f7550" } modify_external_catalogs: true
I20260810 19:48:01.399504 10367 raft_consensus.cc:359] T 3e8ae48a2fb548358176abefe1ee3baa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.399703 10367 raft_consensus.cc:385] T 3e8ae48a2fb548358176abefe1ee3baa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.399775 10367 raft_consensus.cc:740] T 3e8ae48a2fb548358176abefe1ee3baa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.400004 10367 consensus_queue.cc:260] T 3e8ae48a2fb548358176abefe1ee3baa P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.400473 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 613) took 1253 ms. Trace:
I20260810 19:48:01.400601 10371 rpcz_store.cc:276] 0810 19:48:00.146817 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:00.162376 (+ 15559us) service_pool.cc:224] Handling call
0810 19:48:01.385622 (+1223246us) ts_tablet_manager.cc:1151] Deleting tablet 3c828ae089774fb9b0582141f4b99313
0810 19:48:01.385632 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:01.394106 (+ 8474us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:01.398712 (+ 4606us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:01.400428 (+ 1716us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1223021}
I20260810 19:48:01.401022 10371 tablet_replica.cc:333] T 476e762e46c04ae6bfef5e14df2d16e2 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:01.401262 10371 raft_consensus.cc:2243] T 476e762e46c04ae6bfef5e14df2d16e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:01.402246 10371 raft_consensus.cc:2272] T 476e762e46c04ae6bfef5e14df2d16e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:01.402281 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 3c828ae089774fb9b0582141f4b99313 (table default.Table_cc3aacf41a5e424687efa546af746ffa [id=56c4ed6bce3c4b88b8f47f0313355de1]) successfully deleted
I20260810 19:48:01.402343 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet 8503d5162548463bae22402fdc4c502a with delete_type TABLET_DATA_DELETED (replaced by tablet 5b56fb5bed4b46a2a1fc0ab22379760b) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:01.402916 10371 ts_tablet_manager.cc:1916] T 476e762e46c04ae6bfef5e14df2d16e2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:01.403239 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 8503d5162548463bae22402fdc4c502a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8503d5162548463bae22402fdc4c502a already in progress: creating tablet
I20260810 19:48:01.403640 10366 tablet_bootstrap.cc:492] T 0c0a1e360ac648eeb0c734215bc200f6 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:01.403767 10366 ts_tablet_manager.cc:1403] T 0c0a1e360ac648eeb0c734215bc200f6 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20260810 19:48:01.404462 10366 raft_consensus.cc:359] T 0c0a1e360ac648eeb0c734215bc200f6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.404623 10366 raft_consensus.cc:385] T 0c0a1e360ac648eeb0c734215bc200f6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.404665 10366 raft_consensus.cc:740] T 0c0a1e360ac648eeb0c734215bc200f6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.404881 10366 consensus_queue.cc:260] T 0c0a1e360ac648eeb0c734215bc200f6 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.405418 10366 ts_tablet_manager.cc:1434] T 0c0a1e360ac648eeb0c734215bc200f6 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:01.405692 10366 tablet_bootstrap.cc:492] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:01.407505 10366 tablet_bootstrap.cc:654] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:01.409300 10371 ts_tablet_manager.cc:1929] T 476e762e46c04ae6bfef5e14df2d16e2 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:01.409457 10371 log.cc:1199] T 476e762e46c04ae6bfef5e14df2d16e2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/476e762e46c04ae6bfef5e14df2d16e2
I20260810 19:48:01.409775 10371 ts_tablet_manager.cc:1950] T 476e762e46c04ae6bfef5e14df2d16e2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:01.410766 10367 ts_tablet_manager.cc:1434] T 3e8ae48a2fb548358176abefe1ee3baa P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260810 19:48:01.412695 10367 tablet_bootstrap.cc:492] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:01.415833 10366 tablet_bootstrap.cc:492] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:01.416085 10366 ts_tablet_manager.cc:1403] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260810 19:48:01.416314 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 614) took 1240 ms. Trace:
I20260810 19:48:01.416431 10371 rpcz_store.cc:276] 0810 19:48:00.175790 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:00.178387 (+ 2597us) service_pool.cc:224] Handling call
0810 19:48:01.400953 (+1222566us) ts_tablet_manager.cc:1151] Deleting tablet 476e762e46c04ae6bfef5e14df2d16e2
0810 19:48:01.400964 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:01.406110 (+ 5146us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:01.409209 (+ 3099us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:01.416261 (+ 7052us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":761,"tablet-delete.queue_time_us":1221799}
I20260810 19:48:01.417049 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 476e762e46c04ae6bfef5e14df2d16e2 (table default.Table_1b1b59cdf6ef477b856b825bb519bd47 [id=f601112ceee249d49b43a2437b9731ae]) successfully deleted
I20260810 19:48:01.417380 10366 raft_consensus.cc:359] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:01.417676 10366 raft_consensus.cc:385] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.417776 10366 raft_consensus.cc:740] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.418082 10366 consensus_queue.cc:260] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:01.418243 10371 tablet_replica.cc:333] T 9fb544dff4eb4642b7e282657ae15d19 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:01.418753 10371 raft_consensus.cc:2243] T 9fb544dff4eb4642b7e282657ae15d19 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:01.418838 10366 ts_tablet_manager.cc:1434] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:48:01.419207 10366 tablet_bootstrap.cc:492] T 0d79ef93c5bf4ac9895e594198edb251 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:01.419276 10371 raft_consensus.cc:2272] T 9fb544dff4eb4642b7e282657ae15d19 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:01.420820 10366 tablet_bootstrap.cc:654] T 0d79ef93c5bf4ac9895e594198edb251 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:01.420972 10371 ts_tablet_manager.cc:1916] T 9fb544dff4eb4642b7e282657ae15d19 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:01.429013 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e80e2327c394612bffc51f38798dac3 with delete_type TABLET_DATA_DELETED (replaced by tablet 341220bd9f1b40d49ff360c2acc32339) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:01.432526 11518 leader_election.cc:290] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:01.434168 11663 raft_consensus.cc:493] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:01.434474 10366 tablet_bootstrap.cc:492] T 0d79ef93c5bf4ac9895e594198edb251 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:01.434437 11663 raft_consensus.cc:515] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:01.434639 10366 ts_tablet_manager.cc:1403] T 0d79ef93c5bf4ac9895e594198edb251 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.001s
I20260810 19:48:01.434824 10371 ts_tablet_manager.cc:1929] T 9fb544dff4eb4642b7e282657ae15d19 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:01.434962 10371 log.cc:1199] T 9fb544dff4eb4642b7e282657ae15d19 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/9fb544dff4eb4642b7e282657ae15d19
W20260810 19:48:01.435096 10068 leader_election.cc:343] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 28c9eecacc6540ac82ac7faabceec788
I20260810 19:48:01.435288 10371 ts_tablet_manager.cc:1950] T 9fb544dff4eb4642b7e282657ae15d19 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
W20260810 19:48:01.435261 10068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 56738.7us
I20260810 19:48:01.435454 10366 raft_consensus.cc:359] T 0d79ef93c5bf4ac9895e594198edb251 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:01.435624 10366 raft_consensus.cc:385] T 0d79ef93c5bf4ac9895e594198edb251 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.435675 10366 raft_consensus.cc:740] T 0d79ef93c5bf4ac9895e594198edb251 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.435925 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e9feae2570443afa3dec76975493487 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:01.436206 10366 consensus_queue.cc:260] T 0d79ef93c5bf4ac9895e594198edb251 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:01.436836 10067 leader_election.cc:304] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:01.437288 10366 ts_tablet_manager.cc:1434] T 0d79ef93c5bf4ac9895e594198edb251 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:48:01.437762 10366 tablet_bootstrap.cc:492] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:01.438583 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 594) took 1129 ms. Trace:
I20260810 19:48:01.438668 10375 rpcz_store.cc:276] 0810 19:48:00.278806 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:00.286471 (+ 7665us) service_pool.cc:224] Handling call
0810 19:48:01.106699 (+820228us) ts_tablet_manager.cc:1151] Deleting tablet dd632a01fe424a3a956d445ce01e31d2
0810 19:48:01.106709 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:01.306719 (+200010us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:01.342494 (+ 35775us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:01.408140 (+ 65646us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":818130}
I20260810 19:48:01.439191 11894 raft_consensus.cc:493] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:01.439343 11894 raft_consensus.cc:515] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:01.439914 11894 leader_election.cc:290] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:01.440196 10366 tablet_bootstrap.cc:654] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:01.440474 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 615) took 1264 ms. Trace:
I20260810 19:48:01.442248 10371 rpcz_store.cc:276] 0810 19:48:00.175944 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:00.191507 (+ 15563us) service_pool.cc:224] Handling call
0810 19:48:01.418154 (+1226647us) ts_tablet_manager.cc:1151] Deleting tablet 9fb544dff4eb4642b7e282657ae15d19
0810 19:48:01.418169 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:01.427258 (+ 9089us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:01.434722 (+ 7464us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:01.440421 (+ 5699us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1226348}
I20260810 19:48:01.442849 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 8503d5162548463bae22402fdc4c502a with delete_type TABLET_DATA_DELETED (replaced by tablet 5b56fb5bed4b46a2a1fc0ab22379760b) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:01.443068 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f21e03993e841ba901f1e9c176309b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:01.438445 11663 leader_election.cc:290] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:01.443549 9831 leader_election.cc:343] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 28c9eecacc6540ac82ac7faabceec788
I20260810 19:48:01.443610 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 620) took 1207 ms. Trace:
I20260810 19:48:01.443704 10371 rpcz_store.cc:276] 0810 19:48:00.235692 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:00.236184 (+ 492us) service_pool.cc:224] Handling call
0810 19:48:01.443465 (+1207281us) ts_tablet_manager.cc:1151] Deleting tablet ca733de7babe4343ab26dbca2c9020b2
0810 19:48:01.443476 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:01.443577 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1207047}
I20260810 19:48:01.444749 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 621) took 1208 ms. Trace:
I20260810 19:48:01.445225 10371 rpcz_store.cc:276] 0810 19:48:00.236636 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:00.236890 (+ 254us) service_pool.cc:224] Handling call
0810 19:48:01.444619 (+1207729us) ts_tablet_manager.cc:1151] Deleting tablet 3159795344ae492fb099fca0e52fcf20
0810 19:48:01.444629 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:01.444712 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1207567}
I20260810 19:48:01.446003 10371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 622) took 1032 ms. Trace:
I20260810 19:48:01.446425 10371 rpcz_store.cc:276] 0810 19:48:00.413369 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:00.413444 (+ 75us) service_pool.cc:224] Handling call
0810 19:48:01.445882 (+1032438us) ts_tablet_manager.cc:1151] Deleting tablet bb1e4400ca684da7b3b5e6592e19b6e6
0810 19:48:01.445892 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:01.445969 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1032193}
I20260810 19:48:01.443960 11518 raft_consensus.cc:2749] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:01.443876 10067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 94514us
I20260810 19:48:01.449187 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c9eecacc6540ac82ac7faabceec788" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:01.449386 10371 tablet_replica.cc:333] T 4e80e2327c394612bffc51f38798dac3 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:01.449411 9948 raft_consensus.cc:2468] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:01.449604 10371 raft_consensus.cc:2243] T 4e80e2327c394612bffc51f38798dac3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:01.449683 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d79ef93c5bf4ac9895e594198edb251" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:01.449767 10371 raft_consensus.cc:2272] T 4e80e2327c394612bffc51f38798dac3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:01.449844 9939 raft_consensus.cc:2468] T 0d79ef93c5bf4ac9895e594198edb251 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:01.450385 10371 ts_tablet_manager.cc:1916] T 4e80e2327c394612bffc51f38798dac3 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:01.455323 10068 leader_election.cc:343] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 0d79ef93c5bf4ac9895e594198edb251
I20260810 19:48:01.455981 10162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c9eecacc6540ac82ac7faabceec788" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:01.456228 10162 raft_consensus.cc:2468] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
W20260810 19:48:01.457288 10067 leader_election.cc:343] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 6af6dd8913f44e7f966ed2a128ae4fbf
I20260810 19:48:01.457429 10067 leader_election.cc:304] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:01.457913 10067 leader_election.cc:304] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:01.458384 10067 leader_election.cc:304] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:01.458825 11828 raft_consensus.cc:2749] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 19:48:01.459049 11828 raft_consensus.cc:2804] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:01.459141 11828 raft_consensus.cc:493] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:01.459218 11828 raft_consensus.cc:3060] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:01.459520 10367 tablet_bootstrap.cc:654] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:01.460644 10366 tablet_bootstrap.cc:492] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:01.460803 10366 ts_tablet_manager.cc:1403] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.002s
I20260810 19:48:01.461577 10366 raft_consensus.cc:359] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.461760 10366 raft_consensus.cc:385] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.461805 10366 raft_consensus.cc:740] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.462024 10366 consensus_queue.cc:260] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.461997 11828 raft_consensus.cc:515] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:01.462575 10366 ts_tablet_manager.cc:1434] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:01.462992 10366 tablet_bootstrap.cc:492] T 3b6187dbe1ca42f79bf3eddd5475b929 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:01.464692 10366 tablet_bootstrap.cc:654] T 3b6187dbe1ca42f79bf3eddd5475b929 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:01.465061 10371 ts_tablet_manager.cc:1929] T 4e80e2327c394612bffc51f38798dac3 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:01.465188 10371 log.cc:1199] T 4e80e2327c394612bffc51f38798dac3 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/4e80e2327c394612bffc51f38798dac3
I20260810 19:48:01.465521 10371 ts_tablet_manager.cc:1950] T 4e80e2327c394612bffc51f38798dac3 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:01.466863 11663 raft_consensus.cc:2804] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:01.466990 11663 raft_consensus.cc:493] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:01.467080 11663 raft_consensus.cc:3060] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:01.469933 11663 raft_consensus.cc:515] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:01.475176 9830 leader_election.cc:304] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:01.475693 11897 raft_consensus.cc:2804] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:01.475816 11897 raft_consensus.cc:493] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:01.475895 11897 raft_consensus.cc:3060] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:01.476398 11828 leader_election.cc:290] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:01.477525 10068 leader_election.cc:343] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 28c9eecacc6540ac82ac7faabceec788
I20260810 19:48:01.478166 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c9eecacc6540ac82ac7faabceec788" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:01.478802 11897 raft_consensus.cc:515] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:01.478924 11663 leader_election.cc:290] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:01.479182 9939 raft_consensus.cc:2393] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eadde59fd6504d679e47f03a60c64bb0 in current term 1: Already voted for candidate 6986ed920dcb4af29a5eeeda6f671691 in this term.
I20260810 19:48:01.479504 10366 tablet_bootstrap.cc:492] T 3b6187dbe1ca42f79bf3eddd5475b929 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:01.479646 10366 ts_tablet_manager.cc:1403] T 3b6187dbe1ca42f79bf3eddd5475b929 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.001s
W20260810 19:48:01.480458 9831 leader_election.cc:343] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 28c9eecacc6540ac82ac7faabceec788
I20260810 19:48:01.480412 10366 raft_consensus.cc:359] T 3b6187dbe1ca42f79bf3eddd5475b929 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.480561 10366 raft_consensus.cc:385] T 3b6187dbe1ca42f79bf3eddd5475b929 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.480535 10067 leader_election.cc:304] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:01.480612 10366 raft_consensus.cc:740] T 3b6187dbe1ca42f79bf3eddd5475b929 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.480747 11897 leader_election.cc:290] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:01.481385 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d79ef93c5bf4ac9895e594198edb251" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:01.481572 9939 raft_consensus.cc:3060] T 0d79ef93c5bf4ac9895e594198edb251 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:01.480805 10366 consensus_queue.cc:260] T 3b6187dbe1ca42f79bf3eddd5475b929 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.482995 10366 ts_tablet_manager.cc:1434] T 3b6187dbe1ca42f79bf3eddd5475b929 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 19:48:01.484612 9939 raft_consensus.cc:2468] T 0d79ef93c5bf4ac9895e594198edb251 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:01.484992 10366 tablet_bootstrap.cc:492] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
W20260810 19:48:01.485411 10068 leader_election.cc:343] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 0d79ef93c5bf4ac9895e594198edb251
I20260810 19:48:01.485918 10162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c9eecacc6540ac82ac7faabceec788" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:01.486169 10162 raft_consensus.cc:2393] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6986ed920dcb4af29a5eeeda6f671691 in current term 1: Already voted for candidate eadde59fd6504d679e47f03a60c64bb0 in this term.
I20260810 19:48:01.485951 10067 leader_election.cc:304] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:01.486945 9830 leader_election.cc:304] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:01.487201 11897 raft_consensus.cc:2749] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 19:48:01.498474 11663 raft_consensus.cc:2749] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 19:48:01.498872 11663 raft_consensus.cc:2804] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:01.500027 11663 raft_consensus.cc:697] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:01.500402 11724 raft_consensus.cc:493] T 965395b5072e4d47adac504e22a8d484 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:01.500595 11724 raft_consensus.cc:515] T 965395b5072e4d47adac504e22a8d484 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.501332 11724 leader_election.cc:290] T 965395b5072e4d47adac504e22a8d484 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:01.502089 11724 raft_consensus.cc:493] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:01.502262 11724 raft_consensus.cc:515] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.502936 11724 leader_election.cc:290] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:01.503702 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a13b0f5b6b14bb9b72740a8521e4ea5" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:01.503706 11663 consensus_queue.cc:237] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
W20260810 19:48:01.504516 9611 leader_election.cc:343] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:01.504905 10162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965395b5072e4d47adac504e22a8d484" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:01.504947 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a13b0f5b6b14bb9b72740a8521e4ea5" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:01.505406 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965395b5072e4d47adac504e22a8d484" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:01.505606 9611 leader_election.cc:343] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:01.505734 9611 leader_election.cc:304] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:01.505780 10375 tablet_replica.cc:333] T e247ae3828e84092b836f3dd07b44bc6 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:01.506091 10375 raft_consensus.cc:2243] T e247ae3828e84092b836f3dd07b44bc6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260810 19:48:01.506166 9611 leader_election.cc:343] T 965395b5072e4d47adac504e22a8d484 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:01.506276 10375 raft_consensus.cc:2272] T e247ae3828e84092b836f3dd07b44bc6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:01.506574 9611 leader_election.cc:343] T 965395b5072e4d47adac504e22a8d484 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:01.506691 9611 leader_election.cc:304] T 965395b5072e4d47adac504e22a8d484 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:01.506956 10375 ts_tablet_manager.cc:1916] T e247ae3828e84092b836f3dd07b44bc6 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:01.507185 11724 raft_consensus.cc:2749] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:01.507336 11926 raft_consensus.cc:2749] T 965395b5072e4d47adac504e22a8d484 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:01.486940 10366 tablet_bootstrap.cc:654] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:01.522452 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 97c78c188c024b0f9da45cd99d2cb80c consensus state has no leader
I20260810 19:48:01.523231 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 9fb544dff4eb4642b7e282657ae15d19 (table default.Table_e60e43b61eba457e8a4e7cd6543b7cc6 [id=d81c8e61cae4492fbd2681ab1ecdfe4f]) successfully deleted
I20260810 19:48:01.523589 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet dd632a01fe424a3a956d445ce01e31d2 (table default.Table_8398701ecb954c5c833b81f075d2c23a [id=2358cd5d19d24c88803e7861bcfec22c]) successfully deleted
W20260810 19:48:01.526490 9397 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 79751.1us
I20260810 19:48:01.533735 10366 tablet_bootstrap.cc:492] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:01.533937 10366 ts_tablet_manager.cc:1403] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.049s user 0.001s sys 0.002s
W20260810 19:48:01.534268 9395 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.235.195:43797, user_credentials={real_user=slave}} blocked reactor thread for 88791.9us
I20260810 19:48:01.534855 10366 raft_consensus.cc:359] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.535136 10366 raft_consensus.cc:385] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.535219 10366 raft_consensus.cc:740] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.535557 10366 consensus_queue.cc:260] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.536347 10366 ts_tablet_manager.cc:1434] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 19:48:01.536870 10366 tablet_bootstrap.cc:492] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
W20260810 19:48:01.540902 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet ca733de7babe4343ab26dbca2c9020b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca733de7babe4343ab26dbca2c9020b2 already in progress: creating tablet
W20260810 19:48:01.541304 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 3159795344ae492fb099fca0e52fcf20 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3159795344ae492fb099fca0e52fcf20 already in progress: creating tablet
W20260810 19:48:01.541544 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet bb1e4400ca684da7b3b5e6592e19b6e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb1e4400ca684da7b3b5e6592e19b6e6 already in progress: creating tablet
W20260810 19:48:01.541713 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet b91737c2129e4ca385b4e1c8999c62b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b91737c2129e4ca385b4e1c8999c62b4 already in progress: creating tablet
I20260810 19:48:01.541815 10366 tablet_bootstrap.cc:654] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:01.541898 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 9e861473094f42dfa22b9c00145ed1fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e861473094f42dfa22b9c00145ed1fe already in progress: creating tablet
W20260810 19:48:01.542065 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 38b0c6a017dc4afc849090cca7ee8b26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38b0c6a017dc4afc849090cca7ee8b26 already in progress: creating tablet
W20260810 19:48:01.542272 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 36f01bdcf7b24a58b80b6ca9ba307113 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36f01bdcf7b24a58b80b6ca9ba307113 already in progress: creating tablet
I20260810 19:48:01.542486 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 4e80e2327c394612bffc51f38798dac3 (table default.Table_5005f8f74af74cad8c19a3c67e8f9fe9 [id=bd544994cecc42b2adc881ebfe318d7b]) successfully deleted
W20260810 19:48:01.542708 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 4e9feae2570443afa3dec76975493487 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e9feae2570443afa3dec76975493487 already in progress: creating tablet
W20260810 19:48:01.542897 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 4f21e03993e841ba901f1e9c176309b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f21e03993e841ba901f1e9c176309b9 already in progress: creating tablet
W20260810 19:48:01.543076 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 8503d5162548463bae22402fdc4c502a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8503d5162548463bae22402fdc4c502a already in progress: creating tablet
I20260810 19:48:01.551188 10375 ts_tablet_manager.cc:1929] T e247ae3828e84092b836f3dd07b44bc6 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:01.555524 10375 log.cc:1199] T e247ae3828e84092b836f3dd07b44bc6 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/e247ae3828e84092b836f3dd07b44bc6
I20260810 19:48:01.556026 10375 ts_tablet_manager.cc:1950] T e247ae3828e84092b836f3dd07b44bc6 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:01.556910 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet e28348b22e184b5993a4abc5859de6c3
I20260810 19:48:01.557513 9408 catalog_manager.cc:6807] ReplaceTablet: tablet e28348b22e184b5993a4abc5859de6c3 deleted and replaced by tablet dfe9393e0e904718ae2d7bec70d0350b
I20260810 19:48:01.558972 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet e28348b22e184b5993a4abc5859de6c3 with delete_type TABLET_DATA_DELETED (replaced by tablet dfe9393e0e904718ae2d7bec70d0350b) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:01.559312 10127 tablet_service.cc:1558] Processing DeleteTablet for tablet e28348b22e184b5993a4abc5859de6c3 with delete_type TABLET_DATA_DELETED (replaced by tablet dfe9393e0e904718ae2d7bec70d0350b) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:01.559840 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet f6b705416997444485dc187e11a25c34
I20260810 19:48:01.561661 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_9ba19e355042403b818268a2b837356d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:01.562357 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ba19e355042403b818268a2b837356d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:01.562796 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet e28348b22e184b5993a4abc5859de6c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e28348b22e184b5993a4abc5859de6c3 already in progress: creating tablet
I20260810 19:48:01.563288 10127 tablet_service.cc:1558] Processing DeleteTablet for tablet f6b705416997444485dc187e11a25c34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:01.563766 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet f6b705416997444485dc187e11a25c34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:01.564623 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_94098d2314ef497c9b08deced9bed6ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:01.565327 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94098d2314ef497c9b08deced9bed6ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:01.566625 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_affeb6f2001c49628a5c2877c1fb8327"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:01.567139 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_affeb6f2001c49628a5c2877c1fb8327 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:01.567394 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ac646b532a81478bb5f2088324a66676"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:01.567871 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac646b532a81478bb5f2088324a66676 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:01.568383 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet f6b705416997444485dc187e11a25c34 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6b705416997444485dc187e11a25c34 already in progress: creating tablet
I20260810 19:48:01.569116 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_134e9e0b05db45adb8ebab5241b132b1" } new_table_name: "default.Table_6c8e33fd5c7642d7a9e9f0448d1ff065" modify_external_catalogs: true
I20260810 19:48:01.570519 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_aa3fa23fa2314588ba6441c0f0dcbd9d" } new_table_name: "default.Table_63c36107140a41da9c5d337a853cb5d3" modify_external_catalogs: true
I20260810 19:48:01.571781 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet e28348b22e184b5993a4abc5859de6c3 with delete_type TABLET_DATA_DELETED (replaced by tablet dfe9393e0e904718ae2d7bec70d0350b) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:01.574740 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet f6b705416997444485dc187e11a25c34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:01.576006 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet e28348b22e184b5993a4abc5859de6c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e28348b22e184b5993a4abc5859de6c3 already in progress: creating tablet
W20260810 19:48:01.576331 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet f6b705416997444485dc187e11a25c34 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6b705416997444485dc187e11a25c34 already in progress: creating tablet
I20260810 19:48:01.578040 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 596) took 1224 ms. Trace:
I20260810 19:48:01.586107 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_57ec87a309e04d7885f0e1f479dcf1d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:01.586848 10366 tablet_bootstrap.cc:492] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
W20260810 19:48:01.586884 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57ec87a309e04d7885f0e1f479dcf1d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:01.587320 10366 ts_tablet_manager.cc:1403] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.020s
I20260810 19:48:01.588423 10366 raft_consensus.cc:359] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.589704 10366 raft_consensus.cc:385] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.589979 10366 raft_consensus.cc:740] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.590437 10366 consensus_queue.cc:260] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.591758 10366 ts_tablet_manager.cc:1434] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 19:48:01.592562 10366 tablet_bootstrap.cc:492] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:01.594447 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_cedcabd0409548918b17ecd111b19cb0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:01.595073 10366 tablet_bootstrap.cc:654] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:01.595081 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cedcabd0409548918b17ecd111b19cb0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:01.596100 9421 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 7d93fd6556b146ca8933a6dc0a2357e8 (table default.Table_908acdc21674469e937e4539876e0267 [id=de4d62ebb8c440a1a71ed57ac4f3c530]). Expected version 1 got 0
I20260810 19:48:01.597522 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_dcea63ce9a124c2dabf6301a371300ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:01.598106 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dcea63ce9a124c2dabf6301a371300ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:01.598942 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 648ef608fa0c45cc8be4bad80c4200be consensus state has no leader
I20260810 19:48:01.599401 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_04364545a7b04d3faff6d4f818a349c0" } new_table_name: "default.Table_43b864f9a392475687c4ff23fe9dd13a" modify_external_catalogs: true
I20260810 19:48:01.599924 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet ebf33d82af9e494a8e85be8cba55d2c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:01.600260 10371 tablet_replica.cc:333] T ebf33d82af9e494a8e85be8cba55d2c9 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:01.600500 10371 raft_consensus.cc:2243] T ebf33d82af9e494a8e85be8cba55d2c9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:01.600567 10366 tablet_bootstrap.cc:492] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:01.600713 10366 ts_tablet_manager.cc:1403] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.003s
I20260810 19:48:01.600710 10371 raft_consensus.cc:2272] T ebf33d82af9e494a8e85be8cba55d2c9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:01.601207 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8b24b75629ec423b90e4bf287e7cfd38 consensus state has no leader
I20260810 19:48:01.601568 10371 ts_tablet_manager.cc:1916] T ebf33d82af9e494a8e85be8cba55d2c9 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:01.601652 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_943801654ea043f1b8740ea0215abc35" } modify_external_catalogs: true
I20260810 19:48:01.601806 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_943801654ea043f1b8740ea0215abc35" } modify_external_catalogs: true
I20260810 19:48:01.603060 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 092686718efe4b19a610586420d6bc3a (DEFAULT_TABLE table=default.Table_21bf5e30c22c40c4b6fa4c5ea7dbb0a2 [id=38c67981a86d4e3eb82334378233611f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.603775 9407 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 0c0a1e360ac648eeb0c734215bc200f6 (table default.Table_03fbd70a4ed44530a3fab8f17c0769db [id=09fa54104d0f46dbb3f19138bfa2313d]). Expected version 1 got 0
I20260810 19:48:01.604049 9407 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d (table default.Table_5e6891ff4aa040be8b327aafa596bc7e [id=fd840f00bdc5477aaad0b7fa114870dd]). Expected version 1 got 0
I20260810 19:48:01.604336 9407 catalog_manager.cc:5719] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195). New cstate: current_term: 1 leader_uuid: "eadde59fd6504d679e47f03a60c64bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:01.604748 9407 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet bc753970b2464e38b03e377551276343 (table default.Table_87ca145e91d149a68ef630e3a29795b4 [id=fd9deda7275b423b9f9c85aa22dde728]). Expected version 2 got 0
I20260810 19:48:01.604115 10375 rpcz_store.cc:276] 0810 19:48:00.353280 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:00.353500 (+ 220us) service_pool.cc:224] Handling call
0810 19:48:01.439277 (+1085777us) ts_tablet_manager.cc:1151] Deleting tablet e247ae3828e84092b836f3dd07b44bc6
0810 19:48:01.442874 (+ 3597us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:01.527892 (+ 85018us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:01.551097 (+ 23205us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:01.578008 (+ 26911us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1085536}
I20260810 19:48:01.605886 9416 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_5e6891ff4aa040be8b327aafa596bc7e [id=fd840f00bdc5477aaad0b7fa114870dd] alter complete (version 1)
I20260810 19:48:01.606648 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet e247ae3828e84092b836f3dd07b44bc6 (table default.Table_745ec8d1fd994242990bec7acd5bd9cd [id=435f41d3a7ba4f03a738cdb2272f759e]) successfully deleted
I20260810 19:48:01.607282 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c35c3a44fcc44bba8a8c334292245b49" } modify_external_catalogs: true
I20260810 19:48:01.607451 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c35c3a44fcc44bba8a8c334292245b49" } modify_external_catalogs: true
I20260810 19:48:01.608439 10371 ts_tablet_manager.cc:1929] T ebf33d82af9e494a8e85be8cba55d2c9 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:01.608584 10371 log.cc:1199] T ebf33d82af9e494a8e85be8cba55d2c9 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/ebf33d82af9e494a8e85be8cba55d2c9
I20260810 19:48:01.608951 10371 ts_tablet_manager.cc:1950] T ebf33d82af9e494a8e85be8cba55d2c9 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:01.609042 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f18c24b01384299a4f941d7fb840032 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e967384768b4ec7956f1b508e8ab2af) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:01.609318 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet 28c9eecacc6540ac82ac7faabceec788 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:01.610232 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet ebf33d82af9e494a8e85be8cba55d2c9 (table default.Table_998c14b0e9e14df48d3d4367f7c3b941 [id=19618281529d4843b4e58733646f0e08]) successfully deleted
I20260810 19:48:01.610616 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5005f8f74af74cad8c19a3c67e8f9fe9" } modify_external_catalogs: true
I20260810 19:48:01.610816 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5005f8f74af74cad8c19a3c67e8f9fe9" } modify_external_catalogs: true
I20260810 19:48:01.611682 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 092686718efe4b19a610586420d6bc3a (DEFAULT_TABLE table=default.Table_21bf5e30c22c40c4b6fa4c5ea7dbb0a2 [id=38c67981a86d4e3eb82334378233611f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.612169 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 092686718efe4b19a610586420d6bc3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.612463 10366 raft_consensus.cc:359] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.612648 10366 raft_consensus.cc:385] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.612712 10366 raft_consensus.cc:740] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.612782 9420 master_service.cc:960] ReplaceTablet: received request to replace tablet ff3478f19b14418a876b668bd03125ba from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:01.614176 10366 consensus_queue.cc:260] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.615342 10366 ts_tablet_manager.cc:1434] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260810 19:48:01.616061 10377 tablet_replica.cc:333] T 3f18c24b01384299a4f941d7fb840032 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:01.618685 10377 raft_consensus.cc:2243] T 3f18c24b01384299a4f941d7fb840032 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:01.618805 10366 tablet_bootstrap.cc:492] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:01.618860 10377 raft_consensus.cc:2272] T 3f18c24b01384299a4f941d7fb840032 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:01.620023 10377 ts_tablet_manager.cc:1916] T 3f18c24b01384299a4f941d7fb840032 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:01.635129 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 092686718efe4b19a610586420d6bc3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.637343 10366 tablet_bootstrap.cc:654] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:01.645287 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 09a8da9ecf1042bfae5d34e263f501d6
I20260810 19:48:01.645545 11897 raft_consensus.cc:493] T 3b6187dbe1ca42f79bf3eddd5475b929 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:01.645692 11897 raft_consensus.cc:515] T 3b6187dbe1ca42f79bf3eddd5475b929 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.646466 11897 leader_election.cc:290] T 3b6187dbe1ca42f79bf3eddd5475b929 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:01.647732 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 09a8da9ecf1042bfae5d34e263f501d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:01.648530 9831 leader_election.cc:343] T 3b6187dbe1ca42f79bf3eddd5475b929 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 3b6187dbe1ca42f79bf3eddd5475b929
I20260810 19:48:01.649159 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet 09a8da9ecf1042bfae5d34e263f501d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:48:01.649704 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 09a8da9ecf1042bfae5d34e263f501d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09a8da9ecf1042bfae5d34e263f501d6 already in progress: creating tablet
I20260810 19:48:01.651621 10366 tablet_bootstrap.cc:492] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:01.651849 10366 ts_tablet_manager.cc:1403] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.007s
I20260810 19:48:01.652370 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_45a851a9919d48ad94da86574312fb58" } new_table_name: "default.Table_92a5dea12ac142e4ae87c3fa6d55e3db" modify_external_catalogs: true
I20260810 19:48:01.652783 10366 raft_consensus.cc:359] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.653048 10366 raft_consensus.cc:385] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.653106 10366 raft_consensus.cc:740] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.653337 10366 consensus_queue.cc:260] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.654017 10366 ts_tablet_manager.cc:1434] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:01.654029 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 31c8699875b54be888b3128df1b673aa
I20260810 19:48:01.654440 10366 tablet_bootstrap.cc:492] T 4e80e2327c394612bffc51f38798dac3 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:01.654954 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a02e997e3ddd4efeaded0aeef335a1bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:01.655597 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a02e997e3ddd4efeaded0aeef335a1bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:01.656782 10366 tablet_bootstrap.cc:654] T 4e80e2327c394612bffc51f38798dac3 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:01.657305 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 31c8699875b54be888b3128df1b673aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:01.657663 10371 tablet_replica.cc:333] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:01.657923 10371 raft_consensus.cc:2243] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:01.658245 10371 raft_consensus.cc:2272] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:01.658972 10371 ts_tablet_manager.cc:1916] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:01.662752 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet 31c8699875b54be888b3128df1b673aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:01.667445 10366 tablet_bootstrap.cc:492] T 4e80e2327c394612bffc51f38798dac3 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:01.667774 10366 ts_tablet_manager.cc:1403] T 4e80e2327c394612bffc51f38798dac3 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.004s
I20260810 19:48:01.667913 9413 catalog_manager.cc:5719] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } }
I20260810 19:48:01.668686 9413 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet d77785d9bde843bc8366fe15d1b4fa18 (table default.Table_3e78e13c8ecc464eb6af12a2bc3f2eba [id=1af2d06c44b643e28d28bb080cd5eef8]). Expected version 2 got 0
I20260810 19:48:01.669044 9413 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 0c0a1e360ac648eeb0c734215bc200f6 (table default.Table_03fbd70a4ed44530a3fab8f17c0769db [id=09fa54104d0f46dbb3f19138bfa2313d]). Expected version 1 got 0
I20260810 19:48:01.669694 10366 raft_consensus.cc:359] T 4e80e2327c394612bffc51f38798dac3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:01.669938 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a45add97e0e54dce85225e175ecbb45a consensus state has no leader
I20260810 19:48:01.670765 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 9e8a23221e8447bd83592c05c9d1149c
I20260810 19:48:01.670819 10366 raft_consensus.cc:385] T 4e80e2327c394612bffc51f38798dac3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.671131 10366 raft_consensus.cc:740] T 4e80e2327c394612bffc51f38798dac3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.671482 10371 ts_tablet_manager.cc:1929] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:01.671741 10371 log.cc:1199] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/31c8699875b54be888b3128df1b673aa
I20260810 19:48:01.671671 10366 consensus_queue.cc:260] T 4e80e2327c394612bffc51f38798dac3 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.672073 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e8a23221e8447bd83592c05c9d1149c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:01.672283 10371 ts_tablet_manager.cc:1950] T 31c8699875b54be888b3128df1b673aa P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:01.672818 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e8a23221e8447bd83592c05c9d1149c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:01.673818 9408 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 341220bd9f1b40d49ff360c2acc32339
I20260810 19:48:01.673884 10366 ts_tablet_manager.cc:1434] T 4e80e2327c394612bffc51f38798dac3 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260810 19:48:01.674638 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet ff3478f19b14418a876b668bd03125ba
I20260810 19:48:01.674747 10366 tablet_bootstrap.cc:492] T 3c828ae089774fb9b0582141f4b99313 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:01.676031 9420 catalog_manager.cc:6807] ReplaceTablet: tablet ff3478f19b14418a876b668bd03125ba deleted and replaced by tablet 69d677893a8648d9ba08e633bf320146
I20260810 19:48:01.676901 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet ff3478f19b14418a876b668bd03125ba with delete_type TABLET_DATA_DELETED (replaced by tablet 69d677893a8648d9ba08e633bf320146) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:01.679186 10366 tablet_bootstrap.cc:654] T 3c828ae089774fb9b0582141f4b99313 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:01.686203 9400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.253:37397, user_credentials={real_user=slave}} blocked reactor thread for 127816us
I20260810 19:48:01.687755 10377 ts_tablet_manager.cc:1929] T 3f18c24b01384299a4f941d7fb840032 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:01.688501 10377 log.cc:1199] T 3f18c24b01384299a4f941d7fb840032 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/3f18c24b01384299a4f941d7fb840032
I20260810 19:48:01.688972 10377 ts_tablet_manager.cc:1950] T 3f18c24b01384299a4f941d7fb840032 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:01.689834 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 3f18c24b01384299a4f941d7fb840032 (table default.Table_5043edeafbb047c6a7619f91323879c2 [id=6287581e5dad45b4b7fd481e9ae5eae3]) successfully deleted
I20260810 19:48:01.690253 10377 tablet_replica.cc:333] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:01.690570 10377 raft_consensus.cc:2243] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:01.690851 10377 raft_consensus.cc:2272] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:01.690948 9410 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 3e8ae48a2fb548358176abefe1ee3baa (table default.Table_9cb0cc2a8f724781a638706ddcc2c085 [id=12db110e89e04d40bdb05ec61fd5e3b6]). Expected version 1 got 0
I20260810 19:48:01.691514 10377 ts_tablet_manager.cc:1916] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:01.651621 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b6187dbe1ca42f79bf3eddd5475b929" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:01.662523 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 31c8699875b54be888b3128df1b673aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:01.663491 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 08e29e23d54f47968a06be98b313918d with delete_type TABLET_DATA_DELETED (replaced by tablet 19e2bf7b7d254894a07c5a75bf24e742) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:01.663785 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f18c24b01384299a4f941d7fb840032 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e967384768b4ec7956f1b508e8ab2af) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:01.694507 9830 leader_election.cc:343] T 3b6187dbe1ca42f79bf3eddd5475b929 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:01.663877 10144 tablet_service.cc:1558] Processing DeleteTablet for tablet ee65b2c9980d4c77af8c68bf2f5c5f92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:01.694625 9830 leader_election.cc:304] T 3b6187dbe1ca42f79bf3eddd5475b929 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:01.664079 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d79ef93c5bf4ac9895e594198edb251 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:01.664610 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet 6355c14e38b3446493f7bd5e2a717341 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:01.664762 10136 tablet_service.cc:1558] Processing DeleteTablet for tablet 28c9eecacc6540ac82ac7faabceec788 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:01.695046 10366 tablet_bootstrap.cc:492] T 3c828ae089774fb9b0582141f4b99313 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:01.672904 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e8a23221e8447bd83592c05c9d1149c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:01.695093 11897 raft_consensus.cc:2749] T 3b6187dbe1ca42f79bf3eddd5475b929 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:01.695174 10366 ts_tablet_manager.cc:1403] T 3c828ae089774fb9b0582141f4b99313 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.002s
I20260810 19:48:01.677201 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet ff3478f19b14418a876b668bd03125ba with delete_type TABLET_DATA_DELETED (replaced by tablet 69d677893a8648d9ba08e633bf320146) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:01.634799 10375 tablet_replica.cc:333] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:01.696835 10366 raft_consensus.cc:359] T 3c828ae089774fb9b0582141f4b99313 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.697744 10366 raft_consensus.cc:385] T 3c828ae089774fb9b0582141f4b99313 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.697949 10366 raft_consensus.cc:740] T 3c828ae089774fb9b0582141f4b99313 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.698421 10375 raft_consensus.cc:2243] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:01.698624 10375 raft_consensus.cc:2272] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:01.698446 10366 consensus_queue.cc:260] T 3c828ae089774fb9b0582141f4b99313 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.699492 10375 ts_tablet_manager.cc:1916] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:01.700538 10366 ts_tablet_manager.cc:1434] T 3c828ae089774fb9b0582141f4b99313 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 19:48:01.702167 10366 tablet_bootstrap.cc:492] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:01.705785 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 6cde3ef430534878995af31bae223153 (DEFAULT_TABLE table=default.Table_da9cdd42af6a42868f3bae64af56f4b1 [id=1ad5650463c9432191c8a6795a6dab49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.706489 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 6cde3ef430534878995af31bae223153 (DEFAULT_TABLE table=default.Table_da9cdd42af6a42868f3bae64af56f4b1 [id=1ad5650463c9432191c8a6795a6dab49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.706938 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cde3ef430534878995af31bae223153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.580214 10370 raft_consensus.cc:359] T 4b2b0f2fc93647f3bc1d79b4132c3703 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.715979 10370 raft_consensus.cc:385] T 4b2b0f2fc93647f3bc1d79b4132c3703 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.716145 10370 raft_consensus.cc:740] T 4b2b0f2fc93647f3bc1d79b4132c3703 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.716475 10370 consensus_queue.cc:260] T 4b2b0f2fc93647f3bc1d79b4132c3703 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.717262 10370 ts_tablet_manager.cc:1434] T 4b2b0f2fc93647f3bc1d79b4132c3703 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.138s user 0.003s sys 0.000s
I20260810 19:48:01.675712 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet ff3478f19b14418a876b668bd03125ba with delete_type TABLET_DATA_DELETED (replaced by tablet 69d677893a8648d9ba08e633bf320146) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:01.693008 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet dfea147ef3904ab49375def065c6f328 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:53 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:01.693153 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet 965395b5072e4d47adac504e22a8d484 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:01.701952 11926 raft_consensus.cc:493] T 5576e9087855441498904bc59685a442 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:01.718607 11926 raft_consensus.cc:515] T 5576e9087855441498904bc59685a442 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.719700 11926 leader_election.cc:290] T 5576e9087855441498904bc59685a442 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:01.719733 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 31c8699875b54be888b3128df1b673aa (table default.Table_c35c3a44fcc44bba8a8c334292245b49 [id=5abc1f7beec444a4a988fbfcb8b45623]) successfully deleted
I20260810 19:48:01.704967 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 092686718efe4b19a610586420d6bc3a (DEFAULT_TABLE table=default.Table_21bf5e30c22c40c4b6fa4c5ea7dbb0a2 [id=38c67981a86d4e3eb82334378233611f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.720307 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 092686718efe4b19a610586420d6bc3a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:01.720686 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 9e8a23221e8447bd83592c05c9d1149c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e8a23221e8447bd83592c05c9d1149c already in progress: creating tablet
W20260810 19:48:01.721431 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet ff3478f19b14418a876b668bd03125ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff3478f19b14418a876b668bd03125ba already in progress: creating tablet
I20260810 19:48:01.721765 10371 tablet_replica.cc:333] T dfea147ef3904ab49375def065c6f328 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:01.721982 10371 raft_consensus.cc:2243] T dfea147ef3904ab49375def065c6f328 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:01.722150 10371 raft_consensus.cc:2272] T dfea147ef3904ab49375def065c6f328 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:01.726503 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5576e9087855441498904bc59685a442" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:01.727553 10127 tablet_service.cc:1558] Processing DeleteTablet for tablet 09a8da9ecf1042bfae5d34e263f501d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:01.731370 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ac646b532a81478bb5f2088324a66676" } new_table_name: "default.Table_3606999c99584eadb5b437323d900d9d" modify_external_catalogs: true
I20260810 19:48:01.732786 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 6cde3ef430534878995af31bae223153 (DEFAULT_TABLE table=default.Table_da9cdd42af6a42868f3bae64af56f4b1 [id=1ad5650463c9432191c8a6795a6dab49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.733299 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cde3ef430534878995af31bae223153. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:01.734570 9611 leader_election.cc:343] T 5576e9087855441498904bc59685a442 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:01.742663 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d5aaedde75d54341a87764c6e89a03d6 consensus state has no leader
I20260810 19:48:01.746089 9410 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 0c0a1e360ac648eeb0c734215bc200f6 (table default.Table_03fbd70a4ed44530a3fab8f17c0769db [id=09fa54104d0f46dbb3f19138bfa2313d]). Expected version 1 got 0
I20260810 19:48:01.746479 9410 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet bc753970b2464e38b03e377551276343 (table default.Table_87ca145e91d149a68ef630e3a29795b4 [id=fd9deda7275b423b9f9c85aa22dde728]). Expected version 2 got 0
W20260810 19:48:01.746768 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cd05a86e7ccd40afbfb10cb8dfe53e78 has no consensus state
I20260810 19:48:01.748785 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5576e9087855441498904bc59685a442" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:01.748929 10370 tablet_bootstrap.cc:492] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:01.750800 10370 tablet_bootstrap.cc:654] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:01.752027 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet ee65b2c9980d4c77af8c68bf2f5c5f92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:48:01.753108 9611 leader_election.cc:343] T 5576e9087855441498904bc59685a442 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:01.753288 9611 leader_election.cc:304] T 5576e9087855441498904bc59685a442 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:01.753739 11926 raft_consensus.cc:2749] T 5576e9087855441498904bc59685a442 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:01.755136 10367 tablet_bootstrap.cc:492] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:01.755329 10367 ts_tablet_manager.cc:1403] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.344s user 0.003s sys 0.023s
I20260810 19:48:01.756203 10367 raft_consensus.cc:359] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.756417 10367 raft_consensus.cc:385] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.756521 10367 raft_consensus.cc:740] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.756794 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 08e29e23d54f47968a06be98b313918d with delete_type TABLET_DATA_DELETED (replaced by tablet 19e2bf7b7d254894a07c5a75bf24e742) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:01.756767 10367 consensus_queue.cc:260] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.756845 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet a5625dc6303d44c6be28abd6278ce034 with delete_type TABLET_DATA_DELETED (replaced by tablet 64470598ccec45a7ae3e3c77fe4b9518) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:01.756974 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b6187dbe1ca42f79bf3eddd5475b929 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:01.757128 9894 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d79ef93c5bf4ac9895e594198edb251 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:49 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:01.759244 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet 6355c14e38b3446493f7bd5e2a717341 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:01.760259 11663 consensus_queue.cc:1048] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:01.763463 10367 ts_tablet_manager.cc:1434] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.008s user 0.000s sys 0.003s
I20260810 19:48:01.763801 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 11cf9e6ff4f4436f9d9b5d82df3def82 (DEFAULT_TABLE table=default.Table_cdf7ea6b6e514a2fba968ac13ac259dd [id=2fc3c68b569f42ceb7a4743024c26829]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.766482 10366 tablet_bootstrap.cc:654] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:01.766592 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11cf9e6ff4f4436f9d9b5d82df3def82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.767522 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cde3ef430534878995af31bae223153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.773010 11663 consensus_queue.cc:1048] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:01.723577 10371 ts_tablet_manager.cc:1916] T dfea147ef3904ab49375def065c6f328 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:01.784797 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet a5625dc6303d44c6be28abd6278ce034 with delete_type TABLET_DATA_DELETED (replaced by tablet 64470598ccec45a7ae3e3c77fe4b9518) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:01.786785 10367 tablet_bootstrap.cc:492] T 72b39babf851404c89adb317033015ec P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:01.788636 10367 tablet_bootstrap.cc:654] T 72b39babf851404c89adb317033015ec P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:01.790668 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 11cf9e6ff4f4436f9d9b5d82df3def82 (DEFAULT_TABLE table=default.Table_cdf7ea6b6e514a2fba968ac13ac259dd [id=2fc3c68b569f42ceb7a4743024c26829]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.792083 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11cf9e6ff4f4436f9d9b5d82df3def82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.794932 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_78040083fb05410ab04cbefee43fa0b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:01.796180 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_9eed01c5d061435982b79e3888c256d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:01.796806 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78040083fb05410ab04cbefee43fa0b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:01.797820 10370 tablet_bootstrap.cc:492] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
W20260810 19:48:01.797962 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9eed01c5d061435982b79e3888c256d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:01.798017 10370 ts_tablet_manager.cc:1403] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.000s
I20260810 19:48:01.798709 10375 ts_tablet_manager.cc:1929] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:01.798836 10375 log.cc:1199] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/6af6dd8913f44e7f966ed2a128ae4fbf
I20260810 19:48:01.799131 10375 ts_tablet_manager.cc:1950] T 6af6dd8913f44e7f966ed2a128ae4fbf P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:01.799979 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 597) took 1404 ms. Trace:
I20260810 19:48:01.800061 10375 rpcz_store.cc:276] 0810 19:48:00.395539 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:00.395603 (+ 64us) service_pool.cc:224] Handling call
0810 19:48:01.634122 (+1238519us) ts_tablet_manager.cc:1151] Deleting tablet 6af6dd8913f44e7f966ed2a128ae4fbf
0810 19:48:01.634262 (+ 140us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:01.777129 (+142867us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:01.793034 (+ 15905us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:01.799950 (+ 6916us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1214861}
I20260810 19:48:01.801898 9418 master_service.cc:960] ReplaceTablet: received request to replace tablet 4198f46be0194875aea6a7952321bc69 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:01.805073 10366 tablet_bootstrap.cc:492] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:01.805429 10366 ts_tablet_manager.cc:1403] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.104s user 0.000s sys 0.016s
I20260810 19:48:01.807983 9407 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 4b2b0f2fc93647f3bc1d79b4132c3703 (table default.Table_d195688055bd4cfca1a9462585af71bc [id=64e1f507ae574ea6b7fa1627b8e7f4c3]). Expected version 4 got 0
I20260810 19:48:01.808732 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_80796e0b2a8c4bc69e7778f5c8625e71"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:01.809249 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9fc2f929c6aa4ff286e66b35f18da641" } modify_external_catalogs: true
W20260810 19:48:01.809343 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80796e0b2a8c4bc69e7778f5c8625e71 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:01.809432 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9fc2f929c6aa4ff286e66b35f18da641" } modify_external_catalogs: true
I20260810 19:48:01.797602 10371 ts_tablet_manager.cc:1929] T dfea147ef3904ab49375def065c6f328 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:01.810926 10371 log.cc:1199] T dfea147ef3904ab49375def065c6f328 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/dfea147ef3904ab49375def065c6f328
I20260810 19:48:01.811098 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 6af6dd8913f44e7f966ed2a128ae4fbf (table default.Table_ae6b06e8ae0c4fd19fe26b1b08db672a [id=5354f5d091794b14806dd9bc872da0ae]) successfully deleted
I20260810 19:48:01.811399 10371 ts_tablet_manager.cc:1950] T dfea147ef3904ab49375def065c6f328 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:01.811333 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_348f96b1205b40888cfeacca983e5d0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:01.812018 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_348f96b1205b40888cfeacca983e5d0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:01.812512 10371 tablet_replica.cc:333] T 965395b5072e4d47adac504e22a8d484 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:01.812768 10371 raft_consensus.cc:2243] T 965395b5072e4d47adac504e22a8d484 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:01.812942 10371 raft_consensus.cc:2272] T 965395b5072e4d47adac504e22a8d484 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:01.813526 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_455517659634400cbd68b4d4516a4de9" } new_table_name: "default.Table_234beb75a2cf4a2b980e05b9d84375a2" modify_external_catalogs: true
I20260810 19:48:01.814785 9413 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 4b2b0f2fc93647f3bc1d79b4132c3703 (table default.Table_d195688055bd4cfca1a9462585af71bc [id=64e1f507ae574ea6b7fa1627b8e7f4c3]). Expected version 4 got 0
I20260810 19:48:01.815004 9413 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 9a13b0f5b6b14bb9b72740a8521e4ea5 (table default.Table_0844c946c41146f38e51790cd8baed2a [id=4830b444314a4bb6a605cb73432e772f]). Expected version 1 got 0
I20260810 19:48:01.816807 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f6bf38e92579459db083cba7999bb1ea" } new_table_name: "default.Table_44a25bbcf33a40b38fe8f64ca5130e55" modify_external_catalogs: true
I20260810 19:48:01.818660 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_060004eaa4fb4077ace7321f74ecb48a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:01.819085 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e12b767f15c14df4bff9da1d856c2961"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:01.819221 10371 ts_tablet_manager.cc:1916] T 965395b5072e4d47adac504e22a8d484 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:01.821696 11926 raft_consensus.cc:493] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:01.821907 11926 raft_consensus.cc:515] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.822717 11926 leader_election.cc:290] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:01.824138 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d93fd6556b146ca8933a6dc0a2357e8" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:01.824712 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e12b767f15c14df4bff9da1d856c2961 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:01.825264 9611 leader_election.cc:343] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:01.819259 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_060004eaa4fb4077ace7321f74ecb48a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:01.823114 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet dfea147ef3904ab49375def065c6f328 (table default.Table_44197dd0fe1e4c88b41c1e9996eaa4a2 [id=c6c90cd5058a4eb9985fc7df3ef5c79a]) successfully deleted
I20260810 19:48:01.826910 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 11cf9e6ff4f4436f9d9b5d82df3def82 (DEFAULT_TABLE table=default.Table_cdf7ea6b6e514a2fba968ac13ac259dd [id=2fc3c68b569f42ceb7a4743024c26829]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.827384 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11cf9e6ff4f4436f9d9b5d82df3def82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.829758 9416 master_service.cc:960] ReplaceTablet: received request to replace tablet f85f3fa629764c79921a710739eea7ae from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:01.838699 10371 ts_tablet_manager.cc:1929] T 965395b5072e4d47adac504e22a8d484 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:01.839007 10371 log.cc:1199] T 965395b5072e4d47adac504e22a8d484 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/965395b5072e4d47adac504e22a8d484
I20260810 19:48:01.839479 10371 ts_tablet_manager.cc:1950] T 965395b5072e4d47adac504e22a8d484 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:01.841172 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 86937c581d4c46d38699b268b1e0c42d (DEFAULT_TABLE table=default.Table_d64b095dd9e84a8c974131583cd0df88 [id=af431acb21544d8c9a83d09e1e966b1d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:01.842180 9400 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.235.253:37397: connect: Connection refused (error 111) [suppressed 12 similar messages]
I20260810 19:48:01.842350 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 965395b5072e4d47adac504e22a8d484 (table default.Table_4ba52e1a6c3b42688033e6fd1cdcd7ae [id=a88614b26dcb4c16bd100a55431569c8]) successfully deleted
I20260810 19:48:01.848275 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 8455cb11388340beb6daa13fee06177a
W20260810 19:48:01.849625 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ea9408ecf3784a80ac0c064e1689d25e consensus state has no leader
I20260810 19:48:01.850157 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet 8455cb11388340beb6daa13fee06177a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:01.850611 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 024e88bd7629436db4fb66c04e16fc97 consensus state has no leader
I20260810 19:48:01.853108 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet 8455cb11388340beb6daa13fee06177a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:01.853969 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 8455cb11388340beb6daa13fee06177a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8455cb11388340beb6daa13fee06177a already in progress: creating tablet
I20260810 19:48:01.861759 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_21bf5e30c22c40c4b6fa4c5ea7dbb0a2" } modify_external_catalogs: true
I20260810 19:48:01.862008 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_21bf5e30c22c40c4b6fa4c5ea7dbb0a2" } modify_external_catalogs: true
I20260810 19:48:01.862787 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3609f114cc2e412dac61baf2f59e9307"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:01.863456 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3609f114cc2e412dac61baf2f59e9307 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:01.865666 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_bfa0ef28a4704e2589883d5ebd21cb92" } modify_external_catalogs: true
I20260810 19:48:01.865867 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_bfa0ef28a4704e2589883d5ebd21cb92" } modify_external_catalogs: true
I20260810 19:48:01.868233 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3c43fbb6bc7f4a38b470a011714cd243"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:01.868940 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c43fbb6bc7f4a38b470a011714cd243 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:01.874783 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ab79ddcb17e24ce7960c0c41dd451bc2" } modify_external_catalogs: true
I20260810 19:48:01.874807 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b3c82504d474465798c964cff5ce4371" } new_table_name: "default.Table_b94c792bfc8b4c16b86e7127f8082af5" modify_external_catalogs: true
I20260810 19:48:01.877537 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ab79ddcb17e24ce7960c0c41dd451bc2" } modify_external_catalogs: true
I20260810 19:48:01.816646 10377 ts_tablet_manager.cc:1929] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:01.887948 10377 log.cc:1199] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/28c9eecacc6540ac82ac7faabceec788
I20260810 19:48:01.888168 10366 raft_consensus.cc:359] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.888350 10377 ts_tablet_manager.cc:1950] T 28c9eecacc6540ac82ac7faabceec788 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:01.889209 10377 tablet_replica.cc:333] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:01.889402 10377 raft_consensus.cc:2243] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:01.889744 10377 raft_consensus.cc:2272] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:01.822297 11897 raft_consensus.cc:493] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:01.892314 11897 raft_consensus.cc:515] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.823359 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d93fd6556b146ca8933a6dc0a2357e8" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:01.826262 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c828ae089774fb9b0582141f4b99313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:01.826463 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e80e2327c394612bffc51f38798dac3 with delete_type TABLET_DATA_DELETED (replaced by tablet 341220bd9f1b40d49ff360c2acc32339) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:01.839519 9894 tablet_service.cc:1511] Processing CreateTablet for tablet 86937c581d4c46d38699b268b1e0c42d (DEFAULT_TABLE table=default.Table_d64b095dd9e84a8c974131583cd0df88 [id=af431acb21544d8c9a83d09e1e966b1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.849717 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 8455cb11388340beb6daa13fee06177a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:48:01.893080 9611 leader_election.cc:343] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:01.893222 9611 leader_election.cc:304] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:01.893239 11897 leader_election.cc:290] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:01.894003 10377 ts_tablet_manager.cc:1916] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:01.894394 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86937c581d4c46d38699b268b1e0c42d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.897693 11926 raft_consensus.cc:2749] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:01.898528 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 28c9eecacc6540ac82ac7faabceec788 (table default.Table_6e4259d122294c46bd79d8abbb79c520 [id=2d19b64ee46e460e807325299f942e18]) successfully deleted
W20260810 19:48:01.898885 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 09a8da9ecf1042bfae5d34e263f501d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09a8da9ecf1042bfae5d34e263f501d6 already in progress: creating tablet
I20260810 19:48:01.899207 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ad4523adf6cb4df7948a357515ec4b9a" } modify_external_catalogs: true
I20260810 19:48:01.899804 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ad4523adf6cb4df7948a357515ec4b9a" } modify_external_catalogs: true
W20260810 19:48:01.901767 9831 leader_election.cc:343] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: a5625dc6303d44c6be28abd6278ce034
I20260810 19:48:01.902617 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 598) took 1393 ms. Trace:
I20260810 19:48:01.902772 10375 rpcz_store.cc:276] 0810 19:48:00.416422 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:00.416529 (+ 107us) service_pool.cc:224] Handling call
0810 19:48:01.809762 (+1393233us) ts_tablet_manager.cc:1151] Deleting tablet bb1e4400ca684da7b3b5e6592e19b6e6
0810 19:48:01.809777 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:01.809919 (+ 142us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1392728}
I20260810 19:48:01.903299 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 599) took 1377 ms. Trace:
I20260810 19:48:01.903384 11663 raft_consensus.cc:493] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:01.903399 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5625dc6303d44c6be28abd6278ce034" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:01.903545 11663 raft_consensus.cc:515] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:01.903383 10375 rpcz_store.cc:276] 0810 19:48:00.526047 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:00.526145 (+ 98us) service_pool.cc:224] Handling call
0810 19:48:01.903111 (+1376966us) ts_tablet_manager.cc:1151] Deleting tablet b91737c2129e4ca385b4e1c8999c62b4
0810 19:48:01.903124 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:01.903247 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1376693}
I20260810 19:48:01.903682 10168 raft_consensus.cc:2468] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:01.903971 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 600) took 1337 ms. Trace:
I20260810 19:48:01.904040 10375 rpcz_store.cc:276] 0810 19:48:00.566266 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:00.566494 (+ 228us) service_pool.cc:224] Handling call
0810 19:48:01.903851 (+1337357us) ts_tablet_manager.cc:1151] Deleting tablet 9e861473094f42dfa22b9c00145ed1fe
0810 19:48:01.903861 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:01.903953 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1337132}
I20260810 19:48:01.904250 11663 leader_election.cc:290] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:01.904297 10375 tablet_replica.cc:333] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:01.904484 10375 raft_consensus.cc:2243] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:01.904728 10375 pending_rounds.cc:70] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:01.904775 10375 pending_rounds.cc:77] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058686608097280 op_type: NO_OP noop_request { }
I20260810 19:48:01.904865 10375 raft_consensus.cc:2889] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:01.904944 10375 raft_consensus.cc:2272] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:01.904973 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee65b2c9980d4c77af8c68bf2f5c5f92" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:01.905177 9948 raft_consensus.cc:2468] T ee65b2c9980d4c77af8c68bf2f5c5f92 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
W20260810 19:48:01.905565 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet bb1e4400ca684da7b3b5e6592e19b6e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb1e4400ca684da7b3b5e6592e19b6e6 already in progress: creating tablet
W20260810 19:48:01.905856 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet b91737c2129e4ca385b4e1c8999c62b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b91737c2129e4ca385b4e1c8999c62b4 already in progress: creating tablet
I20260810 19:48:01.906038 10067 leader_election.cc:304] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
W20260810 19:48:01.906121 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 9e861473094f42dfa22b9c00145ed1fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e861473094f42dfa22b9c00145ed1fe already in progress: creating tablet
I20260810 19:48:01.906770 10375 ts_tablet_manager.cc:1916] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:01.906942 11663 raft_consensus.cc:2804] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:01.907006 11663 raft_consensus.cc:493] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:01.907064 11663 raft_consensus.cc:3060] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:01.906879 10370 raft_consensus.cc:359] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.907143 10370 raft_consensus.cc:385] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.907217 10370 raft_consensus.cc:740] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.907545 10370 consensus_queue.cc:260] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.888362 10366 raft_consensus.cc:385] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:01.908010 10366 raft_consensus.cc:740] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:01.908748 10366 consensus_queue.cc:260] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.909948 11663 raft_consensus.cc:515] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
W20260810 19:48:01.890261 9400 consensus_peers.cc:597] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a -> Peer f52c40e347e24ab4b3129e7064f4a43e (127.8.235.253:37397): Couldn't send request to peer f52c40e347e24ab4b3129e7064f4a43e. Status: Network error: Client connection negotiation failed: client connection to 127.8.235.253:37397: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260810 19:48:01.912297 9830 leader_election.cc:304] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:01.914691 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee65b2c9980d4c77af8c68bf2f5c5f92" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:01.914878 9948 raft_consensus.cc:3060] T ee65b2c9980d4c77af8c68bf2f5c5f92 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:01.915474 11897 raft_consensus.cc:2804] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:01.915560 11897 raft_consensus.cc:493] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:01.915618 11897 raft_consensus.cc:3060] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:01.917169 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 86937c581d4c46d38699b268b1e0c42d (DEFAULT_TABLE table=default.Table_d64b095dd9e84a8c974131583cd0df88 [id=af431acb21544d8c9a83d09e1e966b1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.917670 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86937c581d4c46d38699b268b1e0c42d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.917896 9948 raft_consensus.cc:2468] T ee65b2c9980d4c77af8c68bf2f5c5f92 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:01.918495 11897 raft_consensus.cc:515] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.918565 10067 leader_election.cc:304] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:01.918917 11518 raft_consensus.cc:2804] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:01.919951 11897 leader_election.cc:290] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:01.920516 10366 ts_tablet_manager.cc:1434] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.033s user 0.000s sys 0.002s
I20260810 19:48:01.921515 10366 tablet_bootstrap.cc:492] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:01.921991 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5625dc6303d44c6be28abd6278ce034" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:01.922200 10168 raft_consensus.cc:3060] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:01.922389 10068 leader_election.cc:343] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: ee65b2c9980d4c77af8c68bf2f5c5f92
I20260810 19:48:01.924301 11663 leader_election.cc:290] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:01.925141 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86937c581d4c46d38699b268b1e0c42d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.925355 10168 raft_consensus.cc:2468] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:01.926007 9830 leader_election.cc:304] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:01.926295 11897 raft_consensus.cc:2804] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:01.926687 11897 raft_consensus.cc:697] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:01.927487 11897 consensus_queue.cc:237] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:01.931625 9831 leader_election.cc:343] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: a5625dc6303d44c6be28abd6278ce034
I20260810 19:48:01.932931 9894 tablet_service.cc:1511] Processing CreateTablet for tablet 6914b47e0cac4cd28ee4fd199684a280 (DEFAULT_TABLE table=default.Table_ae76035c86954fd0b296d6461d767a59 [id=8ba6004d401741c9a572af711cdd95d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.933513 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6914b47e0cac4cd28ee4fd199684a280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.933651 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 6914b47e0cac4cd28ee4fd199684a280 (DEFAULT_TABLE table=default.Table_ae76035c86954fd0b296d6461d767a59 [id=8ba6004d401741c9a572af711cdd95d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.935674 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 6914b47e0cac4cd28ee4fd199684a280 (DEFAULT_TABLE table=default.Table_ae76035c86954fd0b296d6461d767a59 [id=8ba6004d401741c9a572af711cdd95d1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:01.936128 10068 leader_election.cc:343] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: ee65b2c9980d4c77af8c68bf2f5c5f92
I20260810 19:48:01.936348 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6914b47e0cac4cd28ee4fd199684a280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.904985 10377 ts_tablet_manager.cc:1929] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:01.936872 10377 log.cc:1199] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/31c8699875b54be888b3128df1b673aa
I20260810 19:48:01.939894 10366 tablet_bootstrap.cc:654] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:01.940178 10377 ts_tablet_manager.cc:1950] T 31c8699875b54be888b3128df1b673aa P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:01.941787 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 31c8699875b54be888b3128df1b673aa (table default.Table_c35c3a44fcc44bba8a8c334292245b49 [id=5abc1f7beec444a4a988fbfcb8b45623]) successfully deleted
I20260810 19:48:01.941939 10370 ts_tablet_manager.cc:1434] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.144s user 0.002s sys 0.000s
I20260810 19:48:01.942390 10370 tablet_bootstrap.cc:492] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:01.944249 10370 tablet_bootstrap.cc:654] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:01.950498 10366 tablet_bootstrap.cc:492] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:01.951565 10366 ts_tablet_manager.cc:1403] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.002s
I20260810 19:48:01.972899 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6914b47e0cac4cd28ee4fd199684a280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.981490 11663 raft_consensus.cc:493] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:01.981858 11663 raft_consensus.cc:515] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.983546 10375 ts_tablet_manager.cc:1929] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:01.983695 10375 log.cc:1199] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/c8602b7360b747a3af756b139635d95c
I20260810 19:48:01.983865 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c0a1e360ac648eeb0c734215bc200f6" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:01.984099 10375 ts_tablet_manager.cc:1950] T c8602b7360b747a3af756b139635d95c P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:01.984228 9948 raft_consensus.cc:2468] T 0c0a1e360ac648eeb0c734215bc200f6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:01.984745 10067 leader_election.cc:304] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:01.985224 11897 raft_consensus.cc:493] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:01.983564 11663 leader_election.cc:290] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:01.985420 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet c8602b7360b747a3af756b139635d95c (table default.Table_e2c3250ad65342b6b93438349218f41a [id=043b4921c17c438db20e082f44e88787]) successfully deleted
I20260810 19:48:01.985606 11663 raft_consensus.cc:2804] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:01.985438 11897 raft_consensus.cc:515] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.985793 11663 raft_consensus.cc:493] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:01.985921 11663 raft_consensus.cc:3060] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:01.985862 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c0a1e360ac648eeb0c734215bc200f6" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:01.986084 9715 raft_consensus.cc:2468] T 0c0a1e360ac648eeb0c734215bc200f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:01.986948 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b2b0f2fc93647f3bc1d79b4132c3703" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:01.987236 9715 raft_consensus.cc:2468] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:01.987241 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b2b0f2fc93647f3bc1d79b4132c3703" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:01.987435 10168 raft_consensus.cc:2468] T 4b2b0f2fc93647f3bc1d79b4132c3703 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:01.988001 9831 leader_election.cc:304] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:01.988656 11897 leader_election.cc:290] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:01.989012 11897 raft_consensus.cc:2804] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:01.989130 11897 raft_consensus.cc:493] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:01.989238 11897 raft_consensus.cc:3060] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:01.992069 11663 raft_consensus.cc:515] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.992249 11897 raft_consensus.cc:515] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:01.995182 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 956b5d18745f403aad67ec888fbbd379 (DEFAULT_TABLE table=default.Table_601a5399171d49db90ca91584e73086c [id=5bcc07f8aa204f2eb1aac39108476920]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.995836 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 956b5d18745f403aad67ec888fbbd379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.996361 11897 leader_election.cc:290] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:02.001374 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 9e8a23221e8447bd83592c05c9d1149c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e8a23221e8447bd83592c05c9d1149c already in progress: creating tablet
I20260810 19:48:01.992501 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 956b5d18745f403aad67ec888fbbd379 (DEFAULT_TABLE table=default.Table_601a5399171d49db90ca91584e73086c [id=5bcc07f8aa204f2eb1aac39108476920]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.992928 10366 raft_consensus.cc:359] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.002810 10366 raft_consensus.cc:385] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:02.002913 10366 raft_consensus.cc:740] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:02.003189 10366 consensus_queue.cc:260] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.003799 10366 ts_tablet_manager.cc:1434] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.052s user 0.001s sys 0.001s
I20260810 19:48:02.004129 10366 tablet_bootstrap.cc:492] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:02.006018 10366 tablet_bootstrap.cc:654] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:02.006875 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 956b5d18745f403aad67ec888fbbd379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.012072 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b2b0f2fc93647f3bc1d79b4132c3703" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:02.012355 9715 raft_consensus.cc:3060] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:02.020104 10366 tablet_bootstrap.cc:492] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:02.020370 10366 ts_tablet_manager.cc:1403] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
I20260810 19:48:02.020845 9715 raft_consensus.cc:2468] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:02.021569 9831 leader_election.cc:304] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:02.021872 11897 raft_consensus.cc:2804] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:02.022078 10366 raft_consensus.cc:359] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.022248 10366 raft_consensus.cc:385] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:02.022298 10366 raft_consensus.cc:740] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:02.022567 10366 consensus_queue.cc:260] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.023207 10366 ts_tablet_manager.cc:1434] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:48:02.023363 11894 raft_consensus.cc:493] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:02.023530 10366 tablet_bootstrap.cc:492] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:02.023489 11894 raft_consensus.cc:515] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:02.024084 11894 leader_election.cc:290] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:02.025005 11897 raft_consensus.cc:697] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:02.025369 11897 consensus_queue.cc:237] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.026278 10366 tablet_bootstrap.cc:654] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:02.027573 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 36f01bdcf7b24a58b80b6ca9ba307113 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36f01bdcf7b24a58b80b6ca9ba307113 already in progress: creating tablet
W20260810 19:48:02.028556 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 38b0c6a017dc4afc849090cca7ee8b26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38b0c6a017dc4afc849090cca7ee8b26 already in progress: creating tablet
W20260810 19:48:02.030028 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 4e9feae2570443afa3dec76975493487 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e9feae2570443afa3dec76975493487 already in progress: creating tablet
W20260810 19:48:02.031133 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 8503d5162548463bae22402fdc4c502a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8503d5162548463bae22402fdc4c502a already in progress: creating tablet
I20260810 19:48:02.031857 10366 tablet_bootstrap.cc:492] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
W20260810 19:48:02.031855 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 4f21e03993e841ba901f1e9c176309b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f21e03993e841ba901f1e9c176309b9 already in progress: creating tablet
I20260810 19:48:02.032022 10366 ts_tablet_manager.cc:1403] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.003s
W20260810 19:48:02.032740 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet e28348b22e184b5993a4abc5859de6c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e28348b22e184b5993a4abc5859de6c3 already in progress: creating tablet
I20260810 19:48:02.032912 10366 raft_consensus.cc:359] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.033116 10366 raft_consensus.cc:385] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:02.033179 10366 raft_consensus.cc:740] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:02.033420 10366 consensus_queue.cc:260] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:02.033681 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet f6b705416997444485dc187e11a25c34 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6b705416997444485dc187e11a25c34 already in progress: creating tablet
I20260810 19:48:02.033970 10366 ts_tablet_manager.cc:1434] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:02.034261 10366 tablet_bootstrap.cc:492] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:02.035198 10367 tablet_bootstrap.cc:492] T 72b39babf851404c89adb317033015ec P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:02.035442 10367 ts_tablet_manager.cc:1403] T 72b39babf851404c89adb317033015ec P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.249s user 0.026s sys 0.067s
I20260810 19:48:02.036111 10366 tablet_bootstrap.cc:654] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:02.036509 10367 raft_consensus.cc:359] T 72b39babf851404c89adb317033015ec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.036772 10367 raft_consensus.cc:385] T 72b39babf851404c89adb317033015ec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:02.036890 10367 raft_consensus.cc:740] T 72b39babf851404c89adb317033015ec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:02.037196 10367 consensus_queue.cc:260] T 72b39babf851404c89adb317033015ec P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.037873 10367 ts_tablet_manager.cc:1434] T 72b39babf851404c89adb317033015ec P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:02.038439 10367 tablet_bootstrap.cc:492] T db2b8038ee9747109b42510bba02faa9 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:02.041440 10367 tablet_bootstrap.cc:654] T db2b8038ee9747109b42510bba02faa9 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:02.043929 9831 leader_election.cc:343] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 6355c14e38b3446493f7bd5e2a717341
I20260810 19:48:02.045094 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 871f8793e77845399a2e0ae7407adc75 (DEFAULT_TABLE table=default.Table_ee7dc02ca2694c60a65c9b96d4410000 [id=def3a181132246f79f2589a3c7c5331f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.045677 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871f8793e77845399a2e0ae7407adc75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:01.993788 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 956b5d18745f403aad67ec888fbbd379 (DEFAULT_TABLE table=default.Table_601a5399171d49db90ca91584e73086c [id=5bcc07f8aa204f2eb1aac39108476920]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:01.996194 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b2b0f2fc93647f3bc1d79b4132c3703" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:02.024688 10162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6355c14e38b3446493f7bd5e2a717341" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:02.048231 10168 raft_consensus.cc:3060] T 4b2b0f2fc93647f3bc1d79b4132c3703 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:02.048252 10162 raft_consensus.cc:2468] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:02.048854 9830 leader_election.cc:304] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:02.049345 11897 raft_consensus.cc:2804] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:02.049423 11897 raft_consensus.cc:493] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:02.049479 11897 raft_consensus.cc:3060] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:02.050932 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 871f8793e77845399a2e0ae7407adc75 (DEFAULT_TABLE table=default.Table_ee7dc02ca2694c60a65c9b96d4410000 [id=def3a181132246f79f2589a3c7c5331f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.051170 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 956b5d18745f403aad67ec888fbbd379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.051549 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871f8793e77845399a2e0ae7407adc75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.053669 10168 raft_consensus.cc:2468] T 4b2b0f2fc93647f3bc1d79b4132c3703 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:02.054690 11897 raft_consensus.cc:515] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:02.034206 10375 tablet_replica.cc:333] T 31c8699875b54be888b3128df1b673aa P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:02.042778 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 871f8793e77845399a2e0ae7407adc75 (DEFAULT_TABLE table=default.Table_ee7dc02ca2694c60a65c9b96d4410000 [id=def3a181132246f79f2589a3c7c5331f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.055377 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871f8793e77845399a2e0ae7407adc75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.055860 11897 leader_election.cc:290] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:02.055959 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6355c14e38b3446493f7bd5e2a717341" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:02.056141 10168 raft_consensus.cc:3060] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:02.062510 11897 raft_consensus.cc:493] T 3c828ae089774fb9b0582141f4b99313 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:02.062696 11897 raft_consensus.cc:515] T 3c828ae089774fb9b0582141f4b99313 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.063660 11897 leader_election.cc:290] T 3c828ae089774fb9b0582141f4b99313 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:02.063985 10162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c828ae089774fb9b0582141f4b99313" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:02.064546 9831 leader_election.cc:343] T 3c828ae089774fb9b0582141f4b99313 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 3c828ae089774fb9b0582141f4b99313
I20260810 19:48:02.064576 10168 raft_consensus.cc:2468] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
W20260810 19:48:02.064790 9830 leader_election.cc:343] T 3c828ae089774fb9b0582141f4b99313 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:02.064894 9830 leader_election.cc:304] T 3c828ae089774fb9b0582141f4b99313 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:02.065419 9830 leader_election.cc:304] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:02.065716 11894 raft_consensus.cc:2749] T 3c828ae089774fb9b0582141f4b99313 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:02.065762 10370 tablet_bootstrap.cc:492] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:02.065896 10370 ts_tablet_manager.cc:1403] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.124s user 0.003s sys 0.000s
I20260810 19:48:02.065898 11894 raft_consensus.cc:2804] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:02.066000 11894 raft_consensus.cc:697] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:02.066236 11894 consensus_queue.cc:237] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:02.066730 10370 raft_consensus.cc:359] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.066913 10370 raft_consensus.cc:385] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:02.066958 10370 raft_consensus.cc:740] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:02.067158 10370 consensus_queue.cc:260] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.068558 9709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c0a1e360ac648eeb0c734215bc200f6" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:02.072217 9709 raft_consensus.cc:3060] T 0c0a1e360ac648eeb0c734215bc200f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:02.069548 10375 raft_consensus.cc:2243] T 31c8699875b54be888b3128df1b673aa P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:02.072654 10375 raft_consensus.cc:2272] T 31c8699875b54be888b3128df1b673aa P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:02.073434 11663 leader_election.cc:290] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:02.074620 10375 ts_tablet_manager.cc:1916] T 31c8699875b54be888b3128df1b673aa P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:02.069204 9831 leader_election.cc:343] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 6355c14e38b3446493f7bd5e2a717341
I20260810 19:48:02.071022 9894 tablet_service.cc:1511] Processing CreateTablet for tablet 1017f28d62764ac0b9d841e7fefacca1 (DEFAULT_TABLE table=default.Table_2033c77d02d3472a99574dcb4c331377 [id=173fa36f50634ff98126e27bcf2bbb20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.076954 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1017f28d62764ac0b9d841e7fefacca1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:02.071461 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet ff3478f19b14418a876b668bd03125ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff3478f19b14418a876b668bd03125ba already in progress: creating tablet
I20260810 19:48:02.077566 9410 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet bc753970b2464e38b03e377551276343 (table default.Table_87ca145e91d149a68ef630e3a29795b4 [id=fd9deda7275b423b9f9c85aa22dde728]). Expected version 2 got 0
I20260810 19:48:02.075697 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet f85f3fa629764c79921a710739eea7ae
I20260810 19:48:02.078838 9416 catalog_manager.cc:6807] ReplaceTablet: tablet f85f3fa629764c79921a710739eea7ae deleted and replaced by tablet 2892d9fcdda34167a532dde7ed398590
I20260810 19:48:02.079893 10125 tablet_service.cc:1511] Processing CreateTablet for tablet ea942d54b4664ea48a13b6c85118cf6c (DEFAULT_TABLE table=default.Table_28b63802a88349e8a32c912d60173a77 [id=df6932946f6c4abdac38d200293c8920]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.080334 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea942d54b4664ea48a13b6c85118cf6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.081780 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_be85124217454fc9818d73533df69b69"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:02.082054 9416 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet bc753970b2464e38b03e377551276343 (table default.Table_87ca145e91d149a68ef630e3a29795b4 [id=fd9deda7275b423b9f9c85aa22dde728]). Expected version 2 got 0
I20260810 19:48:02.082998 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 625b0e4eedb946908bd00c6af5f06c08 (DEFAULT_TABLE table=default.Table_5282e99c68244e1fa33fbe374acd2ea4 [id=83ff790edf9349ccb1ed33dac6f58711]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.083410 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 625b0e4eedb946908bd00c6af5f06c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.083895 9709 raft_consensus.cc:2468] T 0c0a1e360ac648eeb0c734215bc200f6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:02.083930 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 065536e52b4a477a824ab0261168cbd3 (DEFAULT_TABLE table=default.Table_e750ff6052664ef696dccbd09d3ec5a6 [id=3a35e9a939294f9393fd3f5e049a7939]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.084354 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 065536e52b4a477a824ab0261168cbd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.084969 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6c8e33fd5c7642d7a9e9f0448d1ff065" } new_table_name: "default.Table_ce3ea915b9dd44b3943c4de2b462d48c" modify_external_catalogs: true
I20260810 19:48:02.085366 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 0413ceb18aea4162abb52dd81ba82671 (DEFAULT_TABLE table=default.Table_d966138bce714a71aa8d47f109c66741 [id=128392a67a4f44ef987aa5fb4b81f6e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.085770 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0413ceb18aea4162abb52dd81ba82671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.086665 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 71452c9043f04de19e098ebed12df3ef (DEFAULT_TABLE table=default.Table_2327dde0dc2d4073bda65e867c965c02 [id=0773aee4db3843acb7385d0fda40d48e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.087075 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71452c9043f04de19e098ebed12df3ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.087296 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet f85f3fa629764c79921a710739eea7ae with delete_type TABLET_DATA_DELETED (replaced by tablet 2892d9fcdda34167a532dde7ed398590) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:02.087698 9681 tablet_service.cc:1511] Processing CreateTablet for tablet ea942d54b4664ea48a13b6c85118cf6c (DEFAULT_TABLE table=default.Table_28b63802a88349e8a32c912d60173a77 [id=df6932946f6c4abdac38d200293c8920]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.088037 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea942d54b4664ea48a13b6c85118cf6c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:02.088080 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet f85f3fa629764c79921a710739eea7ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f85f3fa629764c79921a710739eea7ae already in progress: creating tablet
I20260810 19:48:02.090719 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 625b0e4eedb946908bd00c6af5f06c08 (DEFAULT_TABLE table=default.Table_5282e99c68244e1fa33fbe374acd2ea4 [id=83ff790edf9349ccb1ed33dac6f58711]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.091099 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 625b0e4eedb946908bd00c6af5f06c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.091745 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 1017f28d62764ac0b9d841e7fefacca1 (DEFAULT_TABLE table=default.Table_2033c77d02d3472a99574dcb4c331377 [id=173fa36f50634ff98126e27bcf2bbb20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.092077 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1017f28d62764ac0b9d841e7fefacca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.092269 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 71452c9043f04de19e098ebed12df3ef (DEFAULT_TABLE table=default.Table_2327dde0dc2d4073bda65e867c965c02 [id=0773aee4db3843acb7385d0fda40d48e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.092595 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71452c9043f04de19e098ebed12df3ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.073292 10377 tablet_replica.cc:333] T ee65b2c9980d4c77af8c68bf2f5c5f92 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:02.093793 10377 raft_consensus.cc:2243] T ee65b2c9980d4c77af8c68bf2f5c5f92 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:02.094000 10377 raft_consensus.cc:2272] T ee65b2c9980d4c77af8c68bf2f5c5f92 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:02.094589 10068 leader_election.cc:304] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:02.094897 11983 raft_consensus.cc:2804] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:02.095032 11983 raft_consensus.cc:697] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:02.095268 11983 consensus_queue.cc:237] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.096356 10377 ts_tablet_manager.cc:1916] T ee65b2c9980d4c77af8c68bf2f5c5f92 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:02.098253 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 0413ceb18aea4162abb52dd81ba82671 (DEFAULT_TABLE table=default.Table_d966138bce714a71aa8d47f109c66741 [id=128392a67a4f44ef987aa5fb4b81f6e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.098632 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0413ceb18aea4162abb52dd81ba82671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.099218 10370 ts_tablet_manager.cc:1434] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.033s user 0.002s sys 0.000s
I20260810 19:48:02.099510 10370 tablet_bootstrap.cc:492] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:48:02.099689 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be85124217454fc9818d73533df69b69 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:02.100138 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet f85f3fa629764c79921a710739eea7ae with delete_type TABLET_DATA_DELETED (replaced by tablet 2892d9fcdda34167a532dde7ed398590) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:02.068563 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c0a1e360ac648eeb0c734215bc200f6" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:02.106979 9939 raft_consensus.cc:3060] T 0c0a1e360ac648eeb0c734215bc200f6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:02.108091 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 08ac9ae9eceb42b3880c4f35556994c7 (DEFAULT_TABLE table=default.Table_cb11c1913c0a4ed18b7c62e1466292cb [id=fd632e7e6cd4416d992f41a2681f4c6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.108532 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08ac9ae9eceb42b3880c4f35556994c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.110163 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_abc13875e0d6429897eb19f7117e00f5" } new_table_name: "default.Table_28b8191a242a4d8ea55fdaeaec9c1c41" modify_external_catalogs: true
I20260810 19:48:02.111899 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 08ac9ae9eceb42b3880c4f35556994c7 (DEFAULT_TABLE table=default.Table_cb11c1913c0a4ed18b7c62e1466292cb [id=fd632e7e6cd4416d992f41a2681f4c6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.112335 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08ac9ae9eceb42b3880c4f35556994c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.114864 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 0413ceb18aea4162abb52dd81ba82671 (DEFAULT_TABLE table=default.Table_d966138bce714a71aa8d47f109c66741 [id=128392a67a4f44ef987aa5fb4b81f6e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.115298 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0413ceb18aea4162abb52dd81ba82671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.115567 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 1017f28d62764ac0b9d841e7fefacca1 (DEFAULT_TABLE table=default.Table_2033c77d02d3472a99574dcb4c331377 [id=173fa36f50634ff98126e27bcf2bbb20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.115962 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1017f28d62764ac0b9d841e7fefacca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.121629 11982 raft_consensus.cc:493] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:02.121796 11982 raft_consensus.cc:515] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.122625 11982 leader_election.cc:290] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:02.122699 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 065536e52b4a477a824ab0261168cbd3 (DEFAULT_TABLE table=default.Table_e750ff6052664ef696dccbd09d3ec5a6 [id=3a35e9a939294f9393fd3f5e049a7939]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.122784 11982 raft_consensus.cc:493] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:02.122882 11982 raft_consensus.cc:515] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.123216 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 065536e52b4a477a824ab0261168cbd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.123392 11982 leader_election.cc:290] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:02.124625 9898 tablet_service.cc:1511] Processing CreateTablet for tablet ea942d54b4664ea48a13b6c85118cf6c (DEFAULT_TABLE table=default.Table_28b63802a88349e8a32c912d60173a77 [id=df6932946f6c4abdac38d200293c8920]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.124989 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea942d54b4664ea48a13b6c85118cf6c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:02.125046 9831 leader_election.cc:343] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 971e9abee86444a7a9e923b0962ae751
I20260810 19:48:02.125240 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77785d9bde843bc8366fe15d1b4fa18" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:02.125425 9715 raft_consensus.cc:2468] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:02.125881 9831 leader_election.cc:304] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:02.126137 11897 raft_consensus.cc:2804] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:02.126194 11897 raft_consensus.cc:493] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:02.126257 11897 raft_consensus.cc:3060] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:02.126523 9897 tablet_service.cc:1511] Processing CreateTablet for tablet 625b0e4eedb946908bd00c6af5f06c08 (DEFAULT_TABLE table=default.Table_5282e99c68244e1fa33fbe374acd2ea4 [id=83ff790edf9349ccb1ed33dac6f58711]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.126852 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 625b0e4eedb946908bd00c6af5f06c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.131441 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 08ac9ae9eceb42b3880c4f35556994c7 (DEFAULT_TABLE table=default.Table_cb11c1913c0a4ed18b7c62e1466292cb [id=fd632e7e6cd4416d992f41a2681f4c6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.131847 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08ac9ae9eceb42b3880c4f35556994c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.133773 11897 raft_consensus.cc:515] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.135818 11897 leader_election.cc:290] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:02.136447 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77785d9bde843bc8366fe15d1b4fa18" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:02.136639 9715 raft_consensus.cc:3060] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:02.139568 9715 raft_consensus.cc:2468] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:02.140162 9831 leader_election.cc:304] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:02.140602 11897 raft_consensus.cc:2804] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:02.140882 11897 raft_consensus.cc:697] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:02.141197 11897 consensus_queue.cc:237] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.143901 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 71452c9043f04de19e098ebed12df3ef (DEFAULT_TABLE table=default.Table_2327dde0dc2d4073bda65e867c965c02 [id=0773aee4db3843acb7385d0fda40d48e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.144332 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71452c9043f04de19e098ebed12df3ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.145198 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 065536e52b4a477a824ab0261168cbd3 (DEFAULT_TABLE table=default.Table_e750ff6052664ef696dccbd09d3ec5a6 [id=3a35e9a939294f9393fd3f5e049a7939]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.145689 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971e9abee86444a7a9e923b0962ae751" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:02.145869 10162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77785d9bde843bc8366fe15d1b4fa18" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:02.145915 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77785d9bde843bc8366fe15d1b4fa18" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
W20260810 19:48:02.146474 9830 leader_election.cc:343] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:02.146612 9830 leader_election.cc:304] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:48:02.147068 9830 leader_election.cc:343] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:02.147349 11982 raft_consensus.cc:2749] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:02.147907 9830 leader_election.cc:343] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:02.150211 9939 raft_consensus.cc:2468] T 0c0a1e360ac648eeb0c734215bc200f6 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:02.150437 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet f85f3fa629764c79921a710739eea7ae with delete_type TABLET_DATA_DELETED (replaced by tablet 2892d9fcdda34167a532dde7ed398590) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:02.155332 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 065536e52b4a477a824ab0261168cbd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.169704 11663 raft_consensus.cc:493] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:02.170009 11663 raft_consensus.cc:515] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.174388 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 229dd737ee8547a89445593cc117fbc2
I20260810 19:48:02.176678 9418 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet bc753970b2464e38b03e377551276343 (table default.Table_87ca145e91d149a68ef630e3a29795b4 [id=fd9deda7275b423b9f9c85aa22dde728]). Expected version 2 got 0
I20260810 19:48:02.176908 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b60a7be0965645f8be9d8b1e3ea458d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:02.177596 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b60a7be0965645f8be9d8b1e3ea458d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:02.177799 11897 raft_consensus.cc:493] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:02.177960 11897 raft_consensus.cc:515] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.178117 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 092686718efe4b19a610586420d6bc3a
I20260810 19:48:02.178839 9415 master_service.cc:960] ReplaceTablet: received request to replace tablet 0d79ef93c5bf4ac9895e594198edb251 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:02.179224 11897 leader_election.cc:290] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:02.179302 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0a4ab5dd136842c3afce85538dc0461b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:02.179459 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_d98c0b1af3954d4787fb09b4e7b0ffa0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:02.179908 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a4ab5dd136842c3afce85538dc0461b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:02.180194 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b4b6b17ce3354600b2f7450c6e483c69 consensus state has no leader
I20260810 19:48:02.180472 9420 master_service.cc:960] ReplaceTablet: received request to replace tablet 749cea5cd8f842b891f4e2cab07c054e from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:02.181007 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0fa5ed82975d484a938aba25478b3c40" } modify_external_catalogs: true
I20260810 19:48:02.181176 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0fa5ed82975d484a938aba25478b3c40" } modify_external_catalogs: true
I20260810 19:48:02.181536 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 253f302c00cc42ff84076b0c17f7670a
I20260810 19:48:02.182361 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_562588ac5f0a40bb9639dc6131e4f151" } new_table_name: "default.Table_d5ae3dacc4c64900b971f0b4f06554a8" modify_external_catalogs: true
I20260810 19:48:02.183075 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet 229dd737ee8547a89445593cc117fbc2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:02.183957 11518 raft_consensus.cc:697] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:02.185405 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet a776693b6b4943a7b64e13ec10958c16
I20260810 19:48:02.187024 11982 raft_consensus.cc:493] T 4e80e2327c394612bffc51f38798dac3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 19:48:02.187172 9831 leader_election.cc:343] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 08e29e23d54f47968a06be98b313918d
I20260810 19:48:02.187204 11982 raft_consensus.cc:515] T 4e80e2327c394612bffc51f38798dac3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.186208 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0b9123d6d35944a296693b52e14428ad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:02.187856 11982 leader_election.cc:290] T 4e80e2327c394612bffc51f38798dac3 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:02.188071 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b9123d6d35944a296693b52e14428ad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:02.188043 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet a776693b6b4943a7b64e13ec10958c16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:02.188040 11982 consensus_queue.cc:1048] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 19:48:02.189615 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet a776693b6b4943a7b64e13ec10958c16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a776693b6b4943a7b64e13ec10958c16 already in progress: creating tablet
W20260810 19:48:02.179914 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d98c0b1af3954d4787fb09b4e7b0ffa0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:02.192008 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 253f302c00cc42ff84076b0c17f7670a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:02.192687 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 253f302c00cc42ff84076b0c17f7670a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:02.193569 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b58c92af875943db8e95a856d198aa99" } new_table_name: "default.Table_326e6714716f497c8408450e0828e9e8" modify_external_catalogs: true
I20260810 19:48:02.197365 10370 tablet_bootstrap.cc:654] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:02.198189 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet 092686718efe4b19a610586420d6bc3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:02.198561 10136 tablet_service.cc:1558] Processing DeleteTablet for tablet 229dd737ee8547a89445593cc117fbc2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:02.199949 10162 raft_consensus.cc:3060] T b737b216646a4c5baecb88d59bcce4df P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:02.200630 10144 tablet_service.cc:1558] Processing DeleteTablet for tablet 253f302c00cc42ff84076b0c17f7670a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:02.201422 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 092686718efe4b19a610586420d6bc3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:02.201787 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet 72b39babf851404c89adb317033015ec with delete_type TABLET_DATA_DELETED (replaced by tablet 676004738985441985278313d6064530) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:02.202553 10371 tablet_replica.cc:333] T 72b39babf851404c89adb317033015ec P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:02.202749 10371 raft_consensus.cc:2243] T 72b39babf851404c89adb317033015ec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:02.202896 10371 raft_consensus.cc:2272] T 72b39babf851404c89adb317033015ec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:02.203853 10371 ts_tablet_manager.cc:1916] T 72b39babf851404c89adb317033015ec P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:02.206478 9397 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 648ef608fa0c45cc8be4bad80c4200be (table default.Table_63c36107140a41da9c5d337a853cb5d3 [id=d921f4a824ae4dd6b0b9dbb8310ff00a], current schema version=5) failed: Not found: failed to reset TS proxy: No leader found: Tablet 648ef608fa0c45cc8be4bad80c4200be consensus state has no leader
W20260810 19:48:02.206764 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 253f302c00cc42ff84076b0c17f7670a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 253f302c00cc42ff84076b0c17f7670a already in progress: creating tablet
W20260810 19:48:02.207082 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 092686718efe4b19a610586420d6bc3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 092686718efe4b19a610586420d6bc3a already in progress: creating tablet
I20260810 19:48:02.184309 11518 consensus_queue.cc:237] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:02.209810 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e29e23d54f47968a06be98b313918d" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:02.210032 10171 raft_consensus.cc:2468] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:02.210590 9830 leader_election.cc:304] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:02.211198 11894 raft_consensus.cc:2804] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:02.211364 11894 raft_consensus.cc:493] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:02.211513 11894 raft_consensus.cc:3060] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:02.213163 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 229dd737ee8547a89445593cc117fbc2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:02.214150 10371 ts_tablet_manager.cc:1929] T 72b39babf851404c89adb317033015ec P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:02.214553 10371 log.cc:1199] T 72b39babf851404c89adb317033015ec P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/72b39babf851404c89adb317033015ec
I20260810 19:48:02.215047 10371 ts_tablet_manager.cc:1950] T 72b39babf851404c89adb317033015ec P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:02.215117 11894 raft_consensus.cc:515] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.216240 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet a776693b6b4943a7b64e13ec10958c16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:02.216518 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 72b39babf851404c89adb317033015ec (table default.Table_2d7f246476ac4544a3fa089ec3c52657 [id=c681008d2b5f43a9b7b6ed2d72653b1b]) successfully deleted
W20260810 19:48:02.217507 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 229dd737ee8547a89445593cc117fbc2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 229dd737ee8547a89445593cc117fbc2 already in progress: creating tablet
I20260810 19:48:02.219987 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet 092686718efe4b19a610586420d6bc3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:02.227017 10144 tablet_service.cc:1558] Processing DeleteTablet for tablet a776693b6b4943a7b64e13ec10958c16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:02.227447 9709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b722c43ee4b8698b19b2b6c1b401d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:02.227722 9709 raft_consensus.cc:2468] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:02.228785 10068 leader_election.cc:304] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:02.230060 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b722c43ee4b8698b19b2b6c1b401d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:02.230796 10067 leader_election.cc:343] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:02.231070 11663 leader_election.cc:290] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:02.233044 11974 raft_consensus.cc:2804] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:02.233137 11974 raft_consensus.cc:493] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:02.233198 11974 raft_consensus.cc:3060] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:02.233448 10164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e80e2327c394612bffc51f38798dac3" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:02.234244 9830 leader_election.cc:343] T 4e80e2327c394612bffc51f38798dac3 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:02.238392 11894 leader_election.cc:290] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:02.242522 10164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e29e23d54f47968a06be98b313918d" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:02.242748 10164 raft_consensus.cc:3060] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:02.245440 10164 raft_consensus.cc:2468] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:02.246709 11974 raft_consensus.cc:515] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.248134 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b722c43ee4b8698b19b2b6c1b401d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
W20260810 19:48:02.248984 10067 leader_election.cc:343] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:02.249208 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8b24b75629ec423b90e4bf287e7cfd38 consensus state has no leader
I20260810 19:48:02.249693 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_8828e8ce833344fbbf4fa80b95fb29aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:02.249918 11974 leader_election.cc:290] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:02.250432 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8828e8ce833344fbbf4fa80b95fb29aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:02.250725 9830 leader_election.cc:304] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:02.251009 11897 consensus_queue.cc:1048] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:02.251557 11982 raft_consensus.cc:2804] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:02.251709 11982 raft_consensus.cc:697] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:02.251776 9709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b722c43ee4b8698b19b2b6c1b401d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:02.251979 9709 raft_consensus.cc:3060] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:02.251953 9831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 63395.9us
I20260810 19:48:02.251989 11982 consensus_queue.cc:237] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:02.258384 9831 leader_election.cc:343] T 4e80e2327c394612bffc51f38798dac3 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 4e80e2327c394612bffc51f38798dac3
I20260810 19:48:02.258622 9831 leader_election.cc:304] T 4e80e2327c394612bffc51f38798dac3 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:48:02.258828 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a2fe67e8bd014acaa202c022c193cdc6 consensus state has no leader
I20260810 19:48:02.258939 11897 raft_consensus.cc:2749] T 4e80e2327c394612bffc51f38798dac3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:02.259194 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet 48eee4ce10114021855075812e356652 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:02.259732 10367 tablet_bootstrap.cc:492] T db2b8038ee9747109b42510bba02faa9 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
W20260810 19:48:02.259796 9831 leader_election.cc:343] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 08e29e23d54f47968a06be98b313918d
I20260810 19:48:02.259905 10367 ts_tablet_manager.cc:1403] T db2b8038ee9747109b42510bba02faa9 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.222s user 0.029s sys 0.040s
I20260810 19:48:02.261261 10367 raft_consensus.cc:359] T db2b8038ee9747109b42510bba02faa9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.261473 10367 raft_consensus.cc:385] T db2b8038ee9747109b42510bba02faa9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:02.261521 10367 raft_consensus.cc:740] T db2b8038ee9747109b42510bba02faa9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:02.261775 10367 consensus_queue.cc:260] T db2b8038ee9747109b42510bba02faa9 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.262514 11926 raft_consensus.cc:493] T 3e8ae48a2fb548358176abefe1ee3baa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:02.262646 11926 raft_consensus.cc:515] T 3e8ae48a2fb548358176abefe1ee3baa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.263315 11926 leader_election.cc:290] T 3e8ae48a2fb548358176abefe1ee3baa P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:02.263875 9709 raft_consensus.cc:2468] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:02.266556 10366 tablet_bootstrap.cc:492] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:02.266786 10366 ts_tablet_manager.cc:1403] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.233s user 0.005s sys 0.013s
I20260810 19:48:02.267830 10366 raft_consensus.cc:359] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.267997 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8ae48a2fb548358176abefe1ee3baa" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:02.268167 10366 raft_consensus.cc:385] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:02.268303 10366 raft_consensus.cc:740] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
W20260810 19:48:02.268577 9611 leader_election.cc:343] T 3e8ae48a2fb548358176abefe1ee3baa P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:02.268627 10366 consensus_queue.cc:260] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.269304 10366 ts_tablet_manager.cc:1434] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:02.269683 10366 tablet_bootstrap.cc:492] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:02.271710 10366 tablet_bootstrap.cc:654] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:02.277751 11974 raft_consensus.cc:493] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:02.277923 11974 raft_consensus.cc:515] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.279003 10164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8ae48a2fb548358176abefe1ee3baa" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:02.279625 9611 leader_election.cc:343] T 3e8ae48a2fb548358176abefe1ee3baa P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:02.279784 9611 leader_election.cc:304] T 3e8ae48a2fb548358176abefe1ee3baa P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:02.280192 11926 raft_consensus.cc:2749] T 3e8ae48a2fb548358176abefe1ee3baa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:02.280539 9142 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 79970.6us
I20260810 19:48:02.281164 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b649cbc1d141d8bb438105b8e8537c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:02.281831 10067 leader_election.cc:343] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:02.282279 10377 ts_tablet_manager.cc:1929] T ee65b2c9980d4c77af8c68bf2f5c5f92 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:02.283094 10377 log.cc:1199] T ee65b2c9980d4c77af8c68bf2f5c5f92 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/ee65b2c9980d4c77af8c68bf2f5c5f92
I20260810 19:48:02.283891 10377 ts_tablet_manager.cc:1950] T ee65b2c9980d4c77af8c68bf2f5c5f92 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:02.285302 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet c9e2dbef6e7a48caa2964ab90fbf9b73
W20260810 19:48:02.287762 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0a3f0e184b7a472bb7ae2bea8db000ad consensus state has no leader
I20260810 19:48:02.288677 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet c9e2dbef6e7a48caa2964ab90fbf9b73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:48:02.291055 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 548a6996692549df8087393ccef7b4a2 consensus state has no leader
I20260810 19:48:02.291178 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet ee65b2c9980d4c77af8c68bf2f5c5f92 (table default.Table_2784ff35cf7944ada0cefff31407d65d [id=77e412a6dedf44a3a69b72b6a9d017aa]) successfully deleted
I20260810 19:48:02.291662 10377 tablet_replica.cc:333] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:02.292917 10375 ts_tablet_manager.cc:1929] T 31c8699875b54be888b3128df1b673aa P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:02.293148 10375 log.cc:1199] T 31c8699875b54be888b3128df1b673aa P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/31c8699875b54be888b3128df1b673aa
I20260810 19:48:02.293421 11974 leader_election.cc:290] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:02.293902 10367 ts_tablet_manager.cc:1434] T db2b8038ee9747109b42510bba02faa9 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.034s user 0.001s sys 0.001s
I20260810 19:48:02.294595 10367 tablet_bootstrap.cc:492] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:02.298884 10366 tablet_bootstrap.cc:492] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:02.299146 10366 ts_tablet_manager.cc:1403] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.030s user 0.009s sys 0.001s
I20260810 19:48:02.300268 10366 raft_consensus.cc:359] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.300555 10366 raft_consensus.cc:385] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:02.300680 10366 raft_consensus.cc:740] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:02.300981 10366 consensus_queue.cc:260] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.301745 10366 ts_tablet_manager.cc:1434] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:02.302122 10366 tablet_bootstrap.cc:492] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:02.305203 10366 tablet_bootstrap.cc:654] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:02.312114 10375 ts_tablet_manager.cc:1950] T 31c8699875b54be888b3128df1b673aa P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:02.315629 10127 tablet_service.cc:1558] Processing DeleteTablet for tablet c9e2dbef6e7a48caa2964ab90fbf9b73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:02.316761 10367 tablet_bootstrap.cc:654] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:02.317216 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_87b726ec1327405d86e7c849c488b960"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:02.318199 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c29618c93a5c4098a9f996dced9f5a29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:02.322516 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c29618c93a5c4098a9f996dced9f5a29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:02.325661 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87b726ec1327405d86e7c849c488b960 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:02.326496 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 31c8699875b54be888b3128df1b673aa (table default.Table_c35c3a44fcc44bba8a8c334292245b49 [id=5abc1f7beec444a4a988fbfcb8b45623]) successfully deleted
I20260810 19:48:02.338408 10377 raft_consensus.cc:2243] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:02.339048 10377 pending_rounds.cc:70] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691: Trying to abort 1 pending ops.
I20260810 19:48:02.339222 10377 pending_rounds.cc:77] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058692106776576 op_type: NO_OP noop_request { }
I20260810 19:48:02.339448 10377 raft_consensus.cc:2889] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:02.339627 10377 raft_consensus.cc:2272] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:02.340682 10377 ts_tablet_manager.cc:1916] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:02.348191 10375 tablet_replica.cc:333] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:02.348588 10375 raft_consensus.cc:2243] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:02.348863 10375 raft_consensus.cc:2272] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:02.354027 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b649cbc1d141d8bb438105b8e8537c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:02.354231 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet c9e2dbef6e7a48caa2964ab90fbf9b73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:02.354281 9715 raft_consensus.cc:2468] T 63b649cbc1d141d8bb438105b8e8537c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:02.349581 10375 ts_tablet_manager.cc:1916] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:02.352723 10068 leader_election.cc:304] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691
I20260810 19:48:02.358469 11518 raft_consensus.cc:2804] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:02.360208 11518 raft_consensus.cc:697] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:02.360623 11518 consensus_queue.cc:237] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.355669 10370 tablet_bootstrap.cc:492] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:02.363821 10370 ts_tablet_manager.cc:1403] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.264s user 0.008s sys 0.000s
I20260810 19:48:02.364777 10370 raft_consensus.cc:359] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.365166 10370 raft_consensus.cc:385] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:02.365276 10370 raft_consensus.cc:740] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:02.365615 10370 consensus_queue.cc:260] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.365955 9407 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet bc753970b2464e38b03e377551276343 (table default.Table_87ca145e91d149a68ef630e3a29795b4 [id=fd9deda7275b423b9f9c85aa22dde728]). Expected version 2 got 0
I20260810 19:48:02.366438 9407 catalog_manager.cc:5719] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:02.366886 9407 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 4b2b0f2fc93647f3bc1d79b4132c3703 (table default.Table_d195688055bd4cfca1a9462585af71bc [id=64e1f507ae574ea6b7fa1627b8e7f4c3]). Expected version 4 got 0
I20260810 19:48:02.368243 10370 ts_tablet_manager.cc:1434] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260810 19:48:02.369673 10370 tablet_bootstrap.cc:492] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:48:02.372512 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet c9e2dbef6e7a48caa2964ab90fbf9b73 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9e2dbef6e7a48caa2964ab90fbf9b73 already in progress: creating tablet
I20260810 19:48:02.373178 10068 leader_election.cc:304] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691
I20260810 19:48:02.373699 11974 raft_consensus.cc:2804] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:02.373785 11974 raft_consensus.cc:493] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:02.373857 11974 raft_consensus.cc:3060] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:02.376924 11974 raft_consensus.cc:515] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.379056 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b649cbc1d141d8bb438105b8e8537c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:02.380200 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet d2c77a8ac1614bb286e4e168bcf999f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:02.380470 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 971e9abee86444a7a9e923b0962ae751 with delete_type TABLET_DATA_DELETED (replaced by tablet d0f9a22f81894a829fcb350001fc532b) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:02.380641 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 9fb544dff4eb4642b7e282657ae15d19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:48:02.381130 10067 leader_election.cc:343] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:02.381503 11974 leader_election.cc:290] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:02.382774 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet 21208dd824fe432fa307cbb88d37aaa2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:02.384318 11982 raft_consensus.cc:493] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:02.384464 11982 raft_consensus.cc:515] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.385140 11982 leader_election.cc:290] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:02.385380 9413 master_service.cc:960] ReplaceTablet: received request to replace tablet ca733de7babe4343ab26dbca2c9020b2 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:02.386042 9415 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet db2b8038ee9747109b42510bba02faa9 (table default.Table_2b20dee66e634a07bc9f2e2de90e8529 [id=452b19ee68bc463086780f6f72603483]). Expected version 1 got 0
I20260810 19:48:02.386246 10162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21208dd824fe432fa307cbb88d37aaa2" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:02.386909 9830 leader_election.cc:343] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:02.387243 9831 leader_election.cc:343] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 21208dd824fe432fa307cbb88d37aaa2
I20260810 19:48:02.387363 9831 leader_election.cc:304] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:02.388019 9418 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 63b649cbc1d141d8bb438105b8e8537c (table default.Table_b059137abb0e458bbadca41a2f2e8b50 [id=9eaa5e14e854425e8971160c64ee97cf]). Expected version 1 got 0
I20260810 19:48:02.389451 9407 catalog_manager.cc:5719] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:02.389892 9407 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet d77785d9bde843bc8366fe15d1b4fa18 (table default.Table_3e78e13c8ecc464eb6af12a2bc3f2eba [id=1af2d06c44b643e28d28bb080cd5eef8]). Expected version 2 got 0
I20260810 19:48:02.391073 11982 raft_consensus.cc:2749] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:02.392594 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_25921125d38844c9aa2816c5a6c395d1" } new_table_name: "default.Table_4fb96dbc73be4091855b1cbbed3b9ce6" modify_external_catalogs: true
I20260810 19:48:02.395217 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_25a140564d68481997cc263696b5b066"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:02.395830 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25a140564d68481997cc263696b5b066 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:02.397022 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_98357f787dbf48958872d3de9003c202" } modify_external_catalogs: true
I20260810 19:48:02.397200 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_98357f787dbf48958872d3de9003c202" } modify_external_catalogs: true
I20260810 19:48:02.397706 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3102211b2b544d6bae3547d4f9af2574" } modify_external_catalogs: true
I20260810 19:48:02.397877 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3102211b2b544d6bae3547d4f9af2574" } modify_external_catalogs: true
I20260810 19:48:02.397940 11983 consensus_queue.cc:1048] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:02.399246 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c29618c93a5c4098a9f996dced9f5a29" } modify_external_catalogs: true
I20260810 19:48:02.399425 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c29618c93a5c4098a9f996dced9f5a29" } modify_external_catalogs: true
I20260810 19:48:02.400382 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0b2d770d94e74c88bd7d0d7a9ab88982"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:02.400964 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b2d770d94e74c88bd7d0d7a9ab88982 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:02.402655 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 2467e2cb92f5456c81990838910dd923 (DEFAULT_TABLE table=default.Table_e12b767f15c14df4bff9da1d856c2961 [id=dc787ed4bf3a40e3aa3c44484ea68dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.403162 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3ccf56c919e14ad8a02a00cccab81de9" } modify_external_catalogs: true
I20260810 19:48:02.403362 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3ccf56c919e14ad8a02a00cccab81de9" } modify_external_catalogs: true
I20260810 19:48:02.404661 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 2467e2cb92f5456c81990838910dd923 (DEFAULT_TABLE table=default.Table_e12b767f15c14df4bff9da1d856c2961 [id=dc787ed4bf3a40e3aa3c44484ea68dd9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:02.405009 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5b56fb5bed4b46a2a1fc0ab22379760b consensus state has no leader
I20260810 19:48:02.405180 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2467e2cb92f5456c81990838910dd923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.415786 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet f6f9eb86c6c84b4a84d109d4741238e1
I20260810 19:48:02.386516 10367 tablet_bootstrap.cc:492] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:02.417721 10367 ts_tablet_manager.cc:1403] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.123s user 0.002s sys 0.003s
I20260810 19:48:02.418825 10144 tablet_service.cc:1558] Processing DeleteTablet for tablet f6f9eb86c6c84b4a84d109d4741238e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:02.419232 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet f6f9eb86c6c84b4a84d109d4741238e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:02.423941 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 8565cd6fc9e34c5fbabba6e573df9939
I20260810 19:48:02.425127 10144 tablet_service.cc:1558] Processing DeleteTablet for tablet 8565cd6fc9e34c5fbabba6e573df9939 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:02.425227 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet b737b216646a4c5baecb88d59bcce4df
I20260810 19:48:02.426291 9408 catalog_manager.cc:5719] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195). New cstate: current_term: 1 leader_uuid: "eadde59fd6504d679e47f03a60c64bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: HEALTHY } } }
I20260810 19:48:02.427083 9408 catalog_manager.cc:5719] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195). New cstate: current_term: 1 leader_uuid: "eadde59fd6504d679e47f03a60c64bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: HEALTHY } } }
I20260810 19:48:02.427444 9408 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 0c0a1e360ac648eeb0c734215bc200f6 (table default.Table_03fbd70a4ed44530a3fab8f17c0769db [id=09fa54104d0f46dbb3f19138bfa2313d]). Expected version 1 got 0
I20260810 19:48:02.428061 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 8565cd6fc9e34c5fbabba6e573df9939 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:02.429463 9420 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet d73fbedb374c404ab853a58f2c30eb29
I20260810 19:48:02.431834 10144 tablet_service.cc:1558] Processing DeleteTablet for tablet b737b216646a4c5baecb88d59bcce4df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:02.432652 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet b737b216646a4c5baecb88d59bcce4df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:02.433035 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 476e762e46c04ae6bfef5e14df2d16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:02.433543 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b649cbc1d141d8bb438105b8e8537c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:02.433817 9715 raft_consensus.cc:3060] T 63b649cbc1d141d8bb438105b8e8537c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:02.433995 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 6cd145af89874088b41d76d0e2bfdf86 (DEFAULT_TABLE table=default.Table_348f96b1205b40888cfeacca983e5d0f [id=3c0609e9874441d690cf77c2c0535cb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.434540 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cd145af89874088b41d76d0e2bfdf86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.437271 9715 raft_consensus.cc:2468] T 63b649cbc1d141d8bb438105b8e8537c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:02.439824 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 6cd145af89874088b41d76d0e2bfdf86 (DEFAULT_TABLE table=default.Table_348f96b1205b40888cfeacca983e5d0f [id=3c0609e9874441d690cf77c2c0535cb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.441876 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 2467e2cb92f5456c81990838910dd923 (DEFAULT_TABLE table=default.Table_e12b767f15c14df4bff9da1d856c2961 [id=dc787ed4bf3a40e3aa3c44484ea68dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.442410 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2467e2cb92f5456c81990838910dd923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.442384 10068 leader_election.cc:304] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691
I20260810 19:48:02.442680 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet f6f9eb86c6c84b4a84d109d4741238e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:02.442909 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet b737b216646a4c5baecb88d59bcce4df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:02.442981 11518 raft_consensus.cc:2804] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:02.443256 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 6cd145af89874088b41d76d0e2bfdf86 (DEFAULT_TABLE table=default.Table_348f96b1205b40888cfeacca983e5d0f [id=3c0609e9874441d690cf77c2c0535cb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.443593 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cd145af89874088b41d76d0e2bfdf86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.446022 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 8565cd6fc9e34c5fbabba6e573df9939 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:02.446784 10371 tablet_replica.cc:333] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:02.447007 10371 raft_consensus.cc:2243] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:02.447193 10371 raft_consensus.cc:2272] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:02.448149 10371 ts_tablet_manager.cc:1916] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:02.448568 11518 raft_consensus.cc:697] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:02.448915 11518 consensus_queue.cc:237] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.450431 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_51ca1bcf8aa844e8a0e7d1647c932d94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:02.451133 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51ca1bcf8aa844e8a0e7d1647c932d94 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:02.451259 10367 raft_consensus.cc:359] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.451459 10367 raft_consensus.cc:385] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:02.451508 10367 raft_consensus.cc:740] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:02.451707 10367 consensus_queue.cc:260] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.455124 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cd145af89874088b41d76d0e2bfdf86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.455444 9407 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 410855f236004ad4b78839eb1c0c2f1f (table default.Table_44478e93cffb460aaa8df9115b799594 [id=1d363ce63686462f9f4c15669773ee22]). Expected version 1 got 0
I20260810 19:48:02.457758 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_cb11c1913c0a4ed18b7c62e1466292cb" } new_table_name: "default.Table_ba3deeffd39e4301b64f879eac93ca7e" modify_external_catalogs: true
I20260810 19:48:02.460878 11982 raft_consensus.cc:493] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:02.460901 10371 ts_tablet_manager.cc:1929] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:02.461052 11982 raft_consensus.cc:515] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.461822 11982 leader_election.cc:290] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:02.462232 10371 log.cc:1199] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/b737b216646a4c5baecb88d59bcce4df
I20260810 19:48:02.462664 10371 ts_tablet_manager.cc:1950] T b737b216646a4c5baecb88d59bcce4df P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:02.463181 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_97a0d74bc8984c71bcbfe393520ae3ab" } new_table_name: "default.Table_baaf72f9cfd14aaa848f8a9ea745cd3e" modify_external_catalogs: true
I20260810 19:48:02.464277 10136 tablet_service.cc:1558] Processing DeleteTablet for tablet 971e9abee86444a7a9e923b0962ae751 with delete_type TABLET_DATA_DELETED (replaced by tablet d0f9a22f81894a829fcb350001fc532b) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:02.466539 10162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a13b0f5b6b14bb9b72740a8521e4ea5" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:02.467973 10366 tablet_bootstrap.cc:492] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
W20260810 19:48:02.470752 9830 leader_election.cc:343] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:02.472350 10366 ts_tablet_manager.cc:1403] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.170s user 0.021s sys 0.000s
I20260810 19:48:02.474133 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2467e2cb92f5456c81990838910dd923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.474017 10366 raft_consensus.cc:359] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.474462 10366 raft_consensus.cc:385] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:02.474675 10366 raft_consensus.cc:740] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:02.474977 10366 consensus_queue.cc:260] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:02.476023 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a4cba9e5cd44474cbcdceea01d2a9aca consensus state has no leader
W20260810 19:48:02.476930 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 08ac9ae9eceb42b3880c4f35556994c7 consensus state has no leader
I20260810 19:48:02.479359 10366 ts_tablet_manager.cc:1434] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260810 19:48:02.480000 10366 tablet_bootstrap.cc:492] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:02.481721 10366 tablet_bootstrap.cc:654] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:02.467110 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a13b0f5b6b14bb9b72740a8521e4ea5" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:02.482687 9715 raft_consensus.cc:2468] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:02.483373 9831 leader_election.cc:304] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:02.483706 11982 raft_consensus.cc:2804] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:02.483810 11982 raft_consensus.cc:493] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:02.483982 11982 raft_consensus.cc:3060] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:02.487267 11982 raft_consensus.cc:515] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.489023 11982 leader_election.cc:290] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:02.489705 10162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a13b0f5b6b14bb9b72740a8521e4ea5" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:02.489691 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a13b0f5b6b14bb9b72740a8521e4ea5" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:02.489946 9715 raft_consensus.cc:3060] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:02.493515 9715 raft_consensus.cc:2468] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:02.494161 9831 leader_election.cc:304] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:02.494583 11982 raft_consensus.cc:2804] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:02.494746 11982 raft_consensus.cc:697] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:02.494809 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b21befc85a6646199611d93c23783d4e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:02.495029 11982 consensus_queue.cc:237] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:02.495587 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b21befc85a6646199611d93c23783d4e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:02.497184 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_aed769a713644b6eb660a828c788f786"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:02.497380 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet f6f9eb86c6c84b4a84d109d4741238e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6f9eb86c6c84b4a84d109d4741238e1 already in progress: creating tablet
I20260810 19:48:02.497917 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b65ffd5f22ef4b92ac73d90d4d1d682a" } new_table_name: "default.Table_303ea2994db64a769843d09c0252531b" modify_external_catalogs: true
I20260810 19:48:02.499899 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_723332106bc5409c8c0a3201c9e8d99e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:02.500787 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_723332106bc5409c8c0a3201c9e8d99e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:02.502269 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aed769a713644b6eb660a828c788f786 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:02.504613 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f5350bb5f02d47f2b9736182f22ec088" } modify_external_catalogs: true
I20260810 19:48:02.504822 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f5350bb5f02d47f2b9736182f22ec088" } modify_external_catalogs: true
I20260810 19:48:02.507323 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_92ef15e1c6b640b6916580ccb7f93497"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:02.507943 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92ef15e1c6b640b6916580ccb7f93497 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:02.510908 10136 tablet_service.cc:1511] Processing CreateTablet for tablet c0fc251932454c378f94cbfaa4955232 (DEFAULT_TABLE table=default.Table_78040083fb05410ab04cbefee43fa0b5 [id=22e4e79a261c47e29580e8a8c8bc2ff0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.511399 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0fc251932454c378f94cbfaa4955232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.515043 9898 tablet_service.cc:1511] Processing CreateTablet for tablet c0fc251932454c378f94cbfaa4955232 (DEFAULT_TABLE table=default.Table_78040083fb05410ab04cbefee43fa0b5 [id=22e4e79a261c47e29580e8a8c8bc2ff0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.515827 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0fc251932454c378f94cbfaa4955232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.515803 10125 tablet_service.cc:1511] Processing CreateTablet for tablet a1f08f91d3c04d519b7853fa4a45224f (DEFAULT_TABLE table=default.Table_cedcabd0409548918b17ecd111b19cb0 [id=a246bfbb8cf543eca548190411c1673a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.516245 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1f08f91d3c04d519b7853fa4a45224f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:02.520855 9830 leader_election.cc:343] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:02.521652 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 52b79458b8494b1bb02068d43f6bad13 (DEFAULT_TABLE table=default.Table_9eed01c5d061435982b79e3888c256d5 [id=7843b8940ec249e89ac83682232964fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.522085 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52b79458b8494b1bb02068d43f6bad13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.524833 9907 tablet_service.cc:1511] Processing CreateTablet for tablet a1f08f91d3c04d519b7853fa4a45224f (DEFAULT_TABLE table=default.Table_cedcabd0409548918b17ecd111b19cb0 [id=a246bfbb8cf543eca548190411c1673a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.524989 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e2e810e459f24d0b9d348d428782a761" } new_table_name: "default.Table_27917e34d5674a908d7fc73083fd0926" modify_external_catalogs: true
I20260810 19:48:02.525424 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1f08f91d3c04d519b7853fa4a45224f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.529399 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 39cef8b64b424afe98942e821de57c4d (DEFAULT_TABLE table=default.Table_dcea63ce9a124c2dabf6301a371300ab [id=59a907240a784358b7dd0295df678306]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.529839 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39cef8b64b424afe98942e821de57c4d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:02.533298 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 69d677893a8648d9ba08e633bf320146 consensus state has no leader
I20260810 19:48:02.534811 9897 tablet_service.cc:1511] Processing CreateTablet for tablet 39cef8b64b424afe98942e821de57c4d (DEFAULT_TABLE table=default.Table_dcea63ce9a124c2dabf6301a371300ab [id=59a907240a784358b7dd0295df678306]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.535279 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39cef8b64b424afe98942e821de57c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.537492 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f7443dd3f2454ff39faa8eba8fbbb53c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:02.538144 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7443dd3f2454ff39faa8eba8fbbb53c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:02.541779 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_6d1b8db821cb42e987c905dc22630abc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:02.542479 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d1b8db821cb42e987c905dc22630abc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:02.549655 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 52b79458b8494b1bb02068d43f6bad13 (DEFAULT_TABLE table=default.Table_9eed01c5d061435982b79e3888c256d5 [id=7843b8940ec249e89ac83682232964fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.556169 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b0fbac9c2b634c38aad056086165f4ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:02.556839 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0fbac9c2b634c38aad056086165f4ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:02.577247 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52b79458b8494b1bb02068d43f6bad13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.597239 10377 ts_tablet_manager.cc:1929] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:02.598513 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet b737b216646a4c5baecb88d59bcce4df (table default.Table_98357f787dbf48958872d3de9003c202 [id=549322ede70c4efc91018201075b1a29]) successfully deleted
I20260810 19:48:02.599133 10367 ts_tablet_manager.cc:1434] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.181s user 0.001s sys 0.001s
I20260810 19:48:02.601290 10367 tablet_bootstrap.cc:492] T 0bddaf5b5fc1404e83b079ffa97e7321 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:02.603823 10367 tablet_bootstrap.cc:654] T 0bddaf5b5fc1404e83b079ffa97e7321 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:02.609724 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 8fe540ad2a384ccda2b53b54b5dc87a9 (DEFAULT_TABLE table=default.Table_affeb6f2001c49628a5c2877c1fb8327 [id=5221cf714d0444f6bcf5e7bc101c49d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.610226 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fe540ad2a384ccda2b53b54b5dc87a9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:02.611501 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 8565cd6fc9e34c5fbabba6e573df9939 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8565cd6fc9e34c5fbabba6e573df9939 already in progress: creating tablet
I20260810 19:48:02.612241 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 52b79458b8494b1bb02068d43f6bad13 (DEFAULT_TABLE table=default.Table_9eed01c5d061435982b79e3888c256d5 [id=7843b8940ec249e89ac83682232964fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.612711 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52b79458b8494b1bb02068d43f6bad13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.614640 10119 tablet_service.cc:1511] Processing CreateTablet for tablet c807d68fdcf04dc4b930c7cc4d3ca09a (DEFAULT_TABLE table=default.Table_9ba19e355042403b818268a2b837356d [id=735e4ce1a8ab429199907b3e0e048391]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.615046 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c807d68fdcf04dc4b930c7cc4d3ca09a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.618942 9657 tablet_service.cc:1511] Processing CreateTablet for tablet c0fc251932454c378f94cbfaa4955232 (DEFAULT_TABLE table=default.Table_78040083fb05410ab04cbefee43fa0b5 [id=22e4e79a261c47e29580e8a8c8bc2ff0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.619374 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0fc251932454c378f94cbfaa4955232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.620407 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 70d410e0e3e046d898e0d7017e79e881 (DEFAULT_TABLE table=default.Table_0c32faaf2cc249e5aeb42ca18ba243bd [id=e762299f82294152819b1559f5487717]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.620810 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70d410e0e3e046d898e0d7017e79e881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.626757 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 7d84ee2d39a64e7aa2ef066c2cbf30cf (DEFAULT_TABLE table=default.Table_94098d2314ef497c9b08deced9bed6ce [id=bd0842637a26403280986c64121652a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.627305 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d84ee2d39a64e7aa2ef066c2cbf30cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.630232 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5e6891ff4aa040be8b327aafa596bc7e" } new_table_name: "default.Table_c35ddec630d942db9ba85f10a2f405ee" modify_external_catalogs: true
I20260810 19:48:02.632531 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e0c0d0cef9e6465e8abfa449d39fe7bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:02.633224 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0c0d0cef9e6465e8abfa449d39fe7bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:02.633965 9416 catalog_manager.cc:5719] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:02.634517 9416 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 9a13b0f5b6b14bb9b72740a8521e4ea5 (table default.Table_0844c946c41146f38e51790cd8baed2a [id=4830b444314a4bb6a605cb73432e772f]). Expected version 1 got 0
I20260810 19:48:02.634625 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet dfea56a2d5d847058bcf4f508f0778a1
I20260810 19:48:02.634992 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6487065cb4a442eebc88bd267aede484" } modify_external_catalogs: true
I20260810 19:48:02.635185 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6487065cb4a442eebc88bd267aede484" } modify_external_catalogs: true
W20260810 19:48:02.635949 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e68916e2568f4527a181342cdc728001 consensus state has no leader
I20260810 19:48:02.637460 9415 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 410855f236004ad4b78839eb1c0c2f1f (table default.Table_44478e93cffb460aaa8df9115b799594 [id=1d363ce63686462f9f4c15669773ee22]). Expected version 1 got 0
I20260810 19:48:02.640543 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2127777800d84906905aac5e1b9eaf64" } modify_external_catalogs: true
I20260810 19:48:02.640792 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2127777800d84906905aac5e1b9eaf64" } modify_external_catalogs: true
I20260810 19:48:02.642510 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e8f8a641ccd242d79d69a56475e8d33c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:02.643175 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8f8a641ccd242d79d69a56475e8d33c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:02.644246 10370 tablet_bootstrap.cc:700] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0: Time spent opening tablet: real 0.273s user 0.001s sys 0.000s
I20260810 19:48:02.644625 10370 tablet_bootstrap.cc:654] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:02.647399 9894 tablet_service.cc:1558] Processing DeleteTablet for tablet dfea56a2d5d847058bcf4f508f0778a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:02.647928 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 70d410e0e3e046d898e0d7017e79e881 (DEFAULT_TABLE table=default.Table_0c32faaf2cc249e5aeb42ca18ba243bd [id=e762299f82294152819b1559f5487717]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.653460 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet dfea56a2d5d847058bcf4f508f0778a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:02.654790 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8c32f29153754352872be52763234ceb" } modify_external_catalogs: true
I20260810 19:48:02.655040 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8c32f29153754352872be52763234ceb" } modify_external_catalogs: true
I20260810 19:48:02.655295 9413 catalog_manager.cc:5719] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195). New cstate: current_term: 1 leader_uuid: "eadde59fd6504d679e47f03a60c64bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: HEALTHY } } }
I20260810 19:48:02.655652 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_28b63802a88349e8a32c912d60173a77" } modify_external_catalogs: true
I20260810 19:48:02.655757 9413 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 63b649cbc1d141d8bb438105b8e8537c (table default.Table_b059137abb0e458bbadca41a2f2e8b50 [id=9eaa5e14e854425e8971160c64ee97cf]). Expected version 1 got 0
I20260810 19:48:02.655841 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_28b63802a88349e8a32c912d60173a77" } modify_external_catalogs: true
I20260810 19:48:02.658550 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 7d84ee2d39a64e7aa2ef066c2cbf30cf (DEFAULT_TABLE table=default.Table_94098d2314ef497c9b08deced9bed6ce [id=bd0842637a26403280986c64121652a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.658983 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 7d84ee2d39a64e7aa2ef066c2cbf30cf (DEFAULT_TABLE table=default.Table_94098d2314ef497c9b08deced9bed6ce [id=bd0842637a26403280986c64121652a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.659502 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d84ee2d39a64e7aa2ef066c2cbf30cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.660141 9894 tablet_service.cc:1511] Processing CreateTablet for tablet dfe9393e0e904718ae2d7bec70d0350b (DEFAULT_TABLE table=default.Table_829e0547546046f086c33c6c3b66fd3f [id=7b48278aedfe473aa4f51fb93e52e991]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.665743 12012 raft_consensus.cc:493] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:02.665912 12012 raft_consensus.cc:515] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.666637 12012 leader_election.cc:290] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:02.667467 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 39cef8b64b424afe98942e821de57c4d (DEFAULT_TABLE table=default.Table_dcea63ce9a124c2dabf6301a371300ab [id=59a907240a784358b7dd0295df678306]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.667487 10162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320e42f6de6c4452adb7bbb379a156e6" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:02.667925 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39cef8b64b424afe98942e821de57c4d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:02.668238 9611 leader_election.cc:343] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:02.670940 9688 tablet_service.cc:1511] Processing CreateTablet for tablet a1f08f91d3c04d519b7853fa4a45224f (DEFAULT_TABLE table=default.Table_cedcabd0409548918b17ecd111b19cb0 [id=a246bfbb8cf543eca548190411c1673a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.671501 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1f08f91d3c04d519b7853fa4a45224f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.674273 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_39afeeb5729c4dc8827566b36b0dbc1f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:02.674960 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39afeeb5729c4dc8827566b36b0dbc1f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:02.677145 9684 tablet_service.cc:1511] Processing CreateTablet for tablet c807d68fdcf04dc4b930c7cc4d3ca09a (DEFAULT_TABLE table=default.Table_9ba19e355042403b818268a2b837356d [id=735e4ce1a8ab429199907b3e0e048391]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.677595 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c807d68fdcf04dc4b930c7cc4d3ca09a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.680943 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ba3deeffd39e4301b64f879eac93ca7e" } new_table_name: "default.Table_b15450030540496a8b6e252f5f57722c" modify_external_catalogs: true
I20260810 19:48:02.683113 9902 tablet_service.cc:1511] Processing CreateTablet for tablet cd05a86e7ccd40afbfb10cb8dfe53e78 (DEFAULT_TABLE table=default.Table_3606999c99584eadb5b437323d900d9d [id=d84351fee651442aaed09c883c7d876e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.685348 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 8fe540ad2a384ccda2b53b54b5dc87a9 (DEFAULT_TABLE table=default.Table_affeb6f2001c49628a5c2877c1fb8327 [id=5221cf714d0444f6bcf5e7bc101c49d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.685974 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fe540ad2a384ccda2b53b54b5dc87a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.686596 9898 tablet_service.cc:1511] Processing CreateTablet for tablet c807d68fdcf04dc4b930c7cc4d3ca09a (DEFAULT_TABLE table=default.Table_9ba19e355042403b818268a2b837356d [id=735e4ce1a8ab429199907b3e0e048391]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.687063 9897 tablet_service.cc:1511] Processing CreateTablet for tablet 8fe540ad2a384ccda2b53b54b5dc87a9 (DEFAULT_TABLE table=default.Table_affeb6f2001c49628a5c2877c1fb8327 [id=5221cf714d0444f6bcf5e7bc101c49d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.691689 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_128b093f25d14ca588d1d03d416825fc" } new_table_name: "default.Table_3fb4a80c47304a3e815594625c44c7a1" modify_external_catalogs: true
I20260810 19:48:02.695062 10370 tablet_bootstrap.cc:492] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:02.695235 10370 ts_tablet_manager.cc:1403] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.326s user 0.003s sys 0.000s
I20260810 19:48:02.696051 10370 raft_consensus.cc:359] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.696262 10370 raft_consensus.cc:385] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:02.696321 10370 raft_consensus.cc:740] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:02.696385 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 21501544326e49cdb02e42cdbaaa0287 (DEFAULT_TABLE table=default.Table_57ec87a309e04d7885f0e1f479dcf1d1 [id=dc084a14881a4b59a66e1cd9d51824a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.696705 10119 tablet_service.cc:1511] Processing CreateTablet for tablet dfe9393e0e904718ae2d7bec70d0350b (DEFAULT_TABLE table=default.Table_829e0547546046f086c33c6c3b66fd3f [id=7b48278aedfe473aa4f51fb93e52e991]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.696609 10370 consensus_queue.cc:260] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.697125 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfe9393e0e904718ae2d7bec70d0350b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.698523 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320e42f6de6c4452adb7bbb379a156e6" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:02.699234 9611 leader_election.cc:343] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:02.699373 9611 leader_election.cc:304] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:02.699841 12012 raft_consensus.cc:2749] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:02.702831 9885 tablet_service.cc:1511] Processing CreateTablet for tablet 5b56fb5bed4b46a2a1fc0ab22379760b (DEFAULT_TABLE table=default.Table_4fb96dbc73be4091855b1cbbed3b9ce6 [id=c72c64a09f73486abc4b2c6a72271d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.704855 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70d410e0e3e046d898e0d7017e79e881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.705173 10375 ts_tablet_manager.cc:1929] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:02.705296 10375 log.cc:1199] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/08e29e23d54f47968a06be98b313918d
I20260810 19:48:02.705614 10375 ts_tablet_manager.cc:1950] T 08e29e23d54f47968a06be98b313918d P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:02.706588 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 630) took 1043 ms. Trace:
I20260810 19:48:02.707535 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet dfea56a2d5d847058bcf4f508f0778a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:02.708732 9687 tablet_service.cc:1511] Processing CreateTablet for tablet dfe9393e0e904718ae2d7bec70d0350b (DEFAULT_TABLE table=default.Table_829e0547546046f086c33c6c3b66fd3f [id=7b48278aedfe473aa4f51fb93e52e991]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.709197 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfe9393e0e904718ae2d7bec70d0350b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.711968 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c807d68fdcf04dc4b930c7cc4d3ca09a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.712731 11982 raft_consensus.cc:493] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:02.712863 11982 raft_consensus.cc:515] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.713552 11982 leader_election.cc:290] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:02.714290 10162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476e762e46c04ae6bfef5e14df2d16e2" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:02.714967 9830 leader_election.cc:343] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:02.717113 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 09f09289a4c84e25b84c10abef3799c3 (DEFAULT_TABLE table=default.Table_a02e997e3ddd4efeaded0aeef335a1bf [id=72d1105a465249a3a96172107218164b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.717221 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 21501544326e49cdb02e42cdbaaa0287 (DEFAULT_TABLE table=default.Table_57ec87a309e04d7885f0e1f479dcf1d1 [id=dc084a14881a4b59a66e1cd9d51824a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.717604 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f09289a4c84e25b84c10abef3799c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.717669 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21501544326e49cdb02e42cdbaaa0287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.719198 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 5aa0f24443a34714a44137a77c12bbc3
I20260810 19:48:02.720029 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c72aea77b3334c4a9e7920c3d64f53db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:02.720656 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c72aea77b3334c4a9e7920c3d64f53db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:02.722602 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aa0f24443a34714a44137a77c12bbc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:02.726590 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aa0f24443a34714a44137a77c12bbc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:02.730336 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 5b56fb5bed4b46a2a1fc0ab22379760b (DEFAULT_TABLE table=default.Table_4fb96dbc73be4091855b1cbbed3b9ce6 [id=c72c64a09f73486abc4b2c6a72271d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.730878 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b56fb5bed4b46a2a1fc0ab22379760b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:02.730903 9831 leader_election.cc:343] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 476e762e46c04ae6bfef5e14df2d16e2
I20260810 19:48:02.731069 9831 leader_election.cc:304] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:02.731515 11982 raft_consensus.cc:2749] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:02.732159 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 70d410e0e3e046d898e0d7017e79e881 (DEFAULT_TABLE table=default.Table_0c32faaf2cc249e5aeb42ca18ba243bd [id=e762299f82294152819b1559f5487717]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.732616 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70d410e0e3e046d898e0d7017e79e881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.732789 10125 tablet_service.cc:1511] Processing CreateTablet for tablet cd05a86e7ccd40afbfb10cb8dfe53e78 (DEFAULT_TABLE table=default.Table_3606999c99584eadb5b437323d900d9d [id=d84351fee651442aaed09c883c7d876e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.733289 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd05a86e7ccd40afbfb10cb8dfe53e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.737181 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1a90c42d93434c0ab29e50e010af4212" } new_table_name: "default.Table_41357f4dd0244d5f9850412683272914" modify_external_catalogs: true
I20260810 19:48:02.738723 9687 tablet_service.cc:1511] Processing CreateTablet for tablet cd05a86e7ccd40afbfb10cb8dfe53e78 (DEFAULT_TABLE table=default.Table_3606999c99584eadb5b437323d900d9d [id=d84351fee651442aaed09c883c7d876e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.739048 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd05a86e7ccd40afbfb10cb8dfe53e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.739313 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd05a86e7ccd40afbfb10cb8dfe53e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.739694 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet ea557438b7b74944b19e17d7fb8f20cf
I20260810 19:48:02.742573 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21501544326e49cdb02e42cdbaaa0287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.743384 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet ea557438b7b74944b19e17d7fb8f20cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:02.745814 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 09f09289a4c84e25b84c10abef3799c3 (DEFAULT_TABLE table=default.Table_a02e997e3ddd4efeaded0aeef335a1bf [id=72d1105a465249a3a96172107218164b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.746213 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f09289a4c84e25b84c10abef3799c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.746546 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfe9393e0e904718ae2d7bec70d0350b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.748050 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 09f09289a4c84e25b84c10abef3799c3 (DEFAULT_TABLE table=default.Table_a02e997e3ddd4efeaded0aeef335a1bf [id=72d1105a465249a3a96172107218164b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.748485 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f09289a4c84e25b84c10abef3799c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.750252 9885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b56fb5bed4b46a2a1fc0ab22379760b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.754948 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_606cc67677224ea4a2fde51ff7f01e28"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:02.755628 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_606cc67677224ea4a2fde51ff7f01e28 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:02.755823 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 5b56fb5bed4b46a2a1fc0ab22379760b (DEFAULT_TABLE table=default.Table_4fb96dbc73be4091855b1cbbed3b9ce6 [id=c72c64a09f73486abc4b2c6a72271d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.756284 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b56fb5bed4b46a2a1fc0ab22379760b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.758759 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 30131d59f3504ea9ad69586ce90b39ad (DEFAULT_TABLE table=default.Table_6c986245c9bc47b5a094b5f4fa6d1536 [id=ee09d4f232354c1aa9d9748b2220251d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.759526 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30131d59f3504ea9ad69586ce90b39ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.760461 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d84ee2d39a64e7aa2ef066c2cbf30cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.762017 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 30131d59f3504ea9ad69586ce90b39ad (DEFAULT_TABLE table=default.Table_6c986245c9bc47b5a094b5f4fa6d1536 [id=ee09d4f232354c1aa9d9748b2220251d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.597522 10377 log.cc:1199] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/08e29e23d54f47968a06be98b313918d
I20260810 19:48:02.762434 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30131d59f3504ea9ad69586ce90b39ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.762893 10377 ts_tablet_manager.cc:1950] T 08e29e23d54f47968a06be98b313918d P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:02.764556 10130 tablet_service.cc:1511] Processing CreateTablet for tablet fb7364664adb424384f6b646d9e423eb (DEFAULT_TABLE table=default.Table_060004eaa4fb4077ace7321f74ecb48a [id=abe0523384d845d2a197ac4f0dd82065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.765004 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7364664adb424384f6b646d9e423eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.766141 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fe540ad2a384ccda2b53b54b5dc87a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.773818 9413 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet bc753970b2464e38b03e377551276343 (table default.Table_87ca145e91d149a68ef630e3a29795b4 [id=fd9deda7275b423b9f9c85aa22dde728]). Expected version 2 got 0
I20260810 19:48:02.776494 9913 tablet_service.cc:1511] Processing CreateTablet for tablet fb7364664adb424384f6b646d9e423eb (DEFAULT_TABLE table=default.Table_060004eaa4fb4077ace7321f74ecb48a [id=abe0523384d845d2a197ac4f0dd82065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.776916 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7364664adb424384f6b646d9e423eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.781556 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 8e0b02a3642a4e9b80a6069277a6b9f0 (DEFAULT_TABLE table=default.Table_07ad1f3e542846cebb4730066182432d [id=3bdd7cd9de7e4562a237268d5b80f3d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.781746 10367 tablet_bootstrap.cc:492] T 0bddaf5b5fc1404e83b079ffa97e7321 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:02.781888 10367 ts_tablet_manager.cc:1403] T 0bddaf5b5fc1404e83b079ffa97e7321 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.181s user 0.003s sys 0.000s
I20260810 19:48:02.782006 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e0b02a3642a4e9b80a6069277a6b9f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.785100 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 21208dd824fe432fa307cbb88d37aaa2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:02.785877 10370 ts_tablet_manager.cc:1434] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.091s user 0.002s sys 0.001s
I20260810 19:48:02.786963 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet ea557438b7b74944b19e17d7fb8f20cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:02.789213 10370 tablet_bootstrap.cc:492] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:02.790891 10370 tablet_bootstrap.cc:654] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:02.793229 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet ea942d54b4664ea48a13b6c85118cf6c
I20260810 19:48:02.796825 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet ea942d54b4664ea48a13b6c85118cf6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:02.797410 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 8e0b02a3642a4e9b80a6069277a6b9f0 (DEFAULT_TABLE table=default.Table_07ad1f3e542846cebb4730066182432d [id=3bdd7cd9de7e4562a237268d5b80f3d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.798197 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e0b02a3642a4e9b80a6069277a6b9f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.800139 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 2a1b1877c8bf4515a1c1f8c693bdae8e
I20260810 19:48:02.802019 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a1b1877c8bf4515a1c1f8c693bdae8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:02.802857 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a1b1877c8bf4515a1c1f8c693bdae8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:02.803176 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet ea942d54b4664ea48a13b6c85118cf6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:02.803715 10135 tablet_service.cc:1511] Processing CreateTablet for tablet abfa81d2eb2548d0b1688e23240f6d3a (DEFAULT_TABLE table=default.Table_80796e0b2a8c4bc69e7778f5c8625e71 [id=a30f767305b5447bb140ecfcc56a6ca1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.804230 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abfa81d2eb2548d0b1688e23240f6d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.805474 11982 consensus_queue.cc:1048] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:02.807088 9895 tablet_service.cc:1511] Processing CreateTablet for tablet abfa81d2eb2548d0b1688e23240f6d3a (DEFAULT_TABLE table=default.Table_80796e0b2a8c4bc69e7778f5c8625e71 [id=a30f767305b5447bb140ecfcc56a6ca1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.807639 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abfa81d2eb2548d0b1688e23240f6d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.811671 9421 master_service.cc:960] ReplaceTablet: received request to replace tablet 240b2ae8a1484de998d3ea972bc74cfe from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:02.812731 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 654) took 1056 ms. Trace:
I20260810 19:48:02.812907 10377 rpcz_store.cc:276] 0810 19:48:01.756620 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:01.756700 (+ 80us) service_pool.cc:224] Handling call
0810 19:48:02.291553 (+534853us) ts_tablet_manager.cc:1151] Deleting tablet 08e29e23d54f47968a06be98b313918d
0810 19:48:02.291568 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:02.338835 (+ 47267us) spinlock_profiling.cc:243] Waited 46.4 ms on lock 0x6160000a4e54. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd473022780 00007fd4743a9023 00007fd476f6ec67 00007fd476fa1d34 00007fd476f82750 00007fd476f824dd 0000000000aaf86c 00007fd466f6784f 00007fd466f6ab4b 00007fd466f6a9c8
0810 19:48:02.482464 (+143629us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:02.597153 (+114689us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:02.812711 (+215558us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106655104,"tablet-delete.queue_time_us":534605}
I20260810 19:48:02.813522 10377 tablet_replica.cc:333] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:02.818581 10377 raft_consensus.cc:2243] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:02.823633 10377 pending_rounds.cc:70] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691: Trying to abort 1 pending ops.
I20260810 19:48:02.826932 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 08e29e23d54f47968a06be98b313918d (table default.Table_688c01e53a344393b3471974bad3b972 [id=7112ce97719c47919a3d24d1af7d07cd]) successfully deleted
I20260810 19:48:02.827093 10377 pending_rounds.cc:77] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058690779222016 op_type: NO_OP noop_request { }
I20260810 19:48:02.827210 10377 raft_consensus.cc:2889] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:02.827310 10377 raft_consensus.cc:2272] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:02.832136 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 21501544326e49cdb02e42cdbaaa0287 (DEFAULT_TABLE table=default.Table_57ec87a309e04d7885f0e1f479dcf1d1 [id=dc084a14881a4b59a66e1cd9d51824a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.832489 10366 tablet_bootstrap.cc:492] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:02.832583 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21501544326e49cdb02e42cdbaaa0287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.832703 10366 ts_tablet_manager.cc:1403] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.353s user 0.002s sys 0.010s
I20260810 19:48:02.833542 10366 raft_consensus.cc:359] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.833756 10366 raft_consensus.cc:385] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:02.833824 10366 raft_consensus.cc:740] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:02.834069 10366 consensus_queue.cc:260] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.837500 10366 ts_tablet_manager.cc:1434] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260810 19:48:02.844239 9415 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 7d93fd6556b146ca8933a6dc0a2357e8 (table default.Table_908acdc21674469e937e4539876e0267 [id=de4d62ebb8c440a1a71ed57ac4f3c530]). Expected version 1 got 0
I20260810 19:48:02.850287 10377 ts_tablet_manager.cc:1916] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:02.706687 10375 rpcz_store.cc:276] 0810 19:48:01.663271 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:01.663379 (+ 108us) service_pool.cc:224] Handling call
0810 19:48:02.326869 (+663490us) ts_tablet_manager.cc:1151] Deleting tablet 08e29e23d54f47968a06be98b313918d
0810 19:48:02.348113 (+ 21244us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:02.593547 (+245434us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:02.705095 (+111548us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:02.706558 (+ 1463us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":632379}
I20260810 19:48:02.855962 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 2892d9fcdda34167a532dde7ed398590 (DEFAULT_TABLE table=default.Table_aa5df7d93dfb4603b493ab5638468a59 [id=fadd6b8bf2244dfab48fdadb0d12b6fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.856168 10375 tablet_replica.cc:333] T 3f18c24b01384299a4f941d7fb840032 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:02.856415 10375 raft_consensus.cc:2243] T 3f18c24b01384299a4f941d7fb840032 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:02.856351 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 08e29e23d54f47968a06be98b313918d (table default.Table_688c01e53a344393b3471974bad3b972 [id=7112ce97719c47919a3d24d1af7d07cd]) successfully deleted
I20260810 19:48:02.856619 10375 raft_consensus.cc:2272] T 3f18c24b01384299a4f941d7fb840032 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:02.856634 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3cc3af793cf64766bec613e04b146619"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:02.857306 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3cc3af793cf64766bec613e04b146619 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:02.857450 10375 ts_tablet_manager.cc:1916] T 3f18c24b01384299a4f941d7fb840032 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:02.859114 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1383f4d1e0df4822a86bb643f3f1f6ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:02.859709 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1383f4d1e0df4822a86bb643f3f1f6ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:02.860553 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_183640cc5442498ebffedcc23416d8d1" } modify_external_catalogs: true
I20260810 19:48:02.860756 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_183640cc5442498ebffedcc23416d8d1" } modify_external_catalogs: true
I20260810 19:48:02.861212 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 30131d59f3504ea9ad69586ce90b39ad (DEFAULT_TABLE table=default.Table_6c986245c9bc47b5a094b5f4fa6d1536 [id=ee09d4f232354c1aa9d9748b2220251d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.861608 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aa0f24443a34714a44137a77c12bbc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:02.861827 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_401a35fefca043648cdea5f454f66840"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:02.862519 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_401a35fefca043648cdea5f454f66840 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:02.870699 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 08ac9ae9eceb42b3880c4f35556994c7 consensus state has no leader
I20260810 19:48:02.871944 12049 tablet.cc:1724] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:02.872653 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e750ff6052664ef696dccbd09d3ec5a6" } new_table_name: "default.Table_7050c55c82f44e458fec37fef674afea" modify_external_catalogs: true
I20260810 19:48:02.873982 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30131d59f3504ea9ad69586ce90b39ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.874279 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet ea557438b7b74944b19e17d7fb8f20cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:02.875231 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 8e0b02a3642a4e9b80a6069277a6b9f0 (DEFAULT_TABLE table=default.Table_07ad1f3e542846cebb4730066182432d [id=3bdd7cd9de7e4562a237268d5b80f3d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.875671 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e0b02a3642a4e9b80a6069277a6b9f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.876747 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 2892d9fcdda34167a532dde7ed398590 (DEFAULT_TABLE table=default.Table_aa5df7d93dfb4603b493ab5638468a59 [id=fadd6b8bf2244dfab48fdadb0d12b6fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.877214 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2892d9fcdda34167a532dde7ed398590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.863061 11982 raft_consensus.cc:493] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:02.882488 11982 raft_consensus.cc:515] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.883316 11982 leader_election.cc:290] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:02.866211 12048 tablet.cc:1724] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:02.884364 10162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fb544dff4eb4642b7e282657ae15d19" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:02.884819 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2892d9fcdda34167a532dde7ed398590. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:02.885166 9830 leader_election.cc:343] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:02.885970 9831 leader_election.cc:343] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 9fb544dff4eb4642b7e282657ae15d19
I20260810 19:48:02.886085 9831 leader_election.cc:304] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:02.886582 11982 raft_consensus.cc:2749] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:02.889616 10162 raft_consensus.cc:1275] T 4b2b0f2fc93647f3bc1d79b4132c3703 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Refusing update from remote peer 6986ed920dcb4af29a5eeeda6f671691: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 19:48:02.890497 11982 consensus_queue.cc:1048] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:02.897671 12056 tablet.cc:1724] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
W20260810 19:48:02.904743 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1bbd3fe2117c42058dc108b5dc18d560 consensus state has no leader
I20260810 19:48:02.906394 9420 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 4b2b0f2fc93647f3bc1d79b4132c3703 (table default.Table_d195688055bd4cfca1a9462585af71bc [id=64e1f507ae574ea6b7fa1627b8e7f4c3]). Expected version 4 got 0
I20260810 19:48:02.906733 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 2892d9fcdda34167a532dde7ed398590 (DEFAULT_TABLE table=default.Table_aa5df7d93dfb4603b493ab5638468a59 [id=fadd6b8bf2244dfab48fdadb0d12b6fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.906828 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 47c54793369048fc874522388d08d3da (DEFAULT_TABLE table=default.Table_9c7e78bf368c4d99bca05e9fc4dfcbda [id=df9ef32c15fd46caab42b0a0214afd64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.907183 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2892d9fcdda34167a532dde7ed398590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.907418 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47c54793369048fc874522388d08d3da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.907402 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e35d1c469f794eb490a2667f69056cd3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:02.912233 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_9afeebbc1716420c83267e59e7a7163c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:02.912937 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9afeebbc1716420c83267e59e7a7163c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:02.914228 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 240b2ae8a1484de998d3ea972bc74cfe
I20260810 19:48:02.915031 9421 catalog_manager.cc:6807] ReplaceTablet: tablet 240b2ae8a1484de998d3ea972bc74cfe deleted and replaced by tablet f46571d9b4d948d3938607ebef926c40
I20260810 19:48:02.915441 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7418b98ddb584a2888e186a1b7d50810" } new_table_name: "default.Table_0a12a994a3ff4ff8850e8c0d6c0e42ca" modify_external_catalogs: true
I20260810 19:48:02.916479 9668 tablet_service.cc:1511] Processing CreateTablet for tablet fb7364664adb424384f6b646d9e423eb (DEFAULT_TABLE table=default.Table_060004eaa4fb4077ace7321f74ecb48a [id=abe0523384d845d2a197ac4f0dd82065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.916977 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7364664adb424384f6b646d9e423eb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:02.918388 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e35d1c469f794eb490a2667f69056cd3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:02.922088 10068 consensus_peers.cc:597] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0d79ef93c5bf4ac9895e594198edb251. This is attempt 1: this message will repeat every 5th retry.
W20260810 19:48:02.922654 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 48fa5f075d2749dc80ad5594746d7564 consensus state has no leader
I20260810 19:48:02.923098 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_27da81f7dcd74970ba692cc8c2c54ba9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:02.923969 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_27da81f7dcd74970ba692cc8c2c54ba9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:02.924357 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet dfea56a2d5d847058bcf4f508f0778a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfea56a2d5d847058bcf4f508f0778a1 already in progress: creating tablet
W20260810 19:48:02.925822 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 5aa0f24443a34714a44137a77c12bbc3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5aa0f24443a34714a44137a77c12bbc3 already in progress: creating tablet
I20260810 19:48:02.926366 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 240b2ae8a1484de998d3ea972bc74cfe with delete_type TABLET_DATA_DELETED (replaced by tablet f46571d9b4d948d3938607ebef926c40) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:02.926542 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet ea557438b7b74944b19e17d7fb8f20cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea557438b7b74944b19e17d7fb8f20cf already in progress: creating tablet
I20260810 19:48:02.927927 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 69d677893a8648d9ba08e633bf320146 (DEFAULT_TABLE table=default.Table_303ea2994db64a769843d09c0252531b [id=8145c08ee6354dd3923c4c9d70b44c1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.928530 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69d677893a8648d9ba08e633bf320146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.935389 12012 raft_consensus.cc:493] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:02.935578 12012 raft_consensus.cc:515] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.936302 12012 leader_election.cc:290] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:02.937562 10164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410855f236004ad4b78839eb1c0c2f1f" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:02.937249 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410855f236004ad4b78839eb1c0c2f1f" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:02.938670 9611 leader_election.cc:343] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:02.939237 9611 leader_election.cc:343] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:02.939366 9611 leader_election.cc:304] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:02.940007 12012 raft_consensus.cc:2749] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:02.940627 10366 tablet_bootstrap.cc:492] T dfea147ef3904ab49375def065c6f328 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:02.940961 11518 raft_consensus.cc:493] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:02.941120 11518 raft_consensus.cc:515] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.941955 12057 tablet.cc:1724] T 4b2b0f2fc93647f3bc1d79b4132c3703 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260810 19:48:02.942665 11518 leader_election.cc:290] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:02.951357 10367 raft_consensus.cc:359] T 0bddaf5b5fc1404e83b079ffa97e7321 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.951555 10367 raft_consensus.cc:385] T 0bddaf5b5fc1404e83b079ffa97e7321 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:02.951614 10367 raft_consensus.cc:740] T 0bddaf5b5fc1404e83b079ffa97e7321 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:02.951627 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 47c54793369048fc874522388d08d3da (DEFAULT_TABLE table=default.Table_9c7e78bf368c4d99bca05e9fc4dfcbda [id=df9ef32c15fd46caab42b0a0214afd64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.951833 10367 consensus_queue.cc:260] T 0bddaf5b5fc1404e83b079ffa97e7321 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.952385 10367 ts_tablet_manager.cc:1434] T 0bddaf5b5fc1404e83b079ffa97e7321 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.170s user 0.002s sys 0.001s
I20260810 19:48:02.952709 10367 tablet_bootstrap.cc:492] T b5f30148b5c84f7cbdfabd0186611cc4 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:02.953656 9665 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a1b1877c8bf4515a1c1f8c693bdae8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:02.942299 10366 tablet_bootstrap.cc:654] T dfea147ef3904ab49375def065c6f328 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:02.955928 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 2a1b1877c8bf4515a1c1f8c693bdae8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a1b1877c8bf4515a1c1f8c693bdae8e already in progress: creating tablet
I20260810 19:48:02.942458 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 240b2ae8a1484de998d3ea972bc74cfe with delete_type TABLET_DATA_DELETED (replaced by tablet f46571d9b4d948d3938607ebef926c40) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:02.943398 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21208dd824fe432fa307cbb88d37aaa2" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:02.957823 9948 raft_consensus.cc:2468] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:02.958500 10067 leader_election.cc:304] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:02.961531 9657 tablet_service.cc:1511] Processing CreateTablet for tablet abfa81d2eb2548d0b1688e23240f6d3a (DEFAULT_TABLE table=default.Table_80796e0b2a8c4bc69e7778f5c8625e71 [id=a30f767305b5447bb140ecfcc56a6ca1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.962193 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abfa81d2eb2548d0b1688e23240f6d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.964082 11828 raft_consensus.cc:2804] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:02.964275 11828 raft_consensus.cc:493] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:02.964996 11828 raft_consensus.cc:3060] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:02.969609 11828 raft_consensus.cc:515] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.948447 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 47c54793369048fc874522388d08d3da (DEFAULT_TABLE table=default.Table_9c7e78bf368c4d99bca05e9fc4dfcbda [id=df9ef32c15fd46caab42b0a0214afd64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.975159 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47c54793369048fc874522388d08d3da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.942706 11897 raft_consensus.cc:493] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:02.978564 11897 raft_consensus.cc:515] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.979317 11897 leader_election.cc:290] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:02.980718 9831 leader_election.cc:343] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: d2c77a8ac1614bb286e4e168bcf999f3
I20260810 19:48:02.951164 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 69d677893a8648d9ba08e633bf320146 (DEFAULT_TABLE table=default.Table_303ea2994db64a769843d09c0252531b [id=8145c08ee6354dd3923c4c9d70b44c1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.981870 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69d677893a8648d9ba08e633bf320146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:02.982753 10366 tablet_bootstrap.cc:492] T dfea147ef3904ab49375def065c6f328 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:02.982962 10366 ts_tablet_manager.cc:1403] T dfea147ef3904ab49375def065c6f328 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.042s user 0.002s sys 0.001s
I20260810 19:48:02.983775 10366 raft_consensus.cc:359] T dfea147ef3904ab49375def065c6f328 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.984040 10366 raft_consensus.cc:385] T dfea147ef3904ab49375def065c6f328 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:02.984131 10366 raft_consensus.cc:740] T dfea147ef3904ab49375def065c6f328 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:02.984462 10366 consensus_queue.cc:260] T dfea147ef3904ab49375def065c6f328 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:02.985074 10366 ts_tablet_manager.cc:1434] T dfea147ef3904ab49375def065c6f328 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260810 19:48:02.985589 10366 tablet_bootstrap.cc:492] T 63b649cbc1d141d8bb438105b8e8537c P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:02.986393 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_949a9afb4edf45919e8e02945ab84d4b" } modify_external_catalogs: true
I20260810 19:48:02.986608 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_949a9afb4edf45919e8e02945ab84d4b" } modify_external_catalogs: true
I20260810 19:48:02.987252 10366 tablet_bootstrap.cc:654] T 63b649cbc1d141d8bb438105b8e8537c P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:03.000115 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet ea942d54b4664ea48a13b6c85118cf6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:03.015486 10367 tablet_bootstrap.cc:654] T b5f30148b5c84f7cbdfabd0186611cc4 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:03.017958 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b94c792bfc8b4c16b86e7127f8082af5" } modify_external_catalogs: true
W20260810 19:48:03.020730 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet ea942d54b4664ea48a13b6c85118cf6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea942d54b4664ea48a13b6c85118cf6c already in progress: creating tablet
I20260810 19:48:03.021848 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c6196382f3b94d9b97fe5fa8ee34dba7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:03.022266 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 065536e52b4a477a824ab0261168cbd3 consensus state has no leader
I20260810 19:48:03.022490 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 10dd7891d4d844fc8f7a8674ee57627f
I20260810 19:48:03.024051 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_03af1ed093464e9584fda04a56a9d164" } modify_external_catalogs: true
I20260810 19:48:03.019310 9418 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_c35ddec630d942db9ba85f10a2f405ee [id=fd840f00bdc5477aaad0b7fa114870dd] alter complete (version 2)
I20260810 19:48:03.027253 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_03af1ed093464e9584fda04a56a9d164" } modify_external_catalogs: true
I20260810 19:48:03.027701 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e3cc34ea975e4aba9c86b3ddd40060af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:03.028996 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e3cc34ea975e4aba9c86b3ddd40060af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:03.031605 11897 raft_consensus.cc:493] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:03.031755 11897 raft_consensus.cc:515] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.032294 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 10dd7891d4d844fc8f7a8674ee57627f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:03.032446 11897 leader_election.cc:290] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:03.033113 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d93fd6556b146ca8933a6dc0a2357e8" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:03.033356 9711 raft_consensus.cc:2468] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:03.033604 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b94c792bfc8b4c16b86e7127f8082af5" } modify_external_catalogs: true
I20260810 19:48:03.033883 9831 leader_election.cc:304] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:03.034178 11897 raft_consensus.cc:2804] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:03.034266 11897 raft_consensus.cc:493] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:03.034358 11897 raft_consensus.cc:3060] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:03.035915 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f1684a112499413eab2a008659bd34ab" } modify_external_catalogs: true
W20260810 19:48:03.036976 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6196382f3b94d9b97fe5fa8ee34dba7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:03.037240 11897 raft_consensus.cc:515] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.038437 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d93fd6556b146ca8933a6dc0a2357e8" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:03.038216 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f1684a112499413eab2a008659bd34ab" } modify_external_catalogs: true
I20260810 19:48:03.038632 9711 raft_consensus.cc:3060] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:03.041469 9711 raft_consensus.cc:2468] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:03.042094 9831 leader_election.cc:304] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:03.042469 11982 raft_consensus.cc:2804] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:03.044862 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 43770a764bd24d3f9ec60a02dca083dc
I20260810 19:48:03.046245 11897 leader_election.cc:290] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:03.046543 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 43770a764bd24d3f9ec60a02dca083dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:03.049841 9948 raft_consensus.cc:3060] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:03.054073 9948 raft_consensus.cc:1275] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Refusing update from remote peer eadde59fd6504d679e47f03a60c64bb0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 19:48:03.056780 9408 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_d195688055bd4cfca1a9462585af71bc [id=64e1f507ae574ea6b7fa1627b8e7f4c3] alter complete (version 4)
I20260810 19:48:03.057178 9407 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 4b2b0f2fc93647f3bc1d79b4132c3703 (table default.Table_d195688055bd4cfca1a9462585af71bc [id=64e1f507ae574ea6b7fa1627b8e7f4c3]). Expected version 4 got 0
I20260810 19:48:03.057286 11982 raft_consensus.cc:697] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:03.057516 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 814babd6ae4748109b6caf1af54c2733
I20260810 19:48:03.057587 11982 consensus_queue.cc:237] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.058450 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet b4b6b17ce3354600b2f7450c6e483c69
I20260810 19:48:03.060321 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet b4b6b17ce3354600b2f7450c6e483c69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:03.061371 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 814babd6ae4748109b6caf1af54c2733 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:03.063510 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 10dd7891d4d844fc8f7a8674ee57627f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:03.064880 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 240b2ae8a1484de998d3ea972bc74cfe with delete_type TABLET_DATA_DELETED (replaced by tablet f46571d9b4d948d3938607ebef926c40) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:03.072996 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_97bfd454a3b34fb6bccadb843d79f141" } new_table_name: "default.Table_bb5a9a9ebfd340fba882f6db00cf2dac" modify_external_catalogs: true
I20260810 19:48:03.074994 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 814babd6ae4748109b6caf1af54c2733 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:03.075654 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 43770a764bd24d3f9ec60a02dca083dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:03.081586 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 69d677893a8648d9ba08e633bf320146 (DEFAULT_TABLE table=default.Table_303ea2994db64a769843d09c0252531b [id=8145c08ee6354dd3923c4c9d70b44c1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.082226 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69d677893a8648d9ba08e633bf320146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.086124 10367 tablet_bootstrap.cc:492] T b5f30148b5c84f7cbdfabd0186611cc4 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:03.086370 10367 ts_tablet_manager.cc:1403] T b5f30148b5c84f7cbdfabd0186611cc4 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.134s user 0.008s sys 0.001s
I20260810 19:48:03.087486 10367 raft_consensus.cc:359] T b5f30148b5c84f7cbdfabd0186611cc4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.087755 10367 raft_consensus.cc:385] T b5f30148b5c84f7cbdfabd0186611cc4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:03.087868 10367 raft_consensus.cc:740] T b5f30148b5c84f7cbdfabd0186611cc4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:03.088138 10367 consensus_queue.cc:260] T b5f30148b5c84f7cbdfabd0186611cc4 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:03.091675 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c285518ed49d4ed68a6039f98db3b700 consensus state has no leader
I20260810 19:48:03.095511 12072 raft_consensus.cc:493] T dfea147ef3904ab49375def065c6f328 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:03.095675 12072 raft_consensus.cc:515] T dfea147ef3904ab49375def065c6f328 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.097414 12072 leader_election.cc:290] T dfea147ef3904ab49375def065c6f328 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:03.097455 9831 leader_election.cc:343] T dfea147ef3904ab49375def065c6f328 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: dfea147ef3904ab49375def065c6f328
I20260810 19:48:03.100236 9412 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 4b2b0f2fc93647f3bc1d79b4132c3703 (table default.Table_d195688055bd4cfca1a9462585af71bc [id=64e1f507ae574ea6b7fa1627b8e7f4c3]). Expected version 4 got 0
I20260810 19:48:03.102480 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bddaf5b5fc1404e83b079ffa97e7321 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:03.102871 10371 tablet_replica.cc:333] T 0bddaf5b5fc1404e83b079ffa97e7321 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:03.103067 10371 raft_consensus.cc:2243] T 0bddaf5b5fc1404e83b079ffa97e7321 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:03.103212 10371 raft_consensus.cc:2272] T 0bddaf5b5fc1404e83b079ffa97e7321 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:03.104404 10371 ts_tablet_manager.cc:1916] T 0bddaf5b5fc1404e83b079ffa97e7321 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:03.106812 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_fff297e0905545af8312917aed52cbc0" } new_table_name: "default.Table_4e1acd3ace89465287fb5819b364098e" modify_external_catalogs: true
I20260810 19:48:03.109361 12012 raft_consensus.cc:493] T db2b8038ee9747109b42510bba02faa9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:03.109509 12012 raft_consensus.cc:515] T db2b8038ee9747109b42510bba02faa9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.110154 12012 leader_election.cc:290] T db2b8038ee9747109b42510bba02faa9 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:03.111126 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db2b8038ee9747109b42510bba02faa9" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:03.111877 9611 leader_election.cc:343] T db2b8038ee9747109b42510bba02faa9 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:03.115058 10371 ts_tablet_manager.cc:1929] T 0bddaf5b5fc1404e83b079ffa97e7321 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:03.115249 10371 log.cc:1199] T 0bddaf5b5fc1404e83b079ffa97e7321 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/0bddaf5b5fc1404e83b079ffa97e7321
I20260810 19:48:03.115643 10371 ts_tablet_manager.cc:1950] T 0bddaf5b5fc1404e83b079ffa97e7321 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:03.116763 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet b4b6b17ce3354600b2f7450c6e483c69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:03.117617 12072 raft_consensus.cc:493] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:03.117794 12072 raft_consensus.cc:515] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.118160 10367 ts_tablet_manager.cc:1434] T b5f30148b5c84f7cbdfabd0186611cc4 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.031s user 0.002s sys 0.000s
I20260810 19:48:03.118583 12072 leader_election.cc:290] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:03.120604 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b722c43ee4b8698b19b2b6c1b401d" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:03.120688 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_148c29dbb35f4c50a6fb25d6461e613b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:03.120860 9715 raft_consensus.cc:2468] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:03.121261 9831 leader_election.cc:304] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
W20260810 19:48:03.121315 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_148c29dbb35f4c50a6fb25d6461e613b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:03.121541 12072 raft_consensus.cc:2804] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 19:48:03.121605 12072 raft_consensus.cc:493] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:03.121658 12072 raft_consensus.cc:3060] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Advancing to term 2
I20260810 19:48:03.124809 12072 raft_consensus.cc:515] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.125974 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b722c43ee4b8698b19b2b6c1b401d" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:03.126153 9711 raft_consensus.cc:3060] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Advancing to term 2
I20260810 19:48:03.128160 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c537ac5c113143f0b5d0d8ca769417af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:03.128777 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c537ac5c113143f0b5d0d8ca769417af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:03.129123 9711 raft_consensus.cc:2468] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 2.
I20260810 19:48:03.129787 9831 leader_election.cc:304] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:03.130223 11897 raft_consensus.cc:493] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:03.130365 11897 raft_consensus.cc:515] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.130218 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a3cddbf5a63a44a7ba3c412022b3a088" } new_table_name: "default.Table_3b5fc2bb35a448e8bbe8bef5a535e9c2" modify_external_catalogs: true
I20260810 19:48:03.130925 11897 leader_election.cc:290] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:03.131085 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a8963894d23348d3844ab5377762d249 consensus state has no leader
I20260810 19:48:03.131304 11897 raft_consensus.cc:2804] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 19:48:03.131404 11897 raft_consensus.cc:697] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 [term 2 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:03.131630 11897 consensus_queue.cc:237] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.137612 12072 leader_election.cc:290] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 2 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:03.147571 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet b5f30148b5c84f7cbdfabd0186611cc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:03.151564 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 8425f8c3258a41c291f9fa8dbd29fbc6 (DEFAULT_TABLE table=default.Table_606cc67677224ea4a2fde51ff7f01e28 [id=d3531ac9d6ae4f279869dbc3d8bb3aa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.152170 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8425f8c3258a41c291f9fa8dbd29fbc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.153517 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 08f78560ec9f465c94ef08fa2f067c0d
W20260810 19:48:03.158190 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 263a5695e7754b44a64edbda27b42135 consensus state has no leader
I20260810 19:48:03.159152 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 9f01a22232504d80a827e3d1ea0452a3 (DEFAULT_TABLE table=default.Table_6d1b8db821cb42e987c905dc22630abc [id=7bdfdb5f2ee7427389287f0bfda6a50c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.159699 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f01a22232504d80a827e3d1ea0452a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.163024 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21208dd824fe432fa307cbb88d37aaa2" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:03.163264 9948 raft_consensus.cc:3060] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:03.166643 9948 raft_consensus.cc:2468] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:03.167346 10067 leader_election.cc:304] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:03.167599 10134 tablet_service.cc:1511] Processing CreateTablet for tablet dbef3b19330d42779bf0a62ec742bfcb (DEFAULT_TABLE table=default.Table_e0c0d0cef9e6465e8abfa449d39fe7bc [id=815aba326e24410cadef0e060b427979]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.169103 10115 tablet_service.cc:1511] Processing CreateTablet for tablet 224bce6be88842c0a26df57326f34442 (DEFAULT_TABLE table=default.Table_f7443dd3f2454ff39faa8eba8fbbb53c [id=a759e03a91744db9b9c7294728094d7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.998178 10370 tablet_bootstrap.cc:492] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:03.171022 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 75228e6dbe14460ab1280b1951b26c83 (DEFAULT_TABLE table=default.Table_b21befc85a6646199611d93c23783d4e [id=e1b0cc30e09a46f8a7ba98b88fac047f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.171156 10370 ts_tablet_manager.cc:1403] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.382s user 0.004s sys 0.000s
I20260810 19:48:03.171679 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 17a0745b87a24e3ca0e3e32c2059f422 (DEFAULT_TABLE table=default.Table_51ca1bcf8aa844e8a0e7d1647c932d94 [id=063e64ec4fde41f8803eec6ee0de7991]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:02.999539 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47c54793369048fc874522388d08d3da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.172631 10370 raft_consensus.cc:359] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.172869 10370 raft_consensus.cc:385] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:03.172950 10370 raft_consensus.cc:740] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
W20260810 19:48:03.009786 10068 leader_election.cc:343] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 21208dd824fe432fa307cbb88d37aaa2
W20260810 19:48:03.174602 10068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 164794us
I20260810 19:48:02.997900 10162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2c77a8ac1614bb286e4e168bcf999f3" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:03.036829 10144 tablet_service.cc:1558] Processing DeleteTablet for tablet 10dd7891d4d844fc8f7a8674ee57627f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:03.175989 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a0745b87a24e3ca0e3e32c2059f422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.173209 10370 consensus_queue.cc:260] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.178489 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75228e6dbe14460ab1280b1951b26c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.183218 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 224bce6be88842c0a26df57326f34442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.160899 10371 tablet_replica.cc:333] T b5f30148b5c84f7cbdfabd0186611cc4 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:03.187091 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbef3b19330d42779bf0a62ec742bfcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.190517 12012 raft_consensus.cc:493] T b5f30148b5c84f7cbdfabd0186611cc4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:03.190677 12012 raft_consensus.cc:515] T b5f30148b5c84f7cbdfabd0186611cc4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.191401 12012 leader_election.cc:290] T b5f30148b5c84f7cbdfabd0186611cc4 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:03.191432 10371 raft_consensus.cc:2243] T b5f30148b5c84f7cbdfabd0186611cc4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:03.191624 10371 raft_consensus.cc:2272] T b5f30148b5c84f7cbdfabd0186611cc4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:03.161530 10367 tablet_bootstrap.cc:492] T 2b2b20dc77954af7a203f357c746be29 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:03.181546 9673 tablet_service.cc:1558] Processing DeleteTablet for tablet 08f78560ec9f465c94ef08fa2f067c0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:03.193373 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2a7c2c5438234c09ad58a7dc12a13613"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:03.193805 10367 tablet_bootstrap.cc:654] T 2b2b20dc77954af7a203f357c746be29 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:03.193998 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a7c2c5438234c09ad58a7dc12a13613 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:03.183957 9709 raft_consensus.cc:1240] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 2 FOLLOWER]: Rejecting Update request from peer eadde59fd6504d679e47f03a60c64bb0 for earlier term 1. Current term is 2. Ops: []
I20260810 19:48:03.198596 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 3b9f29803809462a9b8b64b03eed040b (DEFAULT_TABLE table=default.Table_25a140564d68481997cc263696b5b066 [id=a26a684a401e43ff99d4cf57dcd3b205]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.199101 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b9f29803809462a9b8b64b03eed040b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.199419 10118 tablet_service.cc:1511] Processing CreateTablet for tablet ad604cd863f74e62b91ed532b48ded9f (DEFAULT_TABLE table=default.Table_d98c0b1af3954d4787fb09b4e7b0ffa0 [id=f0ef2246b3b54605aef3600b65df17ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.199855 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad604cd863f74e62b91ed532b48ded9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.201609 10140 tablet_service.cc:1511] Processing CreateTablet for tablet 1b45327bb5e7421983682deec45bd275 (DEFAULT_TABLE table=default.Table_0b9123d6d35944a296693b52e14428ad [id=e16c505195d442ce8aaf4036e4691d07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.060958 10127 tablet_service.cc:1558] Processing DeleteTablet for tablet b4b6b17ce3354600b2f7450c6e483c69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:03.202056 10377 ts_tablet_manager.cc:1929] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:03.202168 10377 log.cc:1199] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/a5625dc6303d44c6be28abd6278ce034
I20260810 19:48:03.202620 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b45327bb5e7421983682deec45bd275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.203199 11541 rpc_server.cc:307] RPC server started. Bound to: 127.8.235.253:37397
I20260810 19:48:03.206970 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_392e7373fd11463b851f18bc44b44450"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:03.203199 12081 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.235.253:37397 every 8 connection(s)
W20260810 19:48:03.207628 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_392e7373fd11463b851f18bc44b44450 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:03.212231 10371 ts_tablet_manager.cc:1916] T b5f30148b5c84f7cbdfabd0186611cc4 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:03.214542 10120 tablet_service.cc:1511] Processing CreateTablet for tablet 96d1380e23494bbabdad11067159ed79 (DEFAULT_TABLE table=default.Table_87b726ec1327405d86e7c849c488b960 [id=1147184e49a745cb9e7b68225628caef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.215162 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96d1380e23494bbabdad11067159ed79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.215886 10144 tablet_service.cc:1511] Processing CreateTablet for tablet e5f29e86e0854efd9987305e26d7361a (DEFAULT_TABLE table=default.Table_0b2d770d94e74c88bd7d0d7a9ab88982 [id=7041f74e7fc74100b06e353c2009a51a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:03.216459 9400 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 08ac9ae9eceb42b3880c4f35556994c7 (table default.Table_b15450030540496a8b6e252f5f57722c [id=fd632e7e6cd4416d992f41a2681f4c6a], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 08ac9ae9eceb42b3880c4f35556994c7 consensus state has no leader
I20260810 19:48:03.227486 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_14a3eacb9f0740e2bea3ccaf3ce9fc7f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:03.227839 10366 tablet_bootstrap.cc:492] T 63b649cbc1d141d8bb438105b8e8537c P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:03.228004 10366 ts_tablet_manager.cc:1403] T 63b649cbc1d141d8bb438105b8e8537c P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.242s user 0.014s sys 0.040s
I20260810 19:48:03.228209 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_723332106bc5409c8c0a3201c9e8d99e" } new_table_name: "default.Table_908340b735984b7db22ce5c7ce794987" modify_external_catalogs: true
I20260810 19:48:03.228375 9413 master_service.cc:960] ReplaceTablet: received request to replace tablet 8fce298689e9415a8860b8734d73b10a from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:03.228791 10366 raft_consensus.cc:359] T 63b649cbc1d141d8bb438105b8e8537c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.228961 10366 raft_consensus.cc:385] T 63b649cbc1d141d8bb438105b8e8537c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:03.229008 10366 raft_consensus.cc:740] T 63b649cbc1d141d8bb438105b8e8537c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:03.229090 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_8a06d915fdaa4924b0d1a8f2284e9a05"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:03.229246 10366 consensus_queue.cc:260] T 63b649cbc1d141d8bb438105b8e8537c P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:03.229640 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a06d915fdaa4924b0d1a8f2284e9a05 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:03.229913 10366 ts_tablet_manager.cc:1434] T 63b649cbc1d141d8bb438105b8e8537c P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:03.230211 10366 tablet_bootstrap.cc:492] T 965395b5072e4d47adac504e22a8d484 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:03.231695 12085 tablet.cc:1724] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260810 19:48:03.232168 10366 tablet_bootstrap.cc:654] T 965395b5072e4d47adac504e22a8d484 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:03.228219 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_14a3eacb9f0740e2bea3ccaf3ce9fc7f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:03.234781 11541 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/data/info.pb
I20260810 19:48:03.235713 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ad03d1f368ae4d98b1c5c74343beb59e" } new_table_name: "default.Table_5f059e9b730d466a8e8e0437ac1edbe8" modify_external_catalogs: true
I20260810 19:48:03.237166 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e9c6cb527fc84784967198c5b3ae4294"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:03.237739 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9c6cb527fc84784967198c5b3ae4294 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:03.240026 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 53bb7e081b8747308d85ca933bb3528c (DEFAULT_TABLE table=default.Table_92ef15e1c6b640b6916580ccb7f93497 [id=2fe0006d4de7442db427f8ac83e7e9ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.240752 9135 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu as pid 11541
I20260810 19:48:03.240974 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2c45b8ef81f94485a39df1d41c96f9a6" } modify_external_catalogs: true
I20260810 19:48:03.241219 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2c45b8ef81f94485a39df1d41c96f9a6" } modify_external_catalogs: true
I20260810 19:48:03.242739 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53bb7e081b8747308d85ca933bb3528c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.244141 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_45012038df8f4e09bb6516ef3d7ed405"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:03.244841 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45012038df8f4e09bb6516ef3d7ed405 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:03.249358 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f90f1a0c22fa4781812518f44c9d7b17" } modify_external_catalogs: true
I20260810 19:48:03.249577 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f90f1a0c22fa4781812518f44c9d7b17" } modify_external_catalogs: true
W20260810 19:48:03.255543 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 10dd7891d4d844fc8f7a8674ee57627f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10dd7891d4d844fc8f7a8674ee57627f already in progress: creating tablet
W20260810 19:48:03.256237 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 240b2ae8a1484de998d3ea972bc74cfe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 240b2ae8a1484de998d3ea972bc74cfe already in progress: creating tablet
I20260810 19:48:03.061329 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 814babd6ae4748109b6caf1af54c2733 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:03.055219 11518 consensus_queue.cc:1048] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260810 19:48:03.094738 11974 raft_consensus.cc:493] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:03.139544 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 8425f8c3258a41c291f9fa8dbd29fbc6 (DEFAULT_TABLE table=default.Table_606cc67677224ea4a2fde51ff7f01e28 [id=d3531ac9d6ae4f279869dbc3d8bb3aa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.139935 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 9f01a22232504d80a827e3d1ea0452a3 (DEFAULT_TABLE table=default.Table_6d1b8db821cb42e987c905dc22630abc [id=7bdfdb5f2ee7427389287f0bfda6a50c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.154762 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 08f78560ec9f465c94ef08fa2f067c0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:03.160301 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 53bb7e081b8747308d85ca933bb3528c (DEFAULT_TABLE table=default.Table_92ef15e1c6b640b6916580ccb7f93497 [id=2fe0006d4de7442db427f8ac83e7e9ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.199033 10116 tablet_service.cc:1511] Processing CreateTablet for tablet 048a81d8dc7b42a39a9891d57fcd08b0 (DEFAULT_TABLE table=default.Table_8828e8ce833344fbbf4fa80b95fb29aa [id=411490129dd84beeaecdcaee33cd9ec4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.258612 10142 tablet_service.cc:1511] Processing CreateTablet for tablet 23234c7580b64b55b4e62ded19d187d9 (DEFAULT_TABLE table=default.Table_3c43fbb6bc7f4a38b470a011714cd243 [id=d81b865c7caf4f299a026ec42a23c752]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:03.258757 9831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 128986us
I20260810 19:48:03.259526 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5576e9087855441498904bc59685a442" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:03.259792 9711 raft_consensus.cc:2468] T 5576e9087855441498904bc59685a442 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:03.262956 9687 tablet_service.cc:1511] Processing CreateTablet for tablet dbef3b19330d42779bf0a62ec742bfcb (DEFAULT_TABLE table=default.Table_e0c0d0cef9e6465e8abfa449d39fe7bc [id=815aba326e24410cadef0e060b427979]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.263417 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbef3b19330d42779bf0a62ec742bfcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.267930 10124 tablet_service.cc:1511] Processing CreateTablet for tablet c01bde86f6d14c4db35f7211b84b7cb9 (DEFAULT_TABLE table=default.Table_b60a7be0965645f8be9d8b1e3ea458d2 [id=772a7fc6bfb54647bd3cf9e34bd258ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.268018 10127 tablet_service.cc:1511] Processing CreateTablet for tablet f88b19fe8f81408095cce388832da12c (DEFAULT_TABLE table=default.Table_0a4ab5dd136842c3afce85538dc0461b [id=30551371d46f4758abec98d7043552a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.267952 11518 raft_consensus.cc:2804] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:03.271186 9668 tablet_service.cc:1511] Processing CreateTablet for tablet 224bce6be88842c0a26df57326f34442 (DEFAULT_TABLE table=default.Table_f7443dd3f2454ff39faa8eba8fbbb53c [id=a759e03a91744db9b9c7294728094d7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.271695 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 224bce6be88842c0a26df57326f34442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.273672 10366 tablet_bootstrap.cc:492] T 965395b5072e4d47adac504e22a8d484 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:03.273815 10366 ts_tablet_manager.cc:1403] T 965395b5072e4d47adac504e22a8d484 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.000s
I20260810 19:48:03.274685 10366 raft_consensus.cc:359] T 965395b5072e4d47adac504e22a8d484 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.278963 10366 raft_consensus.cc:385] T 965395b5072e4d47adac504e22a8d484 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:03.279247 10366 raft_consensus.cc:740] T 965395b5072e4d47adac504e22a8d484 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
W20260810 19:48:03.282250 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 814babd6ae4748109b6caf1af54c2733 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 814babd6ae4748109b6caf1af54c2733 already in progress: creating tablet
I20260810 19:48:03.051299 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet 43770a764bd24d3f9ec60a02dca083dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:03.283836 10029 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:48:03.286576 10366 consensus_queue.cc:260] T 965395b5072e4d47adac504e22a8d484 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.286952 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 75228e6dbe14460ab1280b1951b26c83 (DEFAULT_TABLE table=default.Table_b21befc85a6646199611d93c23783d4e [id=e1b0cc30e09a46f8a7ba98b88fac047f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.287441 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75228e6dbe14460ab1280b1951b26c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.287699 10366 ts_tablet_manager.cc:1434] T 965395b5072e4d47adac504e22a8d484 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260810 19:48:03.288805 10366 tablet_bootstrap.cc:492] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
W20260810 19:48:03.290271 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 43770a764bd24d3f9ec60a02dca083dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43770a764bd24d3f9ec60a02dca083dc already in progress: creating tablet
I20260810 19:48:03.295313 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f30148b5c84f7cbdfabd0186611cc4" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:03.296566 11974 raft_consensus.cc:515] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.296887 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f29e86e0854efd9987305e26d7361a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.301323 9665 tablet_service.cc:1511] Processing CreateTablet for tablet 17a0745b87a24e3ca0e3e32c2059f422 (DEFAULT_TABLE table=default.Table_51ca1bcf8aa844e8a0e7d1647c932d94 [id=063e64ec4fde41f8803eec6ee0de7991]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.301761 12097 sys_catalog.cc:263] Verifying existing consensus state
I20260810 19:48:03.301806 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a0745b87a24e3ca0e3e32c2059f422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.295990 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 0bddaf5b5fc1404e83b079ffa97e7321 (table default.Table_5bdde0f42da34c6f99e8462d17affb30 [id=7c6a3df13ef44571a127a5ef2e73683a]) successfully deleted
I20260810 19:48:03.306671 12097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e: Bootstrap starting.
W20260810 19:48:03.325223 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet b4b6b17ce3354600b2f7450c6e483c69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4b6b17ce3354600b2f7450c6e483c69 already in progress: creating tablet
I20260810 19:48:03.327553 9665 tablet_service.cc:1511] Processing CreateTablet for tablet 3b9f29803809462a9b8b64b03eed040b (DEFAULT_TABLE table=default.Table_25a140564d68481997cc263696b5b066 [id=a26a684a401e43ff99d4cf57dcd3b205]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.328192 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b9f29803809462a9b8b64b03eed040b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.335952 9897 tablet_service.cc:1511] Processing CreateTablet for tablet dbef3b19330d42779bf0a62ec742bfcb (DEFAULT_TABLE table=default.Table_e0c0d0cef9e6465e8abfa449d39fe7bc [id=815aba326e24410cadef0e060b427979]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.335529 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 53bb7e081b8747308d85ca933bb3528c (DEFAULT_TABLE table=default.Table_92ef15e1c6b640b6916580ccb7f93497 [id=2fe0006d4de7442db427f8ac83e7e9ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.296146 9831 leader_election.cc:304] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:03.340207 9890 tablet_service.cc:1511] Processing CreateTablet for tablet f88b19fe8f81408095cce388832da12c (DEFAULT_TABLE table=default.Table_0a4ab5dd136842c3afce85538dc0461b [id=30551371d46f4758abec98d7043552a1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:03.340469 9831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 44387.2us
I20260810 19:48:03.334839 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 9f01a22232504d80a827e3d1ea0452a3 (DEFAULT_TABLE table=default.Table_6d1b8db821cb42e987c905dc22630abc [id=7bdfdb5f2ee7427389287f0bfda6a50c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.337242 9894 tablet_service.cc:1511] Processing CreateTablet for tablet 75228e6dbe14460ab1280b1951b26c83 (DEFAULT_TABLE table=default.Table_b21befc85a6646199611d93c23783d4e [id=e1b0cc30e09a46f8a7ba98b88fac047f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.338146 9902 tablet_service.cc:1511] Processing CreateTablet for tablet e5f29e86e0854efd9987305e26d7361a (DEFAULT_TABLE table=default.Table_0b2d770d94e74c88bd7d0d7a9ab88982 [id=7041f74e7fc74100b06e353c2009a51a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.337796 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 17a0745b87a24e3ca0e3e32c2059f422 (DEFAULT_TABLE table=default.Table_51ca1bcf8aa844e8a0e7d1647c932d94 [id=063e64ec4fde41f8803eec6ee0de7991]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.338892 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 96d1380e23494bbabdad11067159ed79 (DEFAULT_TABLE table=default.Table_87b726ec1327405d86e7c849c488b960 [id=1147184e49a745cb9e7b68225628caef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.338521 9885 tablet_service.cc:1511] Processing CreateTablet for tablet 3b9f29803809462a9b8b64b03eed040b (DEFAULT_TABLE table=default.Table_25a140564d68481997cc263696b5b066 [id=a26a684a401e43ff99d4cf57dcd3b205]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.339258 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 048a81d8dc7b42a39a9891d57fcd08b0 (DEFAULT_TABLE table=default.Table_8828e8ce833344fbbf4fa80b95fb29aa [id=411490129dd84beeaecdcaee33cd9ec4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.297199 10366 tablet_bootstrap.cc:654] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:03.339706 9896 tablet_service.cc:1511] Processing CreateTablet for tablet ad604cd863f74e62b91ed532b48ded9f (DEFAULT_TABLE table=default.Table_d98c0b1af3954d4787fb09b4e7b0ffa0 [id=f0ef2246b3b54605aef3600b65df17ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.339979 9908 tablet_service.cc:1511] Processing CreateTablet for tablet c01bde86f6d14c4db35f7211b84b7cb9 (DEFAULT_TABLE table=default.Table_b60a7be0965645f8be9d8b1e3ea458d2 [id=772a7fc6bfb54647bd3cf9e34bd258ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.337025 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 8425f8c3258a41c291f9fa8dbd29fbc6 (DEFAULT_TABLE table=default.Table_606cc67677224ea4a2fde51ff7f01e28 [id=d3531ac9d6ae4f279869dbc3d8bb3aa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.339968 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 1b45327bb5e7421983682deec45bd275 (DEFAULT_TABLE table=default.Table_0b9123d6d35944a296693b52e14428ad [id=e16c505195d442ce8aaf4036e4691d07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.335119 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet 08f78560ec9f465c94ef08fa2f067c0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:03.336647 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 224bce6be88842c0a26df57326f34442 (DEFAULT_TABLE table=default.Table_f7443dd3f2454ff39faa8eba8fbbb53c [id=a759e03a91744db9b9c7294728094d7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.340480 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbef3b19330d42779bf0a62ec742bfcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.343554 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f88b19fe8f81408095cce388832da12c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.343792 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c01bde86f6d14c4db35f7211b84b7cb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.343962 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96d1380e23494bbabdad11067159ed79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.344132 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad604cd863f74e62b91ed532b48ded9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.346436 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 048a81d8dc7b42a39a9891d57fcd08b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.350199 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75228e6dbe14460ab1280b1951b26c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.350580 9885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b9f29803809462a9b8b64b03eed040b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.354458 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f01a22232504d80a827e3d1ea0452a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.358450 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f29e86e0854efd9987305e26d7361a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:03.360178 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ac17aa6447f547a9b9a44449b283bb69 consensus state has no leader
I20260810 19:48:03.360668 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3fecec150df147d18964601662fde615"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:03.361310 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fecec150df147d18964601662fde615 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:03.362910 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1bdee0eb4a634cb2beba49dadea53106"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:03.363355 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9afeebbc1716420c83267e59e7a7163c" } modify_external_catalogs: true
W20260810 19:48:03.363513 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1bdee0eb4a634cb2beba49dadea53106 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:03.364871 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b9b567b3338845e4a37cff2a955056ae consensus state has no leader
I20260810 19:48:03.365279 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_606949bc090943c18541d6d8d7f908f9" } modify_external_catalogs: true
I20260810 19:48:03.365476 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_606949bc090943c18541d6d8d7f908f9" } modify_external_catalogs: true
I20260810 19:48:03.363534 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9afeebbc1716420c83267e59e7a7163c" } modify_external_catalogs: true
I20260810 19:48:03.368875 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f77071b80f324808b6401b4f8d20d2cb" } new_table_name: "default.Table_d9d83336ef124c2da242e77391b001c0" modify_external_catalogs: true
I20260810 19:48:03.340803 12086 raft_consensus.cc:2804] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:03.369258 12086 raft_consensus.cc:493] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:03.369414 12086 raft_consensus.cc:3060] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:03.370437 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_da9cdd42af6a42868f3bae64af56f4b1" } new_table_name: "default.Table_d09067447a0645309dfc5b96dea77272" modify_external_catalogs: true
I20260810 19:48:03.371265 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet e87fd882e6b6413480a0cb06aee74722
I20260810 19:48:03.371518 9906 tablet_service.cc:1511] Processing CreateTablet for tablet aaaeafe4afb8454baf2e141a00da8ee3 (DEFAULT_TABLE table=default.Table_3609f114cc2e412dac61baf2f59e9307 [id=a0c4c001152e48a59a1c1db40e92cbdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.372128 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c58aa77863ae41f0a21a0f72876862f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:03.372295 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaaeafe4afb8454baf2e141a00da8ee3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:03.372713 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c58aa77863ae41f0a21a0f72876862f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:03.378731 9894 tablet_service.cc:1511] Processing CreateTablet for tablet 23234c7580b64b55b4e62ded19d187d9 (DEFAULT_TABLE table=default.Table_3c43fbb6bc7f4a38b470a011714cd243 [id=d81b865c7caf4f299a026ec42a23c752]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.379254 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23234c7580b64b55b4e62ded19d187d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.381978 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f833a088b72e42e789d82f2594875bb0" } modify_external_catalogs: true
I20260810 19:48:03.382225 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f833a088b72e42e789d82f2594875bb0" } modify_external_catalogs: true
I20260810 19:48:03.382545 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 224bce6be88842c0a26df57326f34442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.382723 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a0745b87a24e3ca0e3e32c2059f422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.386232 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53bb7e081b8747308d85ca933bb3528c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.386502 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b45327bb5e7421983682deec45bd275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.393924 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8425f8c3258a41c291f9fa8dbd29fbc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.397629 12086 raft_consensus.cc:515] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.400070 9664 tablet_service.cc:1511] Processing CreateTablet for tablet ad604cd863f74e62b91ed532b48ded9f (DEFAULT_TABLE table=default.Table_d98c0b1af3954d4787fb09b4e7b0ffa0 [id=f0ef2246b3b54605aef3600b65df17ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.400070 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 1b45327bb5e7421983682deec45bd275 (DEFAULT_TABLE table=default.Table_0b9123d6d35944a296693b52e14428ad [id=e16c505195d442ce8aaf4036e4691d07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.400604 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b45327bb5e7421983682deec45bd275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.400820 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad604cd863f74e62b91ed532b48ded9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.398368 9890 tablet_service.cc:1511] Processing CreateTablet for tablet f2d00c669285436bbafb4b657532f222 (DEFAULT_TABLE table=default.Table_b0fbac9c2b634c38aad056086165f4ec [id=a2d9d5897cba49d187daf8ba45b9440f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.399103 9901 tablet_service.cc:1511] Processing CreateTablet for tablet e09365db984f41b49197891b332ebd87 (DEFAULT_TABLE table=default.Table_aed769a713644b6eb660a828c788f786 [id=d95aeceb3e284203b8592a98cf766774]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.417887 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2d00c669285436bbafb4b657532f222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.418183 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e09365db984f41b49197891b332ebd87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.399487 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 01f778560eb9475da082dec2e2892e9c (DEFAULT_TABLE table=default.Table_39afeeb5729c4dc8827566b36b0dbc1f [id=c3566c940c1d468b9de79ca2d5f9bb24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.422699 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f778560eb9475da082dec2e2892e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.423007 10370 ts_tablet_manager.cc:1434] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.252s user 0.007s sys 0.000s
I20260810 19:48:03.407585 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 8375754dc8d5452ea1fbdcaf21e0809a (DEFAULT_TABLE table=default.Table_be85124217454fc9818d73533df69b69 [id=68bc013094ff4a76b77455afa3a733b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.426661 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8375754dc8d5452ea1fbdcaf21e0809a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.427143 11974 leader_election.cc:290] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:03.408532 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 5f593e2ff4ef467da4a1b2dacd17c899 (DEFAULT_TABLE table=default.Table_c72aea77b3334c4a9e7920c3d64f53db [id=ac26665836694921995aeb4bf20bb836]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.409116 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 47bbe10c2ac0465caa86125babf12277 (DEFAULT_TABLE table=default.Table_e8f8a641ccd242d79d69a56475e8d33c [id=9b3d22d6b64445e6ada5302dd511728b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.409442 9902 tablet_service.cc:1511] Processing CreateTablet for tablet f46571d9b4d948d3938607ebef926c40 (DEFAULT_TABLE table=default.Table_fdb9a22aaf1046c7b949a64abb7f2fd5 [id=91410b334d9f46fc8794de0b13863d18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.409639 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet e87fd882e6b6413480a0cb06aee74722 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:03.336323 10377 ts_tablet_manager.cc:1950] T a5625dc6303d44c6be28abd6278ce034 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:03.435763 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 655) took 1679 ms. Trace:
I20260810 19:48:03.435926 10377 rpcz_store.cc:276] 0810 19:48:01.756713 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:01.756776 (+ 63us) service_pool.cc:224] Handling call
0810 19:48:02.813470 (+1056694us) ts_tablet_manager.cc:1151] Deleting tablet a5625dc6303d44c6be28abd6278ce034
0810 19:48:02.813480 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:02.854047 (+ 40567us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:03.201987 (+347940us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:03.435725 (+233738us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1056497}
I20260810 19:48:03.436508 10377 tablet_replica.cc:333] T 3b6187dbe1ca42f79bf3eddd5475b929 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:03.439440 12086 leader_election.cc:290] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:03.440158 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c6196382f3b94d9b97fe5fa8ee34dba7" } new_table_name: "default.Table_475e897fdcd7418bbe190ef1ab210c2a" modify_external_catalogs: true
I20260810 19:48:03.441814 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet a5625dc6303d44c6be28abd6278ce034 (table default.Table_20489495f6794646b9eda0458ee58d91 [id=16ed3d0d9475472283f6d95c69c60f8d]) successfully deleted
I20260810 19:48:03.409963 9908 tablet_service.cc:1511] Processing CreateTablet for tablet ac17aa6447f547a9b9a44449b283bb69 (DEFAULT_TABLE table=default.Table_723332106bc5409c8c0a3201c9e8d99e [id=0d3094b81a0c42e18ecc3b1e3bee1494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.417446 10366 tablet_bootstrap.cc:492] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:03.442836 10366 ts_tablet_manager.cc:1403] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.154s user 0.011s sys 0.000s
I20260810 19:48:03.443642 10366 raft_consensus.cc:359] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.443831 10366 raft_consensus.cc:385] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:03.443889 10366 raft_consensus.cc:740] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:03.430698 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f593e2ff4ef467da4a1b2dacd17c899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.444561 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47bbe10c2ac0465caa86125babf12277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.444621 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a70894bcda4548a783ceb79c8f531e1f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:03.445995 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a70894bcda4548a783ceb79c8f531e1f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:03.450160 10145 tablet_service.cc:1511] Processing CreateTablet for tablet aaaeafe4afb8454baf2e141a00da8ee3 (DEFAULT_TABLE table=default.Table_3609f114cc2e412dac61baf2f59e9307 [id=a0c4c001152e48a59a1c1db40e92cbdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.450496 10366 consensus_queue.cc:260] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.451067 10125 tablet_service.cc:1511] Processing CreateTablet for tablet f2d00c669285436bbafb4b657532f222 (DEFAULT_TABLE table=default.Table_b0fbac9c2b634c38aad056086165f4ec [id=a2d9d5897cba49d187daf8ba45b9440f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.451411 10366 ts_tablet_manager.cc:1434] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260810 19:48:03.452222 10366 tablet_bootstrap.cc:492] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:03.450910 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f46571d9b4d948d3938607ebef926c40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.453753 11518 raft_consensus.cc:697] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:03.453838 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac17aa6447f547a9b9a44449b283bb69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.457067 10137 tablet_service.cc:1511] Processing CreateTablet for tablet e09365db984f41b49197891b332ebd87 (DEFAULT_TABLE table=default.Table_aed769a713644b6eb660a828c788f786 [id=d95aeceb3e284203b8592a98cf766774]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.457440 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8425f8c3258a41c291f9fa8dbd29fbc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.457659 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f01a22232504d80a827e3d1ea0452a3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:03.340803 9831 consensus_peers.cc:597] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6355c14e38b3446493f7bd5e2a717341. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:03.457826 10116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 048a81d8dc7b42a39a9891d57fcd08b0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:03.457806 9831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 117037us
W20260810 19:48:03.458418 9611 leader_election.cc:343] T b5f30148b5c84f7cbdfabd0186611cc4 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:03.466063 11828 leader_election.cc:290] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:03.466490 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f88b19fe8f81408095cce388832da12c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.466760 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e09365db984f41b49197891b332ebd87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.466854 10366 tablet_bootstrap.cc:654] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:03.466946 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53bb7e081b8747308d85ca933bb3528c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.467268 10367 tablet_bootstrap.cc:492] T 2b2b20dc77954af7a203f357c746be29 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:03.467422 10367 ts_tablet_manager.cc:1403] T 2b2b20dc77954af7a203f357c746be29 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.306s user 0.004s sys 0.000s
I20260810 19:48:03.467995 10142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23234c7580b64b55b4e62ded19d187d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.468209 10370 tablet_bootstrap.cc:492] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:03.468281 10367 raft_consensus.cc:359] T 2b2b20dc77954af7a203f357c746be29 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.468444 10367 raft_consensus.cc:385] T 2b2b20dc77954af7a203f357c746be29 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:03.468493 10367 raft_consensus.cc:740] T 2b2b20dc77954af7a203f357c746be29 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:03.468725 10367 consensus_queue.cc:260] T 2b2b20dc77954af7a203f357c746be29 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.469259 10367 ts_tablet_manager.cc:1434] T 2b2b20dc77954af7a203f357c746be29 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:03.469496 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2d00c669285436bbafb4b657532f222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.469537 10367 tablet_bootstrap.cc:492] T 0dd49d6fa79e4677b753b6cf9117b02d P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:03.476169 10136 tablet_service.cc:1511] Processing CreateTablet for tablet f46571d9b4d948d3938607ebef926c40 (DEFAULT_TABLE table=default.Table_fdb9a22aaf1046c7b949a64abb7f2fd5 [id=91410b334d9f46fc8794de0b13863d18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.476564 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 96d1380e23494bbabdad11067159ed79 (DEFAULT_TABLE table=default.Table_87b726ec1327405d86e7c849c488b960 [id=1147184e49a745cb9e7b68225628caef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.476969 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96d1380e23494bbabdad11067159ed79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.460193 11518 consensus_queue.cc:237] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.479382 10366 tablet_bootstrap.cc:492] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:03.479598 10366 ts_tablet_manager.cc:1403] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.000s
I20260810 19:48:03.479540 10120 tablet_service.cc:1511] Processing CreateTablet for tablet 8375754dc8d5452ea1fbdcaf21e0809a (DEFAULT_TABLE table=default.Table_be85124217454fc9818d73533df69b69 [id=68bc013094ff4a76b77455afa3a733b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.480674 10366 raft_consensus.cc:359] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.481397 10366 raft_consensus.cc:385] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:03.481523 10366 raft_consensus.cc:740] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:03.481838 10366 consensus_queue.cc:260] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.482743 10366 ts_tablet_manager.cc:1434] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:48:03.482743 9657 tablet_service.cc:1511] Processing CreateTablet for tablet f88b19fe8f81408095cce388832da12c (DEFAULT_TABLE table=default.Table_0a4ab5dd136842c3afce85538dc0461b [id=30551371d46f4758abec98d7043552a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.483144 10366 tablet_bootstrap.cc:492] T 72b39babf851404c89adb317033015ec P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:03.483151 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f88b19fe8f81408095cce388832da12c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.485059 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaaeafe4afb8454baf2e141a00da8ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.486912 10366 tablet_bootstrap.cc:654] T 72b39babf851404c89adb317033015ec P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:03.487239 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f46571d9b4d948d3938607ebef926c40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.488004 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c01bde86f6d14c4db35f7211b84b7cb9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:03.495574 10067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 319415us
W20260810 19:48:03.496902 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6cde3ef430534878995af31bae223153 consensus state has no leader
I20260810 19:48:03.497174 9948 raft_consensus.cc:1240] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 [term 2 LEADER]: Rejecting Update request from peer eadde59fd6504d679e47f03a60c64bb0 for earlier term 1. Current term is 2. Ops: [1.1-1.2]
W20260810 19:48:03.498947 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4571e0c723f74c828220b33116fed9e9 consensus state has no leader
I20260810 19:48:03.500435 9673 tablet_service.cc:1511] Processing CreateTablet for tablet aaaeafe4afb8454baf2e141a00da8ee3 (DEFAULT_TABLE table=default.Table_3609f114cc2e412dac61baf2f59e9307 [id=a0c4c001152e48a59a1c1db40e92cbdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.500944 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaaeafe4afb8454baf2e141a00da8ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.501093 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 8375754dc8d5452ea1fbdcaf21e0809a (DEFAULT_TABLE table=default.Table_be85124217454fc9818d73533df69b69 [id=68bc013094ff4a76b77455afa3a733b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.501431 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8375754dc8d5452ea1fbdcaf21e0809a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.502502 10140 tablet_service.cc:1511] Processing CreateTablet for tablet 01f778560eb9475da082dec2e2892e9c (DEFAULT_TABLE table=default.Table_39afeeb5729c4dc8827566b36b0dbc1f [id=c3566c940c1d468b9de79ca2d5f9bb24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.502619 9668 tablet_service.cc:1511] Processing CreateTablet for tablet e09365db984f41b49197891b332ebd87 (DEFAULT_TABLE table=default.Table_aed769a713644b6eb660a828c788f786 [id=d95aeceb3e284203b8592a98cf766774]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.502975 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e09365db984f41b49197891b332ebd87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.499547 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 842a5dacf9d145889e97069d3c8084b8
I20260810 19:48:03.506614 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 01f778560eb9475da082dec2e2892e9c (DEFAULT_TABLE table=default.Table_39afeeb5729c4dc8827566b36b0dbc1f [id=c3566c940c1d468b9de79ca2d5f9bb24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.507004 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f778560eb9475da082dec2e2892e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.509768 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5576e9087855441498904bc59685a442" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:03.510087 9711 raft_consensus.cc:3060] T 5576e9087855441498904bc59685a442 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:03.511193 10366 tablet_bootstrap.cc:492] T 72b39babf851404c89adb317033015ec P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:03.500437 9664 tablet_service.cc:1511] Processing CreateTablet for tablet f2d00c669285436bbafb4b657532f222 (DEFAULT_TABLE table=default.Table_b0fbac9c2b634c38aad056086165f4ec [id=a2d9d5897cba49d187daf8ba45b9440f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.511744 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2d00c669285436bbafb4b657532f222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.512171 10366 ts_tablet_manager.cc:1403] T 72b39babf851404c89adb317033015ec P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.000s
I20260810 19:48:03.512939 10366 raft_consensus.cc:359] T 72b39babf851404c89adb317033015ec P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.513127 10366 raft_consensus.cc:385] T 72b39babf851404c89adb317033015ec P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:03.513141 9711 raft_consensus.cc:2468] T 5576e9087855441498904bc59685a442 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:03.513177 10366 raft_consensus.cc:740] T 72b39babf851404c89adb317033015ec P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:03.513393 10366 consensus_queue.cc:260] T 72b39babf851404c89adb317033015ec P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.514120 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 23234c7580b64b55b4e62ded19d187d9 (DEFAULT_TABLE table=default.Table_3c43fbb6bc7f4a38b470a011714cd243 [id=d81b865c7caf4f299a026ec42a23c752]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.514513 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23234c7580b64b55b4e62ded19d187d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.515625 10366 ts_tablet_manager.cc:1434] T 72b39babf851404c89adb317033015ec P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 19:48:03.516433 10366 tablet_bootstrap.cc:492] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:03.517269 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 47bbe10c2ac0465caa86125babf12277 (DEFAULT_TABLE table=default.Table_e8f8a641ccd242d79d69a56475e8d33c [id=9b3d22d6b64445e6ada5302dd511728b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.519021 10366 tablet_bootstrap.cc:654] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:03.527160 9418 catalog_manager.cc:5719] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:03.527681 9418 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 7d93fd6556b146ca8933a6dc0a2357e8 (table default.Table_908acdc21674469e937e4539876e0267 [id=de4d62ebb8c440a1a71ed57ac4f3c530]). Expected version 1 got 0
I20260810 19:48:03.530984 9675 tablet_service.cc:1511] Processing CreateTablet for tablet ac17aa6447f547a9b9a44449b283bb69 (DEFAULT_TABLE table=default.Table_723332106bc5409c8c0a3201c9e8d99e [id=0d3094b81a0c42e18ecc3b1e3bee1494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.531558 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac17aa6447f547a9b9a44449b283bb69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.538308 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 47bbe10c2ac0465caa86125babf12277 (DEFAULT_TABLE table=default.Table_e8f8a641ccd242d79d69a56475e8d33c [id=9b3d22d6b64445e6ada5302dd511728b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.539072 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47bbe10c2ac0465caa86125babf12277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.540894 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 048a81d8dc7b42a39a9891d57fcd08b0 (DEFAULT_TABLE table=default.Table_8828e8ce833344fbbf4fa80b95fb29aa [id=411490129dd84beeaecdcaee33cd9ec4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.541363 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 048a81d8dc7b42a39a9891d57fcd08b0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:03.542712 10067 consensus_peers.cc:597] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee65b2c9980d4c77af8c68bf2f5c5f92. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:03.526906 12092 consensus_queue.cc:1059] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260810 19:48:03.549366 12089 consensus_queue.cc:1048] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:03.552631 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8375754dc8d5452ea1fbdcaf21e0809a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.553495 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f778560eb9475da082dec2e2892e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.556133 9666 tablet_service.cc:1511] Processing CreateTablet for tablet b704af46d0da4695a2aefd5dd17e0a7d (DEFAULT_TABLE table=default.Table_148c29dbb35f4c50a6fb25d6461e613b [id=b1bdb7cdd0f74a5aa114627ad1aaa147]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.556288 9677 tablet_service.cc:1511] Processing CreateTablet for tablet f7037b58854c488bac1be56bf21092a7 (DEFAULT_TABLE table=default.Table_c6196382f3b94d9b97fe5fa8ee34dba7 [id=dd721799852845f9a60fcf845125693b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.556767 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b704af46d0da4695a2aefd5dd17e0a7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.556780 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 155b48f454e74ca9bb7007f584231a37 (DEFAULT_TABLE table=default.Table_e3cc34ea975e4aba9c86b3ddd40060af [id=2f802c415a44417ca1cdcc05970b001d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.557053 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7037b58854c488bac1be56bf21092a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.557231 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet 842a5dacf9d145889e97069d3c8084b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:03.557310 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 155b48f454e74ca9bb7007f584231a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.557546 9673 tablet_service.cc:1558] Processing DeleteTablet for tablet e87fd882e6b6413480a0cb06aee74722 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:03.561399 12092 consensus_queue.cc:1243] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Peer 6986ed920dcb4af29a5eeeda6f671691 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260810 19:48:03.562304 10118 tablet_service.cc:1511] Processing CreateTablet for tablet ac17aa6447f547a9b9a44449b283bb69 (DEFAULT_TABLE table=default.Table_723332106bc5409c8c0a3201c9e8d99e [id=0d3094b81a0c42e18ecc3b1e3bee1494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.567040 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac17aa6447f547a9b9a44449b283bb69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.573513 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47bbe10c2ac0465caa86125babf12277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.574625 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5601ab64fee640919e67eafbccf346bc" } new_table_name: "default.Table_409905ea96594ba790ce5aad64871146" modify_external_catalogs: true
I20260810 19:48:03.575335 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_8721298cbe674d2abc25a201da5c09b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:03.576028 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8721298cbe674d2abc25a201da5c09b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:03.577497 9687 tablet_service.cc:1511] Processing CreateTablet for tablet c01bde86f6d14c4db35f7211b84b7cb9 (DEFAULT_TABLE table=default.Table_b60a7be0965645f8be9d8b1e3ea458d2 [id=772a7fc6bfb54647bd3cf9e34bd258ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.577996 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c01bde86f6d14c4db35f7211b84b7cb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.582019 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_7459a9ef6579436aaf36362612271ccb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:03.582762 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7459a9ef6579436aaf36362612271ccb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:03.583388 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b8022049381847cd8f1b45aad5235aec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:03.583926 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8022049381847cd8f1b45aad5235aec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:03.586957 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_27917e34d5674a908d7fc73083fd0926" } new_table_name: "default.Table_3e7715bf0f8c41e3bd4964a0f918c9ea" modify_external_catalogs: true
I20260810 19:48:03.591593 9668 tablet_service.cc:1511] Processing CreateTablet for tablet a89bb334a72e4a3a872b346c39df0635 (DEFAULT_TABLE table=default.Table_1383f4d1e0df4822a86bb643f3f1f6ed [id=cb1ac6a1fc1f4ce282e0b7762cd36659]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.591607 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 2daf9e86dff44999ae8975529cd6014f (DEFAULT_TABLE table=default.Table_401a35fefca043648cdea5f454f66840 [id=67344545cc21406a9c64399e008af284]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.592782 9659 tablet_service.cc:1511] Processing CreateTablet for tablet 4d095bf3749c4cda804ae1e81e306647 (DEFAULT_TABLE table=default.Table_3cc3af793cf64766bec613e04b146619 [id=6d85d50678004cfa9fffe1eebd25f261]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.593361 9663 tablet_service.cc:1511] Processing CreateTablet for tablet dbd3b0b6b636432481f30fc84446e584 (DEFAULT_TABLE table=default.Table_9afeebbc1716420c83267e59e7a7163c [id=93a2ac007c494f98a94302dbd4f7f7aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.589260 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 5f593e2ff4ef467da4a1b2dacd17c899 (DEFAULT_TABLE table=default.Table_c72aea77b3334c4a9e7920c3d64f53db [id=ac26665836694921995aeb4bf20bb836]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.595681 9791 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:48:03.595908 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f593e2ff4ef467da4a1b2dacd17c899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.596037 9658 tablet_service.cc:1511] Processing CreateTablet for tablet e5f29e86e0854efd9987305e26d7361a (DEFAULT_TABLE table=default.Table_0b2d770d94e74c88bd7d0d7a9ab88982 [id=7041f74e7fc74100b06e353c2009a51a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.598742 10367 tablet_bootstrap.cc:654] T 0dd49d6fa79e4677b753b6cf9117b02d P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:03.600312 9659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d095bf3749c4cda804ae1e81e306647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.600543 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a89bb334a72e4a3a872b346c39df0635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.603540 10144 tablet_service.cc:1558] Processing DeleteTablet for tablet e87fd882e6b6413480a0cb06aee74722 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:03.603820 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2daf9e86dff44999ae8975529cd6014f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.606484 9663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbd3b0b6b636432481f30fc84446e584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.607918 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f29e86e0854efd9987305e26d7361a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.608470 10139 tablet_service.cc:1558] Processing DeleteTablet for tablet 842a5dacf9d145889e97069d3c8084b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:03.609146 10370 tablet_bootstrap.cc:654] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:03.609519 10125 tablet_service.cc:1511] Processing CreateTablet for tablet b704af46d0da4695a2aefd5dd17e0a7d (DEFAULT_TABLE table=default.Table_148c29dbb35f4c50a6fb25d6461e613b [id=b1bdb7cdd0f74a5aa114627ad1aaa147]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.609453 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 476e762e46c04ae6bfef5e14df2d16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:03.609972 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b704af46d0da4695a2aefd5dd17e0a7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.610802 10371 ts_tablet_manager.cc:1929] T b5f30148b5c84f7cbdfabd0186611cc4 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:03.610947 10371 log.cc:1199] T b5f30148b5c84f7cbdfabd0186611cc4 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/b5f30148b5c84f7cbdfabd0186611cc4
I20260810 19:48:03.611234 10371 ts_tablet_manager.cc:1950] T b5f30148b5c84f7cbdfabd0186611cc4 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:03.612046 10371 tablet_replica.cc:333] T 842a5dacf9d145889e97069d3c8084b8 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:03.612291 10371 raft_consensus.cc:2243] T 842a5dacf9d145889e97069d3c8084b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:03.612517 10371 raft_consensus.cc:2272] T 842a5dacf9d145889e97069d3c8084b8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:03.613113 10371 ts_tablet_manager.cc:1916] T 842a5dacf9d145889e97069d3c8084b8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:03.614542 11828 raft_consensus.cc:3055] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 19:48:03.614650 11828 raft_consensus.cc:740] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:03.614977 9665 tablet_service.cc:1511] Processing CreateTablet for tablet 5f593e2ff4ef467da4a1b2dacd17c899 (DEFAULT_TABLE table=default.Table_c72aea77b3334c4a9e7920c3d64f53db [id=ac26665836694921995aeb4bf20bb836]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.615356 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f593e2ff4ef467da4a1b2dacd17c899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.617002 12012 raft_consensus.cc:493] T 2b2b20dc77954af7a203f357c746be29 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:03.617143 12012 raft_consensus.cc:515] T 2b2b20dc77954af7a203f357c746be29 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.617861 12012 leader_election.cc:290] T 2b2b20dc77954af7a203f357c746be29 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:03.619812 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 0956ad46321341fc9e4c6252d239b4a5 (DEFAULT_TABLE table=default.Table_e35d1c469f794eb490a2667f69056cd3 [id=373da57ba1d94890847ad333a7cc4c54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.620187 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0956ad46321341fc9e4c6252d239b4a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.620678 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 18202e66f8274c60bffe511f3de08849 (DEFAULT_TABLE table=default.Table_27da81f7dcd74970ba692cc8c2c54ba9 [id=363288a3fee94bbdb7ed15fc7985a087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.620890 10130 tablet_service.cc:1511] Processing CreateTablet for tablet f7037b58854c488bac1be56bf21092a7 (DEFAULT_TABLE table=default.Table_c6196382f3b94d9b97fe5fa8ee34dba7 [id=dd721799852845f9a60fcf845125693b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.623483 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18202e66f8274c60bffe511f3de08849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.626164 9657 tablet_service.cc:1511] Processing CreateTablet for tablet f46571d9b4d948d3938607ebef926c40 (DEFAULT_TABLE table=default.Table_fdb9a22aaf1046c7b949a64abb7f2fd5 [id=91410b334d9f46fc8794de0b13863d18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.626634 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f46571d9b4d948d3938607ebef926c40. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:03.628372 9142 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 47954.6us
I20260810 19:48:03.635556 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet b5f30148b5c84f7cbdfabd0186611cc4 (table default.Table_6d2e6ad78a7841e891fae5f687a3c392 [id=ff056c9a5dc14ebdac724d8e39e6c7bb]) successfully deleted
W20260810 19:48:03.635906 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 08f78560ec9f465c94ef08fa2f067c0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08f78560ec9f465c94ef08fa2f067c0d already in progress: creating tablet
I20260810 19:48:03.653178 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b2b20dc77954af7a203f357c746be29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:03.655499 10367 tablet_bootstrap.cc:492] T 0dd49d6fa79e4677b753b6cf9117b02d P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:03.655754 10367 ts_tablet_manager.cc:1403] T 0dd49d6fa79e4677b753b6cf9117b02d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.186s user 0.004s sys 0.000s
I20260810 19:48:03.656520 10367 raft_consensus.cc:359] T 0dd49d6fa79e4677b753b6cf9117b02d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.656793 10367 raft_consensus.cc:385] T 0dd49d6fa79e4677b753b6cf9117b02d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:03.656898 10367 raft_consensus.cc:740] T 0dd49d6fa79e4677b753b6cf9117b02d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:03.657130 10367 consensus_queue.cc:260] T 0dd49d6fa79e4677b753b6cf9117b02d P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.659405 10367 ts_tablet_manager.cc:1434] T 0dd49d6fa79e4677b753b6cf9117b02d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260810 19:48:03.659801 10367 tablet_bootstrap.cc:492] T da3d8ade850c4d36bd2756c36706195d P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:03.661410 10367 tablet_bootstrap.cc:654] T da3d8ade850c4d36bd2756c36706195d P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:03.686662 10371 ts_tablet_manager.cc:1929] T 842a5dacf9d145889e97069d3c8084b8 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:03.686968 10371 log.cc:1199] T 842a5dacf9d145889e97069d3c8084b8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/842a5dacf9d145889e97069d3c8084b8
I20260810 19:48:03.687433 10371 ts_tablet_manager.cc:1950] T 842a5dacf9d145889e97069d3c8084b8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:03.688961 10371 tablet_replica.cc:333] T 2b2b20dc77954af7a203f357c746be29 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:03.631886 10247 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:48:03.659883 10136 tablet_service.cc:1511] Processing CreateTablet for tablet a89bb334a72e4a3a872b346c39df0635 (DEFAULT_TABLE table=default.Table_1383f4d1e0df4822a86bb643f3f1f6ed [id=cb1ac6a1fc1f4ce282e0b7762cd36659]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.660348 10145 tablet_service.cc:1511] Processing CreateTablet for tablet dbd3b0b6b636432481f30fc84446e584 (DEFAULT_TABLE table=default.Table_9afeebbc1716420c83267e59e7a7163c [id=93a2ac007c494f98a94302dbd4f7f7aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.673813 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 18202e66f8274c60bffe511f3de08849 (DEFAULT_TABLE table=default.Table_27da81f7dcd74970ba692cc8c2c54ba9 [id=363288a3fee94bbdb7ed15fc7985a087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.674679 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 0956ad46321341fc9e4c6252d239b4a5 (DEFAULT_TABLE table=default.Table_e35d1c469f794eb490a2667f69056cd3 [id=373da57ba1d94890847ad333a7cc4c54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.659198 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 2daf9e86dff44999ae8975529cd6014f (DEFAULT_TABLE table=default.Table_401a35fefca043648cdea5f454f66840 [id=67344545cc21406a9c64399e008af284]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.631448 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7037b58854c488bac1be56bf21092a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.693341 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbd3b0b6b636432481f30fc84446e584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.690099 10367 tablet_bootstrap.cc:492] T da3d8ade850c4d36bd2756c36706195d P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:03.694778 10367 ts_tablet_manager.cc:1403] T da3d8ade850c4d36bd2756c36706195d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.000s
I20260810 19:48:03.695314 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a89bb334a72e4a3a872b346c39df0635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.695633 10367 raft_consensus.cc:359] T da3d8ade850c4d36bd2756c36706195d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.695802 10367 raft_consensus.cc:385] T da3d8ade850c4d36bd2756c36706195d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:03.695935 10367 raft_consensus.cc:740] T da3d8ade850c4d36bd2756c36706195d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:03.695981 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18202e66f8274c60bffe511f3de08849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.696203 10367 consensus_queue.cc:260] T da3d8ade850c4d36bd2756c36706195d P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.527133 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971e9abee86444a7a9e923b0962ae751" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:03.696902 9948 raft_consensus.cc:2468] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:03.528157 9939 raft_consensus.cc:3060] T 63b649cbc1d141d8bb438105b8e8537c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:03.530009 9892 tablet_service.cc:1511] Processing CreateTablet for tablet b704af46d0da4695a2aefd5dd17e0a7d (DEFAULT_TABLE table=default.Table_148c29dbb35f4c50a6fb25d6461e613b [id=b1bdb7cdd0f74a5aa114627ad1aaa147]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.697548 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b704af46d0da4695a2aefd5dd17e0a7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.539954 9908 tablet_service.cc:1511] Processing CreateTablet for tablet f7037b58854c488bac1be56bf21092a7 (DEFAULT_TABLE table=default.Table_c6196382f3b94d9b97fe5fa8ee34dba7 [id=dd721799852845f9a60fcf845125693b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.702695 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7037b58854c488bac1be56bf21092a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.704025 10067 leader_election.cc:304] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:03.704360 12089 raft_consensus.cc:2804] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:03.704435 12089 raft_consensus.cc:493] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:03.704490 12089 raft_consensus.cc:3060] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:03.660117 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 4d095bf3749c4cda804ae1e81e306647 (DEFAULT_TABLE table=default.Table_3cc3af793cf64766bec613e04b146619 [id=6d85d50678004cfa9fffe1eebd25f261]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.705783 11974 consensus_queue.cc:1048] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:03.540306 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 155b48f454e74ca9bb7007f584231a37 (DEFAULT_TABLE table=default.Table_e3cc34ea975e4aba9c86b3ddd40060af [id=2f802c415a44417ca1cdcc05970b001d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.706646 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 155b48f454e74ca9bb7007f584231a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.544018 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 18202e66f8274c60bffe511f3de08849 (DEFAULT_TABLE table=default.Table_27da81f7dcd74970ba692cc8c2c54ba9 [id=363288a3fee94bbdb7ed15fc7985a087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.710659 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18202e66f8274c60bffe511f3de08849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.711905 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d095bf3749c4cda804ae1e81e306647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.574182 9831 leader_election.cc:304] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
W20260810 19:48:03.713171 9831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 139013us
I20260810 19:48:03.713534 12087 raft_consensus.cc:2804] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:03.544374 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 0956ad46321341fc9e4c6252d239b4a5 (DEFAULT_TABLE table=default.Table_e35d1c469f794eb490a2667f69056cd3 [id=373da57ba1d94890847ad333a7cc4c54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.713928 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0956ad46321341fc9e4c6252d239b4a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.544080 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 2daf9e86dff44999ae8975529cd6014f (DEFAULT_TABLE table=default.Table_401a35fefca043648cdea5f454f66840 [id=67344545cc21406a9c64399e008af284]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.714661 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2daf9e86dff44999ae8975529cd6014f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.545291 9906 tablet_service.cc:1511] Processing CreateTablet for tablet a89bb334a72e4a3a872b346c39df0635 (DEFAULT_TABLE table=default.Table_1383f4d1e0df4822a86bb643f3f1f6ed [id=cb1ac6a1fc1f4ce282e0b7762cd36659]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.717723 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a89bb334a72e4a3a872b346c39df0635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.547077 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 4d095bf3749c4cda804ae1e81e306647 (DEFAULT_TABLE table=default.Table_3cc3af793cf64766bec613e04b146619 [id=6d85d50678004cfa9fffe1eebd25f261]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.548664 9883 tablet_service.cc:1511] Processing CreateTablet for tablet dbd3b0b6b636432481f30fc84446e584 (DEFAULT_TABLE table=default.Table_9afeebbc1716420c83267e59e7a7163c [id=93a2ac007c494f98a94302dbd4f7f7aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.718369 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d095bf3749c4cda804ae1e81e306647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.718657 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbd3b0b6b636432481f30fc84446e584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.572990 12086 consensus_queue.cc:1048] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:03.589200 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet dfea147ef3904ab49375def065c6f328 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:53 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:03.609839 11897 raft_consensus.cc:493] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:03.596735 9901 tablet_service.cc:1558] Processing DeleteTablet for tablet 842a5dacf9d145889e97069d3c8084b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:03.719115 11897 raft_consensus.cc:515] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.719843 11897 leader_election.cc:290] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:03.722808 10377 raft_consensus.cc:2243] T 3b6187dbe1ca42f79bf3eddd5475b929 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:03.723006 10377 raft_consensus.cc:2272] T 3b6187dbe1ca42f79bf3eddd5475b929 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:03.723569 10377 ts_tablet_manager.cc:1916] T 3b6187dbe1ca42f79bf3eddd5475b929 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:03.732992 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0956ad46321341fc9e4c6252d239b4a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.735061 10029 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:48:03.673310 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 155b48f454e74ca9bb7007f584231a37 (DEFAULT_TABLE table=default.Table_e3cc34ea975e4aba9c86b3ddd40060af [id=2f802c415a44417ca1cdcc05970b001d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:03.748061 10367 ts_tablet_manager.cc:1434] T da3d8ade850c4d36bd2756c36706195d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.053s user 0.002s sys 0.000s
I20260810 19:48:03.753476 10367 tablet_bootstrap.cc:492] T 63486cc3f8774a11827b1cc5f1c16332 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:03.755193 10367 tablet_bootstrap.cc:654] T 63486cc3f8774a11827b1cc5f1c16332 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:03.755470 10371 raft_consensus.cc:2243] T 2b2b20dc77954af7a203f357c746be29 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:03.756492 10371 raft_consensus.cc:2272] T 2b2b20dc77954af7a203f357c746be29 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:03.757390 10371 ts_tablet_manager.cc:1916] T 2b2b20dc77954af7a203f357c746be29 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:03.660884 11828 consensus_queue.cc:260] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.764154 10371 ts_tablet_manager.cc:1929] T 2b2b20dc77954af7a203f357c746be29 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:03.773789 11828 raft_consensus.cc:3060] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Advancing to term 2
I20260810 19:48:03.774446 10371 log.cc:1199] T 2b2b20dc77954af7a203f357c746be29 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/2b2b20dc77954af7a203f357c746be29
I20260810 19:48:03.774791 10371 ts_tablet_manager.cc:1950] T 2b2b20dc77954af7a203f357c746be29 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:03.777688 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2daf9e86dff44999ae8975529cd6014f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:03.779295 12089 raft_consensus.cc:515] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.780706 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971e9abee86444a7a9e923b0962ae751" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:03.780979 9948 raft_consensus.cc:3060] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:03.783973 9948 raft_consensus.cc:2468] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:03.784660 10067 leader_election.cc:304] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:03.785008 12090 raft_consensus.cc:2804] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:03.785151 12090 raft_consensus.cc:697] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:03.789528 12089 leader_election.cc:290] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:03.785414 12090 consensus_queue.cc:237] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.805079 10375 ts_tablet_manager.cc:1929] T 3f18c24b01384299a4f941d7fb840032 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:03.805258 10375 log.cc:1199] T 3f18c24b01384299a4f941d7fb840032 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/3f18c24b01384299a4f941d7fb840032
I20260810 19:48:03.805589 10375 ts_tablet_manager.cc:1950] T 3f18c24b01384299a4f941d7fb840032 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:03.805960 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 632) took 2142 ms. Trace:
I20260810 19:48:03.806066 10375 rpcz_store.cc:276] 0810 19:48:01.663562 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:01.663709 (+ 147us) service_pool.cc:224] Handling call
0810 19:48:02.856090 (+1192381us) ts_tablet_manager.cc:1151] Deleting tablet 3f18c24b01384299a4f941d7fb840032
0810 19:48:02.856106 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:03.150630 (+294524us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:03.805003 (+654373us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:03.805937 (+ 934us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1161475}
I20260810 19:48:03.814409 12087 raft_consensus.cc:697] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:03.814828 12087 consensus_queue.cc:237] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:03.827071 9831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 113550us
I20260810 19:48:03.827708 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 155b48f454e74ca9bb7007f584231a37. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:03.830670 9831 consensus_peers.cc:597] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b737b216646a4c5baecb88d59bcce4df. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:03.833314 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320e42f6de6c4452adb7bbb379a156e6" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:03.833565 9711 raft_consensus.cc:2468] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:03.836532 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 842a5dacf9d145889e97069d3c8084b8 (table default.Table_f833a088b72e42e789d82f2594875bb0 [id=d3257081af314bd898924c879f2d15e1]) successfully deleted
W20260810 19:48:03.837109 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet e87fd882e6b6413480a0cb06aee74722 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e87fd882e6b6413480a0cb06aee74722 already in progress: creating tablet
I20260810 19:48:03.837867 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 2b2b20dc77954af7a203f357c746be29 (table default.Table_0de524b66ecf4dea8ab5e6b87c4f6261 [id=4de43e2ae0424104aa75c5d872b72d3a]) successfully deleted
I20260810 19:48:03.857771 12087 raft_consensus.cc:493] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:03.858028 12087 raft_consensus.cc:515] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.859273 12087 leader_election.cc:290] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:03.865417 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2b20dc77954af7a203f357c746be29" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:03.872578 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 3f18c24b01384299a4f941d7fb840032 (table default.Table_5043edeafbb047c6a7619f91323879c2 [id=6287581e5dad45b4b7fd481e9ae5eae3]) successfully deleted
I20260810 19:48:03.879801 10366 tablet_bootstrap.cc:492] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:03.880153 10366 ts_tablet_manager.cc:1403] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.364s user 0.003s sys 0.003s
I20260810 19:48:03.881145 10366 raft_consensus.cc:359] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.881394 10366 raft_consensus.cc:385] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:03.881455 10366 raft_consensus.cc:740] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:03.881722 10366 consensus_queue.cc:260] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.882619 10367 tablet_bootstrap.cc:492] T 63486cc3f8774a11827b1cc5f1c16332 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:03.882872 10367 ts_tablet_manager.cc:1403] T 63486cc3f8774a11827b1cc5f1c16332 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.129s user 0.017s sys 0.028s
I20260810 19:48:03.883791 10367 raft_consensus.cc:359] T 63486cc3f8774a11827b1cc5f1c16332 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.884078 10367 raft_consensus.cc:385] T 63486cc3f8774a11827b1cc5f1c16332 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:03.884197 10367 raft_consensus.cc:740] T 63486cc3f8774a11827b1cc5f1c16332 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:03.884419 9709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8ae48a2fb548358176abefe1ee3baa" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:03.884637 9709 raft_consensus.cc:2468] T 3e8ae48a2fb548358176abefe1ee3baa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:03.885563 10367 consensus_queue.cc:260] T 63486cc3f8774a11827b1cc5f1c16332 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:03.885774 9611 leader_election.cc:343] T 2b2b20dc77954af7a203f357c746be29 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:03.886250 11897 consensus_queue.cc:1048] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:03.887261 9831 leader_election.cc:304] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:03.887652 11897 raft_consensus.cc:2804] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:03.887756 11897 raft_consensus.cc:493] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:03.887825 11897 raft_consensus.cc:3060] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:03.890467 10367 ts_tablet_manager.cc:1434] T 63486cc3f8774a11827b1cc5f1c16332 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260810 19:48:03.890790 10367 tablet_bootstrap.cc:492] T 00fe7d9a548a487d965d92b53cdf9250 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:03.892428 10367 tablet_bootstrap.cc:654] T 00fe7d9a548a487d965d92b53cdf9250 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:03.895519 10068 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s user 0.020s sys 0.032s
W20260810 19:48:03.895663 10068 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s user 0.020s sys 0.033s
I20260810 19:48:03.896332 11897 raft_consensus.cc:515] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.896884 10161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfea147ef3904ab49375def065c6f328" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:03.897101 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b722c43ee4b8698b19b2b6c1b401d" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:03.897374 10155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5576e9087855441498904bc59685a442" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:03.897682 10152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5576e9087855441498904bc59685a442" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:03.898114 10148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8ae48a2fb548358176abefe1ee3baa" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:03.898366 10168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2b20dc77954af7a203f357c746be29" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:03.898934 9830 leader_election.cc:343] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:03.899071 9830 leader_election.cc:304] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:03.899125 10162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b722c43ee4b8698b19b2b6c1b401d" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:03.899482 12127 raft_consensus.cc:2749] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:03.900336 10164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db2b8038ee9747109b42510bba02faa9" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:03.900897 10159 raft_consensus.cc:2410] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6986ed920dcb4af29a5eeeda6f671691 for term 2 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260810 19:48:03.901697 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f30148b5c84f7cbdfabd0186611cc4" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:03.902875 11897 leader_election.cc:290] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:03.897951 10149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320e42f6de6c4452adb7bbb379a156e6" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:03.904657 9830 leader_election.cc:343] T dfea147ef3904ab49375def065c6f328 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:03.904793 9830 leader_election.cc:304] T dfea147ef3904ab49375def065c6f328 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:03.905443 12127 raft_consensus.cc:2749] T dfea147ef3904ab49375def065c6f328 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:03.925129 9830 leader_election.cc:343] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:03.927525 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d93fd6556b146ca8933a6dc0a2357e8" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:03.928333 10068 leader_election.cc:343] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 21208dd824fe432fa307cbb88d37aaa2
W20260810 19:48:03.929685 9830 leader_election.cc:343] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:03.930127 9830 leader_election.cc:343] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:03.930404 9830 consensus_peers.cc:597] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260810 19:48:03.930577 9830 consensus_peers.cc:597] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260810 19:48:03.930972 9830 consensus_peers.cc:597] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:03.931520 11897 consensus_queue.cc:1048] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 19:48:03.931519 9830 leader_election.cc:343] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:03.933058 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d93fd6556b146ca8933a6dc0a2357e8" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:03.934218 10370 tablet_bootstrap.cc:492] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:03.934500 10370 ts_tablet_manager.cc:1403] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.506s user 0.004s sys 0.016s
W20260810 19:48:03.934715 9830 leader_election.cc:343] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:03.936061 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320e42f6de6c4452adb7bbb379a156e6" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
W20260810 19:48:03.937597 9830 leader_election.cc:343] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:03.938035 9830 leader_election.cc:343] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:03.949831 12085 tablet.cc:1724] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260810 19:48:03.950157 10068 consensus_peers.cc:597] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee65b2c9980d4c77af8c68bf2f5c5f92. This is attempt 1: this message will repeat every 5th retry.
W20260810 19:48:03.950610 10068 leader_election.cc:343] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 971e9abee86444a7a9e923b0962ae751
W20260810 19:48:03.951992 9831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 64757.5us
I20260810 19:48:03.952744 10370 raft_consensus.cc:359] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.953109 10370 raft_consensus.cc:385] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:03.953243 10370 raft_consensus.cc:740] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:03.953590 9831 leader_election.cc:304] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:03.953588 10370 consensus_queue.cc:260] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.953999 11897 raft_consensus.cc:2804] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:03.954089 11897 raft_consensus.cc:493] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:03.954159 11897 raft_consensus.cc:3060] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:03.954200 10370 ts_tablet_manager.cc:1434] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20260810 19:48:03.957039 11897 raft_consensus.cc:515] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.958633 11897 leader_election.cc:290] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:03.962476 10375 tablet_replica.cc:333] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:03.968886 10367 tablet_bootstrap.cc:492] T 00fe7d9a548a487d965d92b53cdf9250 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:03.969038 10367 ts_tablet_manager.cc:1403] T 00fe7d9a548a487d965d92b53cdf9250 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.078s user 0.003s sys 0.000s
I20260810 19:48:03.969303 10377 ts_tablet_manager.cc:1929] T 3b6187dbe1ca42f79bf3eddd5475b929 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:03.969480 10377 log.cc:1199] T 3b6187dbe1ca42f79bf3eddd5475b929 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/3b6187dbe1ca42f79bf3eddd5475b929
I20260810 19:48:03.969843 10377 ts_tablet_manager.cc:1950] T 3b6187dbe1ca42f79bf3eddd5475b929 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:03.969738 10367 raft_consensus.cc:359] T 00fe7d9a548a487d965d92b53cdf9250 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.969924 10367 raft_consensus.cc:385] T 00fe7d9a548a487d965d92b53cdf9250 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:03.969972 10367 raft_consensus.cc:740] T 00fe7d9a548a487d965d92b53cdf9250 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:03.970155 10367 consensus_queue.cc:260] T 00fe7d9a548a487d965d92b53cdf9250 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.977667 12146 raft_consensus.cc:493] T 0dd49d6fa79e4677b753b6cf9117b02d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:03.978237 10367 ts_tablet_manager.cc:1434] T 00fe7d9a548a487d965d92b53cdf9250 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260810 19:48:03.980468 10367 tablet_bootstrap.cc:492] T 8455cb11388340beb6daa13fee06177a P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:03.982055 10367 tablet_bootstrap.cc:654] T 8455cb11388340beb6daa13fee06177a P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:03.982921 12146 raft_consensus.cc:515] T 0dd49d6fa79e4677b753b6cf9117b02d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:03.988052 12146 leader_election.cc:290] T 0dd49d6fa79e4677b753b6cf9117b02d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:03.988400 11518 consensus_queue.cc:1048] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 19:48:03.988502 10068 leader_election.cc:343] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 971e9abee86444a7a9e923b0962ae751
I20260810 19:48:03.989286 12090 consensus_queue.cc:1048] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 19:48:03.990353 9611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 104327us
I20260810 19:48:03.991341 10366 ts_tablet_manager.cc:1434] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.111s user 0.001s sys 0.001s
W20260810 19:48:03.997067 9611 leader_election.cc:343] T 2b2b20dc77954af7a203f357c746be29 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:03.997237 9611 leader_election.cc:304] T 2b2b20dc77954af7a203f357c746be29 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
W20260810 19:48:03.997443 9611 raft_consensus.cc:2686] T 2b2b20dc77954af7a203f357c746be29 P fcd31b1bbb0340cbacfce652b4ad8da4: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260810 19:48:03.998339 9611 leader_election.cc:343] T db2b8038ee9747109b42510bba02faa9 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:03.998473 9611 leader_election.cc:304] T db2b8038ee9747109b42510bba02faa9 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:03.998708 12138 raft_consensus.cc:2749] T db2b8038ee9747109b42510bba02faa9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:03.998832 10367 tablet_bootstrap.cc:492] T 8455cb11388340beb6daa13fee06177a P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
W20260810 19:48:03.998925 9611 leader_election.cc:343] T b5f30148b5c84f7cbdfabd0186611cc4 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:03.999007 10367 ts_tablet_manager.cc:1403] T 8455cb11388340beb6daa13fee06177a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260810 19:48:03.999809 10367 raft_consensus.cc:359] T 8455cb11388340beb6daa13fee06177a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.000057 10367 raft_consensus.cc:385] T 8455cb11388340beb6daa13fee06177a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.000150 10367 raft_consensus.cc:740] T 8455cb11388340beb6daa13fee06177a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.000348 9709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320e42f6de6c4452adb7bbb379a156e6" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:04.000558 9709 raft_consensus.cc:3060] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:04.000429 10367 consensus_queue.cc:260] T 8455cb11388340beb6daa13fee06177a P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.001072 10367 ts_tablet_manager.cc:1434] T 8455cb11388340beb6daa13fee06177a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 19:48:04.001412 10367 tablet_bootstrap.cc:492] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:04.001442 10375 raft_consensus.cc:2243] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:04.001835 10375 pending_rounds.cc:70] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:04.001899 10375 pending_rounds.cc:77] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058692024807424 op_type: NO_OP noop_request { }
I20260810 19:48:04.002008 10375 raft_consensus.cc:2889] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:04.002100 10375 raft_consensus.cc:2272] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:04.003252 10367 tablet_bootstrap.cc:654] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.003453 9709 raft_consensus.cc:2468] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:04.004812 10366 tablet_bootstrap.cc:492] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:04.006953 10366 tablet_bootstrap.cc:654] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.015345 9711 raft_consensus.cc:1275] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 2 FOLLOWER]: Refusing update from remote peer 6986ed920dcb4af29a5eeeda6f671691: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260810 19:48:04.016042 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8ae48a2fb548358176abefe1ee3baa" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:04.016296 9717 raft_consensus.cc:3060] T 3e8ae48a2fb548358176abefe1ee3baa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:04.017849 10367 tablet_bootstrap.cc:492] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:04.018092 10367 ts_tablet_manager.cc:1403] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.000s
I20260810 19:48:04.019066 10367 raft_consensus.cc:359] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.019289 10367 raft_consensus.cc:385] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.019397 10367 raft_consensus.cc:740] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.019672 10367 consensus_queue.cc:260] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.020102 9717 raft_consensus.cc:2468] T 3e8ae48a2fb548358176abefe1ee3baa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:04.020408 10367 ts_tablet_manager.cc:1434] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:04.020764 10367 tablet_bootstrap.cc:492] T ae3e151180ae4d258d18365770acaaad P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:04.021891 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 653) took 2265 ms. Trace:
I20260810 19:48:04.022027 10377 rpcz_store.cc:276] 0810 19:48:01.756542 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:01.756937 (+ 395us) service_pool.cc:224] Handling call
0810 19:48:03.436459 (+1679522us) ts_tablet_manager.cc:1151] Deleting tablet 3b6187dbe1ca42f79bf3eddd5475b929
0810 19:48:03.436470 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:03.727130 (+290660us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:03.877106 (+149976us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:04.021852 (+144746us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133966,"tablet-delete.queue_time_us":1679387}
I20260810 19:48:04.022962 10377 tablet_replica.cc:333] T 0d79ef93c5bf4ac9895e594198edb251 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:04.023526 10377 raft_consensus.cc:2243] T 0d79ef93c5bf4ac9895e594198edb251 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:04.023916 10377 raft_consensus.cc:2272] T 0d79ef93c5bf4ac9895e594198edb251 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:04.025279 10377 ts_tablet_manager.cc:1916] T 0d79ef93c5bf4ac9895e594198edb251 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:03.999042 9611 leader_election.cc:304] T b5f30148b5c84f7cbdfabd0186611cc4 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
W20260810 19:48:04.029592 9611 raft_consensus.cc:2686] T b5f30148b5c84f7cbdfabd0186611cc4 P fcd31b1bbb0340cbacfce652b4ad8da4: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 19:48:04.034003 10367 tablet_bootstrap.cc:654] T ae3e151180ae4d258d18365770acaaad P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:04.038134 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f7037b58854c488bac1be56bf21092a7 consensus state has no leader
I20260810 19:48:04.039816 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 3b6187dbe1ca42f79bf3eddd5475b929 (table default.Table_df0d4b51d323454e8afa1c87c993a1ed [id=ecadc549b3444735b6972f914f5b4e2d]) successfully deleted
I20260810 19:48:04.045616 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b2b20dc77954af7a203f357c746be29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:04.045807 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet da3d8ade850c4d36bd2756c36706195d with delete_type TABLET_DATA_DELETED (replaced by tablet 87bbcc651d034e2a826478b805792e48) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:04.046255 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dd49d6fa79e4677b753b6cf9117b02d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:04.047130 10371 tablet_replica.cc:333] T da3d8ade850c4d36bd2756c36706195d P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:04.047328 10371 raft_consensus.cc:2243] T da3d8ade850c4d36bd2756c36706195d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:04.047478 10371 raft_consensus.cc:2272] T da3d8ade850c4d36bd2756c36706195d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:04.048312 10371 ts_tablet_manager.cc:1916] T da3d8ade850c4d36bd2756c36706195d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:04.054420 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 0849ea9c04104a8184f8a8cd40e06fc2
I20260810 19:48:04.055085 10371 ts_tablet_manager.cc:1929] T da3d8ade850c4d36bd2756c36706195d P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:04.055347 10371 log.cc:1199] T da3d8ade850c4d36bd2756c36706195d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/da3d8ade850c4d36bd2756c36706195d
I20260810 19:48:04.055428 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet b853bf6bbc7845bc9cfa6347687582e2
I20260810 19:48:04.055770 10371 ts_tablet_manager.cc:1950] T da3d8ade850c4d36bd2756c36706195d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
W20260810 19:48:04.055987 9397 catalog_manager.cc:5017] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 2b2b20dc77954af7a203f357c746be29 because the tablet was not found. No further retry: Not found: Tablet not found: 2b2b20dc77954af7a203f357c746be29
I20260810 19:48:04.057087 10371 tablet_replica.cc:333] T 0dd49d6fa79e4677b753b6cf9117b02d P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:04.057898 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet da3d8ade850c4d36bd2756c36706195d (table default.Table_07cbcdfa939f47f0a8f10f834f5ce596 [id=51fc4051f8ac425e9b6b5f86acf32827]) successfully deleted
I20260810 19:48:04.058445 10371 raft_consensus.cc:2243] T 0dd49d6fa79e4677b753b6cf9117b02d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:04.058710 10371 raft_consensus.cc:2272] T 0dd49d6fa79e4677b753b6cf9117b02d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:04.059801 10371 ts_tablet_manager.cc:1916] T 0dd49d6fa79e4677b753b6cf9117b02d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:04.061354 12097 log.cc:826] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e: Log is configured to *not* fsync() on all Append() calls
I20260810 19:48:04.061664 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 0849ea9c04104a8184f8a8cd40e06fc2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:04.055823 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet dbd3b0b6b636432481f30fc84446e584
I20260810 19:48:04.064702 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet b853bf6bbc7845bc9cfa6347687582e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:04.065373 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet 0849ea9c04104a8184f8a8cd40e06fc2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:04.068944 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet dbd3b0b6b636432481f30fc84446e584 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:04.070401 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e6007d18986c4545bd6fdce7b12dc200"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:04.072114 10367 tablet_bootstrap.cc:492] T ae3e151180ae4d258d18365770acaaad P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:04.072228 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet dbd3b0b6b636432481f30fc84446e584 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:04.072441 10367 ts_tablet_manager.cc:1403] T ae3e151180ae4d258d18365770acaaad P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.052s user 0.005s sys 0.000s
I20260810 19:48:04.073504 10367 raft_consensus.cc:359] T ae3e151180ae4d258d18365770acaaad P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.073789 10367 raft_consensus.cc:385] T ae3e151180ae4d258d18365770acaaad P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.074008 10367 raft_consensus.cc:740] T ae3e151180ae4d258d18365770acaaad P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.074276 10367 consensus_queue.cc:260] T ae3e151180ae4d258d18365770acaaad P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.074903 10367 ts_tablet_manager.cc:1434] T ae3e151180ae4d258d18365770acaaad P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:04.077828 10367 tablet_bootstrap.cc:492] T dcb3660108094399b36d19ea8e6b8308 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:04.083596 10367 tablet_bootstrap.cc:654] T dcb3660108094399b36d19ea8e6b8308 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.084084 11518 raft_consensus.cc:493] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:04.084303 11518 raft_consensus.cc:515] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.085084 11518 leader_election.cc:290] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:04.085693 10371 ts_tablet_manager.cc:1929] T 0dd49d6fa79e4677b753b6cf9117b02d P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:04.086229 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2c77a8ac1614bb286e4e168bcf999f3" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:04.086509 9948 raft_consensus.cc:2468] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:04.087245 10067 leader_election.cc:304] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:04.087986 11518 raft_consensus.cc:2804] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260810 19:48:04.088068 10068 leader_election.cc:343] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: d2c77a8ac1614bb286e4e168bcf999f3
I20260810 19:48:04.088081 11518 raft_consensus.cc:493] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:04.088230 11518 raft_consensus.cc:3060] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:04.090452 10371 log.cc:1199] T 0dd49d6fa79e4677b753b6cf9117b02d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/0dd49d6fa79e4677b753b6cf9117b02d
I20260810 19:48:04.090929 10371 ts_tablet_manager.cc:1950] T 0dd49d6fa79e4677b753b6cf9117b02d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:04.096051 10367 tablet_bootstrap.cc:492] T dcb3660108094399b36d19ea8e6b8308 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:04.096310 10367 ts_tablet_manager.cc:1403] T dcb3660108094399b36d19ea8e6b8308 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.000s
I20260810 19:48:04.097213 10367 raft_consensus.cc:359] T dcb3660108094399b36d19ea8e6b8308 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.097494 10367 raft_consensus.cc:385] T dcb3660108094399b36d19ea8e6b8308 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.097590 10367 raft_consensus.cc:740] T dcb3660108094399b36d19ea8e6b8308 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.097553 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet b853bf6bbc7845bc9cfa6347687582e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:04.097877 10367 consensus_queue.cc:260] T dcb3660108094399b36d19ea8e6b8308 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.099068 10367 ts_tablet_manager.cc:1434] T dcb3660108094399b36d19ea8e6b8308 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:48:04.099382 10367 tablet_bootstrap.cc:492] T 4dba7046bdfd41f1a2ad6f299a723776 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:04.101197 10367 tablet_bootstrap.cc:654] T 4dba7046bdfd41f1a2ad6f299a723776 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.106825 12138 raft_consensus.cc:493] T 00fe7d9a548a487d965d92b53cdf9250 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:04.106990 12138 raft_consensus.cc:515] T 00fe7d9a548a487d965d92b53cdf9250 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.107653 12138 leader_election.cc:290] T 00fe7d9a548a487d965d92b53cdf9250 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:04.109824 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e6007d18986c4545bd6fdce7b12dc200 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:04.110361 10367 tablet_bootstrap.cc:492] T 4dba7046bdfd41f1a2ad6f299a723776 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:04.110502 10367 ts_tablet_manager.cc:1403] T 4dba7046bdfd41f1a2ad6f299a723776 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260810 19:48:04.110597 10370 tablet_bootstrap.cc:492] T 3b6187dbe1ca42f79bf3eddd5475b929 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:04.112587 12106 raft_consensus.cc:493] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:04.112711 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 0dd49d6fa79e4677b753b6cf9117b02d (table default.Table_ebe965457d0c46a39803fb5155a0bc0c [id=11015256d39042599eae0f05e96dca2d]) successfully deleted
I20260810 19:48:04.113430 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e897b6492b3e40feb25bfd4dcc970908"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:04.114670 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e897b6492b3e40feb25bfd4dcc970908 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:04.115975 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 0849ea9c04104a8184f8a8cd40e06fc2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0849ea9c04104a8184f8a8cd40e06fc2 already in progress: creating tablet
I20260810 19:48:04.118502 9412 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 63b649cbc1d141d8bb438105b8e8537c (table default.Table_b059137abb0e458bbadca41a2f2e8b50 [id=9eaa5e14e854425e8971160c64ee97cf]). Expected version 1 got 0
I20260810 19:48:04.118955 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2adfdcdb33f543d49ea6f361bf8a55c4" } modify_external_catalogs: true
I20260810 19:48:04.119159 10367 raft_consensus.cc:359] T 4dba7046bdfd41f1a2ad6f299a723776 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.119364 10367 raft_consensus.cc:385] T 4dba7046bdfd41f1a2ad6f299a723776 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.119415 10367 raft_consensus.cc:740] T 4dba7046bdfd41f1a2ad6f299a723776 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.119287 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2adfdcdb33f543d49ea6f361bf8a55c4" } modify_external_catalogs: true
I20260810 19:48:04.119692 10367 consensus_queue.cc:260] T 4dba7046bdfd41f1a2ad6f299a723776 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:04.120078 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet b853bf6bbc7845bc9cfa6347687582e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b853bf6bbc7845bc9cfa6347687582e2 already in progress: creating tablet
I20260810 19:48:04.120216 10367 ts_tablet_manager.cc:1434] T 4dba7046bdfd41f1a2ad6f299a723776 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20260810 19:48:04.120544 10367 tablet_bootstrap.cc:492] T 5394eadabf184158864921dd5d394828 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
W20260810 19:48:04.120563 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet dbd3b0b6b636432481f30fc84446e584 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbd3b0b6b636432481f30fc84446e584 already in progress: creating tablet
I20260810 19:48:04.121237 9412 catalog_manager.cc:5719] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 1 to 2, leader changed from eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195) to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 2 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:04.121958 9412 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet fb7b722c43ee4b8698b19b2b6c1b401d (table default.Table_0a12a994a3ff4ff8850e8c0d6c0e42ca [id=374cf9ed870c448fbbdad7050d0d11f9]). Expected version 1 got 0
I20260810 19:48:04.122262 10367 tablet_bootstrap.cc:654] T 5394eadabf184158864921dd5d394828 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.122498 9412 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 3e8ae48a2fb548358176abefe1ee3baa (table default.Table_9cb0cc2a8f724781a638706ddcc2c085 [id=12db110e89e04d40bdb05ec61fd5e3b6]). Expected version 1 got 0
I20260810 19:48:04.125749 9791 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
W20260810 19:48:04.126752 9831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 100762us
I20260810 19:48:04.127065 9831 leader_election.cc:304] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:04.127380 12129 raft_consensus.cc:2804] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:04.127501 12129 raft_consensus.cc:697] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:04.127790 12129 consensus_queue.cc:237] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.135725 12138 raft_consensus.cc:493] T 63486cc3f8774a11827b1cc5f1c16332 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:04.135934 12138 raft_consensus.cc:515] T 63486cc3f8774a11827b1cc5f1c16332 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.136709 12138 leader_election.cc:290] T 63486cc3f8774a11827b1cc5f1c16332 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:04.137359 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63486cc3f8774a11827b1cc5f1c16332" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:04.138059 9611 leader_election.cc:343] T 63486cc3f8774a11827b1cc5f1c16332 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:03.991110 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd49d6fa79e4677b753b6cf9117b02d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:04.142782 10375 ts_tablet_manager.cc:1916] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:04.108870 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00fe7d9a548a487d965d92b53cdf9250" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:04.143998 9611 leader_election.cc:343] T 0dd49d6fa79e4677b753b6cf9117b02d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:04.144238 9611 leader_election.cc:343] T 00fe7d9a548a487d965d92b53cdf9250 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.112773 12106 raft_consensus.cc:515] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.146104 12106 leader_election.cc:290] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:03.959475 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8ae48a2fb548358176abefe1ee3baa" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:04.147197 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476e762e46c04ae6bfef5e14df2d16e2" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:04.147442 9948 raft_consensus.cc:2468] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:04.148092 10067 leader_election.cc:304] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:04.148500 12106 raft_consensus.cc:2804] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:04.148591 12106 raft_consensus.cc:493] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:04.148659 12106 raft_consensus.cc:3060] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:04.149472 10068 leader_election.cc:343] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 476e762e46c04ae6bfef5e14df2d16e2
I20260810 19:48:04.155268 12129 consensus_queue.cc:1048] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:04.158022 10367 tablet_bootstrap.cc:492] T 5394eadabf184158864921dd5d394828 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:04.158219 10367 ts_tablet_manager.cc:1403] T 5394eadabf184158864921dd5d394828 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.038s user 0.006s sys 0.009s
I20260810 19:48:04.159205 10367 raft_consensus.cc:359] T 5394eadabf184158864921dd5d394828 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.159385 10367 raft_consensus.cc:385] T 5394eadabf184158864921dd5d394828 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.159430 10367 raft_consensus.cc:740] T 5394eadabf184158864921dd5d394828 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.159727 10367 consensus_queue.cc:260] T 5394eadabf184158864921dd5d394828 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.160274 10367 ts_tablet_manager.cc:1434] T 5394eadabf184158864921dd5d394828 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:04.165110 9831 leader_election.cc:304] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:04.165704 12129 raft_consensus.cc:2804] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:04.165910 12129 raft_consensus.cc:697] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:04.166774 12138 raft_consensus.cc:493] T 4dba7046bdfd41f1a2ad6f299a723776 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:04.166923 12138 raft_consensus.cc:515] T 4dba7046bdfd41f1a2ad6f299a723776 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.167554 12138 leader_election.cc:290] T 4dba7046bdfd41f1a2ad6f299a723776 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:04.167462 12129 consensus_queue.cc:237] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.168118 10367 tablet_bootstrap.cc:492] T 3fd5cd2e4c104e45a81d2603c6f7d24a P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:04.170032 10367 tablet_bootstrap.cc:654] T 3fd5cd2e4c104e45a81d2603c6f7d24a P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.191816 12172 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c56283079e74549afd0096f7e72046a)
I20260810 19:48:04.192227 12172 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } }
I20260810 19:48:04.194233 12172 leader_election.cc:290] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f52c40e347e24ab4b3129e7064f4a43e (127.8.235.253:37397), 0c56283079e74549afd0096f7e72046a (127.8.235.252:43301)
I20260810 19:48:04.194300 9435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5268e710af3c43ddab70eb7dd1aaa575" candidate_term: 2 candidate_status { last_received { term: 1 index: 952 } } ignore_live_leader: false dest_uuid: "0c56283079e74549afd0096f7e72046a" is_pre_election: true
I20260810 19:48:04.194767 10367 tablet_bootstrap.cc:492] T 3fd5cd2e4c104e45a81d2603c6f7d24a P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:04.195429 10367 ts_tablet_manager.cc:1403] T 3fd5cd2e4c104e45a81d2603c6f7d24a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.008s
I20260810 19:48:04.197376 10367 raft_consensus.cc:359] T 3fd5cd2e4c104e45a81d2603c6f7d24a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.197762 10367 raft_consensus.cc:385] T 3fd5cd2e4c104e45a81d2603c6f7d24a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.197885 10367 raft_consensus.cc:740] T 3fd5cd2e4c104e45a81d2603c6f7d24a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.198762 10367 consensus_queue.cc:260] T 3fd5cd2e4c104e45a81d2603c6f7d24a P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.201488 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd49d6fa79e4677b753b6cf9117b02d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:04.202062 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00fe7d9a548a487d965d92b53cdf9250" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:04.202461 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63486cc3f8774a11827b1cc5f1c16332" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:04.202795 9941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dba7046bdfd41f1a2ad6f299a723776" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:04.203173 10367 ts_tablet_manager.cc:1434] T 3fd5cd2e4c104e45a81d2603c6f7d24a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260810 19:48:04.204944 10367 tablet_bootstrap.cc:492] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:04.206947 10366 tablet_bootstrap.cc:492] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:04.207114 10366 ts_tablet_manager.cc:1403] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.202s user 0.003s sys 0.000s
I20260810 19:48:04.207983 10366 raft_consensus.cc:359] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.208184 10366 raft_consensus.cc:385] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.208254 10366 raft_consensus.cc:740] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.208551 10366 consensus_queue.cc:260] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.209125 10366 ts_tablet_manager.cc:1434] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:04.209460 10366 tablet_bootstrap.cc:492] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:04.211345 10366 tablet_bootstrap.cc:654] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.215876 10367 tablet_bootstrap.cc:654] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.223304 10127 tablet_service.cc:1558] Processing DeleteTablet for tablet dbd3b0b6b636432481f30fc84446e584 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:04.223620 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet 0849ea9c04104a8184f8a8cd40e06fc2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:04.232818 12115 log.cc:927] Time spent T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0: Append to log took a long time: real 0.121s user 0.000s sys 0.000s
I20260810 19:48:04.234048 10139 tablet_service.cc:1558] Processing DeleteTablet for tablet b853bf6bbc7845bc9cfa6347687582e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:04.238920 10150 raft_consensus.cc:1275] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [term 2 FOLLOWER]: Refusing update from remote peer 6986ed920dcb4af29a5eeeda6f671691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260810 19:48:04.243482 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dba7046bdfd41f1a2ad6f299a723776" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:04.244076 9830 leader_election.cc:343] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:04.246469 9611 leader_election.cc:343] T 4dba7046bdfd41f1a2ad6f299a723776 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.250643 12106 raft_consensus.cc:515] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.252049 10150 pending_rounds.cc:85] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0: Aborting all ops after (but not including) 0
I20260810 19:48:04.252164 10150 pending_rounds.cc:107] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260810 19:48:04.252133 9941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476e762e46c04ae6bfef5e14df2d16e2" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:04.252293 10150 raft_consensus.cc:2889] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260810 19:48:04.252377 10150 pending_rounds.cc:107] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0: Aborting uncommitted ALTER_SCHEMA_OP operation due to leader change: 1.2
I20260810 19:48:04.252358 9941 raft_consensus.cc:3060] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:04.252837 12106 leader_election.cc:290] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:04.253361 11518 raft_consensus.cc:515] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:04.254191 10068 leader_election.cc:343] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 476e762e46c04ae6bfef5e14df2d16e2
I20260810 19:48:04.255295 9941 raft_consensus.cc:2468] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
W20260810 19:48:04.255329 10150 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41610: Aborted: Op aborted by new leader
I20260810 19:48:04.255915 10370 tablet_bootstrap.cc:654] T 3b6187dbe1ca42f79bf3eddd5475b929 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.255946 10067 leader_election.cc:304] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:04.260681 12106 raft_consensus.cc:2804] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:04.260867 12106 raft_consensus.cc:697] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:04.261803 10367 tablet_bootstrap.cc:492] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:04.262100 10367 ts_tablet_manager.cc:1403] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.058s user 0.007s sys 0.006s
I20260810 19:48:04.263631 10367 raft_consensus.cc:359] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.263866 10150 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:41610 (request call id 694) took 1237 ms. Trace:
I20260810 19:48:04.263973 10367 raft_consensus.cc:385] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.264149 11518 leader_election.cc:290] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:04.264107 10367 raft_consensus.cc:740] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.265173 9941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2c77a8ac1614bb286e4e168bcf999f3" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:04.265416 9941 raft_consensus.cc:3060] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:04.264765 10367 consensus_queue.cc:260] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.268568 9941 raft_consensus.cc:2468] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:04.268874 10367 ts_tablet_manager.cc:1434] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260810 19:48:04.269587 10067 leader_election.cc:304] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:04.271170 10367 tablet_bootstrap.cc:492] T 2798f122e0624af6971fc8317244e5ae P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
W20260810 19:48:04.272164 10068 leader_election.cc:343] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: d2c77a8ac1614bb286e4e168bcf999f3
I20260810 19:48:04.272581 11518 raft_consensus.cc:2804] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:04.272718 11518 raft_consensus.cc:697] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:04.272964 12138 raft_consensus.cc:493] T 5394eadabf184158864921dd5d394828 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:04.273092 12138 raft_consensus.cc:515] T 5394eadabf184158864921dd5d394828 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.261144 12106 consensus_queue.cc:237] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.273768 12138 leader_election.cc:290] T 5394eadabf184158864921dd5d394828 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:04.272986 11518 consensus_queue.cc:237] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.285221 10367 tablet_bootstrap.cc:654] T 2798f122e0624af6971fc8317244e5ae P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.263972 10150 rpcz_store.cc:276] 0810 19:48:03.023293 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:03.038868 (+ 15575us) service_pool.cc:224] Handling call
0810 19:48:04.260370 (+1221502us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:48:03.044649 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 19:48:03.044761 (+ 112us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 19:48:03.044770 (+ 9us) alter_schema_op.cc:66] Acquired schema lock
0810 19:48:03.044776 (+ 6us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 19:48:03.044817 (+ 41us) alter_schema_op.cc:128] START. Timestamp: 1786391283044778
0810 19:48:03.044820 (+ 3us) op_driver.cc:348] REPLICATION: starting
0810 19:48:03.045015 (+ 195us) log.cc:844] Serialized 173 byte log entry
0810 19:48:04.252476 (+1207461us) op_driver.cc:464] REPLICATION: finished
0810 19:48:04.254609 (+ 2133us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
0810 19:48:04.254623 (+ 14us) alter_schema_op.cc:171] AlterSchemaCommitCallback: op aborted
Metrics: {"child_traces":[["op",{"prepare.queue_time_us":2078,"prepare.run_cpu_time_us":480,"prepare.run_wall_time_us":480,"raft.queue_time_us":408,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":371,"replication_time_us":1207604}]]}
I20260810 19:48:04.288735 12129 consensus_queue.cc:1048] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:04.292985 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5394eadabf184158864921dd5d394828" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:04.293622 9611 leader_election.cc:343] T 5394eadabf184158864921dd5d394828 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.297091 10370 tablet_bootstrap.cc:492] T 3b6187dbe1ca42f79bf3eddd5475b929 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:04.297333 10370 ts_tablet_manager.cc:1403] T 3b6187dbe1ca42f79bf3eddd5475b929 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.187s user 0.006s sys 0.003s
I20260810 19:48:04.298264 10370 raft_consensus.cc:359] T 3b6187dbe1ca42f79bf3eddd5475b929 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.299775 10370 raft_consensus.cc:385] T 3b6187dbe1ca42f79bf3eddd5475b929 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.299907 10370 raft_consensus.cc:740] T 3b6187dbe1ca42f79bf3eddd5475b929 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.300186 10370 consensus_queue.cc:260] T 3b6187dbe1ca42f79bf3eddd5475b929 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:04.315178 9611 leader_election.cc:343] T 0dd49d6fa79e4677b753b6cf9117b02d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.315371 9611 leader_election.cc:304] T 0dd49d6fa79e4677b753b6cf9117b02d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
W20260810 19:48:04.315586 9611 raft_consensus.cc:2686] T 0dd49d6fa79e4677b753b6cf9117b02d P fcd31b1bbb0340cbacfce652b4ad8da4: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260810 19:48:04.318692 9611 leader_election.cc:343] T 00fe7d9a548a487d965d92b53cdf9250 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.318840 9611 leader_election.cc:304] T 00fe7d9a548a487d965d92b53cdf9250 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
W20260810 19:48:04.319569 9611 leader_election.cc:343] T 63486cc3f8774a11827b1cc5f1c16332 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.319682 9611 leader_election.cc:304] T 63486cc3f8774a11827b1cc5f1c16332 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:04.319939 12146 raft_consensus.cc:2749] T 00fe7d9a548a487d965d92b53cdf9250 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:04.320150 12146 raft_consensus.cc:2749] T 63486cc3f8774a11827b1cc5f1c16332 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:04.323040 9611 leader_election.cc:343] T 4dba7046bdfd41f1a2ad6f299a723776 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.323246 9611 leader_election.cc:304] T 4dba7046bdfd41f1a2ad6f299a723776 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:04.323555 12138 raft_consensus.cc:2749] T 4dba7046bdfd41f1a2ad6f299a723776 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:04.328316 9941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5394eadabf184158864921dd5d394828" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:04.330657 12086 raft_consensus.cc:493] T 965395b5072e4d47adac504e22a8d484 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:04.330806 12086 raft_consensus.cc:515] T 965395b5072e4d47adac504e22a8d484 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.331414 12086 leader_election.cc:290] T 965395b5072e4d47adac504e22a8d484 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:04.332222 12086 raft_consensus.cc:493] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:04.332360 12086 raft_consensus.cc:515] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.332939 12086 leader_election.cc:290] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:04.333288 10367 tablet_bootstrap.cc:492] T 2798f122e0624af6971fc8317244e5ae P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:04.333575 10367 ts_tablet_manager.cc:1403] T 2798f122e0624af6971fc8317244e5ae P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.063s user 0.007s sys 0.010s
I20260810 19:48:04.335131 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965395b5072e4d47adac504e22a8d484" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:04.335314 10367 raft_consensus.cc:359] T 2798f122e0624af6971fc8317244e5ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.335709 10367 raft_consensus.cc:385] T 2798f122e0624af6971fc8317244e5ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.335846 10367 raft_consensus.cc:740] T 2798f122e0624af6971fc8317244e5ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.336357 10367 consensus_queue.cc:260] T 2798f122e0624af6971fc8317244e5ae P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.341792 10367 ts_tablet_manager.cc:1434] T 2798f122e0624af6971fc8317244e5ae P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260810 19:48:04.343173 10367 tablet_bootstrap.cc:492] T a45add97e0e54dce85225e175ecbb45a P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:04.347579 12138 raft_consensus.cc:493] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:04.347746 12138 raft_consensus.cc:515] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.348428 12138 leader_election.cc:290] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:04.350731 12208 tablet.cc:1724] T 0c0a1e360ac648eeb0c734215bc200f6 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 19:48:04.355177 9830 leader_election.cc:343] T 965395b5072e4d47adac504e22a8d484 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.356598 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8a23221e8447bd83592c05c9d1149c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:04.357026 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf33d82af9e494a8e85be8cba55d2c9" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:04.357424 12085 tablet.cc:1724] T 0c0a1e360ac648eeb0c734215bc200f6 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 19:48:04.358146 9611 leader_election.cc:343] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:04.358158 9830 leader_election.cc:343] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.365795 10370 ts_tablet_manager.cc:1434] T 3b6187dbe1ca42f79bf3eddd5475b929 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.068s user 0.002s sys 0.000s
I20260810 19:48:04.366161 10370 tablet_bootstrap.cc:492] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:04.371371 11897 consensus_queue.cc:1048] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:04.376770 10367 tablet_bootstrap.cc:654] T a45add97e0e54dce85225e175ecbb45a P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.381454 10370 tablet_bootstrap.cc:654] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:04.384698 9611 leader_election.cc:343] T 5394eadabf184158864921dd5d394828 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.384846 9611 leader_election.cc:304] T 5394eadabf184158864921dd5d394828 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:04.385111 12138 raft_consensus.cc:2749] T 5394eadabf184158864921dd5d394828 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:04.387991 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8a23221e8447bd83592c05c9d1149c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:04.388586 9611 leader_election.cc:343] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.388702 9611 leader_election.cc:304] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:04.389115 12146 raft_consensus.cc:2749] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:04.390254 9791 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:48:04.392668 12207 tablet.cc:1724] T 0c0a1e360ac648eeb0c734215bc200f6 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 19:48:04.397852 9400 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 08ac9ae9eceb42b3880c4f35556994c7 (table default.Table_b15450030540496a8b6e252f5f57722c [id=fd632e7e6cd4416d992f41a2681f4c6a], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 08ac9ae9eceb42b3880c4f35556994c7 consensus state has no leader
W20260810 19:48:04.399369 9395 catalog_manager.cc:5129] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): alter failed for tablet fb7b722c43ee4b8698b19b2b6c1b401d (table default.Table_0a12a994a3ff4ff8850e8c0d6c0e42ca [id=374cf9ed870c448fbbdad7050d0d11f9]): Aborted: Op aborted by new leader
I20260810 19:48:04.424628 12087 raft_consensus.cc:493] T 72b39babf851404c89adb317033015ec P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:04.424973 12087 raft_consensus.cc:515] T 72b39babf851404c89adb317033015ec P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.432827 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b39babf851404c89adb317033015ec" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:04.433562 9830 leader_election.cc:343] T 72b39babf851404c89adb317033015ec P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.434196 10367 tablet_bootstrap.cc:492] T a45add97e0e54dce85225e175ecbb45a P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:04.434384 10367 ts_tablet_manager.cc:1403] T a45add97e0e54dce85225e175ecbb45a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.091s user 0.009s sys 0.003s
I20260810 19:48:04.434669 12087 leader_election.cc:290] T 72b39babf851404c89adb317033015ec P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:04.435252 10367 raft_consensus.cc:359] T a45add97e0e54dce85225e175ecbb45a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.435432 10367 raft_consensus.cc:385] T a45add97e0e54dce85225e175ecbb45a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.435482 10367 raft_consensus.cc:740] T a45add97e0e54dce85225e175ecbb45a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.435683 10367 consensus_queue.cc:260] T a45add97e0e54dce85225e175ecbb45a P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.436177 10367 ts_tablet_manager.cc:1434] T a45add97e0e54dce85225e175ecbb45a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:04.436484 10367 tablet_bootstrap.cc:492] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:04.443866 10367 tablet_bootstrap.cc:654] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.449285 10375 ts_tablet_manager.cc:1929] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:04.449666 10375 log.cc:1199] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/ee65b2c9980d4c77af8c68bf2f5c5f92
I20260810 19:48:04.450651 10375 ts_tablet_manager.cc:1950] T ee65b2c9980d4c77af8c68bf2f5c5f92 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
W20260810 19:48:04.446182 9831 leader_election.cc:343] T 965395b5072e4d47adac504e22a8d484 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 965395b5072e4d47adac504e22a8d484
I20260810 19:48:04.451563 9831 leader_election.cc:304] T 965395b5072e4d47adac504e22a8d484 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:04.452042 10370 tablet_bootstrap.cc:492] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:04.452183 10370 ts_tablet_manager.cc:1403] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.086s user 0.003s sys 0.000s
I20260810 19:48:04.452888 10370 raft_consensus.cc:359] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.453068 10370 raft_consensus.cc:385] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.452968 12087 raft_consensus.cc:2749] T 965395b5072e4d47adac504e22a8d484 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:04.453223 10370 raft_consensus.cc:740] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.453526 10370 consensus_queue.cc:260] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.455893 10370 ts_tablet_manager.cc:1434] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 19:48:04.456663 10370 tablet_bootstrap.cc:492] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:04.460506 10367 tablet_bootstrap.cc:492] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:04.461004 10367 ts_tablet_manager.cc:1403] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.000s
I20260810 19:48:04.461989 10367 raft_consensus.cc:359] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.462270 10367 raft_consensus.cc:385] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.462411 10367 raft_consensus.cc:740] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.462762 10367 consensus_queue.cc:260] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.463402 10367 ts_tablet_manager.cc:1434] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260810 19:48:04.468366 10130 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41610: Illegal state: replica eadde59fd6504d679e47f03a60c64bb0 is not leader of this config: current role FOLLOWER
I20260810 19:48:04.476519 10367 tablet_bootstrap.cc:492] T 3582ed23ffdf4ff089952e29083e5425 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:04.477618 10366 tablet_bootstrap.cc:492] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:04.477798 10366 ts_tablet_manager.cc:1403] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.268s user 0.000s sys 0.003s
W20260810 19:48:04.478633 10068 consensus_peers.cc:597] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 21208dd824fe432fa307cbb88d37aaa2. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:04.479092 10366 raft_consensus.cc:359] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.479276 10366 raft_consensus.cc:385] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.479336 10366 raft_consensus.cc:740] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.480226 10366 consensus_queue.cc:260] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:04.452734 9831 leader_election.cc:343] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: ebf33d82af9e494a8e85be8cba55d2c9
I20260810 19:48:04.480628 9831 leader_election.cc:304] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:04.481040 10370 tablet_bootstrap.cc:654] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.481083 12087 raft_consensus.cc:2749] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:04.481899 10367 tablet_bootstrap.cc:654] T 3582ed23ffdf4ff089952e29083e5425 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.481635 10366 ts_tablet_manager.cc:1434] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260810 19:48:04.486397 10366 tablet_bootstrap.cc:492] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:04.497321 10366 tablet_bootstrap.cc:654] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.511272 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_4808a61b7def4aeb935036bb48bb8d40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:04.511868 10370 tablet_bootstrap.cc:492] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:04.512065 10370 ts_tablet_manager.cc:1403] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.055s user 0.011s sys 0.000s
I20260810 19:48:04.510182 10377 ts_tablet_manager.cc:1929] T 0d79ef93c5bf4ac9895e594198edb251 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260810 19:48:04.517953 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4808a61b7def4aeb935036bb48bb8d40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:04.517071 10377 log.cc:1199] T 0d79ef93c5bf4ac9895e594198edb251 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/0d79ef93c5bf4ac9895e594198edb251
I20260810 19:48:04.514147 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet d2c77a8ac1614bb286e4e168bcf999f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:04.514854 10134 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41610: Illegal state: replica eadde59fd6504d679e47f03a60c64bb0 is not leader of this config: current role FOLLOWER
I20260810 19:48:04.522665 10367 tablet_bootstrap.cc:492] T 3582ed23ffdf4ff089952e29083e5425 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:04.523303 10370 raft_consensus.cc:359] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.523684 10367 ts_tablet_manager.cc:1403] T 3582ed23ffdf4ff089952e29083e5425 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.009s
I20260810 19:48:04.523839 10370 raft_consensus.cc:385] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.524849 10370 raft_consensus.cc:740] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.525218 10370 consensus_queue.cc:260] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:04.525529 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e68916e2568f4527a181342cdc728001 consensus state has no leader
I20260810 19:48:04.529409 11518 raft_consensus.cc:493] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:04.529564 11518 raft_consensus.cc:515] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.531123 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fb544dff4eb4642b7e282657ae15d19" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:04.531373 9944 raft_consensus.cc:2468] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:04.524726 10367 raft_consensus.cc:359] T 3582ed23ffdf4ff089952e29083e5425 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.531704 10367 raft_consensus.cc:385] T 3582ed23ffdf4ff089952e29083e5425 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.532141 10367 raft_consensus.cc:740] T 3582ed23ffdf4ff089952e29083e5425 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.532423 10367 consensus_queue.cc:260] T 3582ed23ffdf4ff089952e29083e5425 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.533013 10367 ts_tablet_manager.cc:1434] T 3582ed23ffdf4ff089952e29083e5425 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.009s user 0.000s sys 0.001s
I20260810 19:48:04.533737 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet 86937c581d4c46d38699b268b1e0c42d from {username='slave'} at 127.0.0.1:56048
W20260810 19:48:04.535863 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 81f0f3f88d26432fbadc5e90aaa5d158 consensus state has no leader
W20260810 19:48:04.518743 9831 leader_election.cc:343] T 72b39babf851404c89adb317033015ec P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 72b39babf851404c89adb317033015ec
I20260810 19:48:04.529599 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 633) took 2861 ms. Trace:
I20260810 19:48:04.532114 10067 leader_election.cc:304] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:04.543133 9831 leader_election.cc:304] T 72b39babf851404c89adb317033015ec P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:48:04.545034 10068 leader_election.cc:343] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 9fb544dff4eb4642b7e282657ae15d19
I20260810 19:48:04.530344 11518 leader_election.cc:290] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:04.545989 11518 raft_consensus.cc:2804] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:04.545982 12087 raft_consensus.cc:2749] T 72b39babf851404c89adb317033015ec P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:04.546069 11518 raft_consensus.cc:493] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:04.546137 11518 raft_consensus.cc:3060] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:04.546299 10366 tablet_bootstrap.cc:492] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:04.546474 10366 ts_tablet_manager.cc:1403] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.005s
I20260810 19:48:04.544190 10375 rpcz_store.cc:276] 0810 19:48:01.663659 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:01.663819 (+ 160us) service_pool.cc:224] Handling call
0810 19:48:03.962394 (+2298575us) ts_tablet_manager.cc:1151] Deleting tablet ee65b2c9980d4c77af8c68bf2f5c5f92
0810 19:48:03.962412 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:04.229454 (+267042us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:04.449089 (+219635us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:04.524786 (+ 75697us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2178989}
I20260810 19:48:04.546831 10377 ts_tablet_manager.cc:1950] T 0d79ef93c5bf4ac9895e594198edb251 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:04.548482 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet ee65b2c9980d4c77af8c68bf2f5c5f92 (table default.Table_2784ff35cf7944ada0cefff31407d65d [id=77e412a6dedf44a3a69b72b6a9d017aa]) successfully deleted
I20260810 19:48:04.549027 11518 raft_consensus.cc:515] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.551019 10366 raft_consensus.cc:359] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.551237 10366 raft_consensus.cc:385] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.551296 10366 raft_consensus.cc:740] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
W20260810 19:48:04.551553 10068 leader_election.cc:343] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 9fb544dff4eb4642b7e282657ae15d19
I20260810 19:48:04.552062 11518 leader_election.cc:290] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:04.531543 10370 ts_tablet_manager.cc:1434] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260810 19:48:04.551522 10366 consensus_queue.cc:260] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.552666 10367 tablet_bootstrap.cc:492] T f3600d0528164850973cb296aaf6910f P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:04.554036 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fb544dff4eb4642b7e282657ae15d19" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:04.554214 9944 raft_consensus.cc:3060] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:04.554560 10366 ts_tablet_manager.cc:1434] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260810 19:48:04.555074 10366 tablet_bootstrap.cc:492] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:04.554987 10375 tablet_replica.cc:333] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:04.557112 9944 raft_consensus.cc:2468] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:04.557736 10067 leader_election.cc:304] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:04.558462 11828 raft_consensus.cc:2804] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:04.558593 11828 raft_consensus.cc:697] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:04.558861 11828 consensus_queue.cc:237] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.560930 10247 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:48:04.561067 10171 raft_consensus.cc:3060] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:04.559628 10375 raft_consensus.cc:2243] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:04.561826 11518 consensus_queue.cc:1048] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:04.565480 10375 raft_consensus.cc:2272] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:04.565688 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 656) took 2808 ms. Trace:
I20260810 19:48:04.565544 10370 tablet_bootstrap.cc:492] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:04.568173 10370 tablet_bootstrap.cc:654] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.566242 10377 rpcz_store.cc:276] 0810 19:48:01.756880 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:01.757097 (+ 217us) service_pool.cc:224] Handling call
0810 19:48:04.022830 (+2265733us) ts_tablet_manager.cc:1151] Deleting tablet 0d79ef93c5bf4ac9895e594198edb251
0810 19:48:04.022877 (+ 47us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:04.373425 (+350548us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:04.489740 (+116315us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:04.565555 (+ 75815us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131,"tablet-delete.queue_time_us":2265593}
I20260810 19:48:04.570566 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 0d79ef93c5bf4ac9895e594198edb251 (table default.Table_949bcc619f4b45189db61b24b5598e66 [id=ed1551c0accc41eead911b83ee4c0a6f]) successfully deleted
I20260810 19:48:04.573612 10367 tablet_bootstrap.cc:654] T f3600d0528164850973cb296aaf6910f P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.574906 10375 ts_tablet_manager.cc:1916] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:04.576046 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c98abecdcb3043558419cbdff0a68d75"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:04.576713 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c98abecdcb3043558419cbdff0a68d75 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:04.578457 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e4e351705cb84297a4388268a731fd9c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:04.579074 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4e351705cb84297a4388268a731fd9c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:04.582348 10367 tablet_bootstrap.cc:492] T f3600d0528164850973cb296aaf6910f P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:04.582525 10367 ts_tablet_manager.cc:1403] T f3600d0528164850973cb296aaf6910f P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.005s
I20260810 19:48:04.583379 10367 raft_consensus.cc:359] T f3600d0528164850973cb296aaf6910f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.583577 10367 raft_consensus.cc:385] T f3600d0528164850973cb296aaf6910f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.583648 10367 raft_consensus.cc:740] T f3600d0528164850973cb296aaf6910f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.583890 10367 consensus_queue.cc:260] T f3600d0528164850973cb296aaf6910f P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.584458 10367 ts_tablet_manager.cc:1434] T f3600d0528164850973cb296aaf6910f P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:04.587393 9416 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56048 (request call id 951) took 1006 ms. Trace:
I20260810 19:48:04.587549 9416 rpcz_store.cc:276] 0810 19:48:03.580402 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.074504 (+494102us) service_pool.cc:224] Handling call
0810 19:48:04.114803 (+ 40299us) catalog_manager.cc:2127] Acquired catalog manager lock
0810 19:48:04.115342 (+ 539us) catalog_manager.cc:2173] Created new table and tablet info
0810 19:48:04.587074 (+471732us) catalog_manager.cc:2233] Wrote table and tablets to system table
0810 19:48:04.587190 (+ 116us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0810 19:48:04.587314 (+ 124us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:48:04.523769 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 19:48:04.523884 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0810 19:48:04.523890 (+ 6us) write_op.cc:435] Acquired schema lock
0810 19:48:04.523893 (+ 3us) tablet.cc:662] Decoding operations
0810 19:48:04.523978 (+ 85us) write_op.cc:620] Acquiring the partition lock for write op
0810 19:48:04.523988 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0810 19:48:04.523992 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0810 19:48:04.524060 (+ 68us) tablet.cc:701] Row locks acquired
0810 19:48:04.524062 (+ 2us) write_op.cc:260] PREPARE: finished
0810 19:48:04.524105 (+ 43us) write_op.cc:270] Start()
0810 19:48:04.524140 (+ 35us) write_op.cc:276] Timestamp: P: 1786391284524079 usec, L: 0
0810 19:48:04.524144 (+ 4us) op_driver.cc:348] REPLICATION: starting
0810 19:48:04.524314 (+ 170us) log.cc:844] Serialized 433 byte log entry
0810 19:48:04.586221 (+ 61907us) op_driver.cc:464] REPLICATION: finished
0810 19:48:04.586455 (+ 234us) write_op.cc:301] APPLY: starting
0810 19:48:04.586470 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0810 19:48:04.586516 (+ 46us) tablet.cc:1370] finished BulkCheckPresence
0810 19:48:04.586554 (+ 38us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 19:48:04.586653 (+ 99us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 19:48:04.586689 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 19:48:04.586696 (+ 7us) write_op.cc:312] APPLY: finished
0810 19:48:04.586779 (+ 83us) log.cc:844] Serialized 29 byte log entry
0810 19:48:04.586832 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:04.586847 (+ 15us) write_op.cc:454] Released schema lock
0810 19:48:04.586853 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0810 19:48:04.586927 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:04.586930 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":187,"apply.run_cpu_time_us":463,"apply.run_wall_time_us":463,"num_ops":2,"prepare.queue_time_us":407809,"prepare.run_cpu_time_us":614,"prepare.run_wall_time_us":613,"replication_time_us":62046}]]}
I20260810 19:48:04.588400 9416 master_service.cc:960] ReplaceTablet: received request to replace tablet ea557438b7b74944b19e17d7fb8f20cf from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:04.589195 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_454f93562c2f41c7b990019efd3329b8" } new_table_name: "default.Table_e5535527b8e2442fa4edc7b798960924" modify_external_catalogs: true
I20260810 19:48:04.590960 9421 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56048 (request call id 950) took 1010 ms. Trace:
I20260810 19:48:04.591099 9421 rpcz_store.cc:276] 0810 19:48:03.580314 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.070081 (+489767us) service_pool.cc:224] Handling call
0810 19:48:04.113615 (+ 43534us) catalog_manager.cc:2127] Acquired catalog manager lock
0810 19:48:04.116723 (+ 3108us) catalog_manager.cc:2173] Created new table and tablet info
0810 19:48:04.590696 (+473973us) catalog_manager.cc:2233] Wrote table and tablets to system table
0810 19:48:04.590805 (+ 109us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0810 19:48:04.590907 (+ 102us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:48:04.524412 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 19:48:04.524504 (+ 92us) write_op.cc:432] Acquiring schema lock in shared mode
0810 19:48:04.524509 (+ 5us) write_op.cc:435] Acquired schema lock
0810 19:48:04.524511 (+ 2us) tablet.cc:662] Decoding operations
0810 19:48:04.524579 (+ 68us) write_op.cc:620] Acquiring the partition lock for write op
0810 19:48:04.524587 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0810 19:48:04.524591 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0810 19:48:04.524652 (+ 61us) tablet.cc:701] Row locks acquired
0810 19:48:04.524654 (+ 2us) write_op.cc:260] PREPARE: finished
0810 19:48:04.524685 (+ 31us) write_op.cc:270] Start()
0810 19:48:04.537627 (+ 12942us) spinlock_profiling.cc:243] Waited 4.69 ms on lock 0x619000100658. stack: 00007f50aec1d326 00007f50aec1d0e0 00007f50adc4734d 00000000009a5774 00000000009a573d 00000000009a510a 00007f50bc24ae8a 00007f50bc251f6f 00007f50bbfc6b5c 00007f50bbf7e7ea 00007f50bc13c18e 00007f50bc10f42d 00007f50bc10e519 00007f50bc116940 00007f50bc11674d 0000000000aaf86c
0810 19:48:04.537681 (+ 54us) write_op.cc:276] Timestamp: P: 1786391284524662 usec, L: 0
0810 19:48:04.537687 (+ 6us) op_driver.cc:348] REPLICATION: starting
0810 19:48:04.575275 (+ 37588us) log.cc:844] Serialized 433 byte log entry
0810 19:48:04.580440 (+ 5165us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x616000041b54. stack: 00007f50aec1d326 00007f50aec1d0e0 00007f50adc4734d 00000000009a5774 00000000009a573d 00000000009a510a 00007f50bacf3ec2 00007f50bc10f9f5 00007f50bc10e519 00007f50bc116940 00007f50bc11674d 0000000000aaf86c 00007f50aec6384f 00007f50aec66b4b 00007f50aec669c8 0000000000aaf86c
0810 19:48:04.586360 (+ 5920us) op_driver.cc:464] REPLICATION: finished
0810 19:48:04.587000 (+ 640us) write_op.cc:301] APPLY: starting
0810 19:48:04.587011 (+ 11us) tablet.cc:1367] starting BulkCheckPresence
0810 19:48:04.587049 (+ 38us) tablet.cc:1370] finished BulkCheckPresence
0810 19:48:04.587051 (+ 2us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 19:48:04.587151 (+ 100us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 19:48:04.587178 (+ 27us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 19:48:04.587184 (+ 6us) write_op.cc:312] APPLY: finished
0810 19:48:04.587240 (+ 56us) log.cc:844] Serialized 29 byte log entry
0810 19:48:04.587284 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:04.587298 (+ 14us) write_op.cc:454] Released schema lock
0810 19:48:04.587303 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0810 19:48:04.587376 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:04.587381 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":604,"apply.run_cpu_time_us":364,"apply.run_wall_time_us":363,"num_ops":2,"prepare.queue_time_us":407139,"prepare.run_cpu_time_us":1728,"prepare.run_wall_time_us":56111,"raft.queue_time_us":49,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":293,"replication_time_us":48650,"spinlock_wait_cycles":96547584}]]}
I20260810 19:48:04.591957 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e9c6cb527fc84784967198c5b3ae4294" } new_table_name: "default.Table_7f9b257fef5e41f4b0e67f3aab8efd7d" modify_external_catalogs: true
I20260810 19:48:04.599332 10367 tablet_bootstrap.cc:492] T 648ef608fa0c45cc8be4bad80c4200be P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:04.601276 10367 tablet_bootstrap.cc:654] T 648ef608fa0c45cc8be4bad80c4200be P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.608089 9407 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56048 (request call id 953) took 1019 ms. Trace:
I20260810 19:48:04.608242 9407 rpcz_store.cc:276] 0810 19:48:03.587641 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.511000 (+923359us) service_pool.cc:224] Handling call
0810 19:48:04.518090 (+ 7090us) catalog_manager.cc:2127] Acquired catalog manager lock
0810 19:48:04.518620 (+ 530us) catalog_manager.cc:2173] Created new table and tablet info
0810 19:48:04.607246 (+ 88626us) catalog_manager.cc:2233] Wrote table and tablets to system table
0810 19:48:04.607372 (+ 126us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0810 19:48:04.607490 (+ 118us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:48:04.582961 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 19:48:04.583064 (+ 103us) write_op.cc:432] Acquiring schema lock in shared mode
0810 19:48:04.583069 (+ 5us) write_op.cc:435] Acquired schema lock
0810 19:48:04.583072 (+ 3us) tablet.cc:662] Decoding operations
0810 19:48:04.583145 (+ 73us) write_op.cc:620] Acquiring the partition lock for write op
0810 19:48:04.583153 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0810 19:48:04.583157 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0810 19:48:04.583238 (+ 81us) tablet.cc:701] Row locks acquired
0810 19:48:04.583240 (+ 2us) write_op.cc:260] PREPARE: finished
0810 19:48:04.583274 (+ 34us) write_op.cc:270] Start()
0810 19:48:04.583302 (+ 28us) write_op.cc:276] Timestamp: P: 1786391284583244 usec, L: 0
0810 19:48:04.583306 (+ 4us) op_driver.cc:348] REPLICATION: starting
0810 19:48:04.583464 (+ 158us) log.cc:844] Serialized 433 byte log entry
0810 19:48:04.601529 (+ 18065us) op_driver.cc:464] REPLICATION: finished
0810 19:48:04.602132 (+ 603us) write_op.cc:301] APPLY: starting
0810 19:48:04.602143 (+ 11us) tablet.cc:1367] starting BulkCheckPresence
0810 19:48:04.602177 (+ 34us) tablet.cc:1370] finished BulkCheckPresence
0810 19:48:04.602209 (+ 32us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 19:48:04.602408 (+ 199us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 19:48:04.602438 (+ 30us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 19:48:04.602445 (+ 7us) write_op.cc:312] APPLY: finished
0810 19:48:04.602508 (+ 63us) log.cc:844] Serialized 29 byte log entry
0810 19:48:04.602554 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:04.602569 (+ 15us) write_op.cc:454] Released schema lock
0810 19:48:04.602575 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0810 19:48:04.602674 (+ 99us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:04.602678 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":573,"apply.run_cpu_time_us":508,"apply.run_wall_time_us":507,"num_ops":2,"prepare.queue_time_us":63239,"prepare.run_cpu_time_us":572,"prepare.run_wall_time_us":1106,"replication_time_us":18208}]]}
I20260810 19:48:04.612910 10367 tablet_bootstrap.cc:492] T 648ef608fa0c45cc8be4bad80c4200be P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:04.613474 10367 ts_tablet_manager.cc:1403] T 648ef608fa0c45cc8be4bad80c4200be P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.002s
I20260810 19:48:04.615484 10366 tablet_bootstrap.cc:654] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.616875 10367 raft_consensus.cc:359] T 648ef608fa0c45cc8be4bad80c4200be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.617337 10367 raft_consensus.cc:385] T 648ef608fa0c45cc8be4bad80c4200be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.618135 10367 raft_consensus.cc:740] T 648ef608fa0c45cc8be4bad80c4200be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.618816 10367 consensus_queue.cc:260] T 648ef608fa0c45cc8be4bad80c4200be P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.620014 10377 tablet_replica.cc:333] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:04.620358 10377 raft_consensus.cc:2243] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:04.621069 10377 raft_consensus.cc:2272] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:04.621126 10367 ts_tablet_manager.cc:1434] T 648ef608fa0c45cc8be4bad80c4200be P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260810 19:48:04.622232 10367 tablet_bootstrap.cc:492] T 0e967384768b4ec7956f1b508e8ab2af P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:04.622565 10377 ts_tablet_manager.cc:1916] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:04.624178 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_21d8962dbe56454188c9a5b8729034c3" } modify_external_catalogs: true
I20260810 19:48:04.624459 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_21d8962dbe56454188c9a5b8729034c3" } modify_external_catalogs: true
W20260810 19:48:04.624576 9830 consensus_peers.cc:597] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:04.627627 9420 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 63b649cbc1d141d8bb438105b8e8537c (table default.Table_b059137abb0e458bbadca41a2f2e8b50 [id=9eaa5e14e854425e8971160c64ee97cf]). Expected version 1 got 0
I20260810 19:48:04.628561 9420 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 0c0a1e360ac648eeb0c734215bc200f6 (table default.Table_03fbd70a4ed44530a3fab8f17c0769db [id=09fa54104d0f46dbb3f19138bfa2313d]). Expected version 1 got 0
I20260810 19:48:04.628816 9420 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 9a13b0f5b6b14bb9b72740a8521e4ea5 (table default.Table_0844c946c41146f38e51790cd8baed2a [id=4830b444314a4bb6a605cb73432e772f]). Expected version 1 got 0
I20260810 19:48:04.629459 9420 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet d77785d9bde843bc8366fe15d1b4fa18 (table default.Table_3e78e13c8ecc464eb6af12a2bc3f2eba [id=1af2d06c44b643e28d28bb080cd5eef8]). Expected version 2 got 0
I20260810 19:48:04.631029 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 9ed73161398f4f54a20a9173c18b4d3c
I20260810 19:48:04.631599 9408 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:56048 (request call id 952) took 1051 ms. Trace:
I20260810 19:48:04.631834 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ed73161398f4f54a20a9173c18b4d3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:04 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:04.632329 12087 raft_consensus.cc:493] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:04.632480 12087 raft_consensus.cc:515] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.633147 12087 leader_election.cc:290] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:04.634152 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8a23221e8447bd83592c05c9d1149c" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:04.635054 10029 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:48:04.636920 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ed73161398f4f54a20a9173c18b4d3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:04 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:04.637671 9830 leader_election.cc:343] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.637997 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ed73161398f4f54a20a9173c18b4d3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:04 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:04.637533 9791 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:48:04.635897 9408 rpcz_store.cc:276] 0810 19:48:03.580499 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.094161 (+513662us) service_pool.cc:224] Handling call
0810 19:48:04.119620 (+ 25459us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 19:48:04.119789 (+ 169us) catalog_manager.cc:2841] Modifying in-memory table state
0810 19:48:04.122403 (+ 2614us) catalog_manager.cc:2850] Locking tablets
0810 19:48:04.123835 (+ 1432us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 19:48:04.607834 (+483999us) catalog_manager.cc:2882] Removing table from by-name map
0810 19:48:04.607937 (+ 103us) catalog_manager.cc:2898] Committing in-memory state
0810 19:48:04.630432 (+ 22495us) catalog_manager.cc:2902] Aborting table tasks
0810 19:48:04.631561 (+ 1129us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:48:04.581661 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 19:48:04.581786 (+ 125us) write_op.cc:432] Acquiring schema lock in shared mode
0810 19:48:04.581791 (+ 5us) write_op.cc:435] Acquired schema lock
0810 19:48:04.581793 (+ 2us) tablet.cc:662] Decoding operations
0810 19:48:04.581921 (+ 128us) write_op.cc:620] Acquiring the partition lock for write op
0810 19:48:04.581931 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0810 19:48:04.581935 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0810 19:48:04.582040 (+ 105us) tablet.cc:701] Row locks acquired
0810 19:48:04.582043 (+ 3us) write_op.cc:260] PREPARE: finished
0810 19:48:04.582080 (+ 37us) write_op.cc:270] Start()
0810 19:48:04.582110 (+ 30us) write_op.cc:276] Timestamp: P: 1786391284582050 usec, L: 0
0810 19:48:04.582114 (+ 4us) op_driver.cc:348] REPLICATION: starting
0810 19:48:04.582274 (+ 160us) log.cc:844] Serialized 731 byte log entry
0810 19:48:04.601473 (+ 19199us) op_driver.cc:464] REPLICATION: finished
0810 19:48:04.601677 (+ 204us) write_op.cc:301] APPLY: starting
0810 19:48:04.601687 (+ 10us) tablet.cc:1367] starting BulkCheckPresence
0810 19:48:04.601713 (+ 26us) tablet.cc:1370] finished BulkCheckPresence
0810 19:48:04.601730 (+ 17us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 19:48:04.601786 (+ 56us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 19:48:04.601807 (+ 21us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 19:48:04.601812 (+ 5us) write_op.cc:312] APPLY: finished
0810 19:48:04.601865 (+ 53us) log.cc:844] Serialized 29 byte log entry
0810 19:48:04.607618 (+ 5753us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:04.607636 (+ 18us) write_op.cc:454] Released schema lock
0810 19:48:04.607644 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 19:48:04.607722 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:04.607725 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":166,"apply.run_cpu_time_us":383,"apply.run_wall_time_us":6034,"mutex_wait_us":5665,"num_ops":2,"prepare.queue_time_us":457063,"prepare.run_cpu_time_us":711,"prepare.run_wall_time_us":724,"replication_time_us":19340}]]}
I20260810 19:48:04.639736 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_eedceb8b47b24ffdada374252ad7e3b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:04.640180 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8a23221e8447bd83592c05c9d1149c" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:04.640455 9711 raft_consensus.cc:2468] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:04.643733 12208 tablet.cc:1724] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 19:48:04.644019 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eedceb8b47b24ffdada374252ad7e3b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:04.643378 9831 leader_election.cc:304] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:04.645190 12087 raft_consensus.cc:2804] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:04.645279 12087 raft_consensus.cc:493] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:04.645351 12087 raft_consensus.cc:3060] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:04.648197 12085 tablet.cc:1724] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:04.648634 9413 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 63b649cbc1d141d8bb438105b8e8537c (table default.Table_b059137abb0e458bbadca41a2f2e8b50 [id=9eaa5e14e854425e8971160c64ee97cf]). Expected version 1 got 0
I20260810 19:48:04.648799 12087 raft_consensus.cc:515] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.649523 12087 leader_election.cc:290] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:04.649868 9412 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.8.235.194:59637 (request call id 88) took 945 ms (client timeout 1000 ms). Trace:
I20260810 19:48:04.652653 9413 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet fb7b722c43ee4b8698b19b2b6c1b401d (table default.Table_0a12a994a3ff4ff8850e8c0d6c0e42ca [id=374cf9ed870c448fbbdad7050d0d11f9]). Expected version 1 got 0
I20260810 19:48:04.652901 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8a23221e8447bd83592c05c9d1149c" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:04.653100 9711 raft_consensus.cc:3060] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:04.654547 12207 tablet.cc:1724] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:04.655144 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 965395b5072e4d47adac504e22a8d484 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:04.655284 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8a23221e8447bd83592c05c9d1149c" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:04.655498 11828 raft_consensus.cc:493] T 3b6187dbe1ca42f79bf3eddd5475b929 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:04.655869 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet 72b39babf851404c89adb317033015ec with delete_type TABLET_DATA_DELETED (replaced by tablet 676004738985441985278313d6064530) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:04.655973 9711 raft_consensus.cc:2468] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:04.655634 11828 raft_consensus.cc:515] T 3b6187dbe1ca42f79bf3eddd5475b929 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.657370 11828 leader_election.cc:290] T 3b6187dbe1ca42f79bf3eddd5475b929 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:04.657179 9830 leader_election.cc:343] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:04.658304 10068 leader_election.cc:343] T 3b6187dbe1ca42f79bf3eddd5475b929 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 3b6187dbe1ca42f79bf3eddd5475b929
W20260810 19:48:04.650669 9412 rpcz_store.cc:269] 0810 19:48:03.703898 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:03.966818 (+262920us) service_pool.cc:224] Handling call
0810 19:48:04.649817 (+682999us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:48:04.580575 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 19:48:04.580682 (+ 107us) write_op.cc:432] Acquiring schema lock in shared mode
0810 19:48:04.580687 (+ 5us) write_op.cc:435] Acquired schema lock
0810 19:48:04.580689 (+ 2us) tablet.cc:662] Decoding operations
0810 19:48:04.580797 (+ 108us) write_op.cc:620] Acquiring the partition lock for write op
0810 19:48:04.580806 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0810 19:48:04.580811 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0810 19:48:04.580899 (+ 88us) tablet.cc:701] Row locks acquired
0810 19:48:04.580902 (+ 3us) write_op.cc:260] PREPARE: finished
0810 19:48:04.580943 (+ 41us) write_op.cc:270] Start()
0810 19:48:04.580978 (+ 35us) write_op.cc:276] Timestamp: P: 1786391284580914 usec, L: 0
0810 19:48:04.580981 (+ 3us) op_driver.cc:348] REPLICATION: starting
0810 19:48:04.581183 (+ 202us) log.cc:844] Serialized 533 byte log entry
0810 19:48:04.601395 (+ 20212us) op_driver.cc:464] REPLICATION: finished
0810 19:48:04.601614 (+ 219us) write_op.cc:301] APPLY: starting
0810 19:48:04.601630 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0810 19:48:04.601674 (+ 44us) tablet.cc:1370] finished BulkCheckPresence
0810 19:48:04.601701 (+ 27us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 19:48:04.601752 (+ 51us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 19:48:04.601786 (+ 34us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 19:48:04.601794 (+ 8us) write_op.cc:312] APPLY: finished
0810 19:48:04.601865 (+ 71us) log.cc:844] Serialized 23 byte log entry
0810 19:48:04.601952 (+ 87us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:04.601970 (+ 18us) write_op.cc:454] Released schema lock
0810 19:48:04.601978 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 19:48:04.602058 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:04.602062 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":167,"apply.run_cpu_time_us":434,"apply.run_wall_time_us":435,"num_ops":1,"prepare.queue_time_us":456944,"prepare.run_cpu_time_us":688,"prepare.run_wall_time_us":1040,"replication_time_us":20380}]]}
I20260810 19:48:04.658806 9831 leader_election.cc:304] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:04.659096 12087 raft_consensus.cc:2804] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:04.659240 12087 raft_consensus.cc:697] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:04.659516 12087 consensus_queue.cc:237] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.660705 9412 master_service.cc:960] ReplaceTablet: received request to replace tablet 8fadd6f84c75466287b318ed7018b071 from {username='slave'} at 127.0.0.1:56048
W20260810 19:48:04.663288 10067 leader_election.cc:343] T 3b6187dbe1ca42f79bf3eddd5475b929 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 3b6187dbe1ca42f79bf3eddd5475b929
I20260810 19:48:04.663453 10067 leader_election.cc:304] T 3b6187dbe1ca42f79bf3eddd5475b929 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:04.663697 11828 raft_consensus.cc:2749] T 3b6187dbe1ca42f79bf3eddd5475b929 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:04.664021 11828 consensus_queue.cc:1048] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 19:48:04.663925 9831 consensus_peers.cc:597] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 842a5dacf9d145889e97069d3c8084b8. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:04.671416 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet da3d8ade850c4d36bd2756c36706195d with delete_type TABLET_DATA_DELETED (replaced by tablet 87bbcc651d034e2a826478b805792e48) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:04.671706 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 63486cc3f8774a11827b1cc5f1c16332 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:04.671852 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e8a23221e8447bd83592c05c9d1149c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:04.674064 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet 8455cb11388340beb6daa13fee06177a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:04.675684 9420 master_service.cc:960] ReplaceTablet: received request to replace tablet 5f4e2adee0264e418ff8c54912973e60 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:04.676106 12086 raft_consensus.cc:493] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:04.676255 12086 raft_consensus.cc:515] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.676472 9412 master_service.cc:960] ReplaceTablet: received request to replace tablet 9b40fd0d57ea4b71aeef2d66f4958ac8 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:04.676980 12086 leader_election.cc:290] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:04.677626 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410855f236004ad4b78839eb1c0c2f1f" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:04.677767 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 00fe7d9a548a487d965d92b53cdf9250 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ed73161398f4f54a20a9173c18b4d3c) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:04.678164 9830 leader_election.cc:343] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.678900 10370 tablet_bootstrap.cc:492] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:04.679715 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410855f236004ad4b78839eb1c0c2f1f" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:04.680135 10370 ts_tablet_manager.cc:1403] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.115s user 0.015s sys 0.002s
I20260810 19:48:04.680047 9711 raft_consensus.cc:2468] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:04.681001 10370 raft_consensus.cc:359] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.681173 10370 raft_consensus.cc:385] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.681228 10370 raft_consensus.cc:740] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.681455 10370 consensus_queue.cc:260] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.681977 10370 ts_tablet_manager.cc:1434] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:04.684952 9831 leader_election.cc:304] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:04.685309 12087 raft_consensus.cc:2804] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:04.685410 12087 raft_consensus.cc:493] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:04.685483 12087 raft_consensus.cc:3060] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:04.688505 12266 tablet_replica.cc:333] T 63486cc3f8774a11827b1cc5f1c16332 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
W20260810 19:48:04.688637 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 9ed73161398f4f54a20a9173c18b4d3c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ed73161398f4f54a20a9173c18b4d3c already in progress: creating tablet
W20260810 19:48:04.689185 9397 catalog_manager.cc:5017] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet da3d8ade850c4d36bd2756c36706195d because the tablet was not found. No further retry: Not found: Tablet not found: da3d8ade850c4d36bd2756c36706195d
I20260810 19:48:04.689648 10370 tablet_bootstrap.cc:492] T 3c828ae089774fb9b0582141f4b99313 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:04.690440 12266 raft_consensus.cc:2243] T 63486cc3f8774a11827b1cc5f1c16332 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:04.692631 10370 tablet_bootstrap.cc:654] T 3c828ae089774fb9b0582141f4b99313 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.692873 12087 raft_consensus.cc:515] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.694507 10377 ts_tablet_manager.cc:1929] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:04.694576 10367 tablet_bootstrap.cc:654] T 0e967384768b4ec7956f1b508e8ab2af P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.695973 12266 raft_consensus.cc:2272] T 63486cc3f8774a11827b1cc5f1c16332 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:04.698025 12266 ts_tablet_manager.cc:1916] T 63486cc3f8774a11827b1cc5f1c16332 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:04.700986 12087 leader_election.cc:290] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:04.694725 10377 log.cc:1199] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/6355c14e38b3446493f7bd5e2a717341
I20260810 19:48:04.701751 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410855f236004ad4b78839eb1c0c2f1f" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:04.702157 9711 raft_consensus.cc:3060] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:04.702620 10377 ts_tablet_manager.cc:1950] T 6355c14e38b3446493f7bd5e2a717341 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:04.703280 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 652) took 2946 ms. Trace:
I20260810 19:48:04.703425 10377 rpcz_store.cc:276] 0810 19:48:01.756411 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:01.759196 (+ 2785us) service_pool.cc:224] Handling call
0810 19:48:04.570876 (+2811680us) ts_tablet_manager.cc:1151] Deleting tablet 6355c14e38b3446493f7bd5e2a717341
0810 19:48:04.619882 (+ 49006us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:04.656586 (+ 36704us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:04.694358 (+ 37772us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:04.703232 (+ 8874us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2811392}
I20260810 19:48:04.704144 10377 tablet_replica.cc:333] T 3c828ae089774fb9b0582141f4b99313 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:04.704241 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 6355c14e38b3446493f7bd5e2a717341 (table default.Table_20332cc0e9df49adb98c82a60784c4bb [id=ba8ef3f482364fc081f8e796fdbdb076]) successfully deleted
I20260810 19:48:04.706408 10377 raft_consensus.cc:2243] T 3c828ae089774fb9b0582141f4b99313 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:04.706687 9711 raft_consensus.cc:2468] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:04.706748 10377 raft_consensus.cc:2272] T 3c828ae089774fb9b0582141f4b99313 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:04.708022 10366 tablet_bootstrap.cc:492] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:04.708171 10366 ts_tablet_manager.cc:1403] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.153s user 0.002s sys 0.002s
I20260810 19:48:04.709018 10366 raft_consensus.cc:359] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.709199 10366 raft_consensus.cc:385] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.709251 10366 raft_consensus.cc:740] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.709473 10366 consensus_queue.cc:260] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.709959 10366 ts_tablet_manager.cc:1434] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:04.710572 10366 tablet_bootstrap.cc:492] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:04.711882 12146 raft_consensus.cc:493] T 8455cb11388340beb6daa13fee06177a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:04.712045 12146 raft_consensus.cc:515] T 8455cb11388340beb6daa13fee06177a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.712431 10366 tablet_bootstrap.cc:654] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.712798 12146 leader_election.cc:290] T 8455cb11388340beb6daa13fee06177a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:04.712869 9415 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56048 (request call id 955) took 1069 ms. Trace:
W20260810 19:48:04.713249 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bb0bfaf245584de889a5ab0b5dedf534 has no consensus state
I20260810 19:48:04.713442 9421 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:56048 (request call id 959) took 1007 ms. Trace:
I20260810 19:48:04.713580 9418 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56048 (request call id 956) took 1066 ms. Trace:
I20260810 19:48:04.713557 9421 rpcz_store.cc:276] 0810 19:48:03.705870 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.591792 (+885922us) service_pool.cc:224] Handling call
0810 19:48:04.592142 (+ 350us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 19:48:04.592372 (+ 230us) catalog_manager.cc:3751] Apply alter schema
0810 19:48:04.592566 (+ 194us) catalog_manager.cc:3783] Acquired catalog manager lock
0810 19:48:04.592650 (+ 84us) catalog_manager.cc:3941] Updating metadata on disk
0810 19:48:04.712990 (+120340us) catalog_manager.cc:3972] Committing alterations to in-memory state
0810 19:48:04.713398 (+ 408us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:48:04.593195 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 19:48:04.593302 (+ 107us) write_op.cc:432] Acquiring schema lock in shared mode
0810 19:48:04.593308 (+ 6us) write_op.cc:435] Acquired schema lock
0810 19:48:04.593311 (+ 3us) tablet.cc:662] Decoding operations
0810 19:48:04.593399 (+ 88us) write_op.cc:620] Acquiring the partition lock for write op
0810 19:48:04.593408 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0810 19:48:04.593412 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0810 19:48:04.593488 (+ 76us) tablet.cc:701] Row locks acquired
0810 19:48:04.593491 (+ 3us) write_op.cc:260] PREPARE: finished
0810 19:48:04.593532 (+ 41us) write_op.cc:270] Start()
0810 19:48:04.593563 (+ 31us) write_op.cc:276] Timestamp: P: 1786391284593502 usec, L: 0
0810 19:48:04.593567 (+ 4us) op_driver.cc:348] REPLICATION: starting
0810 19:48:04.593778 (+ 211us) log.cc:844] Serialized 405 byte log entry
0810 19:48:04.710032 (+116254us) op_driver.cc:464] REPLICATION: finished
0810 19:48:04.711476 (+ 1444us) write_op.cc:301] APPLY: starting
0810 19:48:04.711486 (+ 10us) tablet.cc:1367] starting BulkCheckPresence
0810 19:48:04.711516 (+ 30us) tablet.cc:1370] finished BulkCheckPresence
0810 19:48:04.711538 (+ 22us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 19:48:04.711573 (+ 35us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 19:48:04.711595 (+ 22us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 19:48:04.711602 (+ 7us) write_op.cc:312] APPLY: finished
0810 19:48:04.711664 (+ 62us) log.cc:844] Serialized 23 byte log entry
0810 19:48:04.711699 (+ 35us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:04.711711 (+ 12us) write_op.cc:454] Released schema lock
0810 19:48:04.711716 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1414,"apply.run_cpu_time_us":293,"apply.run_wall_time_us":292,"num_ops":1,"prepare.queue_time_us":53,"prepare.run_cpu_time_us":658,"prepare.run_wall_time_us":658,"replication_time_us":116450,"threads_started":1}]]}
I20260810 19:48:04.713658 9418 rpcz_store.cc:276] 0810 19:48:03.647493 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.571916 (+924423us) service_pool.cc:224] Handling call
0810 19:48:04.578254 (+ 6338us) spinlock_profiling.cc:243] Waited 6.03 ms on lock 0x616000041b54. stack: 00007f50aec1d326 00007f50aec1d0e0 00007f50adc4734d 00000000009a5774 00000000009a573d 00007f50be19c65d 00007f50be19c753 00007f50bad21ac1 00007f50c2afb40d 00007f50c2c89b13 00007f50b9671d16 00007f50b9671a45 00007f50b5d6061e 00007f50b5d5f4fe 00007f50b5d65738 00007f50b5d6609f
0810 19:48:04.579173 (+ 919us) catalog_manager.cc:2127] Acquired catalog manager lock
0810 19:48:04.579614 (+ 441us) catalog_manager.cc:2173] Created new table and tablet info
0810 19:48:04.713317 (+133703us) catalog_manager.cc:2233] Wrote table and tablets to system table
0810 19:48:04.713438 (+ 121us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0810 19:48:04.713524 (+ 86us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:48:04.585020 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 19:48:04.585095 (+ 75us) write_op.cc:432] Acquiring schema lock in shared mode
0810 19:48:04.585099 (+ 4us) write_op.cc:435] Acquired schema lock
0810 19:48:04.585100 (+ 1us) tablet.cc:662] Decoding operations
0810 19:48:04.585158 (+ 58us) write_op.cc:620] Acquiring the partition lock for write op
0810 19:48:04.585165 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0810 19:48:04.585169 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0810 19:48:04.585233 (+ 64us) tablet.cc:701] Row locks acquired
0810 19:48:04.585235 (+ 2us) write_op.cc:260] PREPARE: finished
0810 19:48:04.585261 (+ 26us) write_op.cc:270] Start()
0810 19:48:04.585285 (+ 24us) write_op.cc:276] Timestamp: P: 1786391284585235 usec, L: 0
0810 19:48:04.585288 (+ 3us) op_driver.cc:348] REPLICATION: starting
0810 19:48:04.585415 (+ 127us) log.cc:844] Serialized 433 byte log entry
0810 19:48:04.709986 (+124571us) op_driver.cc:464] REPLICATION: finished
0810 19:48:04.710973 (+ 987us) write_op.cc:301] APPLY: starting
0810 19:48:04.710984 (+ 11us) tablet.cc:1367] starting BulkCheckPresence
0810 19:48:04.711017 (+ 33us) tablet.cc:1370] finished BulkCheckPresence
0810 19:48:04.711052 (+ 35us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 19:48:04.711140 (+ 88us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 19:48:04.711168 (+ 28us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 19:48:04.711176 (+ 8us) write_op.cc:312] APPLY: finished
0810 19:48:04.711244 (+ 68us) log.cc:844] Serialized 29 byte log entry
0810 19:48:04.711303 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:04.711321 (+ 18us) write_op.cc:454] Released schema lock
0810 19:48:04.711327 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0810 19:48:04.711406 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:04.711410 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":13866880,"child_traces":[["op",{"apply.queue_time_us":955,"apply.run_cpu_time_us":422,"apply.run_wall_time_us":422,"num_ops":2,"prepare.queue_time_us":4943,"prepare.run_cpu_time_us":440,"prepare.run_wall_time_us":439,"replication_time_us":124680}]]}
I20260810 19:48:04.716409 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 86937c581d4c46d38699b268b1e0c42d
I20260810 19:48:04.716955 9410 catalog_manager.cc:6807] ReplaceTablet: tablet 86937c581d4c46d38699b268b1e0c42d deleted and replaced by tablet e663c45e1a1f4d4b8b09048d7c65f60e
I20260810 19:48:04.717118 9410 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:56048 (request call id 954) took 1123 ms. Trace:
I20260810 19:48:04.717204 9410 rpcz_store.cc:276] 0810 19:48:03.594028 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.533656 (+939628us) service_pool.cc:224] Handling call
0810 19:48:04.573643 (+ 39987us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x616000041b54. stack: 00007f50aec1d326 00007f50aec1d0e0 00007f50adc4734d 00000000009a5774 00000000009a573d 00007f50be19c65d 00007f50be19c753 00007f50bad21ac1 00007f50c2afb40d 00007f50c2c9699b 00007f50b967e657 00007f50b967e385 00007f50b5d6061e 00007f50b5d5f4fe 00007f50b5d65738 00007f50b5d6609f
0810 19:48:04.717053 (+143410us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:48:04.583691 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 19:48:04.583845 (+ 154us) write_op.cc:432] Acquiring schema lock in shared mode
0810 19:48:04.583850 (+ 5us) write_op.cc:435] Acquired schema lock
0810 19:48:04.583852 (+ 2us) tablet.cc:662] Decoding operations
0810 19:48:04.583937 (+ 85us) write_op.cc:620] Acquiring the partition lock for write op
0810 19:48:04.583945 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0810 19:48:04.583949 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0810 19:48:04.584009 (+ 60us) tablet.cc:701] Row locks acquired
0810 19:48:04.584011 (+ 2us) write_op.cc:260] PREPARE: finished
0810 19:48:04.584040 (+ 29us) write_op.cc:270] Start()
0810 19:48:04.584177 (+ 137us) write_op.cc:276] Timestamp: P: 1786391284584013 usec, L: 0
0810 19:48:04.584181 (+ 4us) op_driver.cc:348] REPLICATION: starting
0810 19:48:04.584320 (+ 139us) log.cc:844] Serialized 628 byte log entry
0810 19:48:04.709834 (+125514us) op_driver.cc:464] REPLICATION: finished
0810 19:48:04.709985 (+ 151us) write_op.cc:301] APPLY: starting
0810 19:48:04.710007 (+ 22us) tablet.cc:1367] starting BulkCheckPresence
0810 19:48:04.710076 (+ 69us) tablet.cc:1370] finished BulkCheckPresence
0810 19:48:04.710110 (+ 34us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 19:48:04.710248 (+ 138us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 19:48:04.715779 (+ 5531us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 19:48:04.715790 (+ 11us) write_op.cc:312] APPLY: finished
0810 19:48:04.715917 (+ 127us) log.cc:844] Serialized 29 byte log entry
0810 19:48:04.715991 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:04.716012 (+ 21us) write_op.cc:454] Released schema lock
0810 19:48:04.716019 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 19:48:04.716096 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:04.716099 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":90727168,"child_traces":[["op",{"apply.queue_time_us":67,"apply.run_cpu_time_us":700,"apply.run_wall_time_us":6104,"num_ops":2,"prepare.queue_time_us":8594,"prepare.run_cpu_time_us":551,"prepare.run_wall_time_us":814,"replication_time_us":125609}]]}
I20260810 19:48:04.722651 9831 leader_election.cc:304] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:04.723532 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8455cb11388340beb6daa13fee06177a" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:04.724048 12087 raft_consensus.cc:2804] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:04.724188 12087 raft_consensus.cc:697] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:04.724304 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 86937c581d4c46d38699b268b1e0c42d with delete_type TABLET_DATA_DELETED (replaced by tablet e663c45e1a1f4d4b8b09048d7c65f60e) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:04.712982 9415 rpcz_store.cc:276] 0810 19:48:03.643657 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.536101 (+892444us) service_pool.cc:224] Handling call
0810 19:48:04.575956 (+ 39855us) spinlock_profiling.cc:243] Waited 39.5 ms on lock 0x616000041b54. stack: 00007f50aec1d326 00007f50aec1d0e0 00007f50adc4734d 00000000009a5774 00000000009a573d 00007f50be19c65d 00007f50be19c753 00007f50bad21ac1 00007f50c2afb40d 00007f50c2c89b13 00007f50b9671d16 00007f50b9671a45 00007f50b5d6061e 00007f50b5d5f4fe 00007f50b5d65738 00007f50b5d6609f
0810 19:48:04.576831 (+ 875us) catalog_manager.cc:2127] Acquired catalog manager lock
0810 19:48:04.577434 (+ 603us) catalog_manager.cc:2173] Created new table and tablet info
0810 19:48:04.712540 (+135106us) catalog_manager.cc:2233] Wrote table and tablets to system table
0810 19:48:04.712663 (+ 123us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0810 19:48:04.712791 (+ 128us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:48:04.584416 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 19:48:04.584516 (+ 100us) write_op.cc:432] Acquiring schema lock in shared mode
0810 19:48:04.584574 (+ 58us) write_op.cc:435] Acquired schema lock
0810 19:48:04.584578 (+ 4us) tablet.cc:662] Decoding operations
0810 19:48:04.584650 (+ 72us) write_op.cc:620] Acquiring the partition lock for write op
0810 19:48:04.584659 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0810 19:48:04.584663 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0810 19:48:04.584721 (+ 58us) tablet.cc:701] Row locks acquired
0810 19:48:04.584723 (+ 2us) write_op.cc:260] PREPARE: finished
0810 19:48:04.584753 (+ 30us) write_op.cc:270] Start()
0810 19:48:04.584790 (+ 37us) write_op.cc:276] Timestamp: P: 1786391284584725 usec, L: 0
0810 19:48:04.584793 (+ 3us) op_driver.cc:348] REPLICATION: starting
0810 19:48:04.584940 (+ 147us) log.cc:844] Serialized 433 byte log entry
0810 19:48:04.709927 (+124987us) op_driver.cc:464] REPLICATION: finished
0810 19:48:04.710389 (+ 462us) write_op.cc:301] APPLY: starting
0810 19:48:04.710406 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0810 19:48:04.710443 (+ 37us) tablet.cc:1370] finished BulkCheckPresence
0810 19:48:04.710475 (+ 32us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 19:48:04.710573 (+ 98us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 19:48:04.710606 (+ 33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 19:48:04.710612 (+ 6us) write_op.cc:312] APPLY: finished
0810 19:48:04.710705 (+ 93us) log.cc:844] Serialized 29 byte log entry
0810 19:48:04.710777 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:04.710802 (+ 25us) write_op.cc:454] Released schema lock
0810 19:48:04.710810 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 19:48:04.710895 (+ 85us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:04.710899 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":90822400,"child_traces":[["op",{"apply.queue_time_us":402,"apply.run_cpu_time_us":502,"apply.run_wall_time_us":502,"num_ops":2,"prepare.queue_time_us":6468,"prepare.run_cpu_time_us":519,"prepare.run_wall_time_us":571,"replication_time_us":125114}]]}
I20260810 19:48:04.724445 12087 consensus_queue.cc:237] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.728009 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet 86937c581d4c46d38699b268b1e0c42d with delete_type TABLET_DATA_DELETED (replaced by tablet e663c45e1a1f4d4b8b09048d7c65f60e) from {username='slave'} at 127.0.0.1:38276
W20260810 19:48:04.728825 9611 leader_election.cc:343] T 8455cb11388340beb6daa13fee06177a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.732517 10377 ts_tablet_manager.cc:1916] T 3c828ae089774fb9b0582141f4b99313 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:04.733582 12266 ts_tablet_manager.cc:1929] T 63486cc3f8774a11827b1cc5f1c16332 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:04.733736 12086 raft_consensus.cc:493] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:04.733899 12086 raft_consensus.cc:515] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.734707 12086 leader_election.cc:290] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:04.693873 10375 ts_tablet_manager.cc:1929] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260810 19:48:04.700066 10068 consensus_peers.cc:597] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 971e9abee86444a7a9e923b0962ae751. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:04.736588 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8455cb11388340beb6daa13fee06177a" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:04.737386 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410855f236004ad4b78839eb1c0c2f1f" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:04.737762 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f30148b5c84f7cbdfabd0186611cc4" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:04.725934 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 86937c581d4c46d38699b268b1e0c42d with delete_type TABLET_DATA_DELETED (replaced by tablet e663c45e1a1f4d4b8b09048d7c65f60e) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:04.741881 9830 leader_election.cc:343] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:04.742295 9830 leader_election.cc:343] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.742762 10375 log.cc:1199] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/0d79ef93c5bf4ac9895e594198edb251
I20260810 19:48:04.743358 10375 ts_tablet_manager.cc:1950] T 0d79ef93c5bf4ac9895e594198edb251 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:04.745968 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 631) took 3082 ms. Trace:
W20260810 19:48:04.741044 9611 leader_election.cc:343] T 8455cb11388340beb6daa13fee06177a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.746347 12266 log.cc:1199] T 63486cc3f8774a11827b1cc5f1c16332 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/63486cc3f8774a11827b1cc5f1c16332
I20260810 19:48:04.746225 10375 rpcz_store.cc:276] 0810 19:48:01.663447 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:01.664036 (+ 589us) service_pool.cc:224] Handling call
0810 19:48:04.548927 (+2884891us) ts_tablet_manager.cc:1151] Deleting tablet 0d79ef93c5bf4ac9895e594198edb251
0810 19:48:04.549187 (+ 260us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:04.651501 (+102314us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:04.692548 (+ 41047us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:04.745918 (+ 53370us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2853846}
I20260810 19:48:04.747283 10370 tablet_bootstrap.cc:492] T 3c828ae089774fb9b0582141f4b99313 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:04.747267 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 0d79ef93c5bf4ac9895e594198edb251 (table default.Table_949bcc619f4b45189db61b24b5598e66 [id=ed1551c0accc41eead911b83ee4c0a6f]) successfully deleted
I20260810 19:48:04.747504 10370 ts_tablet_manager.cc:1403] T 3c828ae089774fb9b0582141f4b99313 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.058s user 0.005s sys 0.001s
I20260810 19:48:04.747864 10375 tablet_replica.cc:333] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:04.748251 10375 raft_consensus.cc:2243] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:04.748580 10375 raft_consensus.cc:2272] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:04.748951 10370 raft_consensus.cc:359] T 3c828ae089774fb9b0582141f4b99313 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.749240 10370 raft_consensus.cc:385] T 3c828ae089774fb9b0582141f4b99313 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.749337 10370 raft_consensus.cc:740] T 3c828ae089774fb9b0582141f4b99313 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.749666 10370 consensus_queue.cc:260] T 3c828ae089774fb9b0582141f4b99313 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:04.750398 9831 leader_election.cc:343] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: b5f30148b5c84f7cbdfabd0186611cc4
I20260810 19:48:04.750581 9831 leader_election.cc:304] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:04.750787 10370 ts_tablet_manager.cc:1434] T 3c828ae089774fb9b0582141f4b99313 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 19:48:04.750916 12086 raft_consensus.cc:2749] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:04.752156 10366 tablet_bootstrap.cc:492] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:04.752357 10366 ts_tablet_manager.cc:1403] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.042s user 0.006s sys 0.002s
I20260810 19:48:04.746351 9611 leader_election.cc:304] T 8455cb11388340beb6daa13fee06177a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:04.752749 12266 ts_tablet_manager.cc:1950] T 63486cc3f8774a11827b1cc5f1c16332 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:04.752696 12146 raft_consensus.cc:2749] T 8455cb11388340beb6daa13fee06177a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:04.753916 12266 tablet_replica.cc:333] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:04.754173 12266 raft_consensus.cc:2243] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:04.754206 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 63486cc3f8774a11827b1cc5f1c16332 (table default.Table_f1a090bd6e0042b58f8b6f478fc4fb11 [id=2e90b67006f344688d2b021965d8abdf]) successfully deleted
I20260810 19:48:04.754453 12266 raft_consensus.cc:2272] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:04.753751 10366 raft_consensus.cc:359] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.754758 10366 raft_consensus.cc:385] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.754889 10366 raft_consensus.cc:740] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.755285 12266 ts_tablet_manager.cc:1916] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:04.755359 10366 consensus_queue.cc:260] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.756582 10366 ts_tablet_manager.cc:1434] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260810 19:48:04.757388 10375 ts_tablet_manager.cc:1916] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:04.758426 12086 raft_consensus.cc:493] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:04.758561 12086 raft_consensus.cc:515] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.759227 12086 leader_election.cc:290] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:04.760737 9831 leader_election.cc:343] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: da3d8ade850c4d36bd2756c36706195d
I20260810 19:48:04.759271 10370 tablet_bootstrap.cc:492] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:04.760519 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3d8ade850c4d36bd2756c36706195d" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:04.761709 9830 leader_election.cc:343] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.762074 9830 leader_election.cc:304] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:04.762565 12086 raft_consensus.cc:2749] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:04.760818 10366 tablet_bootstrap.cc:492] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:04.765631 10370 tablet_bootstrap.cc:654] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.773523 10367 tablet_bootstrap.cc:492] T 0e967384768b4ec7956f1b508e8ab2af P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:04.773705 10367 ts_tablet_manager.cc:1403] T 0e967384768b4ec7956f1b508e8ab2af P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.152s user 0.002s sys 0.008s
I20260810 19:48:04.774914 10367 raft_consensus.cc:359] T 0e967384768b4ec7956f1b508e8ab2af P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.775234 10367 raft_consensus.cc:385] T 0e967384768b4ec7956f1b508e8ab2af P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.775429 10367 raft_consensus.cc:740] T 0e967384768b4ec7956f1b508e8ab2af P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
W20260810 19:48:04.782861 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b8ad239a5d4a410581d93b66d3982120 consensus state has no leader
I20260810 19:48:04.783085 9416 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:56048 (request call id 958) took 1079 ms. Trace:
I20260810 19:48:04.783205 9416 rpcz_store.cc:276] 0810 19:48:03.703597 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.589002 (+885405us) service_pool.cc:224] Handling call
0810 19:48:04.589412 (+ 410us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 19:48:04.589657 (+ 245us) catalog_manager.cc:3751] Apply alter schema
0810 19:48:04.589840 (+ 183us) catalog_manager.cc:3783] Acquired catalog manager lock
0810 19:48:04.589923 (+ 83us) catalog_manager.cc:3941] Updating metadata on disk
0810 19:48:04.782569 (+192646us) catalog_manager.cc:3972] Committing alterations to in-memory state
0810 19:48:04.783040 (+ 471us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:48:04.597252 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 19:48:04.597362 (+ 110us) write_op.cc:432] Acquiring schema lock in shared mode
0810 19:48:04.597368 (+ 6us) write_op.cc:435] Acquired schema lock
0810 19:48:04.597371 (+ 3us) tablet.cc:662] Decoding operations
0810 19:48:04.597464 (+ 93us) write_op.cc:620] Acquiring the partition lock for write op
0810 19:48:04.597473 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0810 19:48:04.597478 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0810 19:48:04.597536 (+ 58us) tablet.cc:701] Row locks acquired
0810 19:48:04.597539 (+ 3us) write_op.cc:260] PREPARE: finished
0810 19:48:04.597577 (+ 38us) write_op.cc:270] Start()
0810 19:48:04.598085 (+ 508us) write_op.cc:276] Timestamp: P: 1786391284597547 usec, L: 0
0810 19:48:04.598094 (+ 9us) op_driver.cc:348] REPLICATION: starting
0810 19:48:04.598290 (+ 196us) log.cc:844] Serialized 405 byte log entry
0810 19:48:04.781291 (+183001us) op_driver.cc:464] REPLICATION: finished
0810 19:48:04.781540 (+ 249us) write_op.cc:301] APPLY: starting
0810 19:48:04.781563 (+ 23us) tablet.cc:1367] starting BulkCheckPresence
0810 19:48:04.781613 (+ 50us) tablet.cc:1370] finished BulkCheckPresence
0810 19:48:04.781669 (+ 56us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 19:48:04.781750 (+ 81us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 19:48:04.781789 (+ 39us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 19:48:04.781797 (+ 8us) write_op.cc:312] APPLY: finished
0810 19:48:04.781949 (+ 152us) log.cc:844] Serialized 23 byte log entry
0810 19:48:04.782403 (+ 454us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:04.782427 (+ 24us) write_op.cc:454] Released schema lock
0810 19:48:04.782437 (+ 10us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":119,"num_ops":1,"prepare.queue_time_us":54,"prepare.run_cpu_time_us":687,"prepare.run_wall_time_us":1343,"replication_time_us":183143}]]}
I20260810 19:48:04.785223 10366 tablet_bootstrap.cc:654] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.787055 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_75f34d0b0d844a1dba7d3ed6a75b3555" } new_table_name: "default.Table_40317d27e3de4c7ebbe4a80239f78899" modify_external_catalogs: true
I20260810 19:48:04.789624 9408 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56048 (request call id 961) took 1054 ms. Trace:
I20260810 19:48:04.789871 9408 rpcz_store.cc:276] 0810 19:48:03.734985 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.639488 (+904503us) service_pool.cc:224] Handling call
0810 19:48:04.644158 (+ 4670us) catalog_manager.cc:2127] Acquired catalog manager lock
0810 19:48:04.644760 (+ 602us) catalog_manager.cc:2173] Created new table and tablet info
0810 19:48:04.789354 (+144594us) catalog_manager.cc:2233] Wrote table and tablets to system table
0810 19:48:04.789469 (+ 115us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0810 19:48:04.789574 (+ 105us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:48:04.648481 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 19:48:04.651281 (+ 2800us) write_op.cc:432] Acquiring schema lock in shared mode
0810 19:48:04.651290 (+ 9us) write_op.cc:435] Acquired schema lock
0810 19:48:04.651292 (+ 2us) tablet.cc:662] Decoding operations
0810 19:48:04.651404 (+ 112us) write_op.cc:620] Acquiring the partition lock for write op
0810 19:48:04.651418 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0810 19:48:04.651423 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0810 19:48:04.651515 (+ 92us) tablet.cc:701] Row locks acquired
0810 19:48:04.651517 (+ 2us) write_op.cc:260] PREPARE: finished
0810 19:48:04.651567 (+ 50us) write_op.cc:270] Start()
0810 19:48:04.651608 (+ 41us) write_op.cc:276] Timestamp: P: 1786391284651530 usec, L: 0
0810 19:48:04.651613 (+ 5us) op_driver.cc:348] REPLICATION: starting
0810 19:48:04.651835 (+ 222us) log.cc:844] Serialized 433 byte log entry
0810 19:48:04.786887 (+135052us) op_driver.cc:464] REPLICATION: finished
0810 19:48:04.787651 (+ 764us) write_op.cc:301] APPLY: starting
0810 19:48:04.787663 (+ 12us) tablet.cc:1367] starting BulkCheckPresence
0810 19:48:04.787697 (+ 34us) tablet.cc:1370] finished BulkCheckPresence
0810 19:48:04.787719 (+ 22us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 19:48:04.787820 (+ 101us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 19:48:04.787848 (+ 28us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 19:48:04.787855 (+ 7us) write_op.cc:312] APPLY: finished
0810 19:48:04.787915 (+ 60us) log.cc:844] Serialized 29 byte log entry
0810 19:48:04.787959 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:04.787973 (+ 14us) write_op.cc:454] Released schema lock
0810 19:48:04.787978 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0810 19:48:04.788051 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:04.788054 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":732,"apply.run_cpu_time_us":387,"apply.run_wall_time_us":385,"num_ops":2,"prepare.queue_time_us":3155,"prepare.run_cpu_time_us":879,"prepare.run_wall_time_us":3451,"replication_time_us":135258}]]}
W20260810 19:48:04.791437 10696 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.235.253:37397 timed out after 0.596s (SENT)
I20260810 19:48:04.791960 12266 ts_tablet_manager.cc:1929] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:04.792094 12266 log.cc:1199] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/9e8a23221e8447bd83592c05c9d1149c
I20260810 19:48:04.797266 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet fdd82537177a4142bddd0544485b00c4
I20260810 19:48:04.797901 9407 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:56048 (request call id 960) took 1065 ms. Trace:
I20260810 19:48:04.798215 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet fdd82537177a4142bddd0544485b00c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:04 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:04.798048 9407 rpcz_store.cc:276] 0810 19:48:03.732539 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.608877 (+876338us) service_pool.cc:224] Handling call
0810 19:48:04.624593 (+ 15716us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 19:48:04.624894 (+ 301us) catalog_manager.cc:2841] Modifying in-memory table state
0810 19:48:04.624982 (+ 88us) catalog_manager.cc:2850] Locking tablets
0810 19:48:04.625135 (+ 153us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 19:48:04.789111 (+163976us) catalog_manager.cc:2882] Removing table from by-name map
0810 19:48:04.789213 (+ 102us) catalog_manager.cc:2898] Committing in-memory state
0810 19:48:04.789261 (+ 48us) catalog_manager.cc:2902] Aborting table tasks
0810 19:48:04.797860 (+ 8599us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:48:04.626614 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 19:48:04.626767 (+ 153us) write_op.cc:432] Acquiring schema lock in shared mode
0810 19:48:04.626774 (+ 7us) write_op.cc:435] Acquired schema lock
0810 19:48:04.626776 (+ 2us) tablet.cc:662] Decoding operations
0810 19:48:04.626902 (+ 126us) write_op.cc:620] Acquiring the partition lock for write op
0810 19:48:04.626915 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0810 19:48:04.626919 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0810 19:48:04.627057 (+ 138us) tablet.cc:701] Row locks acquired
0810 19:48:04.627060 (+ 3us) write_op.cc:260] PREPARE: finished
0810 19:48:04.627110 (+ 50us) write_op.cc:270] Start()
0810 19:48:04.627149 (+ 39us) write_op.cc:276] Timestamp: P: 1786391284627076 usec, L: 0
0810 19:48:04.627153 (+ 4us) op_driver.cc:348] REPLICATION: starting
0810 19:48:04.627396 (+ 243us) log.cc:844] Serialized 762 byte log entry
0810 19:48:04.786807 (+159411us) op_driver.cc:464] REPLICATION: finished
0810 19:48:04.787062 (+ 255us) write_op.cc:301] APPLY: starting
0810 19:48:04.787080 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0810 19:48:04.787130 (+ 50us) tablet.cc:1370] finished BulkCheckPresence
0810 19:48:04.787167 (+ 37us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 19:48:04.787256 (+ 89us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 19:48:04.787303 (+ 47us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 19:48:04.787311 (+ 8us) write_op.cc:312] APPLY: finished
0810 19:48:04.787400 (+ 89us) log.cc:844] Serialized 29 byte log entry
0810 19:48:04.787477 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:04.787496 (+ 19us) write_op.cc:454] Released schema lock
0810 19:48:04.787503 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 19:48:04.787576 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:04.787580 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7896,"child_traces":[["op",{"apply.queue_time_us":170,"apply.run_cpu_time_us":511,"apply.run_wall_time_us":511,"num_ops":2,"prepare.queue_time_us":64,"prepare.run_cpu_time_us":870,"prepare.run_wall_time_us":869,"replication_time_us":159619}]]}
I20260810 19:48:04.799379 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet fdd82537177a4142bddd0544485b00c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:04 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:04.799662 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet fdd82537177a4142bddd0544485b00c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:04 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:04.802137 10370 tablet_bootstrap.cc:492] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:04.802431 10370 ts_tablet_manager.cc:1403] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.003s
I20260810 19:48:04.803375 10370 raft_consensus.cc:359] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.803642 10370 raft_consensus.cc:385] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.803772 10370 raft_consensus.cc:740] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.803582 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_29e3919bae1c4e8e9d064b4aaa88197e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:04.804072 10370 consensus_queue.cc:260] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:04.804467 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29e3919bae1c4e8e9d064b4aaa88197e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:04.806103 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3fb4a80c47304a3e815594625c44c7a1" } modify_external_catalogs: true
I20260810 19:48:04.806149 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e1752a8c88c0403e8658f5d5f2c0e160"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:04.806342 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3fb4a80c47304a3e815594625c44c7a1" } modify_external_catalogs: true
I20260810 19:48:04.806421 10370 ts_tablet_manager.cc:1434] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20260810 19:48:04.806744 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1752a8c88c0403e8658f5d5f2c0e160 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:04.806819 10370 tablet_bootstrap.cc:492] T dfea147ef3904ab49375def065c6f328 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:04.806890 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_aed769a713644b6eb660a828c788f786" } modify_external_catalogs: true
I20260810 19:48:04.807049 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_aed769a713644b6eb660a828c788f786" } modify_external_catalogs: true
I20260810 19:48:04.808189 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3b5fc2bb35a448e8bbe8bef5a535e9c2" } modify_external_catalogs: true
I20260810 19:48:04.808399 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3b5fc2bb35a448e8bbe8bef5a535e9c2" } modify_external_catalogs: true
I20260810 19:48:04.812979 10370 tablet_bootstrap.cc:654] T dfea147ef3904ab49375def065c6f328 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.822707 9412 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 5394eadabf184158864921dd5d394828 (table default.Table_c5cc7d3e97ae4d02952905907354f9a3 [id=2d447d5da0e74e0885490174fc0f929d]). Expected version 1 got 0
I20260810 19:48:04.823046 9412 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 7d93fd6556b146ca8933a6dc0a2357e8 (table default.Table_908acdc21674469e937e4539876e0267 [id=de4d62ebb8c440a1a71ed57ac4f3c530]). Expected version 1 got 0
I20260810 19:48:04.823365 9412 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet a45add97e0e54dce85225e175ecbb45a (table default.Table_43b864f9a392475687c4ff23fe9dd13a [id=c580a677dcab41d9892011258d5993d7]). Expected version 2 got 0
I20260810 19:48:04.823678 9412 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet b33aa8be266a434cba899da7514c47e9 (table default.Table_75f34d0b0d844a1dba7d3ed6a75b3555 [id=4e38b3a52c3549889893d804ab0dfb89]). Expected version 1 got 0
I20260810 19:48:04.823856 9412 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 648ef608fa0c45cc8be4bad80c4200be (table default.Table_63c36107140a41da9c5d337a853cb5d3 [id=d921f4a824ae4dd6b0b9dbb8310ff00a]). Expected version 5 got 0
I20260810 19:48:04.824064 9412 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 9a13b0f5b6b14bb9b72740a8521e4ea5 (table default.Table_0844c946c41146f38e51790cd8baed2a [id=4830b444314a4bb6a605cb73432e772f]). Expected version 1 got 0
I20260810 19:48:04.824239 9412 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet d77785d9bde843bc8366fe15d1b4fa18 (table default.Table_3e78e13c8ecc464eb6af12a2bc3f2eba [id=1af2d06c44b643e28d28bb080cd5eef8]). Expected version 2 got 0
W20260810 19:48:04.824538 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b33aa8be266a434cba899da7514c47e9 consensus state has no leader
I20260810 19:48:04.824508 9657 tablet_service.cc:1511] Processing CreateTablet for tablet ec11528c81d24cbc851a4c31cf9257a2 (DEFAULT_TABLE table=default.Table_c58aa77863ae41f0a21a0f72876862f0 [id=ea02d52b71bc48629a67e41005634378]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.825006 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec11528c81d24cbc851a4c31cf9257a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:04.827328 9892 tablet_service.cc:1511] Processing CreateTablet for tablet ec11528c81d24cbc851a4c31cf9257a2 (DEFAULT_TABLE table=default.Table_c58aa77863ae41f0a21a0f72876862f0 [id=ea02d52b71bc48629a67e41005634378]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.827452 9902 tablet_service.cc:1511] Processing CreateTablet for tablet c6ac20a42a6f4a3f95479acc5ed9602f (DEFAULT_TABLE table=default.Table_1bdee0eb4a634cb2beba49dadea53106 [id=4c53c0fc90ba414692f5348d5f42ba5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.829937 9669 tablet_service.cc:1511] Processing CreateTablet for tablet c6ac20a42a6f4a3f95479acc5ed9602f (DEFAULT_TABLE table=default.Table_1bdee0eb4a634cb2beba49dadea53106 [id=4c53c0fc90ba414692f5348d5f42ba5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.830413 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6ac20a42a6f4a3f95479acc5ed9602f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:04.830722 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 18c98ce06f5d4e6c8ba12557f1e33502 (DEFAULT_TABLE table=default.Table_392e7373fd11463b851f18bc44b44450 [id=dc8456d562be4d6bb17a47fa3b54862e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.833289 9418 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 410855f236004ad4b78839eb1c0c2f1f (table default.Table_44478e93cffb460aaa8df9115b799594 [id=1d363ce63686462f9f4c15669773ee22]). Expected version 1 got 0
I20260810 19:48:04.833560 9418 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 7d93fd6556b146ca8933a6dc0a2357e8 (table default.Table_908acdc21674469e937e4539876e0267 [id=de4d62ebb8c440a1a71ed57ac4f3c530]). Expected version 1 got 0
I20260810 19:48:04.833941 9418 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 63b649cbc1d141d8bb438105b8e8537c (table default.Table_b059137abb0e458bbadca41a2f2e8b50 [id=9eaa5e14e854425e8971160c64ee97cf]). Expected version 1 got 0
I20260810 19:48:04.834173 9418 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet d77785d9bde843bc8366fe15d1b4fa18 (table default.Table_3e78e13c8ecc464eb6af12a2bc3f2eba [id=1af2d06c44b643e28d28bb080cd5eef8]). Expected version 2 got 0
I20260810 19:48:04.834613 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 18c98ce06f5d4e6c8ba12557f1e33502 (DEFAULT_TABLE table=default.Table_392e7373fd11463b851f18bc44b44450 [id=dc8456d562be4d6bb17a47fa3b54862e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.834983 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18c98ce06f5d4e6c8ba12557f1e33502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:04.836063 9896 tablet_service.cc:1511] Processing CreateTablet for tablet faba7cb75a714244843488a11b0415e0 (DEFAULT_TABLE table=default.Table_2a7c2c5438234c09ad58a7dc12a13613 [id=4b4b00d18a314e1ca7f8623bccec5adf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.837001 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18c98ce06f5d4e6c8ba12557f1e33502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:04.837237 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faba7cb75a714244843488a11b0415e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:04.837546 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6ac20a42a6f4a3f95479acc5ed9602f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:04.841887 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec11528c81d24cbc851a4c31cf9257a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:04.843379 9418 catalog_manager.cc:5719] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:04.843990 9418 catalog_manager.cc:5719] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:04.844609 9418 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 3e8ae48a2fb548358176abefe1ee3baa (table default.Table_9cb0cc2a8f724781a638706ddcc2c085 [id=12db110e89e04d40bdb05ec61fd5e3b6]). Expected version 1 got 0
I20260810 19:48:04.844851 9418 catalog_manager.cc:5719] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:04.845356 9418 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 9a13b0f5b6b14bb9b72740a8521e4ea5 (table default.Table_0844c946c41146f38e51790cd8baed2a [id=4830b444314a4bb6a605cb73432e772f]). Expected version 1 got 0
I20260810 19:48:04.845700 9413 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_03fbd70a4ed44530a3fab8f17c0769db [id=09fa54104d0f46dbb3f19138bfa2313d] alter complete (version 1)
I20260810 19:48:04.853199 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b6187dbe1ca42f79bf3eddd5475b929 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:04.853488 10127 tablet_service.cc:1558] Processing DeleteTablet for tablet 9fb544dff4eb4642b7e282657ae15d19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:04.827898 10134 tablet_service.cc:1511] Processing CreateTablet for tablet ec11528c81d24cbc851a4c31cf9257a2 (DEFAULT_TABLE table=default.Table_c58aa77863ae41f0a21a0f72876862f0 [id=ea02d52b71bc48629a67e41005634378]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.827891 10130 tablet_service.cc:1511] Processing CreateTablet for tablet c6ac20a42a6f4a3f95479acc5ed9602f (DEFAULT_TABLE table=default.Table_1bdee0eb4a634cb2beba49dadea53106 [id=4c53c0fc90ba414692f5348d5f42ba5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.854059 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6ac20a42a6f4a3f95479acc5ed9602f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:04.854730 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec11528c81d24cbc851a4c31cf9257a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:04.829952 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 18c98ce06f5d4e6c8ba12557f1e33502 (DEFAULT_TABLE table=default.Table_392e7373fd11463b851f18bc44b44450 [id=dc8456d562be4d6bb17a47fa3b54862e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.858659 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18c98ce06f5d4e6c8ba12557f1e33502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:04.835162 10137 tablet_service.cc:1511] Processing CreateTablet for tablet faba7cb75a714244843488a11b0415e0 (DEFAULT_TABLE table=default.Table_2a7c2c5438234c09ad58a7dc12a13613 [id=4b4b00d18a314e1ca7f8623bccec5adf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.862463 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faba7cb75a714244843488a11b0415e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:04.868290 12146 raft_consensus.cc:493] T f3600d0528164850973cb296aaf6910f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:04.868455 12146 raft_consensus.cc:515] T f3600d0528164850973cb296aaf6910f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.868719 10370 tablet_bootstrap.cc:492] T dfea147ef3904ab49375def065c6f328 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:04.868620 11897 consensus_queue.cc:1048] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:04.868875 10370 ts_tablet_manager.cc:1403] T dfea147ef3904ab49375def065c6f328 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.062s user 0.005s sys 0.001s
I20260810 19:48:04.869133 12146 leader_election.cc:290] T f3600d0528164850973cb296aaf6910f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:04.869952 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3600d0528164850973cb296aaf6910f" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:04.870160 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3600d0528164850973cb296aaf6910f" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:04.871050 9611 leader_election.cc:343] T f3600d0528164850973cb296aaf6910f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:04.874818 9611 leader_election.cc:343] T f3600d0528164850973cb296aaf6910f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.874984 9611 leader_election.cc:304] T f3600d0528164850973cb296aaf6910f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:04.875201 10370 raft_consensus.cc:359] T dfea147ef3904ab49375def065c6f328 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.875371 10370 raft_consensus.cc:385] T dfea147ef3904ab49375def065c6f328 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.875454 12146 raft_consensus.cc:2749] T f3600d0528164850973cb296aaf6910f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:04.878579 10370 raft_consensus.cc:740] T dfea147ef3904ab49375def065c6f328 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.776446 10367 consensus_queue.cc:260] T 0e967384768b4ec7956f1b508e8ab2af P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.879626 10370 consensus_queue.cc:260] T dfea147ef3904ab49375def065c6f328 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.880208 10367 ts_tablet_manager.cc:1434] T 0e967384768b4ec7956f1b508e8ab2af P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.106s user 0.003s sys 0.000s
I20260810 19:48:04.883231 10370 ts_tablet_manager.cc:1434] T dfea147ef3904ab49375def065c6f328 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
I20260810 19:48:04.884007 10370 tablet_bootstrap.cc:492] T 5576e9087855441498904bc59685a442 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:04.887629 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c58aa77863ae41f0a21a0f72876862f0" } new_table_name: "default.Table_f98594bccdb54d598dbba0d33856edc8" modify_external_catalogs: true
I20260810 19:48:04.889632 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f0a4eda8c4a944db84e6b258924f1494"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:04.890406 9657 tablet_service.cc:1511] Processing CreateTablet for tablet faba7cb75a714244843488a11b0415e0 (DEFAULT_TABLE table=default.Table_2a7c2c5438234c09ad58a7dc12a13613 [id=4b4b00d18a314e1ca7f8623bccec5adf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:04.890524 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0a4eda8c4a944db84e6b258924f1494 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:04.890914 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faba7cb75a714244843488a11b0415e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:04.892204 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_63a8ea5b28c34cf8bdb6a1588dc3fcb8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:04.892884 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63a8ea5b28c34cf8bdb6a1588dc3fcb8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:04.895668 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0a12a994a3ff4ff8850e8c0d6c0e42ca" } new_table_name: "default.Table_0056243a8c8d42a3bfea00d5110ccc12" modify_external_catalogs: true
I20260810 19:48:04.896395 10247 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:48:04.896878 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 49fa134c630d4df4af2d92b0e3f1f498 (DEFAULT_TABLE table=default.Table_c537ac5c113143f0b5d0d8ca769417af [id=756f04c7347e4a6ca721697affe2c298]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.897183 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 49fa134c630d4df4af2d92b0e3f1f498 (DEFAULT_TABLE table=default.Table_c537ac5c113143f0b5d0d8ca769417af [id=756f04c7347e4a6ca721697affe2c298]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.897359 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49fa134c630d4df4af2d92b0e3f1f498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:04.897627 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49fa134c630d4df4af2d92b0e3f1f498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:04.898727 10367 tablet_bootstrap.cc:492] T 5ba42032e7344423a0e86c55d613f27d P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:04.900553 10367 tablet_bootstrap.cc:654] T 5ba42032e7344423a0e86c55d613f27d P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.902452 10370 tablet_bootstrap.cc:654] T 5576e9087855441498904bc59685a442 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.906580 12146 raft_consensus.cc:493] T a45add97e0e54dce85225e175ecbb45a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:04.906769 12146 raft_consensus.cc:515] T a45add97e0e54dce85225e175ecbb45a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.907513 12146 leader_election.cc:290] T a45add97e0e54dce85225e175ecbb45a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:04.908567 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45add97e0e54dce85225e175ecbb45a" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:04.909168 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45add97e0e54dce85225e175ecbb45a" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:04.909278 9611 leader_election.cc:343] T a45add97e0e54dce85225e175ecbb45a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:04.909798 9611 leader_election.cc:343] T a45add97e0e54dce85225e175ecbb45a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.909915 9611 leader_election.cc:304] T a45add97e0e54dce85225e175ecbb45a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:04.910460 12146 raft_consensus.cc:2749] T a45add97e0e54dce85225e175ecbb45a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:04.911473 12146 raft_consensus.cc:493] T ae3e151180ae4d258d18365770acaaad P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:04.911594 12146 raft_consensus.cc:515] T ae3e151180ae4d258d18365770acaaad P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.912535 12146 leader_election.cc:290] T ae3e151180ae4d258d18365770acaaad P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:04.914058 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3e151180ae4d258d18365770acaaad" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:04.914808 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 49fa134c630d4df4af2d92b0e3f1f498 (DEFAULT_TABLE table=default.Table_c537ac5c113143f0b5d0d8ca769417af [id=756f04c7347e4a6ca721697affe2c298]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.915611 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 07856671e97e4f0089cd67f6b8b2ac42 (DEFAULT_TABLE table=default.Table_14a3eacb9f0740e2bea3ccaf3ce9fc7f [id=924abd405fcf4eb0a41b18ec5a831a47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.916097 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07856671e97e4f0089cd67f6b8b2ac42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:04.916072 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 07856671e97e4f0089cd67f6b8b2ac42 (DEFAULT_TABLE table=default.Table_14a3eacb9f0740e2bea3ccaf3ce9fc7f [id=924abd405fcf4eb0a41b18ec5a831a47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.916581 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07856671e97e4f0089cd67f6b8b2ac42. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:04.919116 9611 leader_election.cc:343] T ae3e151180ae4d258d18365770acaaad P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.914058 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3e151180ae4d258d18365770acaaad" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:04.922714 9611 leader_election.cc:343] T ae3e151180ae4d258d18365770acaaad P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.922981 9611 leader_election.cc:304] T ae3e151180ae4d258d18365770acaaad P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:04.923930 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 07856671e97e4f0089cd67f6b8b2ac42 (DEFAULT_TABLE table=default.Table_14a3eacb9f0740e2bea3ccaf3ce9fc7f [id=924abd405fcf4eb0a41b18ec5a831a47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.926301 12146 raft_consensus.cc:2749] T ae3e151180ae4d258d18365770acaaad P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:04.927764 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07856671e97e4f0089cd67f6b8b2ac42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:04.934520 12146 raft_consensus.cc:493] T dcb3660108094399b36d19ea8e6b8308 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:04.934700 12146 raft_consensus.cc:515] T dcb3660108094399b36d19ea8e6b8308 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.935474 12146 leader_election.cc:290] T dcb3660108094399b36d19ea8e6b8308 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:04.935791 10366 tablet_bootstrap.cc:492] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:04.935943 10366 ts_tablet_manager.cc:1403] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.178s user 0.005s sys 0.001s
I20260810 19:48:04.936319 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb3660108094399b36d19ea8e6b8308" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:04.936930 10375 ts_tablet_manager.cc:1929] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260810 19:48:04.936942 9611 leader_election.cc:343] T dcb3660108094399b36d19ea8e6b8308 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.937666 12266 ts_tablet_manager.cc:1950] T 9e8a23221e8447bd83592c05c9d1149c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:04.942299 12266 tablet_replica.cc:333] T 8455cb11388340beb6daa13fee06177a P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:04.942526 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 9e8a23221e8447bd83592c05c9d1149c (table default.Table_943801654ea043f1b8740ea0215abc35 [id=5cf32f9df60d4b04a704522da9f7973d]) successfully deleted
I20260810 19:48:04.942809 12266 raft_consensus.cc:2243] T 8455cb11388340beb6daa13fee06177a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:04.943136 12266 raft_consensus.cc:2272] T 8455cb11388340beb6daa13fee06177a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:04.943850 12266 ts_tablet_manager.cc:1916] T 8455cb11388340beb6daa13fee06177a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:04.937656 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb3660108094399b36d19ea8e6b8308" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:04.945286 9611 leader_election.cc:343] T dcb3660108094399b36d19ea8e6b8308 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.945412 9611 leader_election.cc:304] T dcb3660108094399b36d19ea8e6b8308 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:04.946038 12146 raft_consensus.cc:2749] T dcb3660108094399b36d19ea8e6b8308 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:04.946887 10366 raft_consensus.cc:359] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.947073 10366 raft_consensus.cc:385] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.947139 10366 raft_consensus.cc:740] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.947356 10366 consensus_queue.cc:260] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.948271 10366 ts_tablet_manager.cc:1434] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260810 19:48:04.949208 10366 tablet_bootstrap.cc:492] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:04.949978 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49fa134c630d4df4af2d92b0e3f1f498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:04.952244 12266 ts_tablet_manager.cc:1929] T 8455cb11388340beb6daa13fee06177a P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:04.952366 12266 log.cc:1199] T 8455cb11388340beb6daa13fee06177a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/8455cb11388340beb6daa13fee06177a
I20260810 19:48:04.952746 12266 ts_tablet_manager.cc:1950] T 8455cb11388340beb6daa13fee06177a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:04.955714 9902 tablet_service.cc:1511] Processing CreateTablet for tablet bb0bfaf245584de889a5ab0b5dedf534 (DEFAULT_TABLE table=default.Table_7f9b257fef5e41f4b0e67f3aab8efd7d [id=d0dc7b8f19584b0dab2bcca5f35b7ed3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.956863 9669 tablet_service.cc:1511] Processing CreateTablet for tablet bb0bfaf245584de889a5ab0b5dedf534 (DEFAULT_TABLE table=default.Table_7f9b257fef5e41f4b0e67f3aab8efd7d [id=d0dc7b8f19584b0dab2bcca5f35b7ed3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.957537 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb0bfaf245584de889a5ab0b5dedf534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:04.962975 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 6dafcf95102b4104b0e4c6b7f64e22e1 (DEFAULT_TABLE table=default.Table_3fecec150df147d18964601662fde615 [id=2e97759283ce4954b52a829afb94cd0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.962548 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 6dafcf95102b4104b0e4c6b7f64e22e1 (DEFAULT_TABLE table=default.Table_3fecec150df147d18964601662fde615 [id=2e97759283ce4954b52a829afb94cd0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.963766 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dafcf95102b4104b0e4c6b7f64e22e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:04.963717 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 01df0725b38d4517b22df017b6c5e2e7 (DEFAULT_TABLE table=default.Table_8a06d915fdaa4924b0d1a8f2284e9a05 [id=2ae9362472184ef4a5138767fcc1908d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.968663 12146 raft_consensus.cc:493] T 3582ed23ffdf4ff089952e29083e5425 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:04.968845 10367 tablet_bootstrap.cc:492] T 5ba42032e7344423a0e86c55d613f27d P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:04.968811 12146 raft_consensus.cc:515] T 3582ed23ffdf4ff089952e29083e5425 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.968971 10367 ts_tablet_manager.cc:1403] T 5ba42032e7344423a0e86c55d613f27d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.070s user 0.001s sys 0.001s
I20260810 19:48:04.969499 12146 leader_election.cc:290] T 3582ed23ffdf4ff089952e29083e5425 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:04.969866 10367 raft_consensus.cc:359] T 5ba42032e7344423a0e86c55d613f27d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.970052 10367 raft_consensus.cc:385] T 5ba42032e7344423a0e86c55d613f27d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:04.970118 10367 raft_consensus.cc:740] T 5ba42032e7344423a0e86c55d613f27d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:04.970710 10367 consensus_queue.cc:260] T 5ba42032e7344423a0e86c55d613f27d P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.971310 10367 ts_tablet_manager.cc:1434] T 5ba42032e7344423a0e86c55d613f27d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:04.973019 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dafcf95102b4104b0e4c6b7f64e22e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:04.972983 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 8455cb11388340beb6daa13fee06177a (table default.Table_9fc2f929c6aa4ff286e66b35f18da641 [id=2a56448ab2544b8ca7a6a49841520fc4]) successfully deleted
I20260810 19:48:04.974574 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01df0725b38d4517b22df017b6c5e2e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:04.976644 10367 tablet_bootstrap.cc:492] T 839dcdb448d14a8f8e452145ccf41263 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:04.977337 12266 tablet_replica.cc:333] T 00fe7d9a548a487d965d92b53cdf9250 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:04.977530 12266 raft_consensus.cc:2243] T 00fe7d9a548a487d965d92b53cdf9250 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:04.977679 12266 raft_consensus.cc:2272] T 00fe7d9a548a487d965d92b53cdf9250 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:04.978541 12266 ts_tablet_manager.cc:1916] T 00fe7d9a548a487d965d92b53cdf9250 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:04.979293 10367 tablet_bootstrap.cc:654] T 839dcdb448d14a8f8e452145ccf41263 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.984398 12146 raft_consensus.cc:493] T 2798f122e0624af6971fc8317244e5ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:04.984565 12146 raft_consensus.cc:515] T 2798f122e0624af6971fc8317244e5ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.985292 12146 leader_election.cc:290] T 2798f122e0624af6971fc8317244e5ae P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:04.986605 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb0bfaf245584de889a5ab0b5dedf534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:04.988272 11518 raft_consensus.cc:493] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:04.988435 11518 raft_consensus.cc:515] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:04.984573 12266 ts_tablet_manager.cc:1929] T 00fe7d9a548a487d965d92b53cdf9250 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:04.988781 12266 log.cc:1199] T 00fe7d9a548a487d965d92b53cdf9250 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/00fe7d9a548a487d965d92b53cdf9250
I20260810 19:48:04.989100 12266 ts_tablet_manager.cc:1950] T 00fe7d9a548a487d965d92b53cdf9250 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:04.990248 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 00fe7d9a548a487d965d92b53cdf9250 (table default.Table_2adfdcdb33f543d49ea6f361bf8a55c4 [id=cfd27e7efc8f4c529e7dace21742b656]) successfully deleted
W20260810 19:48:04.990640 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 86937c581d4c46d38699b268b1e0c42d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 86937c581d4c46d38699b268b1e0c42d already in progress: creating tablet
I20260810 19:48:04.990726 9658 tablet_service.cc:1511] Processing CreateTablet for tablet ce790f7e3311497391d9840417155e9c (DEFAULT_TABLE table=default.Table_45012038df8f4e09bb6516ef3d7ed405 [id=648bafcb4484421490f285c98461366b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:04.990918 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet fdd82537177a4142bddd0544485b00c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fdd82537177a4142bddd0544485b00c4 already in progress: creating tablet
I20260810 19:48:04.991339 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce790f7e3311497391d9840417155e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:04.995046 11518 leader_election.cc:290] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:04.996534 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 6dafcf95102b4104b0e4c6b7f64e22e1 (DEFAULT_TABLE table=default.Table_3fecec150df147d18964601662fde615 [id=2e97759283ce4954b52a829afb94cd0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.995666 10139 tablet_service.cc:1511] Processing CreateTablet for tablet bb0bfaf245584de889a5ab0b5dedf534 (DEFAULT_TABLE table=default.Table_7f9b257fef5e41f4b0e67f3aab8efd7d [id=d0dc7b8f19584b0dab2bcca5f35b7ed3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.998692 10370 tablet_bootstrap.cc:492] T 5576e9087855441498904bc59685a442 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:04.966840 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 01df0725b38d4517b22df017b6c5e2e7 (DEFAULT_TABLE table=default.Table_8a06d915fdaa4924b0d1a8f2284e9a05 [id=2ae9362472184ef4a5138767fcc1908d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:04.967499 10366 tablet_bootstrap.cc:654] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:04.998848 10370 ts_tablet_manager.cc:1403] T 5576e9087855441498904bc59685a442 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.115s user 0.002s sys 0.002s
I20260810 19:48:04.970342 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3582ed23ffdf4ff089952e29083e5425" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:04.986596 9941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2798f122e0624af6971fc8317244e5ae" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:04.999290 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01df0725b38d4517b22df017b6c5e2e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:04.999449 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3582ed23ffdf4ff089952e29083e5425" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:04.988327 9896 tablet_service.cc:1511] Processing CreateTablet for tablet ce790f7e3311497391d9840417155e9c (DEFAULT_TABLE table=default.Table_45012038df8f4e09bb6516ef3d7ed405 [id=648bafcb4484421490f285c98461366b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.000236 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce790f7e3311497391d9840417155e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.002547 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dafcf95102b4104b0e4c6b7f64e22e1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:05.002521 9611 leader_election.cc:343] T 3582ed23ffdf4ff089952e29083e5425 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:05.002808 9611 leader_election.cc:343] T 2798f122e0624af6971fc8317244e5ae P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:04.995838 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e80e2327c394612bffc51f38798dac3" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:05.003026 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb0bfaf245584de889a5ab0b5dedf534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.003054 9944 raft_consensus.cc:2468] T 4e80e2327c394612bffc51f38798dac3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:05.003584 10067 leader_election.cc:304] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:05.003908 11828 raft_consensus.cc:2804] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:05.003980 11828 raft_consensus.cc:493] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:05.004037 11828 raft_consensus.cc:3060] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:05.008960 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 01df0725b38d4517b22df017b6c5e2e7 (DEFAULT_TABLE table=default.Table_8a06d915fdaa4924b0d1a8f2284e9a05 [id=2ae9362472184ef4a5138767fcc1908d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:05.011109 9611 leader_election.cc:343] T 3582ed23ffdf4ff089952e29083e5425 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:05.011266 9611 leader_election.cc:304] T 3582ed23ffdf4ff089952e29083e5425 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:05.009465 10153 raft_consensus.cc:3060] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:05.011924 10068 leader_election.cc:343] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 4e80e2327c394612bffc51f38798dac3
I20260810 19:48:05.012045 12146 raft_consensus.cc:2749] T 3582ed23ffdf4ff089952e29083e5425 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:05.011940 10127 tablet_service.cc:1511] Processing CreateTablet for tablet ce790f7e3311497391d9840417155e9c (DEFAULT_TABLE table=default.Table_45012038df8f4e09bb6516ef3d7ed405 [id=648bafcb4484421490f285c98461366b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.010461 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2798f122e0624af6971fc8317244e5ae" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:05.012822 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01df0725b38d4517b22df017b6c5e2e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.013041 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce790f7e3311497391d9840417155e9c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:05.015035 9611 leader_election.cc:343] T 2798f122e0624af6971fc8317244e5ae P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:05.015170 9611 leader_election.cc:304] T 2798f122e0624af6971fc8317244e5ae P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:05.015618 12146 raft_consensus.cc:2749] T 2798f122e0624af6971fc8317244e5ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:05.022136 10370 raft_consensus.cc:359] T 5576e9087855441498904bc59685a442 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.022409 10370 raft_consensus.cc:385] T 5576e9087855441498904bc59685a442 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:05.022477 10370 raft_consensus.cc:740] T 5576e9087855441498904bc59685a442 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:05.022707 10370 consensus_queue.cc:260] T 5576e9087855441498904bc59685a442 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.023294 10370 ts_tablet_manager.cc:1434] T 5576e9087855441498904bc59685a442 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260810 19:48:05.031862 10367 tablet_bootstrap.cc:492] T 839dcdb448d14a8f8e452145ccf41263 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:05.032783 10367 ts_tablet_manager.cc:1403] T 839dcdb448d14a8f8e452145ccf41263 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.056s user 0.004s sys 0.000s
I20260810 19:48:05.033852 10367 raft_consensus.cc:359] T 839dcdb448d14a8f8e452145ccf41263 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.038393 10367 raft_consensus.cc:385] T 839dcdb448d14a8f8e452145ccf41263 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:05.038579 10367 raft_consensus.cc:740] T 839dcdb448d14a8f8e452145ccf41263 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:05.038918 10367 consensus_queue.cc:260] T 839dcdb448d14a8f8e452145ccf41263 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.039677 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 5f4e2adee0264e418ff8c54912973e60
I20260810 19:48:05.039719 10367 ts_tablet_manager.cc:1434] T 839dcdb448d14a8f8e452145ccf41263 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260810 19:48:05.040248 9420 catalog_manager.cc:6807] ReplaceTablet: tablet 5f4e2adee0264e418ff8c54912973e60 deleted and replaced by tablet 883bf419763f4dcfab870fea49137eff
I20260810 19:48:05.040421 9420 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:56048 (request call id 963) took 1161 ms. Trace:
I20260810 19:48:05.040505 9420 rpcz_store.cc:276] 0810 19:48:03.878571 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.675339 (+796768us) service_pool.cc:224] Handling call
0810 19:48:05.040360 (+365021us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:48:04.896663 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 19:48:04.896757 (+ 94us) write_op.cc:432] Acquiring schema lock in shared mode
0810 19:48:04.896761 (+ 4us) write_op.cc:435] Acquired schema lock
0810 19:48:04.896764 (+ 3us) tablet.cc:662] Decoding operations
0810 19:48:04.896882 (+ 118us) write_op.cc:620] Acquiring the partition lock for write op
0810 19:48:04.896896 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0810 19:48:04.896901 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0810 19:48:04.896983 (+ 82us) tablet.cc:701] Row locks acquired
0810 19:48:04.896986 (+ 3us) write_op.cc:260] PREPARE: finished
0810 19:48:04.897038 (+ 52us) write_op.cc:270] Start()
0810 19:48:04.897076 (+ 38us) write_op.cc:276] Timestamp: P: 1786391284896982 usec, L: 0
0810 19:48:04.897080 (+ 4us) op_driver.cc:348] REPLICATION: starting
0810 19:48:04.897311 (+ 231us) log.cc:844] Serialized 628 byte log entry
0810 19:48:05.034576 (+137265us) op_driver.cc:464] REPLICATION: finished
0810 19:48:05.035048 (+ 472us) write_op.cc:301] APPLY: starting
0810 19:48:05.035069 (+ 21us) tablet.cc:1367] starting BulkCheckPresence
0810 19:48:05.035121 (+ 52us) tablet.cc:1370] finished BulkCheckPresence
0810 19:48:05.035157 (+ 36us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 19:48:05.035291 (+ 134us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 19:48:05.035352 (+ 61us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 19:48:05.035360 (+ 8us) write_op.cc:312] APPLY: finished
0810 19:48:05.035447 (+ 87us) log.cc:844] Serialized 29 byte log entry
0810 19:48:05.035524 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:05.035545 (+ 21us) write_op.cc:454] Released schema lock
0810 19:48:05.035553 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 19:48:05.035638 (+ 85us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:05.035642 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":413,"apply.run_cpu_time_us":581,"apply.run_wall_time_us":580,"num_ops":2,"prepare.queue_time_us":70812,"prepare.run_cpu_time_us":768,"prepare.run_wall_time_us":1213,"replication_time_us":137452}]]}
I20260810 19:48:05.041165 10366 tablet_bootstrap.cc:492] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:05.041311 10366 ts_tablet_manager.cc:1403] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.092s user 0.004s sys 0.003s
I20260810 19:48:05.042155 10366 raft_consensus.cc:359] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.042380 10366 raft_consensus.cc:385] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:05.042443 10366 raft_consensus.cc:740] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:05.042654 10366 consensus_queue.cc:260] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.043243 10366 ts_tablet_manager.cc:1434] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 19:48:05.044634 9412 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_0a12a994a3ff4ff8850e8c0d6c0e42ca [id=374cf9ed870c448fbbdad7050d0d11f9] alter complete (version 1)
I20260810 19:48:05.045996 10366 tablet_bootstrap.cc:492] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:05.046866 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b8365464a8654203a285a8036593fa40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:05.047557 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8365464a8654203a285a8036593fa40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:05.048120 10367 tablet_bootstrap.cc:492] T 4c75af1e592042f5a4d442b82a539c94 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:05.049665 10367 tablet_bootstrap.cc:654] T 4c75af1e592042f5a4d442b82a539c94 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:05.055166 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet dcb3660108094399b36d19ea8e6b8308 with delete_type TABLET_DATA_DELETED (replaced by tablet f5fa6060b9ef48cea6830cd9d19424ea) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:05.055478 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 4dba7046bdfd41f1a2ad6f299a723776 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:05.055673 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet ae3e151180ae4d258d18365770acaaad with delete_type TABLET_DATA_DELETED (replaced by tablet 6dea3165feb842ecb58b7ace235abf38) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:05.056044 12266 tablet_replica.cc:333] T dcb3660108094399b36d19ea8e6b8308 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:05.056267 12266 raft_consensus.cc:2243] T dcb3660108094399b36d19ea8e6b8308 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:05.056577 12266 raft_consensus.cc:2272] T dcb3660108094399b36d19ea8e6b8308 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:05.057211 12266 ts_tablet_manager.cc:1916] T dcb3660108094399b36d19ea8e6b8308 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:05.058703 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet e09365db984f41b49197891b332ebd87
I20260810 19:48:05.061323 9415 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 5ba42032e7344423a0e86c55d613f27d (table default.Table_c6af56cc89144541a50f07ce309f7aaf [id=0bbc6397fe1b49cb894bb0e50af006fc]). Expected version 2 got 0
I20260810 19:48:05.061601 10366 tablet_bootstrap.cc:654] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:05.062546 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 263a5695e7754b44a64edbda27b42135
I20260810 19:48:05.063235 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_bb58c03ab3af444b99cd4fa12a0482cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:05.063827 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb58c03ab3af444b99cd4fa12a0482cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:05.065199 10377 ts_tablet_manager.cc:1929] T 3c828ae089774fb9b0582141f4b99313 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:05.065313 10377 log.cc:1199] T 3c828ae089774fb9b0582141f4b99313 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/3c828ae089774fb9b0582141f4b99313
I20260810 19:48:05.065629 10377 ts_tablet_manager.cc:1950] T 3c828ae089774fb9b0582141f4b99313 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:05.065984 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 1bbd3fe2117c42058dc108b5dc18d560
I20260810 19:48:05.066808 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_744b0ef1592749908ad53111cb98fa1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:05.067426 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_744b0ef1592749908ad53111cb98fa1c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:05.069032 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_35de6164baf24ff79163d6b665fc6b8c" } modify_external_catalogs: true
I20260810 19:48:05.069221 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_35de6164baf24ff79163d6b665fc6b8c" } modify_external_catalogs: true
W20260810 19:48:05.070681 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ec11528c81d24cbc851a4c31cf9257a2 consensus state has no leader
I20260810 19:48:05.071008 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet ac17aa6447f547a9b9a44449b283bb69 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:05.071002 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet f3600d0528164850973cb296aaf6910f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:05.074347 9420 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 9a13b0f5b6b14bb9b72740a8521e4ea5 (table default.Table_0844c946c41146f38e51790cd8baed2a [id=4830b444314a4bb6a605cb73432e772f]). Expected version 1 got 0
I20260810 19:48:05.074477 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 3582ed23ffdf4ff089952e29083e5425 with delete_type TABLET_DATA_DELETED (replaced by tablet 8503d5162548463bae22402fdc4c502a) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:05.074780 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f4e2adee0264e418ff8c54912973e60 with delete_type TABLET_DATA_DELETED (replaced by tablet 883bf419763f4dcfab870fea49137eff) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:05.081642 12087 consensus_queue.cc:1048] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:05.082437 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f4e2adee0264e418ff8c54912973e60 with delete_type TABLET_DATA_DELETED (replaced by tablet 883bf419763f4dcfab870fea49137eff) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:05.082510 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 659) took 3262 ms. Trace:
I20260810 19:48:05.082674 10377 rpcz_store.cc:276] 0810 19:48:01.819967 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:01.826188 (+ 6221us) service_pool.cc:224] Handling call
0810 19:48:04.703962 (+2877774us) ts_tablet_manager.cc:1151] Deleting tablet 3c828ae089774fb9b0582141f4b99313
0810 19:48:04.704001 (+ 39us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.021933 (+317932us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.065132 (+ 43199us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.082480 (+ 17348us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2811358}
I20260810 19:48:05.082854 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 263a5695e7754b44a64edbda27b42135 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:04 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:05.083060 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bbd3fe2117c42058dc108b5dc18d560 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:04 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:05.083382 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 839dcdb448d14a8f8e452145ccf41263 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:05.083602 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet e09365db984f41b49197891b332ebd87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:04 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:05.084439 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 661) took 3234 ms. Trace:
I20260810 19:48:05.084534 10377 rpcz_store.cc:276] 0810 19:48:01.849554 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:01.849646 (+ 92us) service_pool.cc:224] Handling call
0810 19:48:05.083044 (+3233398us) ts_tablet_manager.cc:1151] Deleting tablet 8455cb11388340beb6daa13fee06177a
0810 19:48:05.084302 (+ 1258us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.084416 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3190107}
I20260810 19:48:05.084872 10377 tablet_replica.cc:333] T 4e80e2327c394612bffc51f38798dac3 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:05.084851 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 3c828ae089774fb9b0582141f4b99313 (table default.Table_cc3aacf41a5e424687efa546af746ffa [id=56c4ed6bce3c4b88b8f47f0313355de1]) successfully deleted
I20260810 19:48:05.085065 10377 raft_consensus.cc:2243] T 4e80e2327c394612bffc51f38798dac3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:05.085235 10377 raft_consensus.cc:2272] T 4e80e2327c394612bffc51f38798dac3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:05.085633 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 263a5695e7754b44a64edbda27b42135 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:04 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:05.085722 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bbd3fe2117c42058dc108b5dc18d560 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:04 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:05.084017 9420 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 7d93fd6556b146ca8933a6dc0a2357e8 (table default.Table_908acdc21674469e937e4539876e0267 [id=de4d62ebb8c440a1a71ed57ac4f3c530]). Expected version 1 got 0
W20260810 19:48:05.087550 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 8455cb11388340beb6daa13fee06177a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8455cb11388340beb6daa13fee06177a already in progress: creating tablet
I20260810 19:48:05.090983 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ee7dc02ca2694c60a65c9b96d4410000" } new_table_name: "default.Table_92455999000f47609f8b7df3aa63031b" modify_external_catalogs: true
I20260810 19:48:05.094941 10377 ts_tablet_manager.cc:1916] T 4e80e2327c394612bffc51f38798dac3 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:05.095158 12266 ts_tablet_manager.cc:1929] T dcb3660108094399b36d19ea8e6b8308 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:05.098119 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b5a8a6be570046fc83326c8efb7b8f10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:05.098753 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5a8a6be570046fc83326c8efb7b8f10 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:05.101112 12266 log.cc:1199] T dcb3660108094399b36d19ea8e6b8308 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/dcb3660108094399b36d19ea8e6b8308
I20260810 19:48:05.101692 12266 ts_tablet_manager.cc:1950] T dcb3660108094399b36d19ea8e6b8308 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:05.102936 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet ac17aa6447f547a9b9a44449b283bb69
I20260810 19:48:05.103395 9410 catalog_manager.cc:6807] ReplaceTablet: tablet ac17aa6447f547a9b9a44449b283bb69 deleted and replaced by tablet 89486e79019a4ea49066231ee761089f
I20260810 19:48:05.103750 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0bf175363efe4e62a23cf86713325670"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:05.105415 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 99aa001db52149dd90ce86e7261f7424
I20260810 19:48:05.106235 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ae6b06e8ae0c4fd19fe26b1b08db672a" } new_table_name: "default.Table_d53c7e2836b143eab54246ed5e0de77e" modify_external_catalogs: true
I20260810 19:48:05.106849 12266 tablet_replica.cc:333] T 4dba7046bdfd41f1a2ad6f299a723776 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:05.107052 12266 raft_consensus.cc:2243] T 4dba7046bdfd41f1a2ad6f299a723776 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:05.107192 12266 raft_consensus.cc:2272] T 4dba7046bdfd41f1a2ad6f299a723776 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:05.107748 12266 ts_tablet_manager.cc:1916] T 4dba7046bdfd41f1a2ad6f299a723776 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:05.109297 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet dcb3660108094399b36d19ea8e6b8308 (table default.Table_9d569d756be84460b1b78812a13b95ad [id=14e993ddf3b646098d6d3a3e24d01b07]) successfully deleted
I20260810 19:48:05.114382 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 6355c14e38b3446493f7bd5e2a717341 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:05.115922 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet ebf33d82af9e494a8e85be8cba55d2c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:05.116042 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet b5f30148b5c84f7cbdfabd0186611cc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:05.116446 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e8a23221e8447bd83592c05c9d1149c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:05.117034 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 99aa001db52149dd90ce86e7261f7424 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:05 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:05.117053 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet ac17aa6447f547a9b9a44449b283bb69 with delete_type TABLET_DATA_DELETED (replaced by tablet 89486e79019a4ea49066231ee761089f) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:05.117501 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a94bb89d6b784e5ab463d0c2ae4778ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:05.118671 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0bf175363efe4e62a23cf86713325670 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:05.121239 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c6af56cc89144541a50f07ce309f7aaf" } modify_external_catalogs: true
I20260810 19:48:05.121501 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c6af56cc89144541a50f07ce309f7aaf" } modify_external_catalogs: true
I20260810 19:48:05.122336 10370 tablet_bootstrap.cc:492] T d77785d9bde843bc8366fe15d1b4fa18 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:48:05.124642 10068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 93560us
W20260810 19:48:05.124943 10067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 81997.7us
I20260810 19:48:05.126134 12207 tablet.cc:1724] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:05.128259 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet e09365db984f41b49197891b332ebd87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:04 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:05.128541 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet 99aa001db52149dd90ce86e7261f7424 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:05 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:05.128571 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f4e2adee0264e418ff8c54912973e60 with delete_type TABLET_DATA_DELETED (replaced by tablet 883bf419763f4dcfab870fea49137eff) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:05.128703 10144 tablet_service.cc:1558] Processing DeleteTablet for tablet 263a5695e7754b44a64edbda27b42135 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:04 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:05.128903 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet ac17aa6447f547a9b9a44449b283bb69 with delete_type TABLET_DATA_DELETED (replaced by tablet 89486e79019a4ea49066231ee761089f) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:05.129176 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bbd3fe2117c42058dc108b5dc18d560 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:04 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:05.134793 12208 tablet.cc:1724] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:05.102279 10377 ts_tablet_manager.cc:1929] T 4e80e2327c394612bffc51f38798dac3 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:05.135512 10377 log.cc:1199] T 4e80e2327c394612bffc51f38798dac3 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/4e80e2327c394612bffc51f38798dac3
I20260810 19:48:05.137552 10377 ts_tablet_manager.cc:1950] T 4e80e2327c394612bffc51f38798dac3 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:05.137945 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 658) took 3321 ms. Trace:
I20260810 19:48:05.138047 10377 rpcz_store.cc:276] 0810 19:48:01.816199 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:01.826409 (+ 10210us) service_pool.cc:224] Handling call
0810 19:48:05.084822 (+3258413us) ts_tablet_manager.cc:1151] Deleting tablet 4e80e2327c394612bffc51f38798dac3
0810 19:48:05.084834 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.099257 (+ 14423us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.102215 (+ 2958us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.137925 (+ 35710us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3191819}
I20260810 19:48:05.138500 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 669) took 3012 ms. Trace:
I20260810 19:48:05.138578 10377 rpcz_store.cc:276] 0810 19:48:02.126056 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.126244 (+ 188us) service_pool.cc:224] Handling call
0810 19:48:05.138355 (+3012111us) ts_tablet_manager.cc:1151] Deleting tablet f85f3fa629764c79921a710739eea7ae
0810 19:48:05.138368 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.138479 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2986369}
I20260810 19:48:05.138907 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 673) took 2963 ms. Trace:
I20260810 19:48:05.138963 10377 rpcz_store.cc:276] 0810 19:48:02.175546 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.182372 (+ 6826us) service_pool.cc:224] Handling call
0810 19:48:05.138811 (+2956439us) ts_tablet_manager.cc:1151] Deleting tablet 229dd737ee8547a89445593cc117fbc2
0810 19:48:05.138821 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.138894 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2955574}
I20260810 19:48:05.139241 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 675) took 2947 ms. Trace:
I20260810 19:48:05.139318 12208 tablet.cc:1724] T 63b649cbc1d141d8bb438105b8e8537c P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 19:48:05.144457 9830 consensus_peers.cc:597] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:05.139336 10377 rpcz_store.cc:276] 0810 19:48:02.191842 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.191908 (+ 66us) service_pool.cc:224] Handling call
0810 19:48:05.139146 (+2947238us) ts_tablet_manager.cc:1151] Deleting tablet 253f302c00cc42ff84076b0c17f7670a
0810 19:48:05.139154 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.139227 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2946984}
I20260810 19:48:05.147462 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 676) took 2955 ms. Trace:
I20260810 19:48:05.147543 10377 rpcz_store.cc:276] 0810 19:48:02.191966 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.216115 (+ 24149us) service_pool.cc:224] Handling call
0810 19:48:05.147330 (+2931215us) ts_tablet_manager.cc:1151] Deleting tablet a776693b6b4943a7b64e13ec10958c16
0810 19:48:05.147342 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.147438 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2928724}
I20260810 19:48:05.147874 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 674) took 2956 ms. Trace:
I20260810 19:48:05.147945 10377 rpcz_store.cc:276] 0810 19:48:02.191706 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.219867 (+ 28161us) service_pool.cc:224] Handling call
0810 19:48:05.147762 (+2927895us) ts_tablet_manager.cc:1151] Deleting tablet 092686718efe4b19a610586420d6bc3a
0810 19:48:05.147783 (+ 21us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.147859 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2927257}
I20260810 19:48:05.148252 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 677) took 2859 ms. Trace:
I20260810 19:48:05.148324 10377 rpcz_store.cc:276] 0810 19:48:02.288491 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.288561 (+ 70us) service_pool.cc:224] Handling call
0810 19:48:05.148151 (+2859590us) ts_tablet_manager.cc:1151] Deleting tablet c9e2dbef6e7a48caa2964ab90fbf9b73
0810 19:48:05.148160 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.148236 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2857994}
I20260810 19:48:05.148581 10377 tablet_replica.cc:333] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:05.148808 10377 raft_consensus.cc:2243] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:05.148974 10377 raft_consensus.cc:2272] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:05.149519 10377 ts_tablet_manager.cc:1916] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:05.148434 11828 raft_consensus.cc:515] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:05.153795 10067 leader_election.cc:343] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 4e80e2327c394612bffc51f38798dac3
I20260810 19:48:05.153832 11518 raft_consensus.cc:493] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:05.154019 11518 raft_consensus.cc:515] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
W20260810 19:48:05.154429 10068 consensus_peers.cc:597] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2c77a8ac1614bb286e4e168bcf999f3. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:05.154649 11518 leader_election.cc:290] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:05.156234 10067 leader_election.cc:343] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 28c9eecacc6540ac82ac7faabceec788
W20260810 19:48:05.156463 9830 consensus_peers.cc:597] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:05.107815 10367 tablet_bootstrap.cc:492] T 4c75af1e592042f5a4d442b82a539c94 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:05.110859 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 99aa001db52149dd90ce86e7261f7424 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:05 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:05.110976 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet ac17aa6447f547a9b9a44449b283bb69 with delete_type TABLET_DATA_DELETED (replaced by tablet 89486e79019a4ea49066231ee761089f) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:05.119976 12146 raft_consensus.cc:493] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:05.156935 10367 ts_tablet_manager.cc:1403] T 4c75af1e592042f5a4d442b82a539c94 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.109s user 0.004s sys 0.004s
I20260810 19:48:05.157033 12146 raft_consensus.cc:515] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:05.157405 10068 leader_election.cc:343] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 4e80e2327c394612bffc51f38798dac3
I20260810 19:48:05.157677 12146 leader_election.cc:290] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:05.136081 12085 tablet.cc:1724] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:05.157727 10367 raft_consensus.cc:359] T 4c75af1e592042f5a4d442b82a539c94 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.157891 10367 raft_consensus.cc:385] T 4c75af1e592042f5a4d442b82a539c94 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:05.157940 10367 raft_consensus.cc:740] T 4c75af1e592042f5a4d442b82a539c94 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:05.158149 10367 consensus_queue.cc:260] T 4c75af1e592042f5a4d442b82a539c94 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.158695 10367 ts_tablet_manager.cc:1434] T 4c75af1e592042f5a4d442b82a539c94 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:05.159025 10367 tablet_bootstrap.cc:492] T 896b7cfdb0ca4904aaeafa13ff19365e P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:05.160495 10367 tablet_bootstrap.cc:654] T 896b7cfdb0ca4904aaeafa13ff19365e P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:05.161995 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e967384768b4ec7956f1b508e8ab2af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:05.150350 12313 raft_consensus.cc:493] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:05.163848 12313 raft_consensus.cc:515] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.164746 9941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf9486839474b2a8ddff3a49b4fda2a" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:05.165617 9941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33aa8be266a434cba899da7514c47e9" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:05.118244 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a94bb89d6b784e5ab463d0c2ae4778ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:05.165618 9611 leader_election.cc:343] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:05.164554 12313 leader_election.cc:290] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:05.153249 11828 leader_election.cc:290] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:05.168382 9611 leader_election.cc:343] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:05.152087 12312 tablet.cc:1724] T 63b649cbc1d141d8bb438105b8e8537c P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:05.170975 10375 log.cc:1199] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/6355c14e38b3446493f7bd5e2a717341
I20260810 19:48:05.172955 10375 ts_tablet_manager.cc:1950] T 6355c14e38b3446493f7bd5e2a717341 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:05.173424 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 635) took 3509 ms. Trace:
I20260810 19:48:05.173528 10375 rpcz_store.cc:276] 0810 19:48:01.663889 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:01.664542 (+ 653us) service_pool.cc:224] Handling call
0810 19:48:04.747734 (+3083192us) ts_tablet_manager.cc:1151] Deleting tablet 6355c14e38b3446493f7bd5e2a717341
0810 19:48:04.747784 (+ 50us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:04.814156 (+ 66372us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:04.936797 (+122641us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.173402 (+236605us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3052803}
I20260810 19:48:05.181229 12313 raft_consensus.cc:493] T 3fd5cd2e4c104e45a81d2603c6f7d24a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:05.181413 12313 raft_consensus.cc:515] T 3fd5cd2e4c104e45a81d2603c6f7d24a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.157507 10068 leader_election.cc:304] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:05.182878 9941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd5cd2e4c104e45a81d2603c6f7d24a" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:05.183435 10068 leader_election.cc:343] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 28c9eecacc6540ac82ac7faabceec788
I20260810 19:48:05.183574 10068 leader_election.cc:304] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:05.184123 12092 raft_consensus.cc:2749] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260810 19:48:05.184140 9611 leader_election.cc:343] T 3fd5cd2e4c104e45a81d2603c6f7d24a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:05.184355 11828 raft_consensus.cc:2749] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 19:48:05.184888 12313 leader_election.cc:290] T 3fd5cd2e4c104e45a81d2603c6f7d24a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:05.185997 12087 raft_consensus.cc:493] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:05.186158 12087 raft_consensus.cc:515] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.186878 12087 leader_election.cc:290] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:05.187542 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db2b8038ee9747109b42510bba02faa9" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:05.187749 9717 raft_consensus.cc:2468] T db2b8038ee9747109b42510bba02faa9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:05.188268 9831 leader_election.cc:304] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:05.188562 12087 raft_consensus.cc:2804] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:05.188640 12087 raft_consensus.cc:493] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:05.188707 12087 raft_consensus.cc:3060] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:05.191552 12087 raft_consensus.cc:515] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.192709 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db2b8038ee9747109b42510bba02faa9" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:05.192922 9717 raft_consensus.cc:3060] T db2b8038ee9747109b42510bba02faa9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:05.195868 9717 raft_consensus.cc:2468] T db2b8038ee9747109b42510bba02faa9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:05.196424 9831 leader_election.cc:304] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:05.196733 11897 raft_consensus.cc:2804] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:05.196887 12087 leader_election.cc:290] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:05.196892 11897 raft_consensus.cc:697] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:05.197256 11897 consensus_queue.cc:237] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.158728 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c5352053fa544be884fb272f00bd81f9" } new_table_name: "default.Table_e2cacf22254c483cb65f6d2b79a4f541" modify_external_catalogs: true
I20260810 19:48:05.159883 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 4e80e2327c394612bffc51f38798dac3 (table default.Table_5005f8f74af74cad8c19a3c67e8f9fe9 [id=bd544994cecc42b2adc881ebfe318d7b]) successfully deleted
W20260810 19:48:05.199748 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet f85f3fa629764c79921a710739eea7ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f85f3fa629764c79921a710739eea7ae already in progress: creating tablet
W20260810 19:48:05.200043 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 229dd737ee8547a89445593cc117fbc2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 229dd737ee8547a89445593cc117fbc2 already in progress: creating tablet
W20260810 19:48:05.200335 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 253f302c00cc42ff84076b0c17f7670a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 253f302c00cc42ff84076b0c17f7670a already in progress: creating tablet
W20260810 19:48:05.200711 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet a776693b6b4943a7b64e13ec10958c16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a776693b6b4943a7b64e13ec10958c16 already in progress: creating tablet
W20260810 19:48:05.201289 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 092686718efe4b19a610586420d6bc3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 092686718efe4b19a610586420d6bc3a already in progress: creating tablet
I20260810 19:48:05.206017 12266 ts_tablet_manager.cc:1929] T 4dba7046bdfd41f1a2ad6f299a723776 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:05.206195 12266 log.cc:1199] T 4dba7046bdfd41f1a2ad6f299a723776 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/4dba7046bdfd41f1a2ad6f299a723776
I20260810 19:48:05.206599 12266 ts_tablet_manager.cc:1950] T 4dba7046bdfd41f1a2ad6f299a723776 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:05.208624 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet e09365db984f41b49197891b332ebd87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:04 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:05.209331 12266 tablet_replica.cc:333] T ae3e151180ae4d258d18365770acaaad P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:05.209502 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 4dba7046bdfd41f1a2ad6f299a723776 (table default.Table_074b525586d74c169b286124d5849cd2 [id=4dd4fbd829aa40048810c5a338d1b741]) successfully deleted
I20260810 19:48:05.211604 12266 raft_consensus.cc:2243] T ae3e151180ae4d258d18365770acaaad P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:05.212993 12266 raft_consensus.cc:2272] T ae3e151180ae4d258d18365770acaaad P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:05.213764 12266 ts_tablet_manager.cc:1916] T ae3e151180ae4d258d18365770acaaad P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:05.214783 12207 tablet.cc:1724] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:05.218446 10375 tablet_replica.cc:333] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:05.218724 10375 raft_consensus.cc:2243] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:05.219341 10375 raft_consensus.cc:2272] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:05.224773 10370 tablet_bootstrap.cc:654] T d77785d9bde843bc8366fe15d1b4fa18 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:05.231154 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet c9e2dbef6e7a48caa2964ab90fbf9b73 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9e2dbef6e7a48caa2964ab90fbf9b73 already in progress: creating tablet
W20260810 19:48:05.231657 9395 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet e68916e2568f4527a181342cdc728001 (table default.Table_3e7715bf0f8c41e3bd4964a0f918c9ea [id=3babf53bc29e4d4f9be8b2c19be6e2bd], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet e68916e2568f4527a181342cdc728001 consensus state has no leader
I20260810 19:48:05.236258 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2a7aefa4ff8c4818b970f0c8a127f276"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:05.237002 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a7aefa4ff8c4818b970f0c8a127f276 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:05.239269 12266 ts_tablet_manager.cc:1929] T ae3e151180ae4d258d18365770acaaad P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:05.239548 12266 log.cc:1199] T ae3e151180ae4d258d18365770acaaad P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/ae3e151180ae4d258d18365770acaaad
I20260810 19:48:05.239933 12266 ts_tablet_manager.cc:1950] T ae3e151180ae4d258d18365770acaaad P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:05.241043 12266 tablet_replica.cc:333] T f3600d0528164850973cb296aaf6910f P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:05.241309 12266 raft_consensus.cc:2243] T f3600d0528164850973cb296aaf6910f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:05.241276 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet ae3e151180ae4d258d18365770acaaad (table default.Table_250f18957ff84ad58246dfec016f0abf [id=197d5993ea8643288fe8814a51e4bfd4]) successfully deleted
I20260810 19:48:05.241562 12266 raft_consensus.cc:2272] T f3600d0528164850973cb296aaf6910f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:05.242240 12266 ts_tablet_manager.cc:1916] T f3600d0528164850973cb296aaf6910f P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:05.245595 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1f4252825a324dc8a245a626aa10c7d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:05.246443 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f4252825a324dc8a245a626aa10c7d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:05.249045 12266 ts_tablet_manager.cc:1929] T f3600d0528164850973cb296aaf6910f P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:05.249208 12266 log.cc:1199] T f3600d0528164850973cb296aaf6910f P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/f3600d0528164850973cb296aaf6910f
I20260810 19:48:05.249562 12266 ts_tablet_manager.cc:1950] T f3600d0528164850973cb296aaf6910f P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:05.250815 12266 tablet_replica.cc:333] T 3582ed23ffdf4ff089952e29083e5425 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:05.250988 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet f3600d0528164850973cb296aaf6910f (table default.Table_a02900865d894a1dbfdb42b50ca8ebbf [id=d772b7f40fc3470ebbfe9442d8c44185]) successfully deleted
I20260810 19:48:05.251070 12266 raft_consensus.cc:2243] T 3582ed23ffdf4ff089952e29083e5425 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:05.251363 12266 raft_consensus.cc:2272] T 3582ed23ffdf4ff089952e29083e5425 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:05.252020 12266 ts_tablet_manager.cc:1916] T 3582ed23ffdf4ff089952e29083e5425 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:05.260139 9412 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 3e8ae48a2fb548358176abefe1ee3baa (table default.Table_9cb0cc2a8f724781a638706ddcc2c085 [id=12db110e89e04d40bdb05ec61fd5e3b6]). Expected version 1 got 0
I20260810 19:48:05.264075 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db2b8038ee9747109b42510bba02faa9" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:05.265134 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db2b8038ee9747109b42510bba02faa9" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:05.266681 10375 ts_tablet_manager.cc:1916] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:05.266920 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf9486839474b2a8ddff3a49b4fda2a" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:05.267448 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33aa8be266a434cba899da7514c47e9" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:05.269613 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd5cd2e4c104e45a81d2603c6f7d24a" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:05.270427 9611 leader_election.cc:343] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:05.270562 9611 leader_election.cc:304] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:05.270853 12313 raft_consensus.cc:2749] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:05.271651 9830 leader_election.cc:343] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:05.272125 9830 leader_election.cc:343] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:05.273597 9611 leader_election.cc:343] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:05.273718 9611 leader_election.cc:304] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:05.273952 12313 raft_consensus.cc:2749] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:05.274354 9611 leader_election.cc:343] T 3fd5cd2e4c104e45a81d2603c6f7d24a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:05.274468 9611 leader_election.cc:304] T 3fd5cd2e4c104e45a81d2603c6f7d24a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:05.274825 12313 raft_consensus.cc:2749] T 3fd5cd2e4c104e45a81d2603c6f7d24a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:05.277094 10067 consensus_peers.cc:597] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:05.278229 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet 5b56fb5bed4b46a2a1fc0ab22379760b from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:05.279227 12266 ts_tablet_manager.cc:1929] T 3582ed23ffdf4ff089952e29083e5425 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:05.279367 12266 log.cc:1199] T 3582ed23ffdf4ff089952e29083e5425 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/3582ed23ffdf4ff089952e29083e5425
I20260810 19:48:05.279686 12266 ts_tablet_manager.cc:1950] T 3582ed23ffdf4ff089952e29083e5425 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:05.280898 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 3582ed23ffdf4ff089952e29083e5425 (table default.Table_4fb96dbc73be4091855b1cbbed3b9ce6 [id=c72c64a09f73486abc4b2c6a72271d57]) successfully deleted
W20260810 19:48:05.281309 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 5f4e2adee0264e418ff8c54912973e60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f4e2adee0264e418ff8c54912973e60 already in progress: creating tablet
W20260810 19:48:05.281651 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 263a5695e7754b44a64edbda27b42135 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 263a5695e7754b44a64edbda27b42135 already in progress: creating tablet
I20260810 19:48:05.281810 12266 tablet_replica.cc:333] T 839dcdb448d14a8f8e452145ccf41263 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
W20260810 19:48:05.281868 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 1bbd3fe2117c42058dc108b5dc18d560 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1bbd3fe2117c42058dc108b5dc18d560 already in progress: creating tablet
I20260810 19:48:05.282023 12266 raft_consensus.cc:2243] T 839dcdb448d14a8f8e452145ccf41263 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:05.282172 12266 raft_consensus.cc:2272] T 839dcdb448d14a8f8e452145ccf41263 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:05.283288 12266 ts_tablet_manager.cc:1916] T 839dcdb448d14a8f8e452145ccf41263 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:05.285250 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 6355c14e38b3446493f7bd5e2a717341 (table default.Table_20332cc0e9df49adb98c82a60784c4bb [id=ba8ef3f482364fc081f8e796fdbdb076]) successfully deleted
W20260810 19:48:05.289927 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 871f8793e77845399a2e0ae7407adc75 consensus state has no leader
I20260810 19:48:05.290388 9421 master_service.cc:960] ReplaceTablet: received request to replace tablet a78960e1f2164c848297411b9273ac64 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:05.291052 9421 master_service.cc:960] ReplaceTablet: received request to replace tablet 98c1a8c9946248b78e5b77ba8dfdb953 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:05.295173 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 028fd8427d824ae89ff035d32548710b (DEFAULT_TABLE table=default.Table_eedceb8b47b24ffdada374252ad7e3b3 [id=cf9de9b525f7401f8706943638b3d247]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.294471 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_84ec8686acb8432fb832c484aab7c394" } modify_external_catalogs: true
I20260810 19:48:05.295552 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_84ec8686acb8432fb832c484aab7c394" } modify_external_catalogs: true
I20260810 19:48:05.295663 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 028fd8427d824ae89ff035d32548710b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.298652 9684 tablet_service.cc:1511] Processing CreateTablet for tablet a66e86ff6248473885f90cb7a83a724d (DEFAULT_TABLE table=default.Table_e6007d18986c4545bd6fdce7b12dc200 [id=115eb118d8ac4be1833da22d7561908f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.299073 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a66e86ff6248473885f90cb7a83a724d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.299036 9687 tablet_service.cc:1511] Processing CreateTablet for tablet efbe1ac330634c9485f7a44164ff7395 (DEFAULT_TABLE table=default.Table_7459a9ef6579436aaf36362612271ccb [id=2e2d1a64fd214c1d82ff1dea70e58fd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.299362 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efbe1ac330634c9485f7a44164ff7395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.299563 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 3fca05565d6b4a289c58a1c84d0d4c13 (DEFAULT_TABLE table=default.Table_a70894bcda4548a783ceb79c8f531e1f [id=8a38aaa8631c475ca53b686c903238c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.299885 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fca05565d6b4a289c58a1c84d0d4c13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.300478 9677 tablet_service.cc:1511] Processing CreateTablet for tablet 42130675907e4239bd7db3d13686dc16 (DEFAULT_TABLE table=default.Table_4808a61b7def4aeb935036bb48bb8d40 [id=7f56703a0ac742b5921b3fe0e9ae05cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.300881 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42130675907e4239bd7db3d13686dc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.302253 11828 raft_consensus.cc:493] T 3c828ae089774fb9b0582141f4b99313 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:05.302449 11828 raft_consensus.cc:515] T 3c828ae089774fb9b0582141f4b99313 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.302574 9675 tablet_service.cc:1511] Processing CreateTablet for tablet e663c45e1a1f4d4b8b09048d7c65f60e (DEFAULT_TABLE table=default.Table_d64b095dd9e84a8c974131583cd0df88 [id=af431acb21544d8c9a83d09e1e966b1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.302922 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e663c45e1a1f4d4b8b09048d7c65f60e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.303189 11828 leader_election.cc:290] T 3c828ae089774fb9b0582141f4b99313 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:05.304684 10067 leader_election.cc:343] T 3c828ae089774fb9b0582141f4b99313 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 3c828ae089774fb9b0582141f4b99313
I20260810 19:48:05.306687 9664 tablet_service.cc:1511] Processing CreateTablet for tablet f06df4cdb79c440b91b0eff135d2dfac (DEFAULT_TABLE table=default.Table_8721298cbe674d2abc25a201da5c09b0 [id=cc80f50e7f3c4af6868c70e2a30452b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.307046 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f06df4cdb79c440b91b0eff135d2dfac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.308069 12266 ts_tablet_manager.cc:1929] T 839dcdb448d14a8f8e452145ccf41263 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:05.308159 12266 log.cc:1199] T 839dcdb448d14a8f8e452145ccf41263 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/839dcdb448d14a8f8e452145ccf41263
I20260810 19:48:05.308451 12266 ts_tablet_manager.cc:1950] T 839dcdb448d14a8f8e452145ccf41263 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:05.310601 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 5cff3aebf3064c44a004143372e8575b (DEFAULT_TABLE table=default.Table_c98abecdcb3043558419cbdff0a68d75 [id=e8525fa6c39444d1962c570e00e5736e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.310956 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cff3aebf3064c44a004143372e8575b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.312565 9688 tablet_service.cc:1511] Processing CreateTablet for tablet fb79696a914d4d8d9210758ea1759b16 (DEFAULT_TABLE table=default.Table_b8022049381847cd8f1b45aad5235aec [id=b0d50d8d1e5541bca7bd3bfee5f48437]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.312906 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb79696a914d4d8d9210758ea1759b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.314800 9666 tablet_service.cc:1511] Processing CreateTablet for tablet df2ad3636656472bada97194b3524a83 (DEFAULT_TABLE table=default.Table_e1752a8c88c0403e8658f5d5f2c0e160 [id=9beae237b4b34956b56ec710093bcd46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.315130 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df2ad3636656472bada97194b3524a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.318598 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 04fddcde3f3c4bb2ba4a538c90d80bc8 (DEFAULT_TABLE table=default.Table_e4e351705cb84297a4388268a731fd9c [id=d26993ebd34e4df7a56d5119d1290d8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.318955 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04fddcde3f3c4bb2ba4a538c90d80bc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.319499 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 8f93030ff2b3437796c2ea52df1432a1 (DEFAULT_TABLE table=default.Table_29e3919bae1c4e8e9d064b4aaa88197e [id=6b51d9a6963749ea95fce98f35a9a03d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.319849 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f93030ff2b3437796c2ea52df1432a1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:05.311038 10068 leader_election.cc:343] T 3c828ae089774fb9b0582141f4b99313 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 3c828ae089774fb9b0582141f4b99313
I20260810 19:48:05.320719 10068 leader_election.cc:304] T 3c828ae089774fb9b0582141f4b99313 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:05.321208 11828 raft_consensus.cc:2749] T 3c828ae089774fb9b0582141f4b99313 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:05.302574 9665 tablet_service.cc:1511] Processing CreateTablet for tablet cef05a75108049aeba6eb1ef44d64f33 (DEFAULT_TABLE table=default.Table_e897b6492b3e40feb25bfd4dcc970908 [id=bdefc5f775204704970447618fa5d1ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.323097 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cef05a75108049aeba6eb1ef44d64f33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.327039 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_cfeef51f25594045916e90c140464db0" } modify_external_catalogs: true
I20260810 19:48:05.327613 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_cfeef51f25594045916e90c140464db0" } modify_external_catalogs: true
I20260810 19:48:05.332489 12087 consensus_queue.cc:1048] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:05.348562 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 839dcdb448d14a8f8e452145ccf41263 (table default.Table_745ec8d1fd994242990bec7acd5bd9cd [id=435f41d3a7ba4f03a738cdb2272f759e]) successfully deleted
W20260810 19:48:05.348954 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet e09365db984f41b49197891b332ebd87 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e09365db984f41b49197891b332ebd87 already in progress: creating tablet
W20260810 19:48:05.349241 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 99aa001db52149dd90ce86e7261f7424 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99aa001db52149dd90ce86e7261f7424 already in progress: creating tablet
I20260810 19:48:05.350248 9791 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
W20260810 19:48:05.355301 10068 consensus_peers.cc:597] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 476e762e46c04ae6bfef5e14df2d16e2. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:05.363988 12146 raft_consensus.cc:493] T 4c75af1e592042f5a4d442b82a539c94 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:05.364140 12146 raft_consensus.cc:515] T 4c75af1e592042f5a4d442b82a539c94 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.367997 11828 consensus_queue.cc:1048] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:05.368711 10377 ts_tablet_manager.cc:1929] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:05.371608 10377 log.cc:1199] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/d2c77a8ac1614bb286e4e168bcf999f3
I20260810 19:48:05.371933 10377 ts_tablet_manager.cc:1950] T d2c77a8ac1614bb286e4e168bcf999f3 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:05.372267 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 679) took 2992 ms. Trace:
I20260810 19:48:05.372365 10377 rpcz_store.cc:276] 0810 19:48:02.379860 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.380101 (+ 241us) service_pool.cc:224] Handling call
0810 19:48:05.148536 (+2768435us) ts_tablet_manager.cc:1151] Deleting tablet d2c77a8ac1614bb286e4e168bcf999f3
0810 19:48:05.148545 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.362401 (+213856us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.368634 (+ 6233us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.372236 (+ 3602us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2768182}
I20260810 19:48:05.378988 12146 leader_election.cc:290] T 4c75af1e592042f5a4d442b82a539c94 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:05.379316 12266 tablet_replica.cc:333] T 0e967384768b4ec7956f1b508e8ab2af P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:05.379532 12266 raft_consensus.cc:2243] T 0e967384768b4ec7956f1b508e8ab2af P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:05.379689 12266 raft_consensus.cc:2272] T 0e967384768b4ec7956f1b508e8ab2af P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:05.379734 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet ac17aa6447f547a9b9a44449b283bb69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac17aa6447f547a9b9a44449b283bb69 already in progress: creating tablet
I20260810 19:48:05.379935 9941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c75af1e592042f5a4d442b82a539c94" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:05.380046 12312 tablet.cc:1724] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:05.380630 10377 tablet_replica.cc:333] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:05.380690 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c75af1e592042f5a4d442b82a539c94" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:05.381349 9611 leader_election.cc:343] T 4c75af1e592042f5a4d442b82a539c94 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:05.381711 10377 raft_consensus.cc:2243] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 19:48:05.385329 9611 leader_election.cc:343] T 4c75af1e592042f5a4d442b82a539c94 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:05.385448 9611 leader_election.cc:304] T 4c75af1e592042f5a4d442b82a539c94 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:05.385891 12146 raft_consensus.cc:2749] T 4c75af1e592042f5a4d442b82a539c94 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:05.390470 10377 raft_consensus.cc:2272] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:05.392303 10377 ts_tablet_manager.cc:1916] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:05.394899 11828 raft_consensus.cc:493] T 5576e9087855441498904bc59685a442 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:05.395061 11828 raft_consensus.cc:515] T 5576e9087855441498904bc59685a442 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.395763 11828 leader_election.cc:290] T 5576e9087855441498904bc59685a442 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:05.398510 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5576e9087855441498904bc59685a442" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:05.401782 9941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5576e9087855441498904bc59685a442" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:05.402559 10067 leader_election.cc:304] T 5576e9087855441498904bc59685a442 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:05.403139 11828 raft_consensus.cc:2749] T 5576e9087855441498904bc59685a442 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:05.408316 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c828ae089774fb9b0582141f4b99313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:05.411013 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e80e2327c394612bffc51f38798dac3 with delete_type TABLET_DATA_DELETED (replaced by tablet 341220bd9f1b40d49ff360c2acc32339) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:05.414120 12266 ts_tablet_manager.cc:1916] T 0e967384768b4ec7956f1b508e8ab2af P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:05.439199 12208 tablet.cc:1724] T 81720b897a674b5380c6469d1600a979 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:05.441390 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 028fd8427d824ae89ff035d32548710b (DEFAULT_TABLE table=default.Table_eedceb8b47b24ffdada374252ad7e3b3 [id=cf9de9b525f7401f8706943638b3d247]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.441926 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 028fd8427d824ae89ff035d32548710b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.449833 10377 ts_tablet_manager.cc:1929] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:05.450006 10377 log.cc:1199] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/971e9abee86444a7a9e923b0962ae751
I20260810 19:48:05.450446 10377 ts_tablet_manager.cc:1950] T 971e9abee86444a7a9e923b0962ae751 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:05.450774 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 680) took 3070 ms. Trace:
I20260810 19:48:05.450865 10377 rpcz_store.cc:276] 0810 19:48:02.379937 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.380398 (+ 461us) service_pool.cc:224] Handling call
0810 19:48:05.380574 (+3000176us) ts_tablet_manager.cc:1151] Deleting tablet 971e9abee86444a7a9e923b0962ae751
0810 19:48:05.380586 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.429464 (+ 48878us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.449748 (+ 20284us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.450754 (+ 1006us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3000011}
I20260810 19:48:05.451222 10377 tablet_replica.cc:333] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:05.451417 10377 raft_consensus.cc:2243] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:05.451588 10377 raft_consensus.cc:2272] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:05.452147 10377 ts_tablet_manager.cc:1916] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:05.452577 12313 raft_consensus.cc:493] T 648ef608fa0c45cc8be4bad80c4200be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:05.452749 12313 raft_consensus.cc:515] T 648ef608fa0c45cc8be4bad80c4200be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.453970 9941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648ef608fa0c45cc8be4bad80c4200be" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:05.454602 9611 leader_election.cc:343] T 648ef608fa0c45cc8be4bad80c4200be P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:05.454569 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648ef608fa0c45cc8be4bad80c4200be" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:05.454217 12313 leader_election.cc:290] T 648ef608fa0c45cc8be4bad80c4200be P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:05.455216 9611 leader_election.cc:343] T 648ef608fa0c45cc8be4bad80c4200be P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:05.455359 9611 leader_election.cc:304] T 648ef608fa0c45cc8be4bad80c4200be P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:05.456153 12329 raft_consensus.cc:2749] T 648ef608fa0c45cc8be4bad80c4200be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:05.458961 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 028fd8427d824ae89ff035d32548710b (DEFAULT_TABLE table=default.Table_eedceb8b47b24ffdada374252ad7e3b3 [id=cf9de9b525f7401f8706943638b3d247]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.459640 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 028fd8427d824ae89ff035d32548710b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.465579 12207 tablet.cc:1724] T 81720b897a674b5380c6469d1600a979 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:05.474908 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 04fddcde3f3c4bb2ba4a538c90d80bc8 (DEFAULT_TABLE table=default.Table_e4e351705cb84297a4388268a731fd9c [id=d26993ebd34e4df7a56d5119d1290d8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.475088 10377 ts_tablet_manager.cc:1929] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:05.475189 10377 log.cc:1199] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/9fb544dff4eb4642b7e282657ae15d19
I20260810 19:48:05.475361 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04fddcde3f3c4bb2ba4a538c90d80bc8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:05.476230 10067 consensus_peers.cc:597] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 971e9abee86444a7a9e923b0962ae751. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:05.477171 10137 tablet_service.cc:1511] Processing CreateTablet for tablet a66e86ff6248473885f90cb7a83a724d (DEFAULT_TABLE table=default.Table_e6007d18986c4545bd6fdce7b12dc200 [id=115eb118d8ac4be1833da22d7561908f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.477603 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a66e86ff6248473885f90cb7a83a724d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.477890 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 04fddcde3f3c4bb2ba4a538c90d80bc8 (DEFAULT_TABLE table=default.Table_e4e351705cb84297a4388268a731fd9c [id=d26993ebd34e4df7a56d5119d1290d8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.478673 9902 tablet_service.cc:1511] Processing CreateTablet for tablet a66e86ff6248473885f90cb7a83a724d (DEFAULT_TABLE table=default.Table_e6007d18986c4545bd6fdce7b12dc200 [id=115eb118d8ac4be1833da22d7561908f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.479043 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a66e86ff6248473885f90cb7a83a724d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.479707 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 3fca05565d6b4a289c58a1c84d0d4c13 (DEFAULT_TABLE table=default.Table_a70894bcda4548a783ceb79c8f531e1f [id=8a38aaa8631c475ca53b686c903238c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.480911 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04fddcde3f3c4bb2ba4a538c90d80bc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.484301 10377 ts_tablet_manager.cc:1950] T 9fb544dff4eb4642b7e282657ae15d19 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:05.484691 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 681) took 3104 ms. Trace:
I20260810 19:48:05.484786 10377 rpcz_store.cc:276] 0810 19:48:02.380048 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.380588 (+ 540us) service_pool.cc:224] Handling call
0810 19:48:05.451169 (+3070581us) ts_tablet_manager.cc:1151] Deleting tablet 9fb544dff4eb4642b7e282657ae15d19
0810 19:48:05.451180 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.464000 (+ 12820us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.475021 (+ 11021us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.484671 (+ 9650us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3070446}
I20260810 19:48:05.485330 10377 tablet_replica.cc:333] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:05.486490 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fca05565d6b4a289c58a1c84d0d4c13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.488278 10377 raft_consensus.cc:2243] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:05.488477 10377 raft_consensus.cc:2272] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:05.489704 10377 ts_tablet_manager.cc:1916] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:05.495406 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9ba19e355042403b818268a2b837356d" } new_table_name: "default.Table_2a407e7f5af54ac4b14ab34e5585f929" modify_external_catalogs: true
I20260810 19:48:05.498489 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_af6e508271a340b0b1cc5e7a16cd66ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:05.499266 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af6e508271a340b0b1cc5e7a16cd66ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:05.503677 10377 ts_tablet_manager.cc:1929] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:05.503818 10377 log.cc:1199] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/21208dd824fe432fa307cbb88d37aaa2
I20260810 19:48:05.504165 10377 ts_tablet_manager.cc:1950] T 21208dd824fe432fa307cbb88d37aaa2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:05.504537 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 678) took 3124 ms. Trace:
I20260810 19:48:05.504637 10377 rpcz_store.cc:276] 0810 19:48:02.379763 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.382705 (+ 2942us) service_pool.cc:224] Handling call
0810 19:48:05.485276 (+3102571us) ts_tablet_manager.cc:1151] Deleting tablet 21208dd824fe432fa307cbb88d37aaa2
0810 19:48:05.485286 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.493096 (+ 7810us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.503602 (+ 10506us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.504515 (+ 913us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2711,"tablet-delete.queue_time_us":3102288}
I20260810 19:48:05.505129 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 683) took 3086 ms. Trace:
I20260810 19:48:05.505230 10377 rpcz_store.cc:276] 0810 19:48:02.418646 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.419148 (+ 502us) service_pool.cc:224] Handling call
0810 19:48:05.504989 (+3085841us) ts_tablet_manager.cc:1151] Deleting tablet f6f9eb86c6c84b4a84d109d4741238e1
0810 19:48:05.505000 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.505108 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3085599}
I20260810 19:48:05.505625 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 684) took 3080 ms. Trace:
I20260810 19:48:05.505710 10377 rpcz_store.cc:276] 0810 19:48:02.425534 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.427972 (+ 2438us) service_pool.cc:224] Handling call
0810 19:48:05.505495 (+3077523us) ts_tablet_manager.cc:1151] Deleting tablet 8565cd6fc9e34c5fbabba6e573df9939
0810 19:48:05.505504 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.505607 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3077271}
I20260810 19:48:05.505980 10377 tablet_replica.cc:333] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:05.506194 10377 raft_consensus.cc:2243] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
W20260810 19:48:05.508142 10696 leader_election.cc:336] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f52c40e347e24ab4b3129e7064f4a43e (127.8.235.253:37397): Timed out: RequestConsensusVote RPC to 127.8.235.253:37397 timed out after 0.596s (SENT)
I20260810 19:48:05.508322 10696 leader_election.cc:304] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5268e710af3c43ddab70eb7dd1aaa575; no voters: 0c56283079e74549afd0096f7e72046a, f52c40e347e24ab4b3129e7064f4a43e
I20260810 19:48:05.515579 10377 raft_consensus.cc:2272] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:05.516237 10377 ts_tablet_manager.cc:1916] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:05.523272 10377 ts_tablet_manager.cc:1929] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:05.523416 10377 log.cc:1199] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/b737b216646a4c5baecb88d59bcce4df
I20260810 19:48:05.523773 10377 ts_tablet_manager.cc:1950] T b737b216646a4c5baecb88d59bcce4df P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:05.524139 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 685) took 3091 ms. Trace:
I20260810 19:48:05.524245 10377 rpcz_store.cc:276] 0810 19:48:02.432456 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.432569 (+ 113us) service_pool.cc:224] Handling call
0810 19:48:05.505935 (+3073366us) ts_tablet_manager.cc:1151] Deleting tablet b737b216646a4c5baecb88d59bcce4df
0810 19:48:05.505943 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.519785 (+ 13842us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.523197 (+ 3412us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.524115 (+ 918us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3073108}
I20260810 19:48:05.524638 10377 tablet_replica.cc:333] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:05.526495 12106 raft_consensus.cc:493] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6986ed920dcb4af29a5eeeda6f671691)
I20260810 19:48:05.526674 12106 raft_consensus.cc:515] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.527572 12106 leader_election.cc:290] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:05.532434 12313 raft_consensus.cc:493] T 5ba42032e7344423a0e86c55d613f27d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:05.532616 12313 raft_consensus.cc:515] T 5ba42032e7344423a0e86c55d613f27d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.532619 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d93fd6556b146ca8933a6dc0a2357e8" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:05.533313 12313 leader_election.cc:290] T 5ba42032e7344423a0e86c55d613f27d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:05.534057 9941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba42032e7344423a0e86c55d613f27d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:05.534763 9611 leader_election.cc:343] T 5ba42032e7344423a0e86c55d613f27d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:05.535601 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba42032e7344423a0e86c55d613f27d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:05.539007 12086 raft_consensus.cc:493] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 19:48:05.539053 10068 consensus_peers.cc:597] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9fb544dff4eb4642b7e282657ae15d19. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:05.539165 12086 raft_consensus.cc:515] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:05.539328 9611 leader_election.cc:343] T 5ba42032e7344423a0e86c55d613f27d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:05.539477 9611 leader_election.cc:304] T 5ba42032e7344423a0e86c55d613f27d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:05.539822 12086 leader_election.cc:290] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:05.539929 12313 raft_consensus.cc:2749] T 5ba42032e7344423a0e86c55d613f27d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:05.540787 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00fe7d9a548a487d965d92b53cdf9250" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:05.540901 9831 leader_election.cc:343] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 00fe7d9a548a487d965d92b53cdf9250
W20260810 19:48:05.541262 9830 leader_election.cc:343] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:05.541380 9830 leader_election.cc:304] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:05.541798 12086 raft_consensus.cc:2749] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:05.552420 10370 tablet_bootstrap.cc:492] T d77785d9bde843bc8366fe15d1b4fa18 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:05.552610 10370 ts_tablet_manager.cc:1403] T d77785d9bde843bc8366fe15d1b4fa18 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.430s user 0.026s sys 0.013s
I20260810 19:48:05.553761 10370 raft_consensus.cc:359] T d77785d9bde843bc8366fe15d1b4fa18 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.553949 10370 raft_consensus.cc:385] T d77785d9bde843bc8366fe15d1b4fa18 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:05.554003 10370 raft_consensus.cc:740] T d77785d9bde843bc8366fe15d1b4fa18 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:05.554208 10370 consensus_queue.cc:260] T d77785d9bde843bc8366fe15d1b4fa18 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.554715 10370 ts_tablet_manager.cc:1434] T d77785d9bde843bc8366fe15d1b4fa18 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:05.557036 10370 tablet_bootstrap.cc:492] T 3e8ae48a2fb548358176abefe1ee3baa P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:05.560520 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d93fd6556b146ca8933a6dc0a2357e8" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:05.561326 10067 leader_election.cc:304] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:05.561832 12106 raft_consensus.cc:2749] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 19:48:05.563607 10367 tablet_bootstrap.cc:492] T 896b7cfdb0ca4904aaeafa13ff19365e P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:05.563809 10367 ts_tablet_manager.cc:1403] T 896b7cfdb0ca4904aaeafa13ff19365e P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.405s user 0.036s sys 0.051s
I20260810 19:48:05.564659 10367 raft_consensus.cc:359] T 896b7cfdb0ca4904aaeafa13ff19365e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.564850 10367 raft_consensus.cc:385] T 896b7cfdb0ca4904aaeafa13ff19365e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:05.564903 10367 raft_consensus.cc:740] T 896b7cfdb0ca4904aaeafa13ff19365e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:05.564949 9896 tablet_service.cc:1511] Processing CreateTablet for tablet e663c45e1a1f4d4b8b09048d7c65f60e (DEFAULT_TABLE table=default.Table_d64b095dd9e84a8c974131583cd0df88 [id=af431acb21544d8c9a83d09e1e966b1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.565110 10367 consensus_queue.cc:260] T 896b7cfdb0ca4904aaeafa13ff19365e P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.565438 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e663c45e1a1f4d4b8b09048d7c65f60e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.565609 10367 ts_tablet_manager.cc:1434] T 896b7cfdb0ca4904aaeafa13ff19365e P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:05.565943 10367 tablet_bootstrap.cc:492] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:05.567615 10366 tablet_bootstrap.cc:492] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:05.567778 10366 ts_tablet_manager.cc:1403] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.522s user 0.021s sys 0.077s
I20260810 19:48:05.568639 10366 raft_consensus.cc:359] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.568806 10366 raft_consensus.cc:385] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:05.568856 10366 raft_consensus.cc:740] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:05.569060 10366 consensus_queue.cc:260] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.569594 10366 ts_tablet_manager.cc:1434] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:05.569939 10366 tablet_bootstrap.cc:492] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:05.573623 10366 tablet_bootstrap.cc:654] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:05.574828 10367 tablet_bootstrap.cc:654] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:05.575991 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 3fca05565d6b4a289c58a1c84d0d4c13 (DEFAULT_TABLE table=default.Table_a70894bcda4548a783ceb79c8f531e1f [id=8a38aaa8631c475ca53b686c903238c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.576434 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fca05565d6b4a289c58a1c84d0d4c13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.579907 12312 tablet.cc:1724] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:05.583477 12311 tablet.cc:1724] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:05.586800 10153 raft_consensus.cc:3060] T 5576e9087855441498904bc59685a442 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:05.592310 10137 tablet_service.cc:1511] Processing CreateTablet for tablet e663c45e1a1f4d4b8b09048d7c65f60e (DEFAULT_TABLE table=default.Table_d64b095dd9e84a8c974131583cd0df88 [id=af431acb21544d8c9a83d09e1e966b1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.592796 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e663c45e1a1f4d4b8b09048d7c65f60e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.592980 12339 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5268e710af3c43ddab70eb7dd1aaa575 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 19:48:05.593446 10696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.253:37397, user_credentials={real_user=slave}} blocked reactor thread for 85320.2us
W20260810 19:48:05.601804 10067 consensus_peers.cc:597] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 21208dd824fe432fa307cbb88d37aaa2. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:05.602615 10366 tablet_bootstrap.cc:492] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:05.602854 10366 ts_tablet_manager.cc:1403] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.033s user 0.007s sys 0.003s
I20260810 19:48:05.603845 10366 raft_consensus.cc:359] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.604115 10366 raft_consensus.cc:385] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:05.604239 10366 raft_consensus.cc:740] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:05.604592 10366 consensus_queue.cc:260] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.605337 10366 ts_tablet_manager.cc:1434] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 19:48:05.606360 10377 raft_consensus.cc:2243] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:05.606765 10377 pending_rounds.cc:70] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691: Trying to abort 1 pending ops.
I20260810 19:48:05.606812 10377 pending_rounds.cc:77] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058700390191104 op_type: NO_OP noop_request { }
I20260810 19:48:05.606909 10377 raft_consensus.cc:2889] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:05.606985 10377 raft_consensus.cc:2272] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:05.609515 10137 tablet_service.cc:1511] Processing CreateTablet for tablet f06df4cdb79c440b91b0eff135d2dfac (DEFAULT_TABLE table=default.Table_8721298cbe674d2abc25a201da5c09b0 [id=cc80f50e7f3c4af6868c70e2a30452b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.611096 10377 ts_tablet_manager.cc:1916] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:05.611413 10366 tablet_bootstrap.cc:492] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:05.613754 9407 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 7d93fd6556b146ca8933a6dc0a2357e8 (table default.Table_908acdc21674469e937e4539876e0267 [id=de4d62ebb8c440a1a71ed57ac4f3c530]). Expected version 1 got 0
I20260810 19:48:05.614696 10370 tablet_bootstrap.cc:654] T 3e8ae48a2fb548358176abefe1ee3baa P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:05.616111 10366 tablet_bootstrap.cc:654] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:05.618141 10067 consensus_peers.cc:597] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:05.621896 10367 tablet_bootstrap.cc:492] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:05.622064 10367 ts_tablet_manager.cc:1403] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.056s user 0.005s sys 0.005s
I20260810 19:48:05.623366 10367 raft_consensus.cc:359] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.623622 10367 raft_consensus.cc:385] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:05.623690 10367 raft_consensus.cc:740] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:05.623975 10367 consensus_queue.cc:260] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.624719 10367 ts_tablet_manager.cc:1434] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:48:05.628849 10127 tablet_service.cc:1511] Processing CreateTablet for tablet efbe1ac330634c9485f7a44164ff7395 (DEFAULT_TABLE table=default.Table_7459a9ef6579436aaf36362612271ccb [id=2e2d1a64fd214c1d82ff1dea70e58fd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.630025 10370 tablet_bootstrap.cc:492] T 3e8ae48a2fb548358176abefe1ee3baa P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:05.630163 10130 tablet_service.cc:1511] Processing CreateTablet for tablet cef05a75108049aeba6eb1ef44d64f33 (DEFAULT_TABLE table=default.Table_e897b6492b3e40feb25bfd4dcc970908 [id=bdefc5f775204704970447618fa5d1ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.630257 10370 ts_tablet_manager.cc:1403] T 3e8ae48a2fb548358176abefe1ee3baa P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.073s user 0.001s sys 0.002s
I20260810 19:48:05.632174 10125 tablet_service.cc:1511] Processing CreateTablet for tablet df2ad3636656472bada97194b3524a83 (DEFAULT_TABLE table=default.Table_e1752a8c88c0403e8658f5d5f2c0e160 [id=9beae237b4b34956b56ec710093bcd46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.632611 10118 tablet_service.cc:1511] Processing CreateTablet for tablet 5cff3aebf3064c44a004143372e8575b (DEFAULT_TABLE table=default.Table_c98abecdcb3043558419cbdff0a68d75 [id=e8525fa6c39444d1962c570e00e5736e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.632761 10370 raft_consensus.cc:359] T 3e8ae48a2fb548358176abefe1ee3baa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.632948 10370 raft_consensus.cc:385] T 3e8ae48a2fb548358176abefe1ee3baa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:05.632997 10370 raft_consensus.cc:740] T 3e8ae48a2fb548358176abefe1ee3baa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:05.633039 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 8f93030ff2b3437796c2ea52df1432a1 (DEFAULT_TABLE table=default.Table_29e3919bae1c4e8e9d064b4aaa88197e [id=6b51d9a6963749ea95fce98f35a9a03d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.633211 10370 consensus_queue.cc:260] T 3e8ae48a2fb548358176abefe1ee3baa P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.633039 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 42130675907e4239bd7db3d13686dc16 (DEFAULT_TABLE table=default.Table_4808a61b7def4aeb935036bb48bb8d40 [id=7f56703a0ac742b5921b3fe0e9ae05cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.633977 9896 tablet_service.cc:1511] Processing CreateTablet for tablet cef05a75108049aeba6eb1ef44d64f33 (DEFAULT_TABLE table=default.Table_e897b6492b3e40feb25bfd4dcc970908 [id=bdefc5f775204704970447618fa5d1ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.634145 10115 tablet_service.cc:1511] Processing CreateTablet for tablet fb79696a914d4d8d9210758ea1759b16 (DEFAULT_TABLE table=default.Table_b8022049381847cd8f1b45aad5235aec [id=b0d50d8d1e5541bca7bd3bfee5f48437]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.635921 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cef05a75108049aeba6eb1ef44d64f33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.636471 10370 ts_tablet_manager.cc:1434] T 3e8ae48a2fb548358176abefe1ee3baa P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20260810 19:48:05.636157 9906 tablet_service.cc:1511] Processing CreateTablet for tablet efbe1ac330634c9485f7a44164ff7395 (DEFAULT_TABLE table=default.Table_7459a9ef6579436aaf36362612271ccb [id=2e2d1a64fd214c1d82ff1dea70e58fd6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:05.642037 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a7d3a90046d74f4087fd5b283581970d consensus state has no leader
I20260810 19:48:05.642606 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ae76035c86954fd0b296d6461d767a59" } modify_external_catalogs: true
I20260810 19:48:05.642829 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ae76035c86954fd0b296d6461d767a59" } modify_external_catalogs: true
I20260810 19:48:05.647315 10375 ts_tablet_manager.cc:1929] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:05.647454 10375 log.cc:1199] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/28c9eecacc6540ac82ac7faabceec788
I20260810 19:48:05.647763 10375 ts_tablet_manager.cc:1950] T 28c9eecacc6540ac82ac7faabceec788 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:05.652516 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f06df4cdb79c440b91b0eff135d2dfac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.654695 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cef05a75108049aeba6eb1ef44d64f33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.654930 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cff3aebf3064c44a004143372e8575b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.654946 12266 ts_tablet_manager.cc:1929] T 0e967384768b4ec7956f1b508e8ab2af P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:05.655082 12266 log.cc:1199] T 0e967384768b4ec7956f1b508e8ab2af P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/0e967384768b4ec7956f1b508e8ab2af
I20260810 19:48:05.655406 12266 ts_tablet_manager.cc:1950] T 0e967384768b4ec7956f1b508e8ab2af P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:05.658583 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efbe1ac330634c9485f7a44164ff7395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.658859 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 0e967384768b4ec7956f1b508e8ab2af (table default.Table_5043edeafbb047c6a7619f91323879c2 [id=6287581e5dad45b4b7fd481e9ae5eae3]) successfully deleted
I20260810 19:48:05.659318 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df2ad3636656472bada97194b3524a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.662662 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f93030ff2b3437796c2ea52df1432a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.666558 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42130675907e4239bd7db3d13686dc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.670197 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb79696a914d4d8d9210758ea1759b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.673250 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efbe1ac330634c9485f7a44164ff7395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.673316 10370 tablet_bootstrap.cc:492] T 320e42f6de6c4452adb7bbb379a156e6 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:05.674849 10370 tablet_bootstrap.cc:654] T 320e42f6de6c4452adb7bbb379a156e6 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:05.678334 9908 tablet_service.cc:1511] Processing CreateTablet for tablet df2ad3636656472bada97194b3524a83 (DEFAULT_TABLE table=default.Table_e1752a8c88c0403e8658f5d5f2c0e160 [id=9beae237b4b34956b56ec710093bcd46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.678939 9902 tablet_service.cc:1511] Processing CreateTablet for tablet f06df4cdb79c440b91b0eff135d2dfac (DEFAULT_TABLE table=default.Table_8721298cbe674d2abc25a201da5c09b0 [id=cc80f50e7f3c4af6868c70e2a30452b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.679255 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f06df4cdb79c440b91b0eff135d2dfac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.683390 10367 tablet_bootstrap.cc:492] T e68916e2568f4527a181342cdc728001 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:05.684551 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 5cff3aebf3064c44a004143372e8575b (DEFAULT_TABLE table=default.Table_c98abecdcb3043558419cbdff0a68d75 [id=e8525fa6c39444d1962c570e00e5736e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.684906 10367 tablet_bootstrap.cc:654] T e68916e2568f4527a181342cdc728001 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:05.684983 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cff3aebf3064c44a004143372e8575b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.686690 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 42130675907e4239bd7db3d13686dc16 (DEFAULT_TABLE table=default.Table_4808a61b7def4aeb935036bb48bb8d40 [id=7f56703a0ac742b5921b3fe0e9ae05cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.687041 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 8f93030ff2b3437796c2ea52df1432a1 (DEFAULT_TABLE table=default.Table_29e3919bae1c4e8e9d064b4aaa88197e [id=6b51d9a6963749ea95fce98f35a9a03d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.687427 9883 tablet_service.cc:1511] Processing CreateTablet for tablet fb79696a914d4d8d9210758ea1759b16 (DEFAULT_TABLE table=default.Table_b8022049381847cd8f1b45aad5235aec [id=b0d50d8d1e5541bca7bd3bfee5f48437]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:05.696745 10367 tablet_bootstrap.cc:492] T e68916e2568f4527a181342cdc728001 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:05.696921 10367 ts_tablet_manager.cc:1403] T e68916e2568f4527a181342cdc728001 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.002s
I20260810 19:48:05.697649 10367 raft_consensus.cc:359] T e68916e2568f4527a181342cdc728001 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.697830 10367 raft_consensus.cc:385] T e68916e2568f4527a181342cdc728001 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:05.697880 10367 raft_consensus.cc:740] T e68916e2568f4527a181342cdc728001 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:05.698144 10367 consensus_queue.cc:260] T e68916e2568f4527a181342cdc728001 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.698405 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 5ba42032e7344423a0e86c55d613f27d
I20260810 19:48:05.698684 10367 ts_tablet_manager.cc:1434] T e68916e2568f4527a181342cdc728001 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:05.699008 10367 tablet_bootstrap.cc:492] T 15c070c23de34348ad3426c894e11022 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:05.699362 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3fd0fd1fa532480fb2a10e99a8835b4c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:05.700016 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fd0fd1fa532480fb2a10e99a8835b4c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:05.700470 10367 tablet_bootstrap.cc:654] T 15c070c23de34348ad3426c894e11022 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:05.701568 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ba42032e7344423a0e86c55d613f27d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:05 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:05.701819 12266 tablet_replica.cc:333] T 5ba42032e7344423a0e86c55d613f27d P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:05.702016 12266 raft_consensus.cc:2243] T 5ba42032e7344423a0e86c55d613f27d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:05.702167 12266 raft_consensus.cc:2272] T 5ba42032e7344423a0e86c55d613f27d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:05.703101 12266 ts_tablet_manager.cc:1916] T 5ba42032e7344423a0e86c55d613f27d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:05.704403 9831 consensus_peers.cc:597] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e8a23221e8447bd83592c05c9d1149c. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:05.711458 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df2ad3636656472bada97194b3524a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.711699 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42130675907e4239bd7db3d13686dc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.712316 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb79696a914d4d8d9210758ea1759b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.712575 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f93030ff2b3437796c2ea52df1432a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:05.713812 12266 ts_tablet_manager.cc:1929] T 5ba42032e7344423a0e86c55d613f27d P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:05.715520 12266 log.cc:1199] T 5ba42032e7344423a0e86c55d613f27d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/5ba42032e7344423a0e86c55d613f27d
I20260810 19:48:05.715920 12266 ts_tablet_manager.cc:1950] T 5ba42032e7344423a0e86c55d613f27d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:05.718851 12313 raft_consensus.cc:493] T 896b7cfdb0ca4904aaeafa13ff19365e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:05.719008 12313 raft_consensus.cc:515] T 896b7cfdb0ca4904aaeafa13ff19365e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.719709 12313 leader_election.cc:290] T 896b7cfdb0ca4904aaeafa13ff19365e P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:05.720705 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896b7cfdb0ca4904aaeafa13ff19365e" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:05.721431 10366 tablet_bootstrap.cc:492] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:05.721611 10366 ts_tablet_manager.cc:1403] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.110s user 0.011s sys 0.012s
W20260810 19:48:05.721737 9611 leader_election.cc:343] T 896b7cfdb0ca4904aaeafa13ff19365e P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:05.723286 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896b7cfdb0ca4904aaeafa13ff19365e" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:05.724220 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 636) took 4060 ms. Trace:
I20260810 19:48:05.724618 10375 rpcz_store.cc:276] 0810 19:48:01.663984 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:01.664640 (+ 656us) service_pool.cc:224] Handling call
0810 19:48:05.218368 (+3553728us) ts_tablet_manager.cc:1151] Deleting tablet 28c9eecacc6540ac82ac7faabceec788
0810 19:48:05.218385 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.509689 (+291304us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.647229 (+137540us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.724194 (+ 76965us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3523331}
I20260810 19:48:05.725965 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 637) took 4053 ms. Trace:
W20260810 19:48:05.726114 9611 leader_election.cc:343] T 896b7cfdb0ca4904aaeafa13ff19365e P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:05.726194 10375 rpcz_store.cc:276] 0810 19:48:01.672752 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:01.672829 (+ 77us) service_pool.cc:224] Handling call
0810 19:48:05.725808 (+4052979us) ts_tablet_manager.cc:1151] Deleting tablet 9e8a23221e8447bd83592c05c9d1149c
0810 19:48:05.725820 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.725941 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4030672}
I20260810 19:48:05.726243 9611 leader_election.cc:304] T 896b7cfdb0ca4904aaeafa13ff19365e P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:05.726758 10367 tablet_bootstrap.cc:492] T 15c070c23de34348ad3426c894e11022 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:05.727001 10367 ts_tablet_manager.cc:1403] T 15c070c23de34348ad3426c894e11022 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.001s
I20260810 19:48:05.727154 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 5ba42032e7344423a0e86c55d613f27d (table default.Table_c6af56cc89144541a50f07ce309f7aaf [id=0bbc6397fe1b49cb894bb0e50af006fc]) successfully deleted
I20260810 19:48:05.727157 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 5b56fb5bed4b46a2a1fc0ab22379760b
I20260810 19:48:05.727977 9410 catalog_manager.cc:6807] ReplaceTablet: tablet 5b56fb5bed4b46a2a1fc0ab22379760b deleted and replaced by tablet 8713212c586a4143b65ff044a67b8b72
I20260810 19:48:05.728294 10370 tablet_bootstrap.cc:492] T 320e42f6de6c4452adb7bbb379a156e6 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:05.728281 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b56fb5bed4b46a2a1fc0ab22379760b with delete_type TABLET_DATA_DELETED (replaced by tablet 8713212c586a4143b65ff044a67b8b72) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:05.728425 10370 ts_tablet_manager.cc:1403] T 320e42f6de6c4452adb7bbb379a156e6 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.055s user 0.005s sys 0.005s
I20260810 19:48:05.727254 12313 raft_consensus.cc:2749] T 896b7cfdb0ca4904aaeafa13ff19365e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:05.728763 10367 raft_consensus.cc:359] T 15c070c23de34348ad3426c894e11022 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.729606 10367 raft_consensus.cc:385] T 15c070c23de34348ad3426c894e11022 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:05.729806 10367 raft_consensus.cc:740] T 15c070c23de34348ad3426c894e11022 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:05.729864 10370 raft_consensus.cc:359] T 320e42f6de6c4452adb7bbb379a156e6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.730145 10367 consensus_queue.cc:260] T 15c070c23de34348ad3426c894e11022 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.731038 10377 ts_tablet_manager.cc:1929] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:05.731178 10377 log.cc:1199] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/476e762e46c04ae6bfef5e14df2d16e2
I20260810 19:48:05.731650 10377 ts_tablet_manager.cc:1950] T 476e762e46c04ae6bfef5e14df2d16e2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:05.732043 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 686) took 3299 ms. Trace:
I20260810 19:48:05.732132 10377 rpcz_store.cc:276] 0810 19:48:02.432642 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.432992 (+ 350us) service_pool.cc:224] Handling call
0810 19:48:05.524588 (+3091596us) ts_tablet_manager.cc:1151] Deleting tablet 476e762e46c04ae6bfef5e14df2d16e2
0810 19:48:05.524598 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.606657 (+ 82059us) spinlock_profiling.cc:243] Waited 81.5 ms on lock 0x616000173254. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd473022780 00007fd4743a9023 00007fd476f6ec67 00007fd476fa1d34 00007fd476f82750 00007fd476f824dd 0000000000aaf86c 00007fd466f6784f 00007fd466f6ab4b 00007fd466f6a9c8
0810 19:48:05.620005 (+ 13348us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.730969 (+110964us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.732023 (+ 1054us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187510016,"tablet-delete.queue_time_us":3091451}
I20260810 19:48:05.732589 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 695) took 3085 ms. Trace:
I20260810 19:48:05.732676 10377 rpcz_store.cc:276] 0810 19:48:02.647092 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.647323 (+ 231us) service_pool.cc:224] Handling call
0810 19:48:05.732453 (+3085130us) ts_tablet_manager.cc:1151] Deleting tablet dfea56a2d5d847058bcf4f508f0778a1
0810 19:48:05.732465 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.732568 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3084863}
I20260810 19:48:05.733033 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 701) took 3010 ms. Trace:
I20260810 19:48:05.733110 10377 rpcz_store.cc:276] 0810 19:48:02.722394 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.722483 (+ 89us) service_pool.cc:224] Handling call
0810 19:48:05.732926 (+3010443us) ts_tablet_manager.cc:1151] Deleting tablet 5aa0f24443a34714a44137a77c12bbc3
0810 19:48:05.732936 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.733018 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3010164}
I20260810 19:48:05.733431 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 702) took 2992 ms. Trace:
I20260810 19:48:05.733510 10377 rpcz_store.cc:276] 0810 19:48:02.740651 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.743298 (+ 2647us) service_pool.cc:224] Handling call
0810 19:48:05.733327 (+2990029us) ts_tablet_manager.cc:1151] Deleting tablet ea557438b7b74944b19e17d7fb8f20cf
0810 19:48:05.733336 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.733413 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2989789}
I20260810 19:48:05.733811 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 708) took 2931 ms. Trace:
I20260810 19:48:05.733889 10377 rpcz_store.cc:276] 0810 19:48:02.801898 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.801955 (+ 57us) service_pool.cc:224] Handling call
0810 19:48:05.733717 (+2931762us) ts_tablet_manager.cc:1151] Deleting tablet 2a1b1877c8bf4515a1c1f8c693bdae8e
0810 19:48:05.733725 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.733796 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2930996}
I20260810 19:48:05.734216 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 706) took 2939 ms. Trace:
I20260810 19:48:05.737715 10367 ts_tablet_manager.cc:1434] T 15c070c23de34348ad3426c894e11022 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260810 19:48:05.738871 10367 tablet_bootstrap.cc:492] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:05.734297 10377 rpcz_store.cc:276] 0810 19:48:02.795173 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.803121 (+ 7948us) service_pool.cc:224] Handling call
0810 19:48:05.734117 (+2930996us) ts_tablet_manager.cc:1151] Deleting tablet ea942d54b4664ea48a13b6c85118cf6c
0810 19:48:05.734126 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.734200 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2930750}
I20260810 19:48:05.739328 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 713) took 2812 ms. Trace:
I20260810 19:48:05.739625 10370 raft_consensus.cc:385] T 320e42f6de6c4452adb7bbb379a156e6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:05.740324 10370 raft_consensus.cc:740] T 320e42f6de6c4452adb7bbb379a156e6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:05.740522 9791 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:48:05.739421 10377 rpcz_store.cc:276] 0810 19:48:02.926824 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.942388 (+ 15564us) service_pool.cc:224] Handling call
0810 19:48:05.739205 (+2796817us) ts_tablet_manager.cc:1151] Deleting tablet 240b2ae8a1484de998d3ea972bc74cfe
0810 19:48:05.739218 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.739310 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2782466}
I20260810 19:48:05.741060 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 715) took 2709 ms. Trace:
I20260810 19:48:05.741147 10377 rpcz_store.cc:276] 0810 19:48:03.032092 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:03.032194 (+ 102us) service_pool.cc:224] Handling call
0810 19:48:05.740945 (+2708751us) ts_tablet_manager.cc:1151] Deleting tablet 10dd7891d4d844fc8f7a8674ee57627f
0810 19:48:05.740955 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.741043 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2708500}
I20260810 19:48:05.741477 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 716) took 2695 ms. Trace:
I20260810 19:48:05.741559 10377 rpcz_store.cc:276] 0810 19:48:03.046220 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:03.046474 (+ 254us) service_pool.cc:224] Handling call
0810 19:48:05.741373 (+2694899us) ts_tablet_manager.cc:1151] Deleting tablet 43770a764bd24d3f9ec60a02dca083dc
0810 19:48:05.741382 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.741459 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2694692}
I20260810 19:48:05.741873 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 719) took 2681 ms. Trace:
W20260810 19:48:05.741508 10067 consensus_peers.cc:597] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9fb544dff4eb4642b7e282657ae15d19. This is attempt 1: this message will repeat every 5th retry.
W20260810 19:48:05.742965 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 5b56fb5bed4b46a2a1fc0ab22379760b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b56fb5bed4b46a2a1fc0ab22379760b already in progress: creating tablet
I20260810 19:48:05.743397 10367 tablet_bootstrap.cc:654] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:05.747072 10366 raft_consensus.cc:359] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.747781 10366 raft_consensus.cc:385] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:05.747934 10366 raft_consensus.cc:740] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:05.739560 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a02e997e3ddd4efeaded0aeef335a1bf" } new_table_name: "default.Table_f6d50f80460c49978230429d978b40e6" modify_external_catalogs: true
I20260810 19:48:05.748246 10366 consensus_queue.cc:260] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.749127 10370 consensus_queue.cc:260] T 320e42f6de6c4452adb7bbb379a156e6 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.749807 10370 ts_tablet_manager.cc:1434] T 320e42f6de6c4452adb7bbb379a156e6 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.021s user 0.001s sys 0.001s
I20260810 19:48:05.751197 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 28c9eecacc6540ac82ac7faabceec788 (table default.Table_6e4259d122294c46bd79d8abbb79c520 [id=2d19b64ee46e460e807325299f942e18]) successfully deleted
I20260810 19:48:05.741961 10377 rpcz_store.cc:276] 0810 19:48:03.060055 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:03.060248 (+ 193us) service_pool.cc:224] Handling call
0810 19:48:05.741771 (+2681523us) ts_tablet_manager.cc:1151] Deleting tablet b4b6b17ce3354600b2f7450c6e483c69
0810 19:48:05.741780 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.741857 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2681296}
I20260810 19:48:05.752219 10366 ts_tablet_manager.cc:1434] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.030s user 0.001s sys 0.001s
W20260810 19:48:05.752261 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 9e8a23221e8447bd83592c05c9d1149c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e8a23221e8447bd83592c05c9d1149c already in progress: creating tablet
I20260810 19:48:05.752729 10370 tablet_bootstrap.cc:492] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:05.753003 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 718) took 2693 ms. Trace:
I20260810 19:48:05.753415 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet d2c77a8ac1614bb286e4e168bcf999f3 (table default.Table_c2a3c3f509104c5cbeb2f53726021955 [id=8fddaf13b1664006ac4b4fc2dcd2e90c]) successfully deleted
I20260810 19:48:05.753656 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 971e9abee86444a7a9e923b0962ae751 (table default.Table_64e5558a29af405b85912f54bebdf3be [id=f3f4d6ebcacf43489369bd8f742a0631]) successfully deleted
I20260810 19:48:05.753852 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 9fb544dff4eb4642b7e282657ae15d19 (table default.Table_e60e43b61eba457e8a4e7cd6543b7cc6 [id=d81c8e61cae4492fbd2681ab1ecdfe4f]) successfully deleted
I20260810 19:48:05.754056 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 638) took 4077 ms. Trace:
I20260810 19:48:05.754206 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 21208dd824fe432fa307cbb88d37aaa2 (table default.Table_fc65a045265c494998007900c7ac9e01 [id=190f70ae5e5f44c294a4c0250fc7b08a]) successfully deleted
I20260810 19:48:05.754150 10375 rpcz_store.cc:276] 0810 19:48:01.677047 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:01.677113 (+ 66us) service_pool.cc:224] Handling call
0810 19:48:05.753642 (+4076529us) ts_tablet_manager.cc:1151] Deleting tablet ff3478f19b14418a876b668bd03125ba
0810 19:48:05.753652 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.754033 (+ 381us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4058343}
I20260810 19:48:05.754537 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 628) took 4106 ms. Trace:
I20260810 19:48:05.754619 10375 rpcz_store.cc:276] 0810 19:48:01.648329 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:01.727479 (+ 79150us) service_pool.cc:224] Handling call
0810 19:48:05.754424 (+4026945us) ts_tablet_manager.cc:1151] Deleting tablet 09a8da9ecf1042bfae5d34e263f501d6
0810 19:48:05.754435 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.754519 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4026724}
I20260810 19:48:05.754885 10375 tablet_replica.cc:333] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:05.755091 10375 raft_consensus.cc:2243] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:05.755260 10375 raft_consensus.cc:2272] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:05.760583 10367 tablet_bootstrap.cc:492] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:05.760859 10367 ts_tablet_manager.cc:1403] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.000s
I20260810 19:48:05.758878 10370 tablet_bootstrap.cc:654] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:05.761811 10367 raft_consensus.cc:359] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.762075 10367 raft_consensus.cc:385] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:05.762185 10367 raft_consensus.cc:740] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:05.755853 10375 ts_tablet_manager.cc:1916] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:05.762688 10367 consensus_queue.cc:260] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.768779 10367 ts_tablet_manager.cc:1434] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260810 19:48:05.769259 10367 tablet_bootstrap.cc:492] T a78960e1f2164c848297411b9273ac64 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:05.772270 10367 tablet_bootstrap.cc:654] T a78960e1f2164c848297411b9273ac64 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:05.779844 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 98c1a8c9946248b78e5b77ba8dfdb953
I20260810 19:48:05.753134 10377 rpcz_store.cc:276] 0810 19:48:03.059897 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:03.061316 (+ 1419us) service_pool.cc:224] Handling call
0810 19:48:05.752017 (+2690701us) ts_tablet_manager.cc:1151] Deleting tablet 814babd6ae4748109b6caf1af54c2733
0810 19:48:05.752831 (+ 814us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.752980 (+ 149us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2690514}
I20260810 19:48:05.786234 10375 ts_tablet_manager.cc:1929] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:05.786414 10375 log.cc:1199] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/a5625dc6303d44c6be28abd6278ce034
I20260810 19:48:05.786602 9421 catalog_manager.cc:6807] ReplaceTablet: tablet 98c1a8c9946248b78e5b77ba8dfdb953 deleted and replaced by tablet 8988c60f2d8848d98d373813bdfc2228
I20260810 19:48:05.787380 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 98c1a8c9946248b78e5b77ba8dfdb953 with delete_type TABLET_DATA_DELETED (replaced by tablet 8988c60f2d8848d98d373813bdfc2228) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:05.788265 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 98c1a8c9946248b78e5b77ba8dfdb953 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98c1a8c9946248b78e5b77ba8dfdb953 already in progress: creating tablet
I20260810 19:48:05.788455 10370 tablet_bootstrap.cc:492] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:05.788605 10370 ts_tablet_manager.cc:1403] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.036s user 0.005s sys 0.000s
I20260810 19:48:05.789427 10366 tablet_bootstrap.cc:492] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:05.789749 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 722) took 2454 ms. Trace:
I20260810 19:48:05.789832 10377 rpcz_store.cc:276] 0810 19:48:03.335004 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:03.335061 (+ 57us) service_pool.cc:224] Handling call
0810 19:48:05.781124 (+2446063us) ts_tablet_manager.cc:1151] Deleting tablet 08f78560ec9f465c94ef08fa2f067c0d
0810 19:48:05.789590 (+ 8466us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.789723 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2438252}
I20260810 19:48:05.789999 10367 tablet_bootstrap.cc:492] T a78960e1f2164c848297411b9273ac64 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:05.790246 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 746) took 2381 ms. Trace:
I20260810 19:48:05.790342 10377 rpcz_store.cc:276] 0810 19:48:03.409232 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:03.409588 (+ 356us) service_pool.cc:224] Handling call
0810 19:48:05.790121 (+2380533us) ts_tablet_manager.cc:1151] Deleting tablet e87fd882e6b6413480a0cb06aee74722
0810 19:48:05.790132 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.790226 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2359311}
I20260810 19:48:05.790419 10367 ts_tablet_manager.cc:1403] T a78960e1f2164c848297411b9273ac64 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.001s
I20260810 19:48:05.790580 10377 tablet_replica.cc:333] T dfea147ef3904ab49375def065c6f328 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:05.790766 10377 raft_consensus.cc:2243] T dfea147ef3904ab49375def065c6f328 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:05.790935 10377 raft_consensus.cc:2272] T dfea147ef3904ab49375def065c6f328 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:05.790954 9412 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_0056243a8c8d42a3bfea00d5110ccc12 [id=374cf9ed870c448fbbdad7050d0d11f9] alter complete (version 2)
I20260810 19:48:05.791457 10377 ts_tablet_manager.cc:1916] T dfea147ef3904ab49375def065c6f328 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:05.791472 10367 raft_consensus.cc:359] T a78960e1f2164c848297411b9273ac64 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.792055 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d195688055bd4cfca1a9462585af71bc" } modify_external_catalogs: true
I20260810 19:48:05.792152 10367 raft_consensus.cc:385] T a78960e1f2164c848297411b9273ac64 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:05.792214 10367 raft_consensus.cc:740] T a78960e1f2164c848297411b9273ac64 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:05.792207 10370 raft_consensus.cc:359] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.792374 10370 raft_consensus.cc:385] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:05.792428 10370 raft_consensus.cc:740] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:05.792425 10367 consensus_queue.cc:260] T a78960e1f2164c848297411b9273ac64 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.792609 10370 consensus_queue.cc:260] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.793560 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c75af1e592042f5a4d442b82a539c94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:05.793843 12266 tablet_replica.cc:333] T 4c75af1e592042f5a4d442b82a539c94 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:05.794044 12266 raft_consensus.cc:2243] T 4c75af1e592042f5a4d442b82a539c94 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:05.794178 12266 raft_consensus.cc:2272] T 4c75af1e592042f5a4d442b82a539c94 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:05.794737 12266 ts_tablet_manager.cc:1916] T 4c75af1e592042f5a4d442b82a539c94 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:05.796279 10370 ts_tablet_manager.cc:1434] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260810 19:48:05.796598 10370 tablet_bootstrap.cc:492] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:05.798126 10367 ts_tablet_manager.cc:1434] T a78960e1f2164c848297411b9273ac64 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260810 19:48:05.798465 10367 tablet_bootstrap.cc:492] T 39885c3e0adb4132945d507628f4f082 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:05.799774 10370 tablet_bootstrap.cc:654] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:05.800123 10367 tablet_bootstrap.cc:654] T 39885c3e0adb4132945d507628f4f082 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:05.800982 10375 ts_tablet_manager.cc:1950] T a5625dc6303d44c6be28abd6278ce034 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:05.801324 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 641) took 4023 ms. Trace:
I20260810 19:48:05.801401 10375 rpcz_store.cc:276] 0810 19:48:01.778232 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:01.784690 (+ 6458us) service_pool.cc:224] Handling call
0810 19:48:05.754838 (+3970148us) ts_tablet_manager.cc:1151] Deleting tablet a5625dc6303d44c6be28abd6278ce034
0810 19:48:05.754847 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.769110 (+ 14263us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.786162 (+ 17052us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.801305 (+ 15143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3969484}
I20260810 19:48:05.801833 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 643) took 3951 ms. Trace:
I20260810 19:48:05.801909 10375 rpcz_store.cc:276] 0810 19:48:01.850024 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:01.850088 (+ 64us) service_pool.cc:224] Handling call
0810 19:48:05.801699 (+3951611us) ts_tablet_manager.cc:1151] Deleting tablet 8455cb11388340beb6daa13fee06177a
0810 19:48:05.801709 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.801817 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3951392}
I20260810 19:48:05.802264 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 650) took 3722 ms. Trace:
I20260810 19:48:05.802374 10375 rpcz_store.cc:276] 0810 19:48:02.079398 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.100081 (+ 20683us) service_pool.cc:224] Handling call
0810 19:48:05.802142 (+3702061us) ts_tablet_manager.cc:1151] Deleting tablet f85f3fa629764c79921a710739eea7ae
0810 19:48:05.802164 (+ 22us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.802248 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3701863}
I20260810 19:48:05.802682 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 656) took 3610 ms. Trace:
I20260810 19:48:05.802753 10375 rpcz_store.cc:276] 0810 19:48:02.192247 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.198096 (+ 5849us) service_pool.cc:224] Handling call
0810 19:48:05.802582 (+3604486us) ts_tablet_manager.cc:1151] Deleting tablet 092686718efe4b19a610586420d6bc3a
0810 19:48:05.802591 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.802665 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3604134}
I20260810 19:48:05.803050 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 655) took 3621 ms. Trace:
I20260810 19:48:05.803115 10375 rpcz_store.cc:276] 0810 19:48:02.181268 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.198502 (+ 17234us) service_pool.cc:224] Handling call
0810 19:48:05.802951 (+3604449us) ts_tablet_manager.cc:1151] Deleting tablet 229dd737ee8547a89445593cc117fbc2
0810 19:48:05.802961 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.803035 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3604231}
I20260810 19:48:05.803396 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 657) took 3611 ms. Trace:
I20260810 19:48:05.803453 10375 rpcz_store.cc:276] 0810 19:48:02.192369 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.192503 (+ 134us) service_pool.cc:224] Handling call
0810 19:48:05.803307 (+3610804us) ts_tablet_manager.cc:1151] Deleting tablet 253f302c00cc42ff84076b0c17f7670a
0810 19:48:05.803316 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.803383 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3602560}
I20260810 19:48:05.803704 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 658) took 3593 ms. Trace:
I20260810 19:48:05.803757 10375 rpcz_store.cc:276] 0810 19:48:02.210052 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.210204 (+ 152us) service_pool.cc:224] Handling call
0810 19:48:05.803624 (+3593420us) ts_tablet_manager.cc:1151] Deleting tablet a776693b6b4943a7b64e13ec10958c16
0810 19:48:05.803631 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.803693 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3576446}
I20260810 19:48:05.804032 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 659) took 3515 ms. Trace:
I20260810 19:48:05.804096 10375 rpcz_store.cc:276] 0810 19:48:02.288522 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.315528 (+ 27006us) service_pool.cc:224] Handling call
0810 19:48:05.803938 (+3488410us) ts_tablet_manager.cc:1151] Deleting tablet c9e2dbef6e7a48caa2964ab90fbf9b73
0810 19:48:05.803947 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.804016 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3488098}
I20260810 19:48:05.804384 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 661) took 3385 ms. Trace:
I20260810 19:48:05.804450 10375 rpcz_store.cc:276] 0810 19:48:02.418629 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.418705 (+ 76us) service_pool.cc:224] Handling call
0810 19:48:05.804295 (+3385590us) ts_tablet_manager.cc:1151] Deleting tablet f6f9eb86c6c84b4a84d109d4741238e1
0810 19:48:05.804303 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.804370 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3385294}
I20260810 19:48:05.804740 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 662) took 3379 ms. Trace:
I20260810 19:48:05.804814 10375 rpcz_store.cc:276] 0810 19:48:02.424985 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.425050 (+ 65us) service_pool.cc:224] Handling call
0810 19:48:05.804639 (+3379589us) ts_tablet_manager.cc:1151] Deleting tablet 8565cd6fc9e34c5fbabba6e573df9939
0810 19:48:05.804646 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.804726 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3379368}
I20260810 19:48:05.805124 10375 tablet_replica.cc:333] T b737b216646a4c5baecb88d59bcce4df P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:05.805315 10375 raft_consensus.cc:2243] T b737b216646a4c5baecb88d59bcce4df P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:05.805503 10375 raft_consensus.cc:2272] T b737b216646a4c5baecb88d59bcce4df P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:05.806114 10375 ts_tablet_manager.cc:1916] T b737b216646a4c5baecb88d59bcce4df P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:05.811441 10370 tablet_bootstrap.cc:492] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:05.811609 10370 ts_tablet_manager.cc:1403] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.004s
I20260810 19:48:05.811658 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d195688055bd4cfca1a9462585af71bc" } modify_external_catalogs: true
I20260810 19:48:05.812451 10370 raft_consensus.cc:359] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.812625 10370 raft_consensus.cc:385] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:05.812668 10370 raft_consensus.cc:740] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:05.812865 10370 consensus_queue.cc:260] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.813894 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 90b6f76f0cec4f33879030958cbe89bf
I20260810 19:48:05.814255 10366 tablet_bootstrap.cc:654] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:05.814990 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 90b6f76f0cec4f33879030958cbe89bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:05 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:05.816845 10370 ts_tablet_manager.cc:1434] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 19:48:05.817183 10370 tablet_bootstrap.cc:492] T 965395b5072e4d47adac504e22a8d484 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:05.819895 10370 tablet_bootstrap.cc:654] T 965395b5072e4d47adac504e22a8d484 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:05.822867 12266 ts_tablet_manager.cc:1929] T 4c75af1e592042f5a4d442b82a539c94 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:05.823105 12266 log.cc:1199] T 4c75af1e592042f5a4d442b82a539c94 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/4c75af1e592042f5a4d442b82a539c94
I20260810 19:48:05.823566 12266 ts_tablet_manager.cc:1950] T 4c75af1e592042f5a4d442b82a539c94 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:05.824937 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 4c75af1e592042f5a4d442b82a539c94 (table default.Table_b15ce9ec2404408f8f8e74743a8cce0d [id=d26dfd722c9448a0a299198ccf217edc]) successfully deleted
W20260810 19:48:05.825963 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 90b6f76f0cec4f33879030958cbe89bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90b6f76f0cec4f33879030958cbe89bf already in progress: creating tablet
W20260810 19:48:05.827838 9395 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 73626.6us
W20260810 19:48:05.828174 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet f6f9eb86c6c84b4a84d109d4741238e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6f9eb86c6c84b4a84d109d4741238e1 already in progress: creating tablet
W20260810 19:48:05.828540 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 8565cd6fc9e34c5fbabba6e573df9939 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8565cd6fc9e34c5fbabba6e573df9939 already in progress: creating tablet
I20260810 19:48:05.828914 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet b737b216646a4c5baecb88d59bcce4df (table default.Table_98357f787dbf48958872d3de9003c202 [id=549322ede70c4efc91018201075b1a29]) successfully deleted
I20260810 19:48:05.829502 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 476e762e46c04ae6bfef5e14df2d16e2 (table default.Table_1b1b59cdf6ef477b856b825bb519bd47 [id=f601112ceee249d49b43a2437b9731ae]) successfully deleted
W20260810 19:48:05.829840 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet dfea56a2d5d847058bcf4f508f0778a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfea56a2d5d847058bcf4f508f0778a1 already in progress: creating tablet
W20260810 19:48:05.830130 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 5aa0f24443a34714a44137a77c12bbc3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5aa0f24443a34714a44137a77c12bbc3 already in progress: creating tablet
W20260810 19:48:05.830451 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet ea557438b7b74944b19e17d7fb8f20cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea557438b7b74944b19e17d7fb8f20cf already in progress: creating tablet
W20260810 19:48:05.830735 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 2a1b1877c8bf4515a1c1f8c693bdae8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a1b1877c8bf4515a1c1f8c693bdae8e already in progress: creating tablet
W20260810 19:48:05.831032 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet ea942d54b4664ea48a13b6c85118cf6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea942d54b4664ea48a13b6c85118cf6c already in progress: creating tablet
W20260810 19:48:05.831293 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 240b2ae8a1484de998d3ea972bc74cfe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 240b2ae8a1484de998d3ea972bc74cfe already in progress: creating tablet
I20260810 19:48:05.841547 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet e750622b406c4783adf01bb1af6895de
W20260810 19:48:05.841652 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c807d68fdcf04dc4b930c7cc4d3ca09a consensus state has no leader
I20260810 19:48:05.842183 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_d525715cfc784dae8f9b3f058b64db20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:05.842526 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_82769090fe3a4bc49bc9b6672448e6b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:05.842959 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d525715cfc784dae8f9b3f058b64db20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:05.843168 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82769090fe3a4bc49bc9b6672448e6b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:05.845064 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet e750622b406c4783adf01bb1af6895de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:05 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:05.850991 12338 raft_consensus.cc:493] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:05.851163 12338 raft_consensus.cc:515] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.851917 12338 leader_election.cc:290] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:05.853196 9831 leader_election.cc:343] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 0dd49d6fa79e4677b753b6cf9117b02d
W20260810 19:48:05.855219 9830 consensus_peers.cc:597] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:05.845917 12106 raft_consensus.cc:493] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:05.858548 12106 raft_consensus.cc:515] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.859285 12106 leader_election.cc:290] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:05.854477 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd49d6fa79e4677b753b6cf9117b02d" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:05.855880 11828 raft_consensus.cc:493] T dfea147ef3904ab49375def065c6f328 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:05.859858 11828 raft_consensus.cc:515] T dfea147ef3904ab49375def065c6f328 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.860459 11828 leader_election.cc:290] T dfea147ef3904ab49375def065c6f328 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:05.861549 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf33d82af9e494a8e85be8cba55d2c9" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:05.861740 9945 raft_consensus.cc:2468] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:05.862216 10067 leader_election.cc:304] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:05.862604 11828 raft_consensus.cc:2804] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:05.862682 11828 raft_consensus.cc:493] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:05.862744 11828 raft_consensus.cc:3060] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:05.862841 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfea147ef3904ab49375def065c6f328" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:05.863159 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet e750622b406c4783adf01bb1af6895de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e750622b406c4783adf01bb1af6895de already in progress: creating tablet
I20260810 19:48:05.865414 11828 raft_consensus.cc:515] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:05.866533 10067 leader_election.cc:343] T dfea147ef3904ab49375def065c6f328 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: Tablet not RUNNING: STOPPED
I20260810 19:48:05.867012 12106 raft_consensus.cc:493] T d77785d9bde843bc8366fe15d1b4fa18 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:05.867132 12106 raft_consensus.cc:515] T d77785d9bde843bc8366fe15d1b4fa18 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.867666 12106 leader_election.cc:290] T d77785d9bde843bc8366fe15d1b4fa18 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:05.868053 11828 leader_election.cc:290] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:05.869624 9830 leader_election.cc:343] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:05.869757 9830 leader_election.cc:304] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:05.870234 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77785d9bde843bc8366fe15d1b4fa18" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:05.870805 10171 raft_consensus.cc:3060] T 3e8ae48a2fb548358176abefe1ee3baa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:05.875591 10068 leader_election.cc:343] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: ebf33d82af9e494a8e85be8cba55d2c9
W20260810 19:48:05.875795 10068 leader_election.cc:343] T dfea147ef3904ab49375def065c6f328 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: dfea147ef3904ab49375def065c6f328
I20260810 19:48:05.875885 10068 leader_election.cc:304] T dfea147ef3904ab49375def065c6f328 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:48:05.876348 10068 leader_election.cc:343] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: ebf33d82af9e494a8e85be8cba55d2c9
I20260810 19:48:05.876874 12106 raft_consensus.cc:2749] T dfea147ef3904ab49375def065c6f328 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:05.880278 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_14bad8f87ea44929a0de0f4351d51d20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:05.880990 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_14bad8f87ea44929a0de0f4351d51d20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:05.881263 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77785d9bde843bc8366fe15d1b4fa18" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:05.881353 12338 raft_consensus.cc:2749] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:05.882376 10067 leader_election.cc:304] T d77785d9bde843bc8366fe15d1b4fa18 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:05.882751 11828 raft_consensus.cc:2749] T d77785d9bde843bc8366fe15d1b4fa18 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:05.881914 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf33d82af9e494a8e85be8cba55d2c9" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:05.884577 9944 raft_consensus.cc:3060] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:05.887746 9944 raft_consensus.cc:2468] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
W20260810 19:48:05.890007 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 10dd7891d4d844fc8f7a8674ee57627f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10dd7891d4d844fc8f7a8674ee57627f already in progress: creating tablet
I20260810 19:48:05.890049 10067 leader_election.cc:304] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:48:05.890290 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 43770a764bd24d3f9ec60a02dca083dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43770a764bd24d3f9ec60a02dca083dc already in progress: creating tablet
W20260810 19:48:05.890518 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet b4b6b17ce3354600b2f7450c6e483c69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4b6b17ce3354600b2f7450c6e483c69 already in progress: creating tablet
W20260810 19:48:05.890700 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 814babd6ae4748109b6caf1af54c2733 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 814babd6ae4748109b6caf1af54c2733 already in progress: creating tablet
W20260810 19:48:05.890892 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 08f78560ec9f465c94ef08fa2f067c0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08f78560ec9f465c94ef08fa2f067c0d already in progress: creating tablet
I20260810 19:48:05.891106 11828 raft_consensus.cc:2804] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
W20260810 19:48:05.891199 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet e87fd882e6b6413480a0cb06aee74722 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e87fd882e6b6413480a0cb06aee74722 already in progress: creating tablet
I20260810 19:48:05.891353 11828 raft_consensus.cc:697] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:05.891673 11828 consensus_queue.cc:237] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.892401 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ba42032e7344423a0e86c55d613f27d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:05 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:05.898301 10377 ts_tablet_manager.cc:1929] T dfea147ef3904ab49375def065c6f328 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:05.898473 10377 log.cc:1199] T dfea147ef3904ab49375def065c6f328 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/dfea147ef3904ab49375def065c6f328
I20260810 19:48:05.898829 10377 ts_tablet_manager.cc:1950] T dfea147ef3904ab49375def065c6f328 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:05.899184 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 757) took 2310 ms. Trace:
I20260810 19:48:05.899268 10377 rpcz_store.cc:276] 0810 19:48:03.588469 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:03.589132 (+ 663us) service_pool.cc:224] Handling call
0810 19:48:05.790537 (+2201405us) ts_tablet_manager.cc:1151] Deleting tablet dfea147ef3904ab49375def065c6f328
0810 19:48:05.790546 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.829261 (+ 38715us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.898224 (+ 68963us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.899166 (+ 942us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2071441}
I20260810 19:48:05.899626 10377 tablet_replica.cc:333] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:05.899821 10377 raft_consensus.cc:2243] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:05.899843 10367 tablet_bootstrap.cc:492] T 39885c3e0adb4132945d507628f4f082 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:05.900012 10367 ts_tablet_manager.cc:1403] T 39885c3e0adb4132945d507628f4f082 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.102s user 0.042s sys 0.032s
I20260810 19:48:05.900183 10377 raft_consensus.cc:2272] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:05.900767 10377 ts_tablet_manager.cc:1916] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:05.900913 10367 raft_consensus.cc:359] T 39885c3e0adb4132945d507628f4f082 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.901085 10367 raft_consensus.cc:385] T 39885c3e0adb4132945d507628f4f082 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:05.901137 10367 raft_consensus.cc:740] T 39885c3e0adb4132945d507628f4f082 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:05.901363 10367 consensus_queue.cc:260] T 39885c3e0adb4132945d507628f4f082 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.902570 10366 tablet_bootstrap.cc:492] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:05.902758 10366 ts_tablet_manager.cc:1403] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.113s user 0.001s sys 0.009s
I20260810 19:48:05.904408 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 6914b47e0cac4cd28ee4fd199684a280
I20260810 19:48:05.905336 10367 ts_tablet_manager.cc:1434] T 39885c3e0adb4132945d507628f4f082 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 19:48:05.905666 10367 tablet_bootstrap.cc:492] T f85f3fa629764c79921a710739eea7ae P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:05.906114 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 6914b47e0cac4cd28ee4fd199684a280 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:05 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:05.907485 10367 tablet_bootstrap.cc:654] T f85f3fa629764c79921a710739eea7ae P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:05.910772 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 6914b47e0cac4cd28ee4fd199684a280 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6914b47e0cac4cd28ee4fd199684a280 already in progress: creating tablet
I20260810 19:48:05.912485 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e12745e4f4ed4e9d8c0af00601fa49a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:05.913170 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e12745e4f4ed4e9d8c0af00601fa49a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:05.914881 10366 raft_consensus.cc:359] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.916962 10366 raft_consensus.cc:385] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:05.918648 10366 raft_consensus.cc:740] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:05.922355 10366 consensus_queue.cc:260] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.925392 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_10e7f0eade344c0eb91ee0b576d39aae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:05.926048 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10e7f0eade344c0eb91ee0b576d39aae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:05.929808 12313 raft_consensus.cc:493] T 39885c3e0adb4132945d507628f4f082 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:05.929476 10366 ts_tablet_manager.cc:1434] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.027s user 0.004s sys 0.000s
I20260810 19:48:05.929970 12313 raft_consensus.cc:515] T 39885c3e0adb4132945d507628f4f082 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.930652 12313 leader_election.cc:290] T 39885c3e0adb4132945d507628f4f082 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:05.931429 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39885c3e0adb4132945d507628f4f082" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:05.932152 9611 leader_election.cc:343] T 39885c3e0adb4132945d507628f4f082 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:05.932296 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39885c3e0adb4132945d507628f4f082" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:05.933156 9611 leader_election.cc:343] T 39885c3e0adb4132945d507628f4f082 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:05.933280 9611 leader_election.cc:304] T 39885c3e0adb4132945d507628f4f082 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:05.933811 12313 raft_consensus.cc:2749] T 39885c3e0adb4132945d507628f4f082 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:05.933521 10366 tablet_bootstrap.cc:492] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
W20260810 19:48:05.941576 9830 consensus_peers.cc:597] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:05.943979 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b56fb5bed4b46a2a1fc0ab22379760b with delete_type TABLET_DATA_DELETED (replaced by tablet 8713212c586a4143b65ff044a67b8b72) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:05.944129 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ba42032e7344423a0e86c55d613f27d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:05 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:05.945106 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b56fb5bed4b46a2a1fc0ab22379760b with delete_type TABLET_DATA_DELETED (replaced by tablet 8713212c586a4143b65ff044a67b8b72) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:05.946007 11897 consensus_queue.cc:1048] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:05.946297 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet 98c1a8c9946248b78e5b77ba8dfdb953 with delete_type TABLET_DATA_DELETED (replaced by tablet 8988c60f2d8848d98d373813bdfc2228) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:05.948381 10370 tablet_bootstrap.cc:492] T 965395b5072e4d47adac504e22a8d484 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:05.948382 10366 tablet_bootstrap.cc:654] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:05.948652 10370 ts_tablet_manager.cc:1403] T 965395b5072e4d47adac504e22a8d484 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.132s user 0.004s sys 0.000s
I20260810 19:48:05.949761 10370 raft_consensus.cc:359] T 965395b5072e4d47adac504e22a8d484 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.950057 10370 raft_consensus.cc:385] T 965395b5072e4d47adac504e22a8d484 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:05.950172 10370 raft_consensus.cc:740] T 965395b5072e4d47adac504e22a8d484 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:05.950552 10370 consensus_queue.cc:260] T 965395b5072e4d47adac504e22a8d484 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.953145 10370 ts_tablet_manager.cc:1434] T 965395b5072e4d47adac504e22a8d484 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 19:48:05.955878 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet 90b6f76f0cec4f33879030958cbe89bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:05 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:05.958160 10370 tablet_bootstrap.cc:492] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:05.958367 10367 tablet_bootstrap.cc:492] T f85f3fa629764c79921a710739eea7ae P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:05.958657 10367 ts_tablet_manager.cc:1403] T f85f3fa629764c79921a710739eea7ae P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.053s user 0.003s sys 0.003s
I20260810 19:48:05.959813 10367 raft_consensus.cc:359] T f85f3fa629764c79921a710739eea7ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.955663 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 98c1a8c9946248b78e5b77ba8dfdb953 with delete_type TABLET_DATA_DELETED (replaced by tablet 8988c60f2d8848d98d373813bdfc2228) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:05.960093 10367 raft_consensus.cc:385] T f85f3fa629764c79921a710739eea7ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:05.960160 10367 raft_consensus.cc:740] T f85f3fa629764c79921a710739eea7ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:05.953493 10375 ts_tablet_manager.cc:1929] T b737b216646a4c5baecb88d59bcce4df P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:05.960304 10375 log.cc:1199] T b737b216646a4c5baecb88d59bcce4df P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/b737b216646a4c5baecb88d59bcce4df
I20260810 19:48:05.960879 10375 ts_tablet_manager.cc:1950] T b737b216646a4c5baecb88d59bcce4df P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:05.961122 10367 consensus_queue.cc:260] T f85f3fa629764c79921a710739eea7ae P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.961841 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 663) took 3530 ms. Trace:
I20260810 19:48:05.961954 10375 rpcz_store.cc:276] 0810 19:48:02.431690 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.431760 (+ 70us) service_pool.cc:224] Handling call
0810 19:48:05.805007 (+3373247us) ts_tablet_manager.cc:1151] Deleting tablet b737b216646a4c5baecb88d59bcce4df
0810 19:48:05.805057 (+ 50us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.921446 (+116389us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.953413 (+ 31967us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.961802 (+ 8389us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3373018}
W20260810 19:48:05.962208 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 09f09289a4c84e25b84c10abef3799c3 consensus state has no leader
I20260810 19:48:05.962599 10367 ts_tablet_manager.cc:1434] T f85f3fa629764c79921a710739eea7ae P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260810 19:48:05.962904 10367 tablet_bootstrap.cc:492] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:05.964206 10370 tablet_bootstrap.cc:654] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:05.966742 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e0c0d0cef9e6465e8abfa449d39fe7bc" } new_table_name: "default.Table_f458a2f7a78d4870b5f489afdcd4eef6" modify_external_catalogs: true
I20260810 19:48:05.967015 10377 ts_tablet_manager.cc:1929] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:05.967142 10377 log.cc:1199] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/842a5dacf9d145889e97069d3c8084b8
I20260810 19:48:05.967257 10367 tablet_bootstrap.cc:654] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:05.967542 10377 ts_tablet_manager.cc:1950] T 842a5dacf9d145889e97069d3c8084b8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:05.967896 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 747) took 2441 ms. Trace:
I20260810 19:48:05.967988 10377 rpcz_store.cc:276] 0810 19:48:03.525973 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:03.596598 (+ 70625us) service_pool.cc:224] Handling call
0810 19:48:05.899572 (+2302974us) ts_tablet_manager.cc:1151] Deleting tablet 842a5dacf9d145889e97069d3c8084b8
0810 19:48:05.899583 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.940197 (+ 40614us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.966943 (+ 26746us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:05.967872 (+ 929us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2180400}
I20260810 19:48:05.968462 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 759) took 1903 ms. Trace:
I20260810 19:48:05.968544 10377 rpcz_store.cc:276] 0810 19:48:04.065234 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.065306 (+ 72us) service_pool.cc:224] Handling call
0810 19:48:05.968310 (+1903004us) ts_tablet_manager.cc:1151] Deleting tablet 0849ea9c04104a8184f8a8cd40e06fc2
0810 19:48:05.968321 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.968431 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1902782}
I20260810 19:48:05.968932 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 760) took 1900 ms. Trace:
I20260810 19:48:05.969030 10377 rpcz_store.cc:276] 0810 19:48:04.068787 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.068871 (+ 84us) service_pool.cc:224] Handling call
0810 19:48:05.968798 (+1899927us) ts_tablet_manager.cc:1151] Deleting tablet dbd3b0b6b636432481f30fc84446e584
0810 19:48:05.968807 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.968900 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1899671}
I20260810 19:48:05.969429 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 761) took 1872 ms. Trace:
I20260810 19:48:05.969507 10377 rpcz_store.cc:276] 0810 19:48:04.097379 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.097464 (+ 85us) service_pool.cc:224] Handling call
0810 19:48:05.969320 (+1871856us) ts_tablet_manager.cc:1151] Deleting tablet b853bf6bbc7845bc9cfa6347687582e2
0810 19:48:05.969329 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.969411 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1871575}
I20260810 19:48:05.969843 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 763) took 1332 ms. Trace:
I20260810 19:48:05.970531 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet e750622b406c4783adf01bb1af6895de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:05 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:48:05.972000 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet ff3478f19b14418a876b668bd03125ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff3478f19b14418a876b668bd03125ba already in progress: creating tablet
I20260810 19:48:05.970441 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 90b6f76f0cec4f33879030958cbe89bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:05 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:05.972044 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet e750622b406c4783adf01bb1af6895de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:05 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:05.977779 10029 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:48:05.976794 10375 tablet_replica.cc:333] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
W20260810 19:48:05.978227 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 09a8da9ecf1042bfae5d34e263f501d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09a8da9ecf1042bfae5d34e263f501d6 already in progress: creating tablet
I20260810 19:48:05.978366 10375 raft_consensus.cc:2243] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:05.978770 10375 raft_consensus.cc:2272] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:05.979403 10375 ts_tablet_manager.cc:1916] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:05.980484 10367 tablet_bootstrap.cc:492] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:05.980624 10367 ts_tablet_manager.cc:1403] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260810 19:48:05.981410 10367 raft_consensus.cc:359] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.981585 10367 raft_consensus.cc:385] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:05.981637 10367 raft_consensus.cc:740] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:05.981909 10367 consensus_queue.cc:260] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.984845 10367 ts_tablet_manager.cc:1434] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 19:48:05.985248 10367 tablet_bootstrap.cc:492] T 4198f46be0194875aea6a7952321bc69 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:05.987193 10367 tablet_bootstrap.cc:654] T 4198f46be0194875aea6a7952321bc69 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:05.994930 10370 tablet_bootstrap.cc:492] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:05.995237 10370 ts_tablet_manager.cc:1403] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.001s
I20260810 19:48:05.996255 10370 raft_consensus.cc:359] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.996599 10370 raft_consensus.cc:385] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:05.996724 10370 raft_consensus.cc:740] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:05.997191 10370 consensus_queue.cc:260] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:05.997960 10370 ts_tablet_manager.cc:1434] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:48:05.969935 10377 rpcz_store.cc:276] 0810 19:48:04.637538 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.637918 (+ 380us) service_pool.cc:224] Handling call
0810 19:48:05.969742 (+1331824us) ts_tablet_manager.cc:1151] Deleting tablet 9ed73161398f4f54a20a9173c18b4d3c
0810 19:48:05.969751 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.969826 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1331617}
I20260810 19:48:05.998515 10377 tablet_replica.cc:333] T 965395b5072e4d47adac504e22a8d484 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:05.998874 10370 tablet_bootstrap.cc:492] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:06.001087 10377 raft_consensus.cc:2243] T 965395b5072e4d47adac504e22a8d484 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:06.003044 10370 tablet_bootstrap.cc:654] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:06.003314 10377 raft_consensus.cc:2272] T 965395b5072e4d47adac504e22a8d484 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:06.004017 10377 ts_tablet_manager.cc:1916] T 965395b5072e4d47adac504e22a8d484 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:06.005992 10366 tablet_bootstrap.cc:492] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:06.006728 10366 ts_tablet_manager.cc:1403] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.074s user 0.004s sys 0.008s
I20260810 19:48:06.010905 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet a5625dc6303d44c6be28abd6278ce034 (table default.Table_20489495f6794646b9eda0458ee58d91 [id=16ed3d0d9475472283f6d95c69c60f8d]) successfully deleted
W20260810 19:48:06.011359 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 8455cb11388340beb6daa13fee06177a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8455cb11388340beb6daa13fee06177a already in progress: creating tablet
W20260810 19:48:06.011973 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet f85f3fa629764c79921a710739eea7ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f85f3fa629764c79921a710739eea7ae already in progress: creating tablet
W20260810 19:48:06.012220 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 092686718efe4b19a610586420d6bc3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 092686718efe4b19a610586420d6bc3a already in progress: creating tablet
W20260810 19:48:06.012897 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 229dd737ee8547a89445593cc117fbc2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 229dd737ee8547a89445593cc117fbc2 already in progress: creating tablet
I20260810 19:48:06.012008 10366 raft_consensus.cc:359] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:06.013149 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 253f302c00cc42ff84076b0c17f7670a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 253f302c00cc42ff84076b0c17f7670a already in progress: creating tablet
I20260810 19:48:06.013371 10366 raft_consensus.cc:385] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 19:48:06.013826 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet a776693b6b4943a7b64e13ec10958c16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a776693b6b4943a7b64e13ec10958c16 already in progress: creating tablet
W20260810 19:48:06.014086 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet c9e2dbef6e7a48caa2964ab90fbf9b73 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9e2dbef6e7a48caa2964ab90fbf9b73 already in progress: creating tablet
W20260810 19:48:06.014335 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet f6f9eb86c6c84b4a84d109d4741238e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6f9eb86c6c84b4a84d109d4741238e1 already in progress: creating tablet
W20260810 19:48:06.014539 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 8565cd6fc9e34c5fbabba6e573df9939 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8565cd6fc9e34c5fbabba6e573df9939 already in progress: creating tablet
I20260810 19:48:06.014003 10366 raft_consensus.cc:740] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:06.014789 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet b737b216646a4c5baecb88d59bcce4df (table default.Table_98357f787dbf48958872d3de9003c202 [id=549322ede70c4efc91018201075b1a29]) successfully deleted
I20260810 19:48:06.015369 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet dfea147ef3904ab49375def065c6f328 (table default.Table_44197dd0fe1e4c88b41c1e9996eaa4a2 [id=c6c90cd5058a4eb9985fc7df3ef5c79a]) successfully deleted
I20260810 19:48:06.015471 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 6914b47e0cac4cd28ee4fd199684a280 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:05 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:06.015901 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet 6914b47e0cac4cd28ee4fd199684a280 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:05 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:06.015928 10375 ts_tablet_manager.cc:1929] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:06.016033 10375 log.cc:1199] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/971e9abee86444a7a9e923b0962ae751
I20260810 19:48:06.016402 10375 ts_tablet_manager.cc:1950] T 971e9abee86444a7a9e923b0962ae751 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:06.016753 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 665) took 3552 ms. Trace:
I20260810 19:48:06.016840 10375 rpcz_store.cc:276] 0810 19:48:02.464116 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.464193 (+ 77us) service_pool.cc:224] Handling call
0810 19:48:05.976726 (+3512533us) ts_tablet_manager.cc:1151] Deleting tablet 971e9abee86444a7a9e923b0962ae751
0810 19:48:05.976739 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:05.999312 (+ 22573us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.015855 (+ 16543us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.016734 (+ 879us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3512292}
I20260810 19:48:06.016098 10366 consensus_queue.cc:260] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.017292 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 674) took 3368 ms. Trace:
I20260810 19:48:06.017386 10375 rpcz_store.cc:276] 0810 19:48:02.648752 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.653369 (+ 4617us) service_pool.cc:224] Handling call
0810 19:48:06.017152 (+3363783us) ts_tablet_manager.cc:1151] Deleting tablet dfea56a2d5d847058bcf4f508f0778a1
0810 19:48:06.017162 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.017273 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3363526}
I20260810 19:48:06.018971 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 681) took 3291 ms. Trace:
I20260810 19:48:06.019055 10375 rpcz_store.cc:276] 0810 19:48:02.726107 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.726511 (+ 404us) service_pool.cc:224] Handling call
0810 19:48:06.017620 (+3291109us) ts_tablet_manager.cc:1151] Deleting tablet 5aa0f24443a34714a44137a77c12bbc3
0810 19:48:06.017630 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.017720 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3290793}
I20260810 19:48:06.019361 10375 tablet_replica.cc:333] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:06.019556 10375 raft_consensus.cc:2243] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:06.019928 10375 raft_consensus.cc:2272] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:06.020126 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 842a5dacf9d145889e97069d3c8084b8 (table default.Table_f833a088b72e42e789d82f2594875bb0 [id=d3257081af314bd898924c879f2d15e1]) successfully deleted
I20260810 19:48:06.020591 10375 ts_tablet_manager.cc:1916] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:06.026662 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 0849ea9c04104a8184f8a8cd40e06fc2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0849ea9c04104a8184f8a8cd40e06fc2 already in progress: creating tablet
W20260810 19:48:06.027104 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet dbd3b0b6b636432481f30fc84446e584 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbd3b0b6b636432481f30fc84446e584 already in progress: creating tablet
I20260810 19:48:06.027361 10375 ts_tablet_manager.cc:1929] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:06.027495 10375 log.cc:1199] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/21208dd824fe432fa307cbb88d37aaa2
W20260810 19:48:06.027426 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet b853bf6bbc7845bc9cfa6347687582e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b853bf6bbc7845bc9cfa6347687582e2 already in progress: creating tablet
W20260810 19:48:06.028117 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 9ed73161398f4f54a20a9173c18b4d3c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ed73161398f4f54a20a9173c18b4d3c already in progress: creating tablet
I20260810 19:48:06.028425 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 971e9abee86444a7a9e923b0962ae751 (table default.Table_64e5558a29af405b85912f54bebdf3be [id=f3f4d6ebcacf43489369bd8f742a0631]) successfully deleted
W20260810 19:48:06.028744 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet dfea56a2d5d847058bcf4f508f0778a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfea56a2d5d847058bcf4f508f0778a1 already in progress: creating tablet
W20260810 19:48:06.029062 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 5aa0f24443a34714a44137a77c12bbc3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5aa0f24443a34714a44137a77c12bbc3 already in progress: creating tablet
I20260810 19:48:06.029232 10375 ts_tablet_manager.cc:1950] T 21208dd824fe432fa307cbb88d37aaa2 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:06.030148 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 685) took 3249 ms. Trace:
I20260810 19:48:06.030251 10375 rpcz_store.cc:276] 0810 19:48:02.780944 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.785033 (+ 4089us) service_pool.cc:224] Handling call
0810 19:48:06.019309 (+3234276us) ts_tablet_manager.cc:1151] Deleting tablet 21208dd824fe432fa307cbb88d37aaa2
0810 19:48:06.019320 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.024036 (+ 4716us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.027281 (+ 3245us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.030121 (+ 2840us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3234064}
I20260810 19:48:06.030778 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 682) took 3289 ms. Trace:
I20260810 19:48:06.030864 10375 rpcz_store.cc:276] 0810 19:48:02.740942 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.786867 (+ 45925us) service_pool.cc:224] Handling call
0810 19:48:06.030607 (+3243740us) ts_tablet_manager.cc:1151] Deleting tablet ea557438b7b74944b19e17d7fb8f20cf
0810 19:48:06.030619 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.030759 (+ 140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3243388}
I20260810 19:48:06.031221 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 687) took 3235 ms. Trace:
I20260810 19:48:06.031311 10375 rpcz_store.cc:276] 0810 19:48:02.796054 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.796746 (+ 692us) service_pool.cc:224] Handling call
0810 19:48:06.031099 (+3234353us) ts_tablet_manager.cc:1151] Deleting tablet ea942d54b4664ea48a13b6c85118cf6c
0810 19:48:06.031110 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.031204 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3234042}
I20260810 19:48:06.031642 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 689) took 3229 ms. Trace:
I20260810 19:48:06.031713 10375 rpcz_store.cc:276] 0810 19:48:02.802237 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.802785 (+ 548us) service_pool.cc:224] Handling call
0810 19:48:06.031541 (+3228756us) ts_tablet_manager.cc:1151] Deleting tablet 2a1b1877c8bf4515a1c1f8c693bdae8e
0810 19:48:06.031550 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.031626 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3228479}
I20260810 19:48:06.032049 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 692) took 3106 ms. Trace:
I20260810 19:48:06.032115 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 4b2b0f2fc93647f3bc1d79b4132c3703
I20260810 19:48:06.032117 10375 rpcz_store.cc:276] 0810 19:48:02.925581 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:02.926250 (+ 669us) service_pool.cc:224] Handling call
0810 19:48:06.031926 (+3105676us) ts_tablet_manager.cc:1151] Deleting tablet 240b2ae8a1484de998d3ea972bc74cfe
0810 19:48:06.031936 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.032033 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3105406}
I20260810 19:48:06.032469 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 695) took 2995 ms. Trace:
I20260810 19:48:06.032545 10375 rpcz_store.cc:276] 0810 19:48:03.036548 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:03.036697 (+ 149us) service_pool.cc:224] Handling call
0810 19:48:06.032349 (+2995652us) ts_tablet_manager.cc:1151] Deleting tablet 10dd7891d4d844fc8f7a8674ee57627f
0810 19:48:06.032358 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.032452 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2856566}
I20260810 19:48:06.032883 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 698) took 2972 ms. Trace:
I20260810 19:48:06.032963 10375 rpcz_store.cc:276] 0810 19:48:03.060706 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:03.060874 (+ 168us) service_pool.cc:224] Handling call
0810 19:48:06.032765 (+2971891us) ts_tablet_manager.cc:1151] Deleting tablet b4b6b17ce3354600b2f7450c6e483c69
0810 19:48:06.032775 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.032866 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2830713}
I20260810 19:48:06.033068 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b8bd05c31450458cb9d2bdb337397fde" } new_table_name: "default.Table_f9dcbf84ccd243aebda13a2295238bf2" modify_external_catalogs: true
I20260810 19:48:06.033277 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 701) took 2878 ms. Trace:
I20260810 19:48:06.033351 10375 rpcz_store.cc:276] 0810 19:48:03.154621 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:03.154690 (+ 69us) service_pool.cc:224] Handling call
0810 19:48:06.033181 (+2878491us) ts_tablet_manager.cc:1151] Deleting tablet 08f78560ec9f465c94ef08fa2f067c0d
0810 19:48:06.033189 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.033262 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2775431}
I20260810 19:48:06.033656 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 696) took 2987 ms. Trace:
I20260810 19:48:06.033713 10375 rpcz_store.cc:276] 0810 19:48:03.046046 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:03.051151 (+ 5105us) service_pool.cc:224] Handling call
0810 19:48:06.033547 (+2982396us) ts_tablet_manager.cc:1151] Deleting tablet 43770a764bd24d3f9ec60a02dca083dc
0810 19:48:06.033555 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.033641 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2746978}
I20260810 19:48:06.033994 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 697) took 2973 ms. Trace:
I20260810 19:48:06.034053 10375 rpcz_store.cc:276] 0810 19:48:03.060580 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:03.061246 (+ 666us) service_pool.cc:224] Handling call
0810 19:48:06.033907 (+2972661us) ts_tablet_manager.cc:1151] Deleting tablet 814babd6ae4748109b6caf1af54c2733
0810 19:48:06.033915 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.033981 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2733991}
I20260810 19:48:06.034380 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 725) took 2582 ms. Trace:
I20260810 19:48:06.034440 10375 rpcz_store.cc:276] 0810 19:48:03.451649 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:03.563129 (+111480us) service_pool.cc:224] Handling call
0810 19:48:06.034241 (+2471112us) ts_tablet_manager.cc:1151] Deleting tablet e87fd882e6b6413480a0cb06aee74722
0810 19:48:06.034248 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.034365 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2430483}
I20260810 19:48:06.034701 10375 tablet_replica.cc:333] T 842a5dacf9d145889e97069d3c8084b8 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:06.034891 10375 raft_consensus.cc:2243] T 842a5dacf9d145889e97069d3c8084b8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:06.035061 10375 raft_consensus.cc:2272] T 842a5dacf9d145889e97069d3c8084b8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:06.035674 10375 ts_tablet_manager.cc:1916] T 842a5dacf9d145889e97069d3c8084b8 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:06.035691 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b2b0f2fc93647f3bc1d79b4132c3703 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:05 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:06.036270 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b2b0f2fc93647f3bc1d79b4132c3703 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:05 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:06.036268 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b2b0f2fc93647f3bc1d79b4132c3703 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:05 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:06.036444 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 21208dd824fe432fa307cbb88d37aaa2 (table default.Table_fc65a045265c494998007900c7ac9e01 [id=190f70ae5e5f44c294a4c0250fc7b08a]) successfully deleted
W20260810 19:48:06.036697 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet ea557438b7b74944b19e17d7fb8f20cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea557438b7b74944b19e17d7fb8f20cf already in progress: creating tablet
W20260810 19:48:06.036912 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet ea942d54b4664ea48a13b6c85118cf6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea942d54b4664ea48a13b6c85118cf6c already in progress: creating tablet
W20260810 19:48:06.037086 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 2a1b1877c8bf4515a1c1f8c693bdae8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a1b1877c8bf4515a1c1f8c693bdae8e already in progress: creating tablet
W20260810 19:48:06.037258 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 240b2ae8a1484de998d3ea972bc74cfe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 240b2ae8a1484de998d3ea972bc74cfe already in progress: creating tablet
W20260810 19:48:06.037424 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 10dd7891d4d844fc8f7a8674ee57627f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10dd7891d4d844fc8f7a8674ee57627f already in progress: creating tablet
W20260810 19:48:06.037591 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet b4b6b17ce3354600b2f7450c6e483c69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4b6b17ce3354600b2f7450c6e483c69 already in progress: creating tablet
W20260810 19:48:06.037751 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 08f78560ec9f465c94ef08fa2f067c0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08f78560ec9f465c94ef08fa2f067c0d already in progress: creating tablet
W20260810 19:48:06.038002 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 43770a764bd24d3f9ec60a02dca083dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43770a764bd24d3f9ec60a02dca083dc already in progress: creating tablet
W20260810 19:48:06.038203 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 814babd6ae4748109b6caf1af54c2733 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 814babd6ae4748109b6caf1af54c2733 already in progress: creating tablet
W20260810 19:48:06.038455 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet e87fd882e6b6413480a0cb06aee74722 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e87fd882e6b6413480a0cb06aee74722 already in progress: creating tablet
I20260810 19:48:06.038738 12266 tablet_replica.cc:333] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:06.039026 12266 raft_consensus.cc:2243] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:06.039302 12266 raft_consensus.cc:2272] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:06.039955 12266 ts_tablet_manager.cc:1916] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:06.042402 10370 tablet_bootstrap.cc:492] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:06.042618 10370 ts_tablet_manager.cc:1403] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.044s user 0.004s sys 0.000s
I20260810 19:48:06.042424 10375 ts_tablet_manager.cc:1929] T 842a5dacf9d145889e97069d3c8084b8 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:06.045097 10375 log.cc:1199] T 842a5dacf9d145889e97069d3c8084b8 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/842a5dacf9d145889e97069d3c8084b8
I20260810 19:48:06.045485 10375 ts_tablet_manager.cc:1950] T 842a5dacf9d145889e97069d3c8084b8 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:06.045678 10370 raft_consensus.cc:359] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.045869 10370 raft_consensus.cc:385] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:06.045944 10370 raft_consensus.cc:740] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:06.046211 10370 consensus_queue.cc:260] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.046344 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 727) took 2443 ms. Trace:
I20260810 19:48:06.046451 10375 rpcz_store.cc:276] 0810 19:48:03.602988 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:03.603983 (+ 995us) service_pool.cc:224] Handling call
0810 19:48:06.034653 (+2430670us) ts_tablet_manager.cc:1151] Deleting tablet 842a5dacf9d145889e97069d3c8084b8
0810 19:48:06.034662 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.039243 (+ 4581us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.042362 (+ 3119us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.046284 (+ 3922us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2426055}
I20260810 19:48:06.046813 10375 tablet_replica.cc:333] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:06.047006 10375 raft_consensus.cc:2243] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:06.047354 10375 raft_consensus.cc:2272] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:06.048746 10370 ts_tablet_manager.cc:1434] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260810 19:48:06.049209 10370 tablet_bootstrap.cc:492] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:06.056720 11828 raft_consensus.cc:493] T 320e42f6de6c4452adb7bbb379a156e6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.056895 11828 raft_consensus.cc:515] T 320e42f6de6c4452adb7bbb379a156e6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.057575 11828 leader_election.cc:290] T 320e42f6de6c4452adb7bbb379a156e6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:06.058269 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320e42f6de6c4452adb7bbb379a156e6" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:06.062211 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 842a5dacf9d145889e97069d3c8084b8 (table default.Table_f833a088b72e42e789d82f2594875bb0 [id=d3257081af314bd898924c879f2d15e1]) successfully deleted
I20260810 19:48:06.064255 12266 ts_tablet_manager.cc:1929] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:06.064486 12266 log.cc:1199] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/4b2b0f2fc93647f3bc1d79b4132c3703
I20260810 19:48:06.064978 12266 ts_tablet_manager.cc:1950] T 4b2b0f2fc93647f3bc1d79b4132c3703 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:06.065264 12087 raft_consensus.cc:493] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.065424 12087 raft_consensus.cc:515] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.066078 12087 leader_election.cc:290] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:06.066924 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 4b2b0f2fc93647f3bc1d79b4132c3703 (table default.Table_d195688055bd4cfca1a9462585af71bc [id=64e1f507ae574ea6b7fa1627b8e7f4c3]) successfully deleted
I20260810 19:48:06.067255 10377 ts_tablet_manager.cc:1929] T 965395b5072e4d47adac504e22a8d484 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:06.067399 10377 log.cc:1199] T 965395b5072e4d47adac504e22a8d484 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/965395b5072e4d47adac504e22a8d484
W20260810 19:48:06.067550 9831 leader_election.cc:343] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 0bddaf5b5fc1404e83b079ffa97e7321
I20260810 19:48:06.067760 10377 ts_tablet_manager.cc:1950] T 965395b5072e4d47adac504e22a8d484 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:06.068105 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 765) took 1413 ms. Trace:
I20260810 19:48:06.068190 10377 rpcz_store.cc:276] 0810 19:48:04.654857 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.655077 (+ 220us) service_pool.cc:224] Handling call
0810 19:48:05.998454 (+1343377us) ts_tablet_manager.cc:1151] Deleting tablet 965395b5072e4d47adac504e22a8d484
0810 19:48:05.998467 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.030806 (+ 32339us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.067180 (+ 36374us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.068086 (+ 906us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1343112}
I20260810 19:48:06.068531 10377 tablet_replica.cc:333] T 72b39babf851404c89adb317033015ec P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:06.068725 10377 raft_consensus.cc:2243] T 72b39babf851404c89adb317033015ec P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:06.068897 10377 raft_consensus.cc:2272] T 72b39babf851404c89adb317033015ec P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:06.069468 10377 ts_tablet_manager.cc:1916] T 72b39babf851404c89adb317033015ec P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:06.069476 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 965395b5072e4d47adac504e22a8d484 (table default.Table_4ba52e1a6c3b42688033e6fd1cdcd7ae [id=a88614b26dcb4c16bd100a55431569c8]) successfully deleted
I20260810 19:48:06.071430 10375 ts_tablet_manager.cc:1916] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:06.071834 10370 tablet_bootstrap.cc:654] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:06.083797 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320e42f6de6c4452adb7bbb379a156e6" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:06.087343 10068 leader_election.cc:304] T 320e42f6de6c4452adb7bbb379a156e6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:06.089246 11828 raft_consensus.cc:2749] T 320e42f6de6c4452adb7bbb379a156e6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:06.089986 10366 ts_tablet_manager.cc:1434] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.083s user 0.002s sys 0.001s
I20260810 19:48:06.092664 10247 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:48:06.095290 9418 master_service.cc:960] ReplaceTablet: received request to replace tablet 841f58b4e8f7465eaa7fa08629e0bc2a from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:06.105082 9420 master_service.cc:960] ReplaceTablet: received request to replace tablet 648ef608fa0c45cc8be4bad80c4200be from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:06.112453 10367 tablet_bootstrap.cc:492] T 4198f46be0194875aea6a7952321bc69 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:06.112623 10367 ts_tablet_manager.cc:1403] T 4198f46be0194875aea6a7952321bc69 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.127s user 0.013s sys 0.000s
I20260810 19:48:06.113454 10367 raft_consensus.cc:359] T 4198f46be0194875aea6a7952321bc69 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.113652 10367 raft_consensus.cc:385] T 4198f46be0194875aea6a7952321bc69 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:06.113705 10367 raft_consensus.cc:740] T 4198f46be0194875aea6a7952321bc69 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:06.113929 10367 consensus_queue.cc:260] T 4198f46be0194875aea6a7952321bc69 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.114504 10367 ts_tablet_manager.cc:1434] T 4198f46be0194875aea6a7952321bc69 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 19:48:06.116428 10367 tablet_bootstrap.cc:492] T 4f21e03993e841ba901f1e9c176309b9 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:06.118152 10367 tablet_bootstrap.cc:654] T 4f21e03993e841ba901f1e9c176309b9 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:06.119545 10375 ts_tablet_manager.cc:1929] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:06.119669 10375 log.cc:1199] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/476e762e46c04ae6bfef5e14df2d16e2
I20260810 19:48:06.120065 10375 ts_tablet_manager.cc:1950] T 476e762e46c04ae6bfef5e14df2d16e2 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:06.120937 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 728) took 2513 ms. Trace:
I20260810 19:48:06.121023 10375 rpcz_store.cc:276] 0810 19:48:03.607885 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:03.609248 (+ 1363us) service_pool.cc:224] Handling call
0810 19:48:06.046758 (+2437510us) ts_tablet_manager.cc:1151] Deleting tablet 476e762e46c04ae6bfef5e14df2d16e2
0810 19:48:06.046768 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.075081 (+ 28313us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.119472 (+ 44391us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.120911 (+ 1439us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2436912}
I20260810 19:48:06.121527 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 738) took 1898 ms. Trace:
I20260810 19:48:06.121603 10375 rpcz_store.cc:276] 0810 19:48:04.223147 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.223219 (+ 72us) service_pool.cc:224] Handling call
0810 19:48:06.121330 (+1898111us) ts_tablet_manager.cc:1151] Deleting tablet dbd3b0b6b636432481f30fc84446e584
0810 19:48:06.121342 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.121505 (+ 163us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1897824}
I20260810 19:48:06.121969 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 739) took 1898 ms. Trace:
I20260810 19:48:06.122037 10375 rpcz_store.cc:276] 0810 19:48:04.223313 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.223561 (+ 248us) service_pool.cc:224] Handling call
0810 19:48:06.121854 (+1898293us) ts_tablet_manager.cc:1151] Deleting tablet 0849ea9c04104a8184f8a8cd40e06fc2
0810 19:48:06.121863 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.121954 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1898077}
I20260810 19:48:06.122424 10370 tablet_bootstrap.cc:492] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:06.122565 10370 ts_tablet_manager.cc:1403] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.073s user 0.003s sys 0.004s
I20260810 19:48:06.123445 10370 raft_consensus.cc:359] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.123631 10370 raft_consensus.cc:385] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:06.123685 10370 raft_consensus.cc:740] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:06.123942 10370 consensus_queue.cc:260] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.124838 10370 ts_tablet_manager.cc:1434] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 19:48:06.125201 10370 tablet_bootstrap.cc:492] T 410855f236004ad4b78839eb1c0c2f1f P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:06.125965 9791 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:48:06.130442 10377 ts_tablet_manager.cc:1929] T 72b39babf851404c89adb317033015ec P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:06.133020 10370 tablet_bootstrap.cc:654] T 410855f236004ad4b78839eb1c0c2f1f P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:06.140974 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 476e762e46c04ae6bfef5e14df2d16e2 (table default.Table_1b1b59cdf6ef477b856b825bb519bd47 [id=f601112ceee249d49b43a2437b9731ae]) successfully deleted
I20260810 19:48:06.132475 11897 consensus_queue.cc:1048] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:06.141345 10377 log.cc:1199] T 72b39babf851404c89adb317033015ec P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/72b39babf851404c89adb317033015ec
W20260810 19:48:06.141337 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet dbd3b0b6b636432481f30fc84446e584 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbd3b0b6b636432481f30fc84446e584 already in progress: creating tablet
W20260810 19:48:06.141533 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 0849ea9c04104a8184f8a8cd40e06fc2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0849ea9c04104a8184f8a8cd40e06fc2 already in progress: creating tablet
I20260810 19:48:06.141716 10377 ts_tablet_manager.cc:1950] T 72b39babf851404c89adb317033015ec P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:06.142458 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 740) took 1919 ms. Trace:
I20260810 19:48:06.142566 10375 rpcz_store.cc:276] 0810 19:48:04.223416 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.224425 (+ 1009us) service_pool.cc:224] Handling call
0810 19:48:06.122250 (+1897825us) ts_tablet_manager.cc:1151] Deleting tablet b853bf6bbc7845bc9cfa6347687582e2
0810 19:48:06.122258 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.142424 (+ 20166us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1888032}
I20260810 19:48:06.142956 10375 tablet_replica.cc:333] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
W20260810 19:48:06.143078 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet b853bf6bbc7845bc9cfa6347687582e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b853bf6bbc7845bc9cfa6347687582e2 already in progress: creating tablet
I20260810 19:48:06.143157 10375 raft_consensus.cc:2243] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:06.143489 10375 pending_rounds.cc:70] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:06.143553 10375 pending_rounds.cc:77] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058700410241024 op_type: NO_OP noop_request { }
I20260810 19:48:06.143662 10375 raft_consensus.cc:2889] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:06.143748 10375 raft_consensus.cc:2272] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:06.145536 10375 ts_tablet_manager.cc:1916] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:06.153787 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bddaf5b5fc1404e83b079ffa97e7321" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:06.155586 10370 tablet_bootstrap.cc:492] T 410855f236004ad4b78839eb1c0c2f1f P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:06.155741 10370 ts_tablet_manager.cc:1403] T 410855f236004ad4b78839eb1c0c2f1f P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.001s
I20260810 19:48:06.156562 10370 raft_consensus.cc:359] T 410855f236004ad4b78839eb1c0c2f1f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.156744 10370 raft_consensus.cc:385] T 410855f236004ad4b78839eb1c0c2f1f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:06.156798 10370 raft_consensus.cc:740] T 410855f236004ad4b78839eb1c0c2f1f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:06.157855 10366 tablet_bootstrap.cc:492] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:06.159464 10366 tablet_bootstrap.cc:654] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:06.161166 9830 leader_election.cc:343] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.161381 9830 leader_election.cc:304] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:06.161456 10367 tablet_bootstrap.cc:492] T 4f21e03993e841ba901f1e9c176309b9 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:06.161619 10367 ts_tablet_manager.cc:1403] T 4f21e03993e841ba901f1e9c176309b9 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.001s
I20260810 19:48:06.161974 11897 raft_consensus.cc:2749] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:06.162396 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 764) took 1507 ms. Trace:
I20260810 19:48:06.162492 10377 rpcz_store.cc:276] 0810 19:48:04.654708 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.655802 (+ 1094us) service_pool.cc:224] Handling call
0810 19:48:06.068477 (+1412675us) ts_tablet_manager.cc:1151] Deleting tablet 72b39babf851404c89adb317033015ec
0810 19:48:06.068489 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.084848 (+ 16359us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.130361 (+ 45513us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.162376 (+ 32015us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1412481}
I20260810 19:48:06.162978 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 766) took 1435 ms. Trace:
I20260810 19:48:06.163064 10377 rpcz_store.cc:276] 0810 19:48:04.727898 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.727954 (+ 56us) service_pool.cc:224] Handling call
0810 19:48:06.162830 (+1434876us) ts_tablet_manager.cc:1151] Deleting tablet 86937c581d4c46d38699b268b1e0c42d
0810 19:48:06.162841 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.162958 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1434677}
I20260810 19:48:06.163414 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 767) took 1364 ms. Trace:
I20260810 19:48:06.163491 10377 rpcz_store.cc:276] 0810 19:48:04.799256 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.799317 (+ 61us) service_pool.cc:224] Handling call
0810 19:48:06.163304 (+1363987us) ts_tablet_manager.cc:1151] Deleting tablet fdd82537177a4142bddd0544485b00c4
0810 19:48:06.163312 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.163398 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1363774}
I20260810 19:48:06.163798 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 779) took 1106 ms. Trace:
I20260810 19:48:06.163867 10377 rpcz_store.cc:276] 0810 19:48:05.057246 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.082369 (+ 25123us) service_pool.cc:224] Handling call
0810 19:48:06.163700 (+1081331us) ts_tablet_manager.cc:1151] Deleting tablet 5f4e2adee0264e418ff8c54912973e60
0810 19:48:06.163709 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.163784 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1080964}
I20260810 19:48:06.164186 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 781) took 1078 ms. Trace:
I20260810 19:48:06.164256 10377 rpcz_store.cc:276] 0810 19:48:05.085535 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.085583 (+ 48us) service_pool.cc:224] Handling call
0810 19:48:06.164085 (+1078502us) ts_tablet_manager.cc:1151] Deleting tablet 263a5695e7754b44a64edbda27b42135
0810 19:48:06.164094 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.164169 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1078330}
I20260810 19:48:06.164215 10367 raft_consensus.cc:359] T 4f21e03993e841ba901f1e9c176309b9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.164422 10367 raft_consensus.cc:385] T 4f21e03993e841ba901f1e9c176309b9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:06.164499 10367 raft_consensus.cc:740] T 4f21e03993e841ba901f1e9c176309b9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:06.164561 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 782) took 1078 ms. Trace:
I20260810 19:48:06.164633 10377 rpcz_store.cc:276] 0810 19:48:05.085636 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.085688 (+ 52us) service_pool.cc:224] Handling call
0810 19:48:06.164460 (+1078772us) ts_tablet_manager.cc:1151] Deleting tablet 1bbd3fe2117c42058dc108b5dc18d560
0810 19:48:06.164468 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.164545 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1078653}
I20260810 19:48:06.164821 10367 consensus_queue.cc:260] T 4f21e03993e841ba901f1e9c176309b9 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.164930 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 784) took 1050 ms. Trace:
I20260810 19:48:06.164992 10377 rpcz_store.cc:276] 0810 19:48:05.113987 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.114300 (+ 313us) service_pool.cc:224] Handling call
0810 19:48:06.164840 (+1050540us) ts_tablet_manager.cc:1151] Deleting tablet 6355c14e38b3446493f7bd5e2a717341
0810 19:48:06.164848 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.164905 (+ 57us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1050307}
I20260810 19:48:06.165239 10377 tablet_replica.cc:333] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:06.165426 10377 raft_consensus.cc:2243] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:06.165489 10367 ts_tablet_manager.cc:1434] T 4f21e03993e841ba901f1e9c176309b9 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260810 19:48:06.165589 10377 raft_consensus.cc:2272] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:06.165792 10367 tablet_bootstrap.cc:492] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:06.166175 10377 ts_tablet_manager.cc:1916] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:06.166564 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 72b39babf851404c89adb317033015ec (table default.Table_2d7f246476ac4544a3fa089ec3c52657 [id=c681008d2b5f43a9b7b6ed2d72653b1b]) successfully deleted
W20260810 19:48:06.167100 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 86937c581d4c46d38699b268b1e0c42d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 86937c581d4c46d38699b268b1e0c42d already in progress: creating tablet
W20260810 19:48:06.167523 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet fdd82537177a4142bddd0544485b00c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fdd82537177a4142bddd0544485b00c4 already in progress: creating tablet
I20260810 19:48:06.167848 12313 raft_consensus.cc:493] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 19:48:06.167898 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 5f4e2adee0264e418ff8c54912973e60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f4e2adee0264e418ff8c54912973e60 already in progress: creating tablet
I20260810 19:48:06.167970 12313 raft_consensus.cc:515] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:06.168360 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 263a5695e7754b44a64edbda27b42135 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 263a5695e7754b44a64edbda27b42135 already in progress: creating tablet
I20260810 19:48:06.168586 12313 leader_election.cc:290] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:06.168756 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 1bbd3fe2117c42058dc108b5dc18d560 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1bbd3fe2117c42058dc108b5dc18d560 already in progress: creating tablet
W20260810 19:48:06.169159 9395 catalog_manager.cc:5017] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 6355c14e38b3446493f7bd5e2a717341 because the tablet was not found. No further retry: Not found: Tablet not found: 6355c14e38b3446493f7bd5e2a717341
I20260810 19:48:06.169560 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639c824ba4834734a4ebfd558181bebe" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:06.171350 9611 leader_election.cc:343] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.157008 10370 consensus_queue.cc:260] T 410855f236004ad4b78839eb1c0c2f1f P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.170481 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639c824ba4834734a4ebfd558181bebe" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:06.173028 10367 tablet_bootstrap.cc:654] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:06.176944 10370 ts_tablet_manager.cc:1434] T 410855f236004ad4b78839eb1c0c2f1f P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.021s user 0.000s sys 0.002s
I20260810 19:48:06.177815 10370 tablet_bootstrap.cc:492] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:48:06.178921 9611 leader_election.cc:343] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.179075 9611 leader_election.cc:304] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:06.179548 12313 raft_consensus.cc:2749] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:06.180302 10370 tablet_bootstrap.cc:654] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:06.180981 10375 ts_tablet_manager.cc:1929] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:06.181103 10375 log.cc:1199] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/d2c77a8ac1614bb286e4e168bcf999f3
I20260810 19:48:06.181486 10375 ts_tablet_manager.cc:1950] T d2c77a8ac1614bb286e4e168bcf999f3 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:06.182421 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 742) took 1668 ms. Trace:
I20260810 19:48:06.182515 10375 rpcz_store.cc:276] 0810 19:48:04.514013 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.514077 (+ 64us) service_pool.cc:224] Handling call
0810 19:48:06.142900 (+1628823us) ts_tablet_manager.cc:1151] Deleting tablet d2c77a8ac1614bb286e4e168bcf999f3
0810 19:48:06.142912 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.148956 (+ 6044us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.180907 (+ 31951us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.182394 (+ 1487us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1621096}
I20260810 19:48:06.183194 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 744) took 1546 ms. Trace:
I20260810 19:48:06.183239 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet d2c77a8ac1614bb286e4e168bcf999f3 (table default.Table_c2a3c3f509104c5cbeb2f53726021955 [id=8fddaf13b1664006ac4b4fc2dcd2e90c]) successfully deleted
I20260810 19:48:06.183271 10375 rpcz_store.cc:276] 0810 19:48:04.636790 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.636855 (+ 65us) service_pool.cc:224] Handling call
0810 19:48:06.182957 (+1546102us) ts_tablet_manager.cc:1151] Deleting tablet 9ed73161398f4f54a20a9173c18b4d3c
0810 19:48:06.182971 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.183175 (+ 204us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1545859}
I20260810 19:48:06.183729 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 746) took 1458 ms. Trace:
I20260810 19:48:06.183794 10375 rpcz_store.cc:276] 0810 19:48:04.725802 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.725867 (+ 65us) service_pool.cc:224] Handling call
0810 19:48:06.183604 (+1457737us) ts_tablet_manager.cc:1151] Deleting tablet 86937c581d4c46d38699b268b1e0c42d
0810 19:48:06.183614 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.183712 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1444531}
W20260810 19:48:06.183864 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 9ed73161398f4f54a20a9173c18b4d3c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ed73161398f4f54a20a9173c18b4d3c already in progress: creating tablet
I20260810 19:48:06.184100 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 747) took 1384 ms. Trace:
I20260810 19:48:06.184157 10375 rpcz_store.cc:276] 0810 19:48:04.799388 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.799595 (+ 207us) service_pool.cc:224] Handling call
0810 19:48:06.184002 (+1384407us) ts_tablet_manager.cc:1151] Deleting tablet fdd82537177a4142bddd0544485b00c4
0810 19:48:06.184010 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.184086 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1384186}
W20260810 19:48:06.184302 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 86937c581d4c46d38699b268b1e0c42d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 86937c581d4c46d38699b268b1e0c42d already in progress: creating tablet
I20260810 19:48:06.184422 10375 tablet_replica.cc:333] T 3b6187dbe1ca42f79bf3eddd5475b929 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:06.184633 10375 raft_consensus.cc:2243] T 3b6187dbe1ca42f79bf3eddd5475b929 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260810 19:48:06.184677 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet fdd82537177a4142bddd0544485b00c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fdd82537177a4142bddd0544485b00c4 already in progress: creating tablet
I20260810 19:48:06.184808 10375 raft_consensus.cc:2272] T 3b6187dbe1ca42f79bf3eddd5475b929 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:06.185416 10375 ts_tablet_manager.cc:1916] T 3b6187dbe1ca42f79bf3eddd5475b929 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:06.189957 12313 raft_consensus.cc:493] T 4198f46be0194875aea6a7952321bc69 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.190142 12313 raft_consensus.cc:515] T 4198f46be0194875aea6a7952321bc69 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.190802 12313 leader_election.cc:290] T 4198f46be0194875aea6a7952321bc69 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:06.191504 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198f46be0194875aea6a7952321bc69" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:06.191686 10367 tablet_bootstrap.cc:492] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:06.191835 10367 ts_tablet_manager.cc:1403] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.003s
W20260810 19:48:06.192329 9611 leader_election.cc:343] T 4198f46be0194875aea6a7952321bc69 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.192724 10367 raft_consensus.cc:359] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:06.192982 10367 raft_consensus.cc:385] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:06.193109 10367 raft_consensus.cc:740] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:06.193512 10367 consensus_queue.cc:260] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:06.194135 10367 ts_tablet_manager.cc:1434] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:06.194521 10367 tablet_bootstrap.cc:492] T 82c3f619c76e40c583bfcdf2bb77fe42 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:06.196358 10367 tablet_bootstrap.cc:654] T 82c3f619c76e40c583bfcdf2bb77fe42 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:06.203042 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198f46be0194875aea6a7952321bc69" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:06.204053 9611 leader_election.cc:343] T 4198f46be0194875aea6a7952321bc69 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.204190 9611 leader_election.cc:304] T 4198f46be0194875aea6a7952321bc69 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:06.204703 12313 raft_consensus.cc:2749] T 4198f46be0194875aea6a7952321bc69 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:06.205370 11828 raft_consensus.cc:493] T 410855f236004ad4b78839eb1c0c2f1f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.205515 11828 raft_consensus.cc:515] T 410855f236004ad4b78839eb1c0c2f1f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.206223 11828 leader_election.cc:290] T 410855f236004ad4b78839eb1c0c2f1f P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:06.207309 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410855f236004ad4b78839eb1c0c2f1f" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:06.222213 9421 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 3e8ae48a2fb548358176abefe1ee3baa (table default.Table_9cb0cc2a8f724781a638706ddcc2c085 [id=12db110e89e04d40bdb05ec61fd5e3b6]). Expected version 1 got 0
I20260810 19:48:06.222950 9421 catalog_manager.cc:5719] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:06.223492 9421 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet db2b8038ee9747109b42510bba02faa9 (table default.Table_2b20dee66e634a07bc9f2e2de90e8529 [id=452b19ee68bc463086780f6f72603483]). Expected version 1 got 0
I20260810 19:48:06.223771 9421 catalog_manager.cc:5719] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:06.224159 9421 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 410855f236004ad4b78839eb1c0c2f1f (table default.Table_44478e93cffb460aaa8df9115b799594 [id=1d363ce63686462f9f4c15669773ee22]). Expected version 1 got 0
W20260810 19:48:06.224629 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dbef3b19330d42779bf0a62ec742bfcb consensus state has no leader
I20260810 19:48:06.226814 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 4fece5e3c8714b6eaac71078e938727f (DEFAULT_TABLE table=default.Table_b8365464a8654203a285a8036593fa40 [id=b313f1ab77ac42f9b143918359dab155]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.226900 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 3b2f576afb084987be171167a62883bb (DEFAULT_TABLE table=default.Table_b5a8a6be570046fc83326c8efb7b8f10 [id=7312ca5a38f64257a3a70d5c16f7c8a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.227351 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fece5e3c8714b6eaac71078e938727f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.227313 9666 tablet_service.cc:1511] Processing CreateTablet for tablet fd92028cb8c849d4b121cec3775cbe62 (DEFAULT_TABLE table=default.Table_744b0ef1592749908ad53111cb98fa1c [id=d67aa0559aef4a7491fa25286797430c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.227955 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 60d8ba917fe644e18279eaef8088ec63 (DEFAULT_TABLE table=default.Table_bb58c03ab3af444b99cd4fa12a0482cd [id=1c808a1746b2421d967d6041bb12f8ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.228818 9664 tablet_service.cc:1511] Processing CreateTablet for tablet cf1a85faabf4403096a37034ae6ea2e4 (DEFAULT_TABLE table=default.Table_0bf175363efe4e62a23cf86713325670 [id=467ef19db44142d5a56bfeb5e534875e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.229250 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 3b2f576afb084987be171167a62883bb (DEFAULT_TABLE table=default.Table_b5a8a6be570046fc83326c8efb7b8f10 [id=7312ca5a38f64257a3a70d5c16f7c8a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.229698 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b2f576afb084987be171167a62883bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.230744 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd92028cb8c849d4b121cec3775cbe62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.232008 10375 ts_tablet_manager.cc:1929] T 3b6187dbe1ca42f79bf3eddd5475b929 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:06.232128 10375 log.cc:1199] T 3b6187dbe1ca42f79bf3eddd5475b929 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/3b6187dbe1ca42f79bf3eddd5475b929
I20260810 19:48:06.234628 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d8ba917fe644e18279eaef8088ec63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.234834 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b2f576afb084987be171167a62883bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.235584 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 4fece5e3c8714b6eaac71078e938727f (DEFAULT_TABLE table=default.Table_b8365464a8654203a285a8036593fa40 [id=b313f1ab77ac42f9b143918359dab155]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.235998 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fece5e3c8714b6eaac71078e938727f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.238765 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1a85faabf4403096a37034ae6ea2e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.239595 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 60d8ba917fe644e18279eaef8088ec63 (DEFAULT_TABLE table=default.Table_bb58c03ab3af444b99cd4fa12a0482cd [id=1c808a1746b2421d967d6041bb12f8ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.240029 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d8ba917fe644e18279eaef8088ec63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.242682 10139 tablet_service.cc:1511] Processing CreateTablet for tablet fd92028cb8c849d4b121cec3775cbe62 (DEFAULT_TABLE table=default.Table_744b0ef1592749908ad53111cb98fa1c [id=d67aa0559aef4a7491fa25286797430c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:06.242987 9395 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 871f8793e77845399a2e0ae7407adc75 (table default.Table_92455999000f47609f8b7df3aa63031b [id=def3a181132246f79f2589a3c7c5331f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 871f8793e77845399a2e0ae7407adc75 consensus state has no leader
I20260810 19:48:06.243106 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd92028cb8c849d4b121cec3775cbe62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.243608 10115 tablet_service.cc:1511] Processing CreateTablet for tablet cf1a85faabf4403096a37034ae6ea2e4 (DEFAULT_TABLE table=default.Table_0bf175363efe4e62a23cf86713325670 [id=467ef19db44142d5a56bfeb5e534875e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.243959 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1a85faabf4403096a37034ae6ea2e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.247328 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 3b2f576afb084987be171167a62883bb (DEFAULT_TABLE table=default.Table_b5a8a6be570046fc83326c8efb7b8f10 [id=7312ca5a38f64257a3a70d5c16f7c8a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.247795 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b2f576afb084987be171167a62883bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.250615 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 4fece5e3c8714b6eaac71078e938727f (DEFAULT_TABLE table=default.Table_b8365464a8654203a285a8036593fa40 [id=b313f1ab77ac42f9b143918359dab155]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.251097 9895 tablet_service.cc:1511] Processing CreateTablet for tablet fd92028cb8c849d4b121cec3775cbe62 (DEFAULT_TABLE table=default.Table_744b0ef1592749908ad53111cb98fa1c [id=d67aa0559aef4a7491fa25286797430c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.251497 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 60d8ba917fe644e18279eaef8088ec63 (DEFAULT_TABLE table=default.Table_bb58c03ab3af444b99cd4fa12a0482cd [id=1c808a1746b2421d967d6041bb12f8ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.251860 9908 tablet_service.cc:1511] Processing CreateTablet for tablet cf1a85faabf4403096a37034ae6ea2e4 (DEFAULT_TABLE table=default.Table_0bf175363efe4e62a23cf86713325670 [id=467ef19db44142d5a56bfeb5e534875e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.252313 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2de6c377720f4c89a6fb761cad0efa2f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:06.252600 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fece5e3c8714b6eaac71078e938727f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:06.253013 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2de6c377720f4c89a6fb761cad0efa2f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:06.255996 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_060004eaa4fb4077ace7321f74ecb48a" } new_table_name: "default.Table_24f01441a6eb478e88b5144c56003edb" modify_external_catalogs: true
I20260810 19:48:06.257542 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_527eab54be8245589580b409f997f44c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:06.258184 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_527eab54be8245589580b409f997f44c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:06.259477 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3fa3d0ea397e42ee85937bb679ac16e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:06.260000 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fa3d0ea397e42ee85937bb679ac16e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:06.262562 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1a85faabf4403096a37034ae6ea2e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.265727 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2d55b7a83d4d4faeb63acf0fd1c205b7" } modify_external_catalogs: true
I20260810 19:48:06.265969 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2d55b7a83d4d4faeb63acf0fd1c205b7" } modify_external_catalogs: true
I20260810 19:48:06.266593 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d8ba917fe644e18279eaef8088ec63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.269088 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410855f236004ad4b78839eb1c0c2f1f" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:06.270586 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd92028cb8c849d4b121cec3775cbe62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.282646 10375 ts_tablet_manager.cc:1950] T 3b6187dbe1ca42f79bf3eddd5475b929 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:06.283749 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 752) took 1435 ms. Trace:
I20260810 19:48:06.283861 10375 rpcz_store.cc:276] 0810 19:48:04.847987 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.853123 (+ 5136us) service_pool.cc:224] Handling call
0810 19:48:06.184361 (+1331238us) ts_tablet_manager.cc:1151] Deleting tablet 3b6187dbe1ca42f79bf3eddd5475b929
0810 19:48:06.184369 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.205138 (+ 20769us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.231931 (+ 26793us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.283704 (+ 51773us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1330985}
I20260810 19:48:06.286527 10375 tablet_replica.cc:333] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:06.286791 10375 raft_consensus.cc:2243] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:06.287143 10375 pending_rounds.cc:70] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:06.287184 10375 pending_rounds.cc:77] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058701555458048 op_type: NO_OP noop_request { }
I20260810 19:48:06.287308 10375 raft_consensus.cc:2889] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:06.287391 10375 raft_consensus.cc:2272] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:06.288048 10375 ts_tablet_manager.cc:1916] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:06.291483 10068 leader_election.cc:304] T 410855f236004ad4b78839eb1c0c2f1f P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:06.292546 10153 raft_consensus.cc:3060] T 320e42f6de6c4452adb7bbb379a156e6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:06.295780 12106 raft_consensus.cc:2749] T 410855f236004ad4b78839eb1c0c2f1f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:06.320030 11897 raft_consensus.cc:493] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.320204 11897 raft_consensus.cc:515] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.320351 11828 raft_consensus.cc:493] T 965395b5072e4d47adac504e22a8d484 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.320519 11828 raft_consensus.cc:515] T 965395b5072e4d47adac504e22a8d484 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.320876 11897 leader_election.cc:290] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:06.321352 11828 leader_election.cc:290] T 965395b5072e4d47adac504e22a8d484 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:06.322569 9831 leader_election.cc:343] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: ae3e151180ae4d258d18365770acaaad
W20260810 19:48:06.322700 10067 leader_election.cc:343] T 965395b5072e4d47adac504e22a8d484 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 965395b5072e4d47adac504e22a8d484
I20260810 19:48:06.324340 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3e151180ae4d258d18365770acaaad" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:06.325959 9830 leader_election.cc:343] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.326121 9830 leader_election.cc:304] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:48:06.326151 10068 leader_election.cc:343] T 965395b5072e4d47adac504e22a8d484 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 965395b5072e4d47adac504e22a8d484
I20260810 19:48:06.326377 10068 leader_election.cc:304] T 965395b5072e4d47adac504e22a8d484 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:06.326781 11897 raft_consensus.cc:2749] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:06.327142 11828 raft_consensus.cc:2749] T 965395b5072e4d47adac504e22a8d484 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:06.328243 12402 tablet.cc:1724] T 320e42f6de6c4452adb7bbb379a156e6 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:06.330389 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 3b6187dbe1ca42f79bf3eddd5475b929 (table default.Table_df0d4b51d323454e8afa1c87c993a1ed [id=ecadc549b3444735b6972f914f5b4e2d]) successfully deleted
I20260810 19:48:06.334573 12313 raft_consensus.cc:493] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.334735 12313 raft_consensus.cc:515] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.335394 12313 leader_election.cc:290] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:06.336143 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b40fd0d57ea4b71aeef2d66f4958ac8" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:06.336833 9611 leader_election.cc:343] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.336742 11897 raft_consensus.cc:493] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.337073 11897 raft_consensus.cc:515] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.338093 11897 leader_election.cc:290] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:06.338487 9831 leader_election.cc:343] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 2b2b20dc77954af7a203f357c746be29
I20260810 19:48:06.343362 10367 tablet_bootstrap.cc:492] T 82c3f619c76e40c583bfcdf2bb77fe42 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:06.343501 10367 ts_tablet_manager.cc:1403] T 82c3f619c76e40c583bfcdf2bb77fe42 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.149s user 0.029s sys 0.034s
I20260810 19:48:06.343803 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 883bf419763f4dcfab870fea49137eff (DEFAULT_TABLE table=default.Table_4b3474ab5fac40a28a050d69fc60bfe5 [id=495386acd3524a388b83e38f07bf9967]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.344246 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 883bf419763f4dcfab870fea49137eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.344368 10367 raft_consensus.cc:359] T 82c3f619c76e40c583bfcdf2bb77fe42 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.344534 10367 raft_consensus.cc:385] T 82c3f619c76e40c583bfcdf2bb77fe42 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:06.344591 10367 raft_consensus.cc:740] T 82c3f619c76e40c583bfcdf2bb77fe42 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:06.344848 10367 consensus_queue.cc:260] T 82c3f619c76e40c583bfcdf2bb77fe42 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.347128 10115 tablet_service.cc:1511] Processing CreateTablet for tablet 883bf419763f4dcfab870fea49137eff (DEFAULT_TABLE table=default.Table_4b3474ab5fac40a28a050d69fc60bfe5 [id=495386acd3524a388b83e38f07bf9967]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.347361 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 89486e79019a4ea49066231ee761089f (DEFAULT_TABLE table=default.Table_908340b735984b7db22ce5c7ce794987 [id=0d3094b81a0c42e18ecc3b1e3bee1494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.350546 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89486e79019a4ea49066231ee761089f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.351902 10367 ts_tablet_manager.cc:1434] T 82c3f619c76e40c583bfcdf2bb77fe42 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260810 19:48:06.352203 10367 tablet_bootstrap.cc:492] T 60bd14fb8c2e40dc955352518d463ccb P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:06.353888 10367 tablet_bootstrap.cc:654] T 60bd14fb8c2e40dc955352518d463ccb P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:06.356375 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 883bf419763f4dcfab870fea49137eff (DEFAULT_TABLE table=default.Table_4b3474ab5fac40a28a050d69fc60bfe5 [id=495386acd3524a388b83e38f07bf9967]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.356941 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 883bf419763f4dcfab870fea49137eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.357699 10375 ts_tablet_manager.cc:1929] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:06.357846 10375 log.cc:1199] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/9fb544dff4eb4642b7e282657ae15d19
I20260810 19:48:06.358259 10375 ts_tablet_manager.cc:1950] T 9fb544dff4eb4642b7e282657ae15d19 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:06.363370 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 883bf419763f4dcfab870fea49137eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.367671 9896 tablet_service.cc:1511] Processing CreateTablet for tablet da807b279a8e47f3a7bb7b773c04b558 (DEFAULT_TABLE table=default.Table_f0a4eda8c4a944db84e6b258924f1494 [id=b0c7c3c248654cfe82bee070f067fbe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.369024 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da807b279a8e47f3a7bb7b773c04b558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.370770 9658 tablet_service.cc:1511] Processing CreateTablet for tablet da807b279a8e47f3a7bb7b773c04b558 (DEFAULT_TABLE table=default.Table_f0a4eda8c4a944db84e6b258924f1494 [id=b0c7c3c248654cfe82bee070f067fbe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.371426 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da807b279a8e47f3a7bb7b773c04b558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.377104 10137 tablet_service.cc:1511] Processing CreateTablet for tablet da807b279a8e47f3a7bb7b773c04b558 (DEFAULT_TABLE table=default.Table_f0a4eda8c4a944db84e6b258924f1494 [id=b0c7c3c248654cfe82bee070f067fbe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.378443 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da807b279a8e47f3a7bb7b773c04b558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.379132 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 89486e79019a4ea49066231ee761089f (DEFAULT_TABLE table=default.Table_908340b735984b7db22ce5c7ce794987 [id=0d3094b81a0c42e18ecc3b1e3bee1494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.381229 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89486e79019a4ea49066231ee761089f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.383375 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b40fd0d57ea4b71aeef2d66f4958ac8" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:06.385066 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 841f58b4e8f7465eaa7fa08629e0bc2a
I20260810 19:48:06.385648 9418 catalog_manager.cc:6807] ReplaceTablet: tablet 841f58b4e8f7465eaa7fa08629e0bc2a deleted and replaced by tablet 1a615a32f94949179de8e8ee8a444576
I20260810 19:48:06.386340 9418 master_service.cc:960] ReplaceTablet: received request to replace tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:06.387710 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet 841f58b4e8f7465eaa7fa08629e0bc2a with delete_type TABLET_DATA_DELETED (replaced by tablet 1a615a32f94949179de8e8ee8a444576) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:06.388375 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 841f58b4e8f7465eaa7fa08629e0bc2a with delete_type TABLET_DATA_DELETED (replaced by tablet 1a615a32f94949179de8e8ee8a444576) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:06.388908 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 841f58b4e8f7465eaa7fa08629e0bc2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 841f58b4e8f7465eaa7fa08629e0bc2a already in progress: creating tablet
W20260810 19:48:06.382423 9830 consensus_peers.cc:597] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:06.390435 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 841f58b4e8f7465eaa7fa08629e0bc2a with delete_type TABLET_DATA_DELETED (replaced by tablet 1a615a32f94949179de8e8ee8a444576) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:06.380692 10366 tablet_bootstrap.cc:492] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:06.390834 10366 ts_tablet_manager.cc:1403] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.233s user 0.001s sys 0.009s
I20260810 19:48:06.393854 10366 raft_consensus.cc:359] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.395550 10367 tablet_bootstrap.cc:492] T 60bd14fb8c2e40dc955352518d463ccb P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:06.395687 10367 ts_tablet_manager.cc:1403] T 60bd14fb8c2e40dc955352518d463ccb P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.044s user 0.008s sys 0.003s
I20260810 19:48:06.396425 10367 raft_consensus.cc:359] T 60bd14fb8c2e40dc955352518d463ccb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.396589 10367 raft_consensus.cc:385] T 60bd14fb8c2e40dc955352518d463ccb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:06.396646 10367 raft_consensus.cc:740] T 60bd14fb8c2e40dc955352518d463ccb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:06.396852 10367 consensus_queue.cc:260] T 60bd14fb8c2e40dc955352518d463ccb P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.397332 10367 ts_tablet_manager.cc:1434] T 60bd14fb8c2e40dc955352518d463ccb P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:06.399488 9413 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 639c824ba4834734a4ebfd558181bebe (table default.Table_35ada13f5f5a41b0a93a57276b7756d9 [id=fa3844f34a5b4d55b6e87ec2164eb8fb]). Expected version 2 got 0
I20260810 19:48:06.399699 9413 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet e68916e2568f4527a181342cdc728001 (table default.Table_3e7715bf0f8c41e3bd4964a0f918c9ea [id=3babf53bc29e4d4f9be8b2c19be6e2bd]). Expected version 2 got 0
I20260810 19:48:06.401332 9407 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_b059137abb0e458bbadca41a2f2e8b50 [id=9eaa5e14e854425e8971160c64ee97cf] alter complete (version 1)
I20260810 19:48:06.401413 10367 tablet_bootstrap.cc:492] T ca733de7babe4343ab26dbca2c9020b2 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
W20260810 19:48:06.401975 9407 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.8.235.195:32931 (request call id 112) took 847 ms (client timeout 1000 ms). Trace:
W20260810 19:48:06.402108 9407 rpcz_store.cc:269] 0810 19:48:05.554282 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.611170 (+ 56888us) service_pool.cc:224] Handling call
0810 19:48:06.401910 (+790740us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:48:05.873259 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 19:48:05.873379 (+ 120us) write_op.cc:432] Acquiring schema lock in shared mode
0810 19:48:05.873385 (+ 6us) write_op.cc:435] Acquired schema lock
0810 19:48:05.873388 (+ 3us) tablet.cc:662] Decoding operations
0810 19:48:05.873505 (+ 117us) write_op.cc:620] Acquiring the partition lock for write op
0810 19:48:05.873515 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0810 19:48:05.873520 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0810 19:48:05.873591 (+ 71us) tablet.cc:701] Row locks acquired
0810 19:48:05.873593 (+ 2us) write_op.cc:260] PREPARE: finished
0810 19:48:05.873637 (+ 44us) write_op.cc:270] Start()
0810 19:48:05.873675 (+ 38us) write_op.cc:276] Timestamp: P: 1786391285873586 usec, L: 0
0810 19:48:05.873680 (+ 5us) op_driver.cc:348] REPLICATION: starting
0810 19:48:05.873911 (+ 231us) log.cc:844] Serialized 356 byte log entry
0810 19:48:05.884172 (+ 10261us) op_driver.cc:464] REPLICATION: finished
0810 19:48:05.885047 (+ 875us) write_op.cc:301] APPLY: starting
0810 19:48:05.885067 (+ 20us) tablet.cc:1367] starting BulkCheckPresence
0810 19:48:05.885112 (+ 45us) tablet.cc:1370] finished BulkCheckPresence
0810 19:48:05.885149 (+ 37us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 19:48:05.885212 (+ 63us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 19:48:05.885245 (+ 33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 19:48:05.885253 (+ 8us) write_op.cc:312] APPLY: finished
0810 19:48:05.885331 (+ 78us) log.cc:844] Serialized 23 byte log entry
0810 19:48:05.885383 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:05.885404 (+ 21us) write_op.cc:454] Released schema lock
0810 19:48:05.885411 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 19:48:05.892920 (+ 7509us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:05.892929 (+ 9us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":806,"apply.run_cpu_time_us":441,"apply.run_wall_time_us":441,"num_ops":1,"prepare.queue_time_us":258150,"prepare.run_cpu_time_us":828,"prepare.run_wall_time_us":19656,"raft.queue_time_us":51,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":129,"replication_time_us":10457}]]}
I20260810 19:48:06.403198 10367 tablet_bootstrap.cc:654] T ca733de7babe4343ab26dbca2c9020b2 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:06.405651 12106 raft_consensus.cc:493] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.406019 12106 raft_consensus.cc:515] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.406780 12106 leader_election.cc:290] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:06.406924 12106 raft_consensus.cc:493] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.407027 12106 raft_consensus.cc:515] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.413338 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 89486e79019a4ea49066231ee761089f (DEFAULT_TABLE table=default.Table_908340b735984b7db22ce5c7ce794987 [id=0d3094b81a0c42e18ecc3b1e3bee1494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.413924 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89486e79019a4ea49066231ee761089f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.418741 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet dfea147ef3904ab49375def065c6f328 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:53 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:06.420446 12106 leader_election.cc:290] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:06.421514 10367 tablet_bootstrap.cc:492] T ca733de7babe4343ab26dbca2c9020b2 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:06.421772 10367 ts_tablet_manager.cc:1403] T ca733de7babe4343ab26dbca2c9020b2 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.005s
I20260810 19:48:06.422719 10367 raft_consensus.cc:359] T ca733de7babe4343ab26dbca2c9020b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.423026 10367 raft_consensus.cc:385] T ca733de7babe4343ab26dbca2c9020b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:06.423141 10367 raft_consensus.cc:740] T ca733de7babe4343ab26dbca2c9020b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:06.423434 10367 consensus_queue.cc:260] T ca733de7babe4343ab26dbca2c9020b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.425132 10153 raft_consensus.cc:3060] T d77785d9bde843bc8366fe15d1b4fa18 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:06.431380 10367 ts_tablet_manager.cc:1434] T ca733de7babe4343ab26dbca2c9020b2 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.009s user 0.004s sys 0.000s
I20260810 19:48:06.431550 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2b20dc77954af7a203f357c746be29" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:06.433349 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 648ef608fa0c45cc8be4bad80c4200be
I20260810 19:48:06.438164 9420 catalog_manager.cc:6807] ReplaceTablet: tablet 648ef608fa0c45cc8be4bad80c4200be deleted and replaced by tablet 67d02a8eea444f3383f14a1e1f0e236b
I20260810 19:48:06.440579 10367 tablet_bootstrap.cc:492] T 31c2b9a4b8334e678b4632fc2f58dd0c P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:06.443867 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 648ef608fa0c45cc8be4bad80c4200be with delete_type TABLET_DATA_DELETED (replaced by tablet 67d02a8eea444f3383f14a1e1f0e236b) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:06.444550 12266 tablet_replica.cc:333] T 648ef608fa0c45cc8be4bad80c4200be P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:06.444782 12266 raft_consensus.cc:2243] T 648ef608fa0c45cc8be4bad80c4200be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:06.444940 12266 raft_consensus.cc:2272] T 648ef608fa0c45cc8be4bad80c4200be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:06.445468 12266 ts_tablet_manager.cc:1916] T 648ef608fa0c45cc8be4bad80c4200be P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:06.445755 10367 tablet_bootstrap.cc:654] T 31c2b9a4b8334e678b4632fc2f58dd0c P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:06.449594 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 753) took 1601 ms. Trace:
I20260810 19:48:06.449707 10375 rpcz_store.cc:276] 0810 19:48:04.848118 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.853436 (+ 5318us) service_pool.cc:224] Handling call
0810 19:48:06.286449 (+1433013us) ts_tablet_manager.cc:1151] Deleting tablet 9fb544dff4eb4642b7e282657ae15d19
0810 19:48:06.286465 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.321028 (+ 34563us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.357621 (+ 36593us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.449568 (+ 91947us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1432838}
I20260810 19:48:06.450173 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 762) took 1322 ms. Trace:
I20260810 19:48:06.450249 10375 rpcz_store.cc:276] 0810 19:48:05.127655 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.128197 (+ 542us) service_pool.cc:224] Handling call
0810 19:48:06.450023 (+1321826us) ts_tablet_manager.cc:1151] Deleting tablet e09365db984f41b49197891b332ebd87
0810 19:48:06.450034 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.450154 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1321598}
I20260810 19:48:06.450652 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 766) took 1322 ms. Trace:
I20260810 19:48:06.450719 10375 rpcz_store.cc:276] 0810 19:48:05.128115 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.128486 (+ 371us) service_pool.cc:224] Handling call
0810 19:48:06.450528 (+1322042us) ts_tablet_manager.cc:1151] Deleting tablet 99aa001db52149dd90ce86e7261f7424
0810 19:48:06.450539 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.450636 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1321879}
I20260810 19:48:06.451040 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 763) took 1323 ms. Trace:
I20260810 19:48:06.451099 10375 rpcz_store.cc:276] 0810 19:48:05.127760 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.128670 (+ 910us) service_pool.cc:224] Handling call
0810 19:48:06.450940 (+1322270us) ts_tablet_manager.cc:1151] Deleting tablet 263a5695e7754b44a64edbda27b42135
0810 19:48:06.450949 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.451026 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1322143}
I20260810 19:48:06.451385 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 765) took 1323 ms. Trace:
I20260810 19:48:06.451437 10375 rpcz_store.cc:276] 0810 19:48:05.127998 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.128835 (+ 837us) service_pool.cc:224] Handling call
0810 19:48:06.451294 (+1322459us) ts_tablet_manager.cc:1151] Deleting tablet ac17aa6447f547a9b9a44449b283bb69
0810 19:48:06.451302 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.451371 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1322293}
I20260810 19:48:06.451752 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 764) took 1323 ms. Trace:
I20260810 19:48:06.451819 10375 rpcz_store.cc:276] 0810 19:48:05.127906 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.128460 (+ 554us) service_pool.cc:224] Handling call
0810 19:48:06.451638 (+1323178us) ts_tablet_manager.cc:1151] Deleting tablet 1bbd3fe2117c42058dc108b5dc18d560
0810 19:48:06.451647 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.451723 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1322354}
I20260810 19:48:06.452131 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 761) took 1324 ms. Trace:
I20260810 19:48:06.452189 10375 rpcz_store.cc:276] 0810 19:48:05.127534 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.128455 (+ 921us) service_pool.cc:224] Handling call
0810 19:48:06.452032 (+1323577us) ts_tablet_manager.cc:1151] Deleting tablet 5f4e2adee0264e418ff8c54912973e60
0810 19:48:06.452040 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.452113 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":665,"tablet-delete.queue_time_us":1323377}
I20260810 19:48:06.452459 10375 tablet_replica.cc:333] T 3c828ae089774fb9b0582141f4b99313 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:06.452534 10367 tablet_bootstrap.cc:492] T 31c2b9a4b8334e678b4632fc2f58dd0c P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:06.452644 10375 raft_consensus.cc:2243] T 3c828ae089774fb9b0582141f4b99313 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:06.452672 10367 ts_tablet_manager.cc:1403] T 31c2b9a4b8334e678b4632fc2f58dd0c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.004s
I20260810 19:48:06.452818 10375 raft_consensus.cc:2272] T 3c828ae089774fb9b0582141f4b99313 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:06.453357 10375 ts_tablet_manager.cc:1916] T 3c828ae089774fb9b0582141f4b99313 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:06.453509 10367 raft_consensus.cc:359] T 31c2b9a4b8334e678b4632fc2f58dd0c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.453696 10367 raft_consensus.cc:385] T 31c2b9a4b8334e678b4632fc2f58dd0c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:06.453750 10367 raft_consensus.cc:740] T 31c2b9a4b8334e678b4632fc2f58dd0c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:06.453936 10367 consensus_queue.cc:260] T 31c2b9a4b8334e678b4632fc2f58dd0c P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.454571 10367 ts_tablet_manager.cc:1434] T 31c2b9a4b8334e678b4632fc2f58dd0c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260810 19:48:06.454859 10367 tablet_bootstrap.cc:492] T d6f410a1659c40f08ac274e63ad01b3d P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:06.456689 10367 tablet_bootstrap.cc:654] T d6f410a1659c40f08ac274e63ad01b3d P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:06.458923 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fb7364664adb424384f6b646d9e423eb consensus state has no leader
I20260810 19:48:06.459331 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet 08ac9ae9eceb42b3880c4f35556994c7 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:06.459714 12266 ts_tablet_manager.cc:1929] T 648ef608fa0c45cc8be4bad80c4200be P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:06.462414 12266 log.cc:1199] T 648ef608fa0c45cc8be4bad80c4200be P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/648ef608fa0c45cc8be4bad80c4200be
I20260810 19:48:06.462857 12266 ts_tablet_manager.cc:1950] T 648ef608fa0c45cc8be4bad80c4200be P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:06.463709 10367 tablet_bootstrap.cc:492] T d6f410a1659c40f08ac274e63ad01b3d P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:06.463692 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 648ef608fa0c45cc8be4bad80c4200be (table default.Table_63c36107140a41da9c5d337a853cb5d3 [id=d921f4a824ae4dd6b0b9dbb8310ff00a]) successfully deleted
I20260810 19:48:06.463853 10367 ts_tablet_manager.cc:1403] T d6f410a1659c40f08ac274e63ad01b3d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260810 19:48:06.464656 10367 raft_consensus.cc:359] T d6f410a1659c40f08ac274e63ad01b3d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.464847 10367 raft_consensus.cc:385] T d6f410a1659c40f08ac274e63ad01b3d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:06.464905 10367 raft_consensus.cc:740] T d6f410a1659c40f08ac274e63ad01b3d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:06.465229 10367 consensus_queue.cc:260] T d6f410a1659c40f08ac274e63ad01b3d P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.465852 10367 ts_tablet_manager.cc:1434] T d6f410a1659c40f08ac274e63ad01b3d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:06.466153 10367 tablet_bootstrap.cc:492] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:06.467633 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 27aca44685be4a0b92767d13bad15daf
I20260810 19:48:06.469260 10375 ts_tablet_manager.cc:1929] T 3c828ae089774fb9b0582141f4b99313 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:06.408174 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8a23221e8447bd83592c05c9d1149c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:06.469872 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 27aca44685be4a0b92767d13bad15daf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:06.421198 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f30148b5c84f7cbdfabd0186611cc4" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:06.470289 9945 raft_consensus.cc:2468] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:06.470993 10367 tablet_bootstrap.cc:654] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:06.471387 10366 raft_consensus.cc:385] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:06.471524 10366 raft_consensus.cc:740] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:06.471884 10366 consensus_queue.cc:260] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.472541 10366 ts_tablet_manager.cc:1434] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.080s user 0.001s sys 0.001s
I20260810 19:48:06.424054 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dd49d6fa79e4677b753b6cf9117b02d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:06.426815 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 21208dd824fe432fa307cbb88d37aaa2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:06.428885 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet 476e762e46c04ae6bfef5e14df2d16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:06.464525 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 00fe7d9a548a487d965d92b53cdf9250 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ed73161398f4f54a20a9173c18b4d3c) from {username='slave'} at 127.0.0.1:38276
W20260810 19:48:06.473577 9830 leader_election.cc:343] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.473789 9830 leader_election.cc:304] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:06.421420 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet da3d8ade850c4d36bd2756c36706195d with delete_type TABLET_DATA_DELETED (replaced by tablet 87bbcc651d034e2a826478b805792e48) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:06.474681 12313 raft_consensus.cc:493] T 15c070c23de34348ad3426c894e11022 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.474835 12313 raft_consensus.cc:515] T 15c070c23de34348ad3426c894e11022 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.474932 12338 raft_consensus.cc:2749] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:06.475461 12313 leader_election.cc:290] T 15c070c23de34348ad3426c894e11022 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:06.467258 9611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 77479.8us
I20260810 19:48:06.477327 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 971e9abee86444a7a9e923b0962ae751 with delete_type TABLET_DATA_DELETED (replaced by tablet d0f9a22f81894a829fcb350001fc532b) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:06.480646 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3b8970ea8dcf44efa5779c1ce574f779" } modify_external_catalogs: true
I20260810 19:48:06.480743 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 0d1429cc977047c7b3c06eae00d21fa5 (DEFAULT_TABLE table=default.Table_63a8ea5b28c34cf8bdb6a1588dc3fcb8 [id=a70ea2120f0f4521a6aea2187d6187d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.480906 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3b8970ea8dcf44efa5779c1ce574f779" } modify_external_catalogs: true
I20260810 19:48:06.481176 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d1429cc977047c7b3c06eae00d21fa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.482563 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8a06d915fdaa4924b0d1a8f2284e9a05" } modify_external_catalogs: true
I20260810 19:48:06.482790 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8a06d915fdaa4924b0d1a8f2284e9a05" } modify_external_catalogs: true
I20260810 19:48:06.482944 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b619c177222648b880c95d285975c0c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:06.483520 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b619c177222648b880c95d285975c0c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:06.485572 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e6007d18986c4545bd6fdce7b12dc200" } new_table_name: "default.Table_4edc097371b64a4fae34a38e21ee61c0" modify_external_catalogs: true
I20260810 19:48:06.487083 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_52a19c74f223463fa626772f18c826bd" } new_table_name: "default.Table_5a3f6c9b86e34bb78b562d25e72f43ab" modify_external_catalogs: true
I20260810 19:48:06.488449 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0ce62d56d03f4f9aa5441e1150e8fc6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:06.489065 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ce62d56d03f4f9aa5441e1150e8fc6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:06.491430 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_19afc4f535124fd2bfe0e8a019a8a86e" } modify_external_catalogs: true
I20260810 19:48:06.491607 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_19afc4f535124fd2bfe0e8a019a8a86e" } modify_external_catalogs: true
I20260810 19:48:06.494886 10367 tablet_bootstrap.cc:492] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:06.495054 10367 ts_tablet_manager.cc:1403] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.029s user 0.007s sys 0.000s
I20260810 19:48:06.496007 10367 raft_consensus.cc:359] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.496182 10367 raft_consensus.cc:385] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:06.496230 10367 raft_consensus.cc:740] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:06.496435 10367 consensus_queue.cc:260] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.496677 12087 raft_consensus.cc:493] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.496840 12087 raft_consensus.cc:515] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.496948 10367 ts_tablet_manager.cc:1434] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:06.497311 10367 tablet_bootstrap.cc:492] T 827dce05c192467589e2692fabd2a84e P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:06.497511 12087 leader_election.cc:290] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:06.498994 9831 leader_election.cc:343] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 8455cb11388340beb6daa13fee06177a
I20260810 19:48:06.499245 10367 tablet_bootstrap.cc:654] T 827dce05c192467589e2692fabd2a84e P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:06.500757 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 648ef608fa0c45cc8be4bad80c4200be with delete_type TABLET_DATA_DELETED (replaced by tablet 67d02a8eea444f3383f14a1e1f0e236b) from {username='slave'} at 127.0.0.1:38276
W20260810 19:48:06.502774 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 27aca44685be4a0b92767d13bad15daf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 27aca44685be4a0b92767d13bad15daf already in progress: creating tablet
I20260810 19:48:06.505539 12430 tablet.cc:1724] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:06.471187 10067 leader_election.cc:304] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:06.513024 10375 log.cc:1199] T 3c828ae089774fb9b0582141f4b99313 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/3c828ae089774fb9b0582141f4b99313
I20260810 19:48:06.513411 10375 ts_tablet_manager.cc:1950] T 3c828ae089774fb9b0582141f4b99313 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:06.513433 11828 raft_consensus.cc:2804] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:06.513525 11828 raft_consensus.cc:493] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:06.513581 11828 raft_consensus.cc:3060] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:06.475786 12106 raft_consensus.cc:493] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.513974 12106 raft_consensus.cc:515] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.514681 12106 leader_election.cc:290] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:06.500916 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c070c23de34348ad3426c894e11022" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:06.501349 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8455cb11388340beb6daa13fee06177a" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:06.504021 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 648ef608fa0c45cc8be4bad80c4200be with delete_type TABLET_DATA_DELETED (replaced by tablet 67d02a8eea444f3383f14a1e1f0e236b) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:06.503618 9611 leader_election.cc:343] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.516625 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 0d1429cc977047c7b3c06eae00d21fa5 (DEFAULT_TABLE table=default.Table_63a8ea5b28c34cf8bdb6a1588dc3fcb8 [id=a70ea2120f0f4521a6aea2187d6187d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.517068 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d1429cc977047c7b3c06eae00d21fa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.516309 9611 leader_election.cc:304] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:06.517863 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 27aca44685be4a0b92767d13bad15daf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:06.519011 12407 raft_consensus.cc:2749] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:06.518972 12433 tablet.cc:1724] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:06.520130 12430 tablet.cc:1724] T 204ef31f396a43a5bf06205560f987c9 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:06.521293 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 0d1429cc977047c7b3c06eae00d21fa5 (DEFAULT_TABLE table=default.Table_63a8ea5b28c34cf8bdb6a1588dc3fcb8 [id=a70ea2120f0f4521a6aea2187d6187d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:06.521770 10139 tablet_service.cc:1558] Processing DeleteTablet for tablet 27aca44685be4a0b92767d13bad15daf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:06.523557 9413 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_d53c7e2836b143eab54246ed5e0de77e [id=5354f5d091794b14806dd9bc872da0ae] alter complete (version 1)
I20260810 19:48:06.528294 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 767) took 1120 ms. Trace:
I20260810 19:48:06.528402 10375 rpcz_store.cc:276] 0810 19:48:05.408184 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.408237 (+ 53us) service_pool.cc:224] Handling call
0810 19:48:06.452418 (+1044181us) ts_tablet_manager.cc:1151] Deleting tablet 3c828ae089774fb9b0582141f4b99313
0810 19:48:06.452426 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.461243 (+ 8817us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.469191 (+ 7948us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.528265 (+ 59074us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1043930}
I20260810 19:48:06.528782 10375 tablet_replica.cc:333] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:06.528960 10375 raft_consensus.cc:2243] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:06.529125 10375 raft_consensus.cc:2272] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:06.529665 10375 ts_tablet_manager.cc:1916] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:06.530575 12097 log.cc:927] Time spent T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e: Append to log took a long time: real 0.087s user 0.001s sys 0.000s
I20260810 19:48:06.519667 12428 tablet.cc:1724] T 204ef31f396a43a5bf06205560f987c9 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:06.530364 9791 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:48:06.530525 12407 raft_consensus.cc:493] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.532006 12407 raft_consensus.cc:515] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.532814 12407 leader_election.cc:290] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:06.534405 11828 raft_consensus.cc:515] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.535579 11828 leader_election.cc:290] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:06.537895 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c070c23de34348ad3426c894e11022" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:06.538105 10366 tablet_bootstrap.cc:492] T 4dba7046bdfd41f1a2ad6f299a723776 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:06.538139 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f30148b5c84f7cbdfabd0186611cc4" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:06.538305 9939 raft_consensus.cc:3060] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:06.506436 10370 tablet_bootstrap.cc:492] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:06.539763 9941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd49d6fa79e4677b753b6cf9117b02d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:06.539933 9941 raft_consensus.cc:2468] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:06.539949 10370 ts_tablet_manager.cc:1403] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.362s user 0.004s sys 0.000s
I20260810 19:48:06.540293 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d1429cc977047c7b3c06eae00d21fa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:06.540818 10370 raft_consensus.cc:359] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.540988 10370 raft_consensus.cc:385] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:06.541047 10370 raft_consensus.cc:740] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
W20260810 19:48:06.541442 10068 leader_election.cc:343] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: b5f30148b5c84f7cbdfabd0186611cc4
I20260810 19:48:06.541698 9939 raft_consensus.cc:2468] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
W20260810 19:48:06.542089 10068 leader_election.cc:343] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 9e8a23221e8447bd83592c05c9d1149c
I20260810 19:48:06.542173 10067 leader_election.cc:304] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:06.542441 11828 raft_consensus.cc:2804] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:06.542510 11828 raft_consensus.cc:493] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:06.542500 10067 leader_election.cc:304] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:06.542605 11828 raft_consensus.cc:3060] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:06.542708 12106 raft_consensus.cc:2804] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:06.545450 11828 raft_consensus.cc:515] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.546746 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd49d6fa79e4677b753b6cf9117b02d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:06.546911 9939 raft_consensus.cc:3060] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:06.548538 9941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3840b035b88243ecad17865d4716fcfc" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:06.549525 9939 raft_consensus.cc:2468] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:06.531021 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 9fb544dff4eb4642b7e282657ae15d19 (table default.Table_e60e43b61eba457e8a4e7cd6543b7cc6 [id=d81c8e61cae4492fbd2681ab1ecdfe4f]) successfully deleted
I20260810 19:48:06.550397 10067 leader_election.cc:304] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:06.558423 11828 leader_election.cc:290] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:06.558754 11828 raft_consensus.cc:2804] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:06.558905 11828 raft_consensus.cc:697] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:06.559222 11828 consensus_queue.cc:237] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:06.560860 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet e09365db984f41b49197891b332ebd87 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e09365db984f41b49197891b332ebd87 already in progress: creating tablet
W20260810 19:48:06.561657 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 99aa001db52149dd90ce86e7261f7424 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99aa001db52149dd90ce86e7261f7424 already in progress: creating tablet
W20260810 19:48:06.562261 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 263a5695e7754b44a64edbda27b42135 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 263a5695e7754b44a64edbda27b42135 already in progress: creating tablet
W20260810 19:48:06.562860 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet ac17aa6447f547a9b9a44449b283bb69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac17aa6447f547a9b9a44449b283bb69 already in progress: creating tablet
W20260810 19:48:06.563481 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 1bbd3fe2117c42058dc108b5dc18d560 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1bbd3fe2117c42058dc108b5dc18d560 already in progress: creating tablet
W20260810 19:48:06.564179 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 5f4e2adee0264e418ff8c54912973e60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f4e2adee0264e418ff8c54912973e60 already in progress: creating tablet
W20260810 19:48:06.565173 9611 leader_election.cc:343] T 15c070c23de34348ad3426c894e11022 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:06.566001 9611 leader_election.cc:343] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.567469 10367 tablet_bootstrap.cc:492] T 827dce05c192467589e2692fabd2a84e P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:06.567667 10367 ts_tablet_manager.cc:1403] T 827dce05c192467589e2692fabd2a84e P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.070s user 0.008s sys 0.012s
I20260810 19:48:06.568560 10367 raft_consensus.cc:359] T 827dce05c192467589e2692fabd2a84e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.568831 10367 raft_consensus.cc:385] T 827dce05c192467589e2692fabd2a84e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:06.568946 10367 raft_consensus.cc:740] T 827dce05c192467589e2692fabd2a84e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:06.569212 10367 consensus_queue.cc:260] T 827dce05c192467589e2692fabd2a84e P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.569365 12407 raft_consensus.cc:493] T f85f3fa629764c79921a710739eea7ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.569607 12407 raft_consensus.cc:515] T f85f3fa629764c79921a710739eea7ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.570286 12407 leader_election.cc:290] T f85f3fa629764c79921a710739eea7ae P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:06.570410 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 49a73b0637664821bcb44ba463baac18
I20260810 19:48:06.570950 10367 ts_tablet_manager.cc:1434] T 827dce05c192467589e2692fabd2a84e P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 19:48:06.571247 10367 tablet_bootstrap.cc:492] T 19e2bf7b7d254894a07c5a75bf24e742 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:06.571440 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 49a73b0637664821bcb44ba463baac18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:06.572250 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 49a73b0637664821bcb44ba463baac18 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49a73b0637664821bcb44ba463baac18 already in progress: creating tablet
I20260810 19:48:06.576632 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 01df0725b38d4517b22df017b6c5e2e7
I20260810 19:48:06.577839 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 01df0725b38d4517b22df017b6c5e2e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:06.578927 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85f3fa629764c79921a710739eea7ae" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:06.579284 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 01df0725b38d4517b22df017b6c5e2e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01df0725b38d4517b22df017b6c5e2e7 already in progress: creating tablet
I20260810 19:48:06.579618 10367 tablet_bootstrap.cc:654] T 19e2bf7b7d254894a07c5a75bf24e742 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:06.581082 9611 leader_election.cc:343] T f85f3fa629764c79921a710739eea7ae P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.582701 10367 tablet_bootstrap.cc:492] T 19e2bf7b7d254894a07c5a75bf24e742 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:06.582852 10367 ts_tablet_manager.cc:1403] T 19e2bf7b7d254894a07c5a75bf24e742 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.002s
I20260810 19:48:06.583659 10367 raft_consensus.cc:359] T 19e2bf7b7d254894a07c5a75bf24e742 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.583838 10367 raft_consensus.cc:385] T 19e2bf7b7d254894a07c5a75bf24e742 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:06.583907 10367 raft_consensus.cc:740] T 19e2bf7b7d254894a07c5a75bf24e742 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:06.584161 10367 consensus_queue.cc:260] T 19e2bf7b7d254894a07c5a75bf24e742 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.584204 12106 raft_consensus.cc:697] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:06.584517 12106 consensus_queue.cc:237] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.584813 10367 ts_tablet_manager.cc:1434] T 19e2bf7b7d254894a07c5a75bf24e742 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:06.585104 10367 tablet_bootstrap.cc:492] T 8fadd6f84c75466287b318ed7018b071 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:06.586753 10367 tablet_bootstrap.cc:654] T 8fadd6f84c75466287b318ed7018b071 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:06.590504 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d
I20260810 19:48:06.591106 9418 catalog_manager.cc:6807] ReplaceTablet: tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d deleted and replaced by tablet 72d92f8b6565416c9da4e8d1ec7a6d50
I20260810 19:48:06.542207 10068 leader_election.cc:304] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:48:06.592414 10068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 50327.8us
W20260810 19:48:06.595533 9830 leader_election.cc:343] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.595690 9830 leader_election.cc:304] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:06.595943 12338 raft_consensus.cc:2749] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:06.596786 12435 raft_consensus.cc:2749] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:06.601517 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a66e86ff6248473885f90cb7a83a724d consensus state has no leader
I20260810 19:48:06.564682 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 3c828ae089774fb9b0582141f4b99313 (table default.Table_cc3aacf41a5e424687efa546af746ffa [id=56c4ed6bce3c4b88b8f47f0313355de1]) successfully deleted
I20260810 19:48:06.605545 10370 consensus_queue.cc:260] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.595346 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d with delete_type TABLET_DATA_DELETED (replaced by tablet 72d92f8b6565416c9da4e8d1ec7a6d50) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:06.598743 9611 leader_election.cc:343] T 15c070c23de34348ad3426c894e11022 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.606513 9611 leader_election.cc:304] T 15c070c23de34348ad3426c894e11022 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:06.606655 12266 tablet_replica.cc:333] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:06.606616 10139 tablet_service.cc:1558] Processing DeleteTablet for tablet 01df0725b38d4517b22df017b6c5e2e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:06.606850 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 49a73b0637664821bcb44ba463baac18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:06.606858 12266 raft_consensus.cc:2243] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:06.607013 12407 raft_consensus.cc:2749] T 15c070c23de34348ad3426c894e11022 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:06.607045 12266 raft_consensus.cc:2272] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:06.607208 10370 ts_tablet_manager.cc:1434] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.067s user 0.002s sys 0.000s
I20260810 19:48:06.607614 10370 tablet_bootstrap.cc:492] T 72b39babf851404c89adb317033015ec P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:06.607674 12266 ts_tablet_manager.cc:1916] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:06.609145 10370 tablet_bootstrap.cc:654] T 72b39babf851404c89adb317033015ec P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:06.612104 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 08ac9ae9eceb42b3880c4f35556994c7
I20260810 19:48:06.612386 10377 ts_tablet_manager.cc:1929] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:06.612809 9410 catalog_manager.cc:6807] ReplaceTablet: tablet 08ac9ae9eceb42b3880c4f35556994c7 deleted and replaced by tablet f146f440c1174d348ed273d29145e815
I20260810 19:48:06.613358 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 08ac9ae9eceb42b3880c4f35556994c7 with delete_type TABLET_DATA_DELETED (replaced by tablet f146f440c1174d348ed273d29145e815) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:06.614022 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8e8928f23c284477822d1f6308432dec consensus state has no leader
I20260810 19:48:06.615937 12266 ts_tablet_manager.cc:1929] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260810 19:48:06.616132 12266 log.cc:1199] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/9714a8a1eeaf41d2bb01d3fa3ff7181d
I20260810 19:48:06.616547 12266 ts_tablet_manager.cc:1950] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:06.617170 10375 ts_tablet_manager.cc:1929] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:06.618336 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d (table default.Table_c35ddec630d942db9ba85f10a2f405ee [id=fd840f00bdc5477aaad0b7fa114870dd]) successfully deleted
I20260810 19:48:06.618695 10375 log.cc:1199] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/4e80e2327c394612bffc51f38798dac3
I20260810 19:48:06.619092 10375 ts_tablet_manager.cc:1950] T 4e80e2327c394612bffc51f38798dac3 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:06.619560 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 2ac59875628e40ffb1385dedea2f3b9d
W20260810 19:48:06.619730 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 08ac9ae9eceb42b3880c4f35556994c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08ac9ae9eceb42b3880c4f35556994c7 already in progress: creating tablet
I20260810 19:48:06.620575 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ac59875628e40ffb1385dedea2f3b9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:06.620965 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 768) took 1210 ms. Trace:
I20260810 19:48:06.612672 10377 log.cc:1199] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/ebf33d82af9e494a8e85be8cba55d2c9
W20260810 19:48:06.621584 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 2ac59875628e40ffb1385dedea2f3b9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ac59875628e40ffb1385dedea2f3b9d already in progress: creating tablet
I20260810 19:48:06.621865 10375 rpcz_store.cc:276] 0810 19:48:05.410884 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.410958 (+ 74us) service_pool.cc:224] Handling call
0810 19:48:06.528720 (+1117762us) ts_tablet_manager.cc:1151] Deleting tablet 4e80e2327c394612bffc51f38798dac3
0810 19:48:06.528730 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.563147 (+ 34417us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.617091 (+ 53944us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.620945 (+ 3854us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1117561}
I20260810 19:48:06.622061 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 01df0725b38d4517b22df017b6c5e2e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:06.622160 10366 tablet_bootstrap.cc:654] T 4dba7046bdfd41f1a2ad6f299a723776 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:06.623368 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d with delete_type TABLET_DATA_DELETED (replaced by tablet 72d92f8b6565416c9da4e8d1ec7a6d50) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:06.624080 10367 tablet_bootstrap.cc:492] T 8fadd6f84c75466287b318ed7018b071 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:06.624305 10367 ts_tablet_manager.cc:1403] T 8fadd6f84c75466287b318ed7018b071 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.003s
I20260810 19:48:06.624333 10375 tablet_replica.cc:333] T 4b2b0f2fc93647f3bc1d79b4132c3703 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:06.624522 10375 raft_consensus.cc:2243] T 4b2b0f2fc93647f3bc1d79b4132c3703 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:06.624756 10375 raft_consensus.cc:2272] T 4b2b0f2fc93647f3bc1d79b4132c3703 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:06.625341 10375 ts_tablet_manager.cc:1916] T 4b2b0f2fc93647f3bc1d79b4132c3703 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:06.625078 10377 ts_tablet_manager.cc:1950] T ebf33d82af9e494a8e85be8cba55d2c9 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:06.625342 10367 raft_consensus.cc:359] T 8fadd6f84c75466287b318ed7018b071 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.625638 10367 raft_consensus.cc:385] T 8fadd6f84c75466287b318ed7018b071 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:06.625741 10367 raft_consensus.cc:740] T 8fadd6f84c75466287b318ed7018b071 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:06.626014 10367 consensus_queue.cc:260] T 8fadd6f84c75466287b318ed7018b071 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.626295 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d with delete_type TABLET_DATA_DELETED (replaced by tablet 72d92f8b6565416c9da4e8d1ec7a6d50) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:06.627767 12402 tablet.cc:1724] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:06.628783 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3609f114cc2e412dac61baf2f59e9307" } modify_external_catalogs: true
I20260810 19:48:06.629026 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3609f114cc2e412dac61baf2f59e9307" } modify_external_catalogs: true
I20260810 19:48:06.630595 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_80796e0b2a8c4bc69e7778f5c8625e71" } new_table_name: "default.Table_f8b2de930d9d40a3a41f9378594506d6" modify_external_catalogs: true
I20260810 19:48:06.631223 10367 ts_tablet_manager.cc:1434] T 8fadd6f84c75466287b318ed7018b071 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260810 19:48:06.631538 10367 tablet_bootstrap.cc:492] T ab27734e3d974260a77f1d94e5f534fe P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:06.632350 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1b436c9645b44aaaa1f939d9c544bdf3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:06.633028 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b436c9645b44aaaa1f939d9c544bdf3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:06.633368 10367 tablet_bootstrap.cc:654] T ab27734e3d974260a77f1d94e5f534fe P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:06.634337 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6c986245c9bc47b5a094b5f4fa6d1536" } new_table_name: "default.Table_e6a17a5139154e0c83acb8ffd2da9d5d" modify_external_catalogs: true
I20260810 19:48:06.635967 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c7237012cc364cdb979f78d0515aa38c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:06.636557 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7237012cc364cdb979f78d0515aa38c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:06.627576 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 49a73b0637664821bcb44ba463baac18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:06.637847 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_9d8436304429432aaa15c2dd270e9082"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:06.638499 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d8436304429432aaa15c2dd270e9082 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:06.639775 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c8ffb29225064887b4bedaef7c9e4d90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:06.640331 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8ffb29225064887b4bedaef7c9e4d90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:06.643692 10367 tablet_bootstrap.cc:492] T ab27734e3d974260a77f1d94e5f534fe P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:06.643846 10367 ts_tablet_manager.cc:1403] T ab27734e3d974260a77f1d94e5f534fe P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.001s
I20260810 19:48:06.644652 10367 raft_consensus.cc:359] T ab27734e3d974260a77f1d94e5f534fe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.644737 9408 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet bc753970b2464e38b03e377551276343 (table default.Table_87ca145e91d149a68ef630e3a29795b4 [id=fd9deda7275b423b9f9c85aa22dde728]). Expected version 2 got 0
I20260810 19:48:06.644829 10367 raft_consensus.cc:385] T ab27734e3d974260a77f1d94e5f534fe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:06.644874 10367 raft_consensus.cc:740] T ab27734e3d974260a77f1d94e5f534fe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:06.645025 9408 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 410855f236004ad4b78839eb1c0c2f1f (table default.Table_44478e93cffb460aaa8df9115b799594 [id=1d363ce63686462f9f4c15669773ee22]). Expected version 1 got 0
I20260810 19:48:06.645131 10367 consensus_queue.cc:260] T ab27734e3d974260a77f1d94e5f534fe P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.645533 9408 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet d77785d9bde843bc8366fe15d1b4fa18 (table default.Table_3e78e13c8ecc464eb6af12a2bc3f2eba [id=1af2d06c44b643e28d28bb080cd5eef8]). Expected version 2 got 0
I20260810 19:48:06.645781 9408 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 7d93fd6556b146ca8933a6dc0a2357e8 (table default.Table_908acdc21674469e937e4539876e0267 [id=de4d62ebb8c440a1a71ed57ac4f3c530]). Expected version 1 got 0
I20260810 19:48:06.645815 10367 ts_tablet_manager.cc:1434] T ab27734e3d974260a77f1d94e5f534fe P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:06.646003 9408 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 3e8ae48a2fb548358176abefe1ee3baa (table default.Table_9cb0cc2a8f724781a638706ddcc2c085 [id=12db110e89e04d40bdb05ec61fd5e3b6]). Expected version 1 got 0
I20260810 19:48:06.646104 10367 tablet_bootstrap.cc:492] T ee5f38d91bb349a9ae1da8ba69d2ddbc P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:06.647920 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2d0ec1a5e759420f928fae1e1cb94c03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:06.648587 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d0ec1a5e759420f928fae1e1cb94c03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:06.652232 12338 raft_consensus.cc:493] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.652431 12338 raft_consensus.cc:515] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.653208 12338 leader_election.cc:290] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:06.654739 10367 tablet_bootstrap.cc:654] T ee5f38d91bb349a9ae1da8ba69d2ddbc P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:06.654876 9831 leader_election.cc:343] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 63486cc3f8774a11827b1cc5f1c16332
I20260810 19:48:06.656733 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 786) took 1540 ms. Trace:
I20260810 19:48:06.658823 10377 rpcz_store.cc:276] 0810 19:48:05.115815 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.115870 (+ 55us) service_pool.cc:224] Handling call
0810 19:48:06.165193 (+1049323us) ts_tablet_manager.cc:1151] Deleting tablet ebf33d82af9e494a8e85be8cba55d2c9
0810 19:48:06.165201 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.187659 (+ 22458us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.612194 (+424535us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.656380 (+ 44186us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1049133}
I20260810 19:48:06.669255 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 08ac9ae9eceb42b3880c4f35556994c7 with delete_type TABLET_DATA_DELETED (replaced by tablet f146f440c1174d348ed273d29145e815) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:06.670660 10377 tablet_replica.cc:333] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:06.675014 9413 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_e4aeb59e91c24097bac9517b3c62b75a [id=8d7f043045ff44cd886367b5860f8433] alter complete (version 1)
I20260810 19:48:06.676313 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ac59875628e40ffb1385dedea2f3b9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:06.682509 12402 tablet.cc:1724] T 204ef31f396a43a5bf06205560f987c9 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:06.677704 10377 raft_consensus.cc:2243] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:06.685592 12407 raft_consensus.cc:493] T e68916e2568f4527a181342cdc728001 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.685796 12407 raft_consensus.cc:515] T e68916e2568f4527a181342cdc728001 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.686621 12407 leader_election.cc:290] T e68916e2568f4527a181342cdc728001 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:06.687110 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet aaaeafe4afb8454baf2e141a00da8ee3
I20260810 19:48:06.687577 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68916e2568f4527a181342cdc728001" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:06.688254 9611 leader_election.cc:343] T e68916e2568f4527a181342cdc728001 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.686301 10377 raft_consensus.cc:2272] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:06.690303 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet aaaeafe4afb8454baf2e141a00da8ee3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:06.691368 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet aaaeafe4afb8454baf2e141a00da8ee3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aaaeafe4afb8454baf2e141a00da8ee3 already in progress: creating tablet
I20260810 19:48:06.695088 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ac59875628e40ffb1385dedea2f3b9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:06.696707 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet abfa81d2eb2548d0b1688e23240f6d3a consensus state has no leader
I20260810 19:48:06.697239 9420 master_service.cc:960] ReplaceTablet: received request to replace tablet ab27734e3d974260a77f1d94e5f534fe from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:06.695554 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet 08ac9ae9eceb42b3880c4f35556994c7 with delete_type TABLET_DATA_DELETED (replaced by tablet f146f440c1174d348ed273d29145e815) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:06.695590 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 4e80e2327c394612bffc51f38798dac3 (table default.Table_5005f8f74af74cad8c19a3c67e8f9fe9 [id=bd544994cecc42b2adc881ebfe318d7b]) successfully deleted
W20260810 19:48:06.704995 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 5ba42032e7344423a0e86c55d613f27d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ba42032e7344423a0e86c55d613f27d already in progress: creating tablet
W20260810 19:48:06.706112 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 5b56fb5bed4b46a2a1fc0ab22379760b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b56fb5bed4b46a2a1fc0ab22379760b already in progress: creating tablet
W20260810 19:48:06.707103 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 98c1a8c9946248b78e5b77ba8dfdb953 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98c1a8c9946248b78e5b77ba8dfdb953 already in progress: creating tablet
I20260810 19:48:06.707288 10375 ts_tablet_manager.cc:1929] T 4b2b0f2fc93647f3bc1d79b4132c3703 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260810 19:48:06.707912 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 90b6f76f0cec4f33879030958cbe89bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90b6f76f0cec4f33879030958cbe89bf already in progress: creating tablet
W20260810 19:48:06.708567 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet e750622b406c4783adf01bb1af6895de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e750622b406c4783adf01bb1af6895de already in progress: creating tablet
I20260810 19:48:06.710067 10377 ts_tablet_manager.cc:1916] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:06.715375 10375 log.cc:1199] T 4b2b0f2fc93647f3bc1d79b4132c3703 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/4b2b0f2fc93647f3bc1d79b4132c3703
I20260810 19:48:06.717052 10375 ts_tablet_manager.cc:1950] T 4b2b0f2fc93647f3bc1d79b4132c3703 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:06.723795 12407 raft_consensus.cc:493] T a78960e1f2164c848297411b9273ac64 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.724002 12407 raft_consensus.cc:515] T a78960e1f2164c848297411b9273ac64 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.717644 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63486cc3f8774a11827b1cc5f1c16332" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:06.724782 12407 leader_election.cc:290] T a78960e1f2164c848297411b9273ac64 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:06.723032 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3840b035b88243ecad17865d4716fcfc" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:06.723647 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85f3fa629764c79921a710739eea7ae" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:06.725757 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78960e1f2164c848297411b9273ac64" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:06.726429 9611 leader_election.cc:343] T a78960e1f2164c848297411b9273ac64 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.726668 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68916e2568f4527a181342cdc728001" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:06.727222 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78960e1f2164c848297411b9273ac64" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:06.730893 9611 leader_election.cc:343] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:06.730962 9830 leader_election.cc:343] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.731050 9611 leader_election.cc:304] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:06.731107 9830 leader_election.cc:304] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:48:06.731297 10068 leader_election.cc:343] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 0dd49d6fa79e4677b753b6cf9117b02d
W20260810 19:48:06.731503 9611 leader_election.cc:343] T f85f3fa629764c79921a710739eea7ae P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.731590 9611 leader_election.cc:304] T f85f3fa629764c79921a710739eea7ae P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
W20260810 19:48:06.731637 10068 leader_election.cc:343] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: b5f30148b5c84f7cbdfabd0186611cc4
I20260810 19:48:06.731801 11897 raft_consensus.cc:2749] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:06.731822 12313 raft_consensus.cc:2749] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:06.731952 9611 leader_election.cc:343] T e68916e2568f4527a181342cdc728001 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:06.731958 10068 leader_election.cc:343] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 0dd49d6fa79e4677b753b6cf9117b02d
I20260810 19:48:06.731985 12313 raft_consensus.cc:2749] T f85f3fa629764c79921a710739eea7ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:06.732034 9611 leader_election.cc:304] T e68916e2568f4527a181342cdc728001 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:06.732200 12313 raft_consensus.cc:2749] T e68916e2568f4527a181342cdc728001 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:06.732359 9611 leader_election.cc:343] T a78960e1f2164c848297411b9273ac64 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.732447 9611 leader_election.cc:304] T a78960e1f2164c848297411b9273ac64 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:06.732628 12313 raft_consensus.cc:2749] T a78960e1f2164c848297411b9273ac64 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:06.732607 12106 raft_consensus.cc:493] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.732758 12106 raft_consensus.cc:515] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.733412 12106 leader_election.cc:290] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:06.734490 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3d8ade850c4d36bd2756c36706195d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:06.734719 9939 raft_consensus.cc:2468] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
W20260810 19:48:06.734762 10067 consensus_peers.cc:597] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ebf33d82af9e494a8e85be8cba55d2c9. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:06.735380 10067 leader_election.cc:304] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
W20260810 19:48:06.738358 9413 catalog_manager.cc:5911] Failed to send AlterTable RPC for tablet 639c824ba4834734a4ebfd558181bebe (table default.Table_35ada13f5f5a41b0a93a57276b7756d9 [id=fa3844f34a5b4d55b6e87ec2164eb8fb], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 639c824ba4834734a4ebfd558181bebe consensus state has no leader
W20260810 19:48:06.739194 9413 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.8.235.193:43705 (request call id 114) took 925 ms (client timeout 1000 ms). Trace:
W20260810 19:48:06.739346 9413 rpcz_store.cc:269] 0810 19:48:05.813637 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.814530 (+ 893us) service_pool.cc:224] Handling call
0810 19:48:06.739125 (+924595us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:48:06.401297 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 19:48:06.401429 (+ 132us) write_op.cc:432] Acquiring schema lock in shared mode
0810 19:48:06.401436 (+ 7us) write_op.cc:435] Acquired schema lock
0810 19:48:06.401439 (+ 3us) tablet.cc:662] Decoding operations
0810 19:48:06.401563 (+ 124us) write_op.cc:620] Acquiring the partition lock for write op
0810 19:48:06.401575 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0810 19:48:06.401580 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0810 19:48:06.401652 (+ 72us) tablet.cc:701] Row locks acquired
0810 19:48:06.401655 (+ 3us) write_op.cc:260] PREPARE: finished
0810 19:48:06.401698 (+ 43us) write_op.cc:270] Start()
0810 19:48:06.401745 (+ 47us) write_op.cc:276] Timestamp: P: 1786391286401647 usec, L: 0
0810 19:48:06.401749 (+ 4us) op_driver.cc:348] REPLICATION: starting
0810 19:48:06.484608 (+ 82859us) log.cc:844] Serialized 356 byte log entry
0810 19:48:06.484833 (+ 225us) spinlock_profiling.cc:243] Waited 82.6 ms on lock 0x616000041b54. stack: 00007f50aec1d326 00007f50aec1d0e0 00007f50adc4734d 00000000009a5774 00000000009a573d 00000000009a510a 00007f50bacf3ec2 00007f50bc10f9f5 00007f50bc10e519 00007f50bc116940 00007f50bc11674d 0000000000aaf86c 00007f50aec6384f 00007f50aec66b4b 00007f50aec669c8 0000000000aaf86c
0810 19:48:06.522595 (+ 37762us) op_driver.cc:464] REPLICATION: finished
0810 19:48:06.522700 (+ 105us) write_op.cc:301] APPLY: starting
0810 19:48:06.522723 (+ 23us) tablet.cc:1367] starting BulkCheckPresence
0810 19:48:06.522781 (+ 58us) tablet.cc:1370] finished BulkCheckPresence
0810 19:48:06.522783 (+ 2us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 19:48:06.522845 (+ 62us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 19:48:06.522881 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 19:48:06.522888 (+ 7us) write_op.cc:312] APPLY: finished
0810 19:48:06.522977 (+ 89us) log.cc:844] Serialized 23 byte log entry
0810 19:48:06.523332 (+ 355us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:06.523355 (+ 23us) write_op.cc:454] Released schema lock
0810 19:48:06.523363 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0810 19:48:06.525856 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 19:48:06.525986 (+ 130us) write_op.cc:432] Acquiring schema lock in shared mode
0810 19:48:06.525993 (+ 7us) write_op.cc:435] Acquired schema lock
0810 19:48:06.525996 (+ 3us) tablet.cc:662] Decoding operations
0810 19:48:06.526101 (+ 105us) write_op.cc:620] Acquiring the partition lock for write op
0810 19:48:06.526111 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0810 19:48:06.526116 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0810 19:48:06.526182 (+ 66us) tablet.cc:701] Row locks acquired
0810 19:48:06.526185 (+ 3us) write_op.cc:260] PREPARE: finished
0810 19:48:06.526229 (+ 44us) write_op.cc:270] Start()
0810 19:48:06.526262 (+ 33us) write_op.cc:276] Timestamp: P: 1786391286526206 usec, L: 0
0810 19:48:06.526266 (+ 4us) op_driver.cc:348] REPLICATION: starting
0810 19:48:06.650689 (+124423us) log.cc:844] Serialized 356 byte log entry
0810 19:48:06.650906 (+ 217us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x616000041b54. stack: 00007f50aec1d326 00007f50aec1d0e0 00007f50adc4734d 00000000009a5774 00000000009a573d 00000000009a510a 00007f50bacf3ec2 00007f50bc10f9f5 00007f50bc10e519 00007f50bc116940 00007f50bc11674d 0000000000aaf86c 00007f50aec6384f 00007f50aec66b4b 00007f50aec669c8 0000000000aaf86c
0810 19:48:06.672926 (+ 22020us) op_driver.cc:464] REPLICATION: finished
0810 19:48:06.674000 (+ 1074us) write_op.cc:301] APPLY: starting
0810 19:48:06.674027 (+ 27us) tablet.cc:1367] starting BulkCheckPresence
0810 19:48:06.674077 (+ 50us) tablet.cc:1370] finished BulkCheckPresence
0810 19:48:06.674080 (+ 3us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 19:48:06.674149 (+ 69us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 19:48:06.674190 (+ 41us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 19:48:06.674198 (+ 8us) write_op.cc:312] APPLY: finished
0810 19:48:06.674302 (+ 104us) log.cc:844] Serialized 23 byte log entry
0810 19:48:06.674650 (+ 348us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:06.674672 (+ 22us) write_op.cc:454] Released schema lock
0810 19:48:06.674680 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":45,"apply.run_cpu_time_us":479,"apply.run_wall_time_us":3874,"num_ops":1,"prepare.queue_time_us":72,"prepare.run_cpu_time_us":1663,"prepare.run_wall_time_us":83584,"replication_time_us":120805,"spinlock_wait_cycles":189995392}],["op",{"apply.queue_time_us":984,"apply.run_cpu_time_us":565,"apply.run_wall_time_us":1421,"num_ops":1,"prepare.queue_time_us":656,"prepare.run_cpu_time_us":1783,"prepare.run_wall_time_us":125136,"raft.queue_time_us":3687,"raft.run_cpu_time_us":406,"raft.run_wall_time_us":1263,"replication_time_us":146617,"spinlock_wait_cycles":285493120}]]}
I20260810 19:48:06.742475 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 896b7cfdb0ca4904aaeafa13ff19365e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:06.742748 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 15c070c23de34348ad3426c894e11022 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:06.742796 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c75af1e592042f5a4d442b82a539c94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:06.743006 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet a78960e1f2164c848297411b9273ac64 with delete_type TABLET_DATA_DELETED (replaced by tablet fdd82537177a4142bddd0544485b00c4) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:06.743211 12266 tablet_replica.cc:333] T 896b7cfdb0ca4904aaeafa13ff19365e P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:06.743427 12266 raft_consensus.cc:2243] T 896b7cfdb0ca4904aaeafa13ff19365e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:06.743599 12266 raft_consensus.cc:2272] T 896b7cfdb0ca4904aaeafa13ff19365e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:06.743914 12407 raft_consensus.cc:493] T 4f21e03993e841ba901f1e9c176309b9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.744050 12407 raft_consensus.cc:515] T 4f21e03993e841ba901f1e9c176309b9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.744222 12266 ts_tablet_manager.cc:1916] T 896b7cfdb0ca4904aaeafa13ff19365e P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:06.744756 12407 leader_election.cc:290] T 4f21e03993e841ba901f1e9c176309b9 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:06.746021 11828 raft_consensus.cc:2804] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:06.746134 11828 raft_consensus.cc:493] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:06.746202 11828 raft_consensus.cc:3060] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:06.746913 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b40fd0d57ea4b71aeef2d66f4958ac8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:06.749191 11828 raft_consensus.cc:515] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.750180 11828 leader_election.cc:290] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:06.750190 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f21e03993e841ba901f1e9c176309b9" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:06.751046 9611 leader_election.cc:343] T 4f21e03993e841ba901f1e9c176309b9 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.751493 11828 raft_consensus.cc:493] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.751698 11828 raft_consensus.cc:515] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.752461 11828 leader_election.cc:290] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:06.753958 10370 tablet_bootstrap.cc:492] T 72b39babf851404c89adb317033015ec P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:06.754202 10375 tablet_replica.cc:333] T dfea147ef3904ab49375def065c6f328 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:06.754416 10370 ts_tablet_manager.cc:1403] T 72b39babf851404c89adb317033015ec P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.147s user 0.003s sys 0.001s
I20260810 19:48:06.757186 12266 ts_tablet_manager.cc:1929] T 896b7cfdb0ca4904aaeafa13ff19365e P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:06.754523 10375 raft_consensus.cc:2243] T dfea147ef3904ab49375def065c6f328 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:06.757741 10375 raft_consensus.cc:2272] T dfea147ef3904ab49375def065c6f328 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:06.758035 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 6914b47e0cac4cd28ee4fd199684a280 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6914b47e0cac4cd28ee4fd199684a280 already in progress: creating tablet
W20260810 19:48:06.758289 9395 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.235.195:43797, user_credentials={real_user=slave}} blocked reactor thread for 49192us
I20260810 19:48:06.758816 10366 tablet_bootstrap.cc:492] T 4dba7046bdfd41f1a2ad6f299a723776 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:06.758888 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 4b2b0f2fc93647f3bc1d79b4132c3703 (table default.Table_d195688055bd4cfca1a9462585af71bc [id=64e1f507ae574ea6b7fa1627b8e7f4c3]) successfully deleted
I20260810 19:48:06.759018 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3d8ade850c4d36bd2756c36706195d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:06.759238 9939 raft_consensus.cc:3060] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:06.759205 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 841f58b4e8f7465eaa7fa08629e0bc2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 841f58b4e8f7465eaa7fa08629e0bc2a already in progress: creating tablet
I20260810 19:48:06.759392 10366 ts_tablet_manager.cc:1403] T 4dba7046bdfd41f1a2ad6f299a723776 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.221s user 0.003s sys 0.002s
I20260810 19:48:06.759509 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet ebf33d82af9e494a8e85be8cba55d2c9 (table default.Table_998c14b0e9e14df48d3d4367f7c3b941 [id=19618281529d4843b4e58733646f0e08]) successfully deleted
I20260810 19:48:06.760555 10366 raft_consensus.cc:359] T 4dba7046bdfd41f1a2ad6f299a723776 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.761502 10375 ts_tablet_manager.cc:1916] T dfea147ef3904ab49375def065c6f328 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:06.763154 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e8a23221e8447bd83592c05c9d1149c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:06.763410 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet da3d8ade850c4d36bd2756c36706195d with delete_type TABLET_DATA_DELETED (replaced by tablet 87bbcc651d034e2a826478b805792e48) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:06.763665 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet b5f30148b5c84f7cbdfabd0186611cc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:06.765905 10068 consensus_peers.cc:597] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9714a8a1eeaf41d2bb01d3fa3ff7181d. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:06.771943 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet aaaeafe4afb8454baf2e141a00da8ee3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:06.777910 12407 raft_consensus.cc:493] T 31c2b9a4b8334e678b4632fc2f58dd0c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.778174 12407 raft_consensus.cc:515] T 31c2b9a4b8334e678b4632fc2f58dd0c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.780298 12407 leader_election.cc:290] T 31c2b9a4b8334e678b4632fc2f58dd0c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:06.788487 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_5194334e6036419bb0a2bdb9a0db856f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:06.789326 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5194334e6036419bb0a2bdb9a0db856f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:06.789669 12402 tablet.cc:1724] T bc753970b2464e38b03e377551276343 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:06.793370 12407 raft_consensus.cc:493] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.793547 12407 raft_consensus.cc:515] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.794382 12407 leader_election.cc:290] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:06.795651 9415 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet db2b8038ee9747109b42510bba02faa9 (table default.Table_2b20dee66e634a07bc9f2e2de90e8529 [id=452b19ee68bc463086780f6f72603483]). Expected version 1 got 0
I20260810 19:48:06.795923 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 9fb544dff4eb4642b7e282657ae15d19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:06.796098 9415 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 410855f236004ad4b78839eb1c0c2f1f (table default.Table_44478e93cffb460aaa8df9115b799594 [id=1d363ce63686462f9f4c15669773ee22]). Expected version 1 got 0
I20260810 19:48:06.796350 9415 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet d77785d9bde843bc8366fe15d1b4fa18 (table default.Table_3e78e13c8ecc464eb6af12a2bc3f2eba [id=1af2d06c44b643e28d28bb080cd5eef8]). Expected version 2 got 0
I20260810 19:48:06.796686 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dd49d6fa79e4677b753b6cf9117b02d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:06.796741 9415 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 3e8ae48a2fb548358176abefe1ee3baa (table default.Table_9cb0cc2a8f724781a638706ddcc2c085 [id=12db110e89e04d40bdb05ec61fd5e3b6]). Expected version 1 got 0
I20260810 19:48:06.797075 9415 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 9a13b0f5b6b14bb9b72740a8521e4ea5 (table default.Table_0844c946c41146f38e51790cd8baed2a [id=4830b444314a4bb6a605cb73432e772f]). Expected version 1 got 0
I20260810 19:48:06.797192 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet ebf33d82af9e494a8e85be8cba55d2c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:06.798750 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3684e48baa2d4e58b5907a7503e5a6ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:06.798925 10367 tablet_bootstrap.cc:492] T ee5f38d91bb349a9ae1da8ba69d2ddbc P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:06.799079 10367 ts_tablet_manager.cc:1403] T ee5f38d91bb349a9ae1da8ba69d2ddbc P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.153s user 0.070s sys 0.058s
W20260810 19:48:06.799460 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3684e48baa2d4e58b5907a7503e5a6ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:06.799854 10367 raft_consensus.cc:359] T ee5f38d91bb349a9ae1da8ba69d2ddbc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.800024 10367 raft_consensus.cc:385] T ee5f38d91bb349a9ae1da8ba69d2ddbc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:06.800077 10367 raft_consensus.cc:740] T ee5f38d91bb349a9ae1da8ba69d2ddbc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:06.803507 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 965395b5072e4d47adac504e22a8d484 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:50 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:06.804768 12407 raft_consensus.cc:493] T ab27734e3d974260a77f1d94e5f534fe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.804931 12407 raft_consensus.cc:515] T ab27734e3d974260a77f1d94e5f534fe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.805588 12407 leader_election.cc:290] T ab27734e3d974260a77f1d94e5f534fe P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:06.805891 10367 consensus_queue.cc:260] T ee5f38d91bb349a9ae1da8ba69d2ddbc P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.806492 10367 ts_tablet_manager.cc:1434] T ee5f38d91bb349a9ae1da8ba69d2ddbc P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260810 19:48:06.806849 10367 tablet_bootstrap.cc:492] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:06.812314 10367 tablet_bootstrap.cc:654] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:06.757021 10370 raft_consensus.cc:359] T 72b39babf851404c89adb317033015ec P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.822841 10370 raft_consensus.cc:385] T 72b39babf851404c89adb317033015ec P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:06.823051 10370 raft_consensus.cc:740] T 72b39babf851404c89adb317033015ec P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:06.823557 10370 consensus_queue.cc:260] T 72b39babf851404c89adb317033015ec P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.824681 12266 log.cc:1199] T 896b7cfdb0ca4904aaeafa13ff19365e P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/896b7cfdb0ca4904aaeafa13ff19365e
I20260810 19:48:06.824776 10370 ts_tablet_manager.cc:1434] T 72b39babf851404c89adb317033015ec P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.070s user 0.002s sys 0.001s
I20260810 19:48:06.825260 10370 tablet_bootstrap.cc:492] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:06.827129 10370 tablet_bootstrap.cc:654] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:06.827476 10366 raft_consensus.cc:385] T 4dba7046bdfd41f1a2ad6f299a723776 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:06.827641 10366 raft_consensus.cc:740] T 4dba7046bdfd41f1a2ad6f299a723776 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:06.761549 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet aaaeafe4afb8454baf2e141a00da8ee3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:06.763919 9939 raft_consensus.cc:2468] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:06.827986 10366 consensus_queue.cc:260] T 4dba7046bdfd41f1a2ad6f299a723776 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.769737 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00fe7d9a548a487d965d92b53cdf9250" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:06.781457 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c2b9a4b8334e678b4632fc2f58dd0c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:06.828428 9945 raft_consensus.cc:2468] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:06.790874 12427 tablet.cc:1724] T bc753970b2464e38b03e377551276343 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:06.795434 9941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e3dde1c29e4275bafb27df63b117be" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:06.806367 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab27734e3d974260a77f1d94e5f534fe" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:06.834219 10366 ts_tablet_manager.cc:1434] T 4dba7046bdfd41f1a2ad6f299a723776 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.075s user 0.002s sys 0.000s
I20260810 19:48:06.834570 10366 tablet_bootstrap.cc:492] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
W20260810 19:48:06.829263 9611 leader_election.cc:343] T 31c2b9a4b8334e678b4632fc2f58dd0c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.835809 12266 ts_tablet_manager.cc:1950] T 896b7cfdb0ca4904aaeafa13ff19365e P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:06.837352 12266 tablet_replica.cc:333] T 15c070c23de34348ad3426c894e11022 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:06.838347 10029 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:48:06.838922 10366 tablet_bootstrap.cc:654] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:06.840353 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 896b7cfdb0ca4904aaeafa13ff19365e (table default.Table_9ae3537027a04f86aa62a86f5668fe12 [id=376702dd80dd4e91b7e35a056f4ec452]) successfully deleted
W20260810 19:48:06.836025 9611 leader_election.cc:343] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.843415 12266 raft_consensus.cc:2243] T 15c070c23de34348ad3426c894e11022 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:06.843605 12266 raft_consensus.cc:2272] T 15c070c23de34348ad3426c894e11022 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:06.843566 9611 leader_election.cc:343] T ab27734e3d974260a77f1d94e5f534fe P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.844202 12266 ts_tablet_manager.cc:1916] T 15c070c23de34348ad3426c894e11022 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:06.860586 12266 ts_tablet_manager.cc:1929] T 15c070c23de34348ad3426c894e11022 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 19:48:06.865784 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 30131d59f3504ea9ad69586ce90b39ad consensus state has no leader
I20260810 19:48:06.867898 12266 log.cc:1199] T 15c070c23de34348ad3426c894e11022 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/15c070c23de34348ad3426c894e11022
I20260810 19:48:06.868499 12266 ts_tablet_manager.cc:1950] T 15c070c23de34348ad3426c894e11022 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:06.869922 10377 ts_tablet_manager.cc:1929] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:06.870131 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 15c070c23de34348ad3426c894e11022 (table default.Table_511b7773a9034830ad84841ad4c71063 [id=b69a88eb84db49daa3c6a51ca2c6e4d7]) successfully deleted
I20260810 19:48:06.870474 10377 log.cc:1199] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/b5f30148b5c84f7cbdfabd0186611cc4
W20260810 19:48:06.870935 9397 catalog_manager.cc:5017] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 4c75af1e592042f5a4d442b82a539c94 because the tablet was not found. No further retry: Not found: Tablet not found: 4c75af1e592042f5a4d442b82a539c94
I20260810 19:48:06.871261 10377 ts_tablet_manager.cc:1950] T b5f30148b5c84f7cbdfabd0186611cc4 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:06.871346 12266 tablet_replica.cc:333] T a78960e1f2164c848297411b9273ac64 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:06.871552 12266 raft_consensus.cc:2243] T a78960e1f2164c848297411b9273ac64 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:06.872014 12266 raft_consensus.cc:2272] T a78960e1f2164c848297411b9273ac64 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:06.872749 12266 ts_tablet_manager.cc:1916] T a78960e1f2164c848297411b9273ac64 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:06.876240 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_4dd3d4c4497546b28df06251099213a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:06.876518 12407 raft_consensus.cc:493] T 8fadd6f84c75466287b318ed7018b071 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:06.876636 12407 raft_consensus.cc:515] T 8fadd6f84c75466287b318ed7018b071 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:06.876932 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4dd3d4c4497546b28df06251099213a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:06.877250 12407 leader_election.cc:290] T 8fadd6f84c75466287b318ed7018b071 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:06.878652 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6f102dcbbfc04cefa60e2601ea7bb372" } modify_external_catalogs: true
I20260810 19:48:06.878847 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6f102dcbbfc04cefa60e2601ea7bb372" } modify_external_catalogs: true
I20260810 19:48:06.880496 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_717c8249c368451e88c10baf2240d27f" } new_table_name: "default.Table_5566f9d152794e309dd817727a18e4cf" modify_external_catalogs: true
I20260810 19:48:06.883587 9407 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet d77785d9bde843bc8366fe15d1b4fa18 (table default.Table_3e78e13c8ecc464eb6af12a2bc3f2eba [id=1af2d06c44b643e28d28bb080cd5eef8]). Expected version 2 got 0
I20260810 19:48:06.887629 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_148c29dbb35f4c50a6fb25d6461e613b" } modify_external_catalogs: true
I20260810 19:48:06.887814 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_148c29dbb35f4c50a6fb25d6461e613b" } modify_external_catalogs: true
I20260810 19:48:06.888978 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fadd6f84c75466287b318ed7018b071" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:06.889659 9611 leader_election.cc:343] T 8fadd6f84c75466287b318ed7018b071 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.889189 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 787) took 1773 ms. Trace:
I20260810 19:48:06.890079 10377 rpcz_store.cc:276] 0810 19:48:05.115936 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.115993 (+ 57us) service_pool.cc:224] Handling call
0810 19:48:06.668563 (+1552570us) ts_tablet_manager.cc:1151] Deleting tablet b5f30148b5c84f7cbdfabd0186611cc4
0810 19:48:06.668587 (+ 24us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.774795 (+106208us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.869778 (+ 94983us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.889162 (+ 19384us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1551587}
I20260810 19:48:06.891649 10367 tablet_bootstrap.cc:492] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:06.891783 10367 ts_tablet_manager.cc:1403] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.085s user 0.008s sys 0.015s
I20260810 19:48:06.892091 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet ab27734e3d974260a77f1d94e5f534fe
I20260810 19:48:06.892469 10367 raft_consensus.cc:359] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.892619 10367 raft_consensus.cc:385] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:06.892632 9420 catalog_manager.cc:6807] ReplaceTablet: tablet ab27734e3d974260a77f1d94e5f534fe deleted and replaced by tablet f1c74666c3694ab881ba8ed452a73714
I20260810 19:48:06.892659 10367 raft_consensus.cc:740] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:06.892894 10367 consensus_queue.cc:260] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.893065 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ec7e4f3e68244e369e1ec60ad7e3fbee" } modify_external_catalogs: true
I20260810 19:48:06.893276 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ec7e4f3e68244e369e1ec60ad7e3fbee" } modify_external_catalogs: true
I20260810 19:48:06.893536 10367 ts_tablet_manager.cc:1434] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:06.893805 10367 tablet_bootstrap.cc:492] T bafc42f0cdf94ebd823dfb678df8a83b P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:06.894135 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet b5f30148b5c84f7cbdfabd0186611cc4 (table default.Table_6d2e6ad78a7841e891fae5f687a3c392 [id=ff056c9a5dc14ebdac724d8e39e6c7bb]) successfully deleted
I20260810 19:48:06.894407 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet ab27734e3d974260a77f1d94e5f534fe with delete_type TABLET_DATA_DELETED (replaced by tablet f1c74666c3694ab881ba8ed452a73714) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:06.894449 10377 tablet_replica.cc:333] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:06.895296 10367 tablet_bootstrap.cc:654] T bafc42f0cdf94ebd823dfb678df8a83b P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:06.896253 10377 raft_consensus.cc:2243] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:06.897818 12266 ts_tablet_manager.cc:1929] T a78960e1f2164c848297411b9273ac64 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:06.897941 12266 log.cc:1199] T a78960e1f2164c848297411b9273ac64 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/a78960e1f2164c848297411b9273ac64
I20260810 19:48:06.898383 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet ab27734e3d974260a77f1d94e5f534fe with delete_type TABLET_DATA_DELETED (replaced by tablet f1c74666c3694ab881ba8ed452a73714) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:06.898761 12266 ts_tablet_manager.cc:1950] T a78960e1f2164c848297411b9273ac64 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:06.899681 12266 tablet_replica.cc:333] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:06.899859 12266 raft_consensus.cc:2243] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:06.900008 12266 raft_consensus.cc:2272] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:06.900537 12266 ts_tablet_manager.cc:1916] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:06.900789 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet a78960e1f2164c848297411b9273ac64 (table default.Table_21d8962dbe56454188c9a5b8729034c3 [id=d277a804313e4f35a31b58d4f682efe6]) successfully deleted
I20260810 19:48:06.903829 10377 pending_rounds.cc:70] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691: Trying to abort 1 pending ops.
I20260810 19:48:06.904680 10377 pending_rounds.cc:77] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058701968252928 op_type: NO_OP noop_request { }
I20260810 19:48:06.905732 10377 raft_consensus.cc:2889] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:06.906950 10377 raft_consensus.cc:2272] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:06.833081 10067 leader_election.cc:304] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
W20260810 19:48:06.910593 10067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 77553.6us
I20260810 19:48:06.910858 10067 leader_election.cc:304] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:06.842845 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f21e03993e841ba901f1e9c176309b9" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:06.911463 12106 raft_consensus.cc:2804] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:06.911592 12106 raft_consensus.cc:697] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:06.911877 12106 consensus_queue.cc:237] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.912948 12435 raft_consensus.cc:2804] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:06.913028 12435 raft_consensus.cc:493] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:06.913089 12435 raft_consensus.cc:3060] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:06.912765 10377 ts_tablet_manager.cc:1916] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:06.915947 12435 raft_consensus.cc:515] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.916637 12435 leader_election.cc:290] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:06.843820 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c2b9a4b8334e678b4632fc2f58dd0c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:06.844164 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e3dde1c29e4275bafb27df63b117be" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:06.844477 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab27734e3d974260a77f1d94e5f534fe" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:06.848798 10159 raft_consensus.cc:3060] T 410855f236004ad4b78839eb1c0c2f1f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:06.921808 12266 ts_tablet_manager.cc:1929] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:06.921947 12266 log.cc:1199] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/9b40fd0d57ea4b71aeef2d66f4958ac8
I20260810 19:48:06.922281 12266 ts_tablet_manager.cc:1950] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:06.923628 12266 tablet_replica.cc:333] T ab27734e3d974260a77f1d94e5f534fe P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:06.923781 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 9b40fd0d57ea4b71aeef2d66f4958ac8 (table default.Table_b1aaf42f1f01402f9f92aabf33808cd4 [id=27df62a1199844dd88c52fdd4757529c]) successfully deleted
I20260810 19:48:06.923846 12266 raft_consensus.cc:2243] T ab27734e3d974260a77f1d94e5f534fe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:06.924243 12266 raft_consensus.cc:2272] T ab27734e3d974260a77f1d94e5f534fe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:06.925057 12266 ts_tablet_manager.cc:1916] T ab27734e3d974260a77f1d94e5f534fe P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:06.925128 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00fe7d9a548a487d965d92b53cdf9250" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:06.925326 9948 raft_consensus.cc:3060] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:06.925818 10367 tablet_bootstrap.cc:492] T bafc42f0cdf94ebd823dfb678df8a83b P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:06.926100 10367 ts_tablet_manager.cc:1403] T bafc42f0cdf94ebd823dfb678df8a83b P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.032s user 0.007s sys 0.003s
I20260810 19:48:06.927059 10367 raft_consensus.cc:359] T bafc42f0cdf94ebd823dfb678df8a83b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.927335 10367 raft_consensus.cc:385] T bafc42f0cdf94ebd823dfb678df8a83b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:06.927453 10367 raft_consensus.cc:740] T bafc42f0cdf94ebd823dfb678df8a83b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:06.927732 10367 consensus_queue.cc:260] T bafc42f0cdf94ebd823dfb678df8a83b P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.928136 9948 raft_consensus.cc:2468] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:06.931274 10067 leader_election.cc:304] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:06.931610 11828 raft_consensus.cc:2804] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:06.931733 11828 raft_consensus.cc:697] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:06.932031 11828 consensus_queue.cc:237] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.938983 10367 ts_tablet_manager.cc:1434] T bafc42f0cdf94ebd823dfb678df8a83b P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260810 19:48:06.940138 10367 tablet_bootstrap.cc:492] T 5aa0f24443a34714a44137a77c12bbc3 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:06.951397 10367 tablet_bootstrap.cc:654] T 5aa0f24443a34714a44137a77c12bbc3 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:06.849391 10068 leader_election.cc:343] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: da3d8ade850c4d36bd2756c36706195d
I20260810 19:48:06.893225 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet ab27734e3d974260a77f1d94e5f534fe with delete_type TABLET_DATA_DELETED (replaced by tablet f1c74666c3694ab881ba8ed452a73714) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:06.952059 10068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 102671us
W20260810 19:48:06.952396 10068 leader_election.cc:343] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: da3d8ade850c4d36bd2756c36706195d
W20260810 19:48:06.952768 10068 leader_election.cc:343] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 00fe7d9a548a487d965d92b53cdf9250
W20260810 19:48:06.953945 9830 consensus_peers.cc:597] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b2b0f2fc93647f3bc1d79b4132c3703. This is attempt 1: this message will repeat every 5th retry.
W20260810 19:48:06.954483 9611 leader_election.cc:343] T 4f21e03993e841ba901f1e9c176309b9 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.954607 9611 leader_election.cc:304] T 4f21e03993e841ba901f1e9c176309b9 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:06.955025 12407 raft_consensus.cc:2749] T 4f21e03993e841ba901f1e9c176309b9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:06.956429 9611 leader_election.cc:343] T 31c2b9a4b8334e678b4632fc2f58dd0c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.956537 9611 leader_election.cc:304] T 31c2b9a4b8334e678b4632fc2f58dd0c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:06.956894 12407 raft_consensus.cc:2749] T 31c2b9a4b8334e678b4632fc2f58dd0c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:06.957391 9611 leader_election.cc:343] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.957486 9611 leader_election.cc:304] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:06.957858 12407 raft_consensus.cc:2749] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:06.958395 9611 leader_election.cc:343] T ab27734e3d974260a77f1d94e5f534fe P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:06.958505 9611 leader_election.cc:304] T ab27734e3d974260a77f1d94e5f534fe P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
W20260810 19:48:06.958643 9611 raft_consensus.cc:2686] T ab27734e3d974260a77f1d94e5f534fe P fcd31b1bbb0340cbacfce652b4ad8da4: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 19:48:06.959846 10367 tablet_bootstrap.cc:492] T 5aa0f24443a34714a44137a77c12bbc3 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:06.959990 10367 ts_tablet_manager.cc:1403] T 5aa0f24443a34714a44137a77c12bbc3 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20260810 19:48:06.960471 12428 tablet.cc:1724] T bc753970b2464e38b03e377551276343 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:06.960827 10367 raft_consensus.cc:359] T 5aa0f24443a34714a44137a77c12bbc3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.960985 10367 raft_consensus.cc:385] T 5aa0f24443a34714a44137a77c12bbc3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:06.961037 10367 raft_consensus.cc:740] T 5aa0f24443a34714a44137a77c12bbc3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:06.961023 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fadd6f84c75466287b318ed7018b071" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:06.961460 10367 consensus_queue.cc:260] T 5aa0f24443a34714a44137a77c12bbc3 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.962512 10150 raft_consensus.cc:3060] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:06.964591 10377 ts_tablet_manager.cc:1929] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:06.965137 10377 log.cc:1199] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/9e8a23221e8447bd83592c05c9d1149c
I20260810 19:48:06.967044 10377 ts_tablet_manager.cc:1950] T 9e8a23221e8447bd83592c05c9d1149c P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:06.968888 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 785) took 1853 ms. Trace:
I20260810 19:48:06.969311 10377 rpcz_store.cc:276] 0810 19:48:05.115722 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.116391 (+ 669us) service_pool.cc:224] Handling call
0810 19:48:06.893274 (+1776883us) ts_tablet_manager.cc:1151] Deleting tablet 9e8a23221e8447bd83592c05c9d1149c
0810 19:48:06.893621 (+ 347us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.945980 (+ 52359us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.964097 (+ 18117us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:06.968758 (+ 4661us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1775881}
I20260810 19:48:06.970870 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 9e8a23221e8447bd83592c05c9d1149c (table default.Table_943801654ea043f1b8740ea0215abc35 [id=5cf32f9df60d4b04a704522da9f7973d]) successfully deleted
I20260810 19:48:06.972721 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 789) took 1855 ms. Trace:
I20260810 19:48:06.973198 10377 rpcz_store.cc:276] 0810 19:48:05.116929 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.116987 (+ 58us) service_pool.cc:224] Handling call
0810 19:48:06.971653 (+1854666us) ts_tablet_manager.cc:1151] Deleting tablet 99aa001db52149dd90ce86e7261f7424
0810 19:48:06.971775 (+ 122us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.972593 (+ 818us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1854487}
W20260810 19:48:06.974655 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 99aa001db52149dd90ce86e7261f7424 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99aa001db52149dd90ce86e7261f7424 already in progress: creating tablet
I20260810 19:48:06.975808 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2027bd0223534a0ca3dd111a68b7e6cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:06.976531 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2027bd0223534a0ca3dd111a68b7e6cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:06.977448 9791 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:48:06.977880 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 788) took 1859 ms. Trace:
I20260810 19:48:06.978300 10377 rpcz_store.cc:276] 0810 19:48:05.116817 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.116982 (+ 165us) service_pool.cc:224] Handling call
0810 19:48:06.975263 (+1858281us) ts_tablet_manager.cc:1151] Deleting tablet ac17aa6447f547a9b9a44449b283bb69
0810 19:48:06.975393 (+ 130us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.975942 (+ 549us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1857829}
W20260810 19:48:06.982864 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet ac17aa6447f547a9b9a44449b283bb69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac17aa6447f547a9b9a44449b283bb69 already in progress: creating tablet
I20260810 19:48:06.983700 10367 ts_tablet_manager.cc:1434] T 5aa0f24443a34714a44137a77c12bbc3 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260810 19:48:06.983685 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 780) took 1898 ms. Trace:
I20260810 19:48:06.984112 10377 rpcz_store.cc:276] 0810 19:48:05.085392 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.208547 (+123155us) service_pool.cc:224] Handling call
0810 19:48:06.980573 (+1772026us) ts_tablet_manager.cc:1151] Deleting tablet e09365db984f41b49197891b332ebd87
0810 19:48:06.980592 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.983558 (+ 2966us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1771338}
W20260810 19:48:06.985489 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet e09365db984f41b49197891b332ebd87 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e09365db984f41b49197891b332ebd87 already in progress: creating tablet
I20260810 19:48:06.985807 10367 tablet_bootstrap.cc:492] T 988d87b2b00a459d9afc44ba0ae1961e P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:06.986984 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 804) took 1094 ms. Trace:
I20260810 19:48:06.987409 10377 rpcz_store.cc:276] 0810 19:48:05.892266 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.892332 (+ 66us) service_pool.cc:224] Handling call
0810 19:48:06.986252 (+1093920us) ts_tablet_manager.cc:1151] Deleting tablet 5ba42032e7344423a0e86c55d613f27d
0810 19:48:06.986268 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.986856 (+ 588us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1093582}
W20260810 19:48:06.989456 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 5ba42032e7344423a0e86c55d613f27d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ba42032e7344423a0e86c55d613f27d already in progress: creating tablet
I20260810 19:48:06.992478 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 805) took 1048 ms. Trace:
I20260810 19:48:06.992900 10377 rpcz_store.cc:276] 0810 19:48:05.943857 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.943916 (+ 59us) service_pool.cc:224] Handling call
0810 19:48:06.989714 (+1045798us) ts_tablet_manager.cc:1151] Deleting tablet 5b56fb5bed4b46a2a1fc0ab22379760b
0810 19:48:06.989738 (+ 24us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.992342 (+ 2604us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1044998}
W20260810 19:48:06.994203 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 5b56fb5bed4b46a2a1fc0ab22379760b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b56fb5bed4b46a2a1fc0ab22379760b already in progress: creating tablet
I20260810 19:48:06.996302 10366 tablet_bootstrap.cc:492] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:06.996447 10366 ts_tablet_manager.cc:1403] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.162s user 0.003s sys 0.000s
I20260810 19:48:06.996989 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 806) took 1050 ms. Trace:
I20260810 19:48:06.997421 10366 raft_consensus.cc:359] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:06.997277 10377 rpcz_store.cc:276] 0810 19:48:05.946190 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.946241 (+ 51us) service_pool.cc:224] Handling call
0810 19:48:06.994772 (+1048531us) ts_tablet_manager.cc:1151] Deleting tablet 98c1a8c9946248b78e5b77ba8dfdb953
0810 19:48:06.994890 (+ 118us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.996866 (+ 1976us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1048299}
W20260810 19:48:06.998687 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 98c1a8c9946248b78e5b77ba8dfdb953 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98c1a8c9946248b78e5b77ba8dfdb953 already in progress: creating tablet
I20260810 19:48:06.999856 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 807) took 1044 ms. Trace:
I20260810 19:48:07.000146 10377 rpcz_store.cc:276] 0810 19:48:05.955604 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.955817 (+ 213us) service_pool.cc:224] Handling call
0810 19:48:06.999206 (+1043389us) ts_tablet_manager.cc:1151] Deleting tablet 90b6f76f0cec4f33879030958cbe89bf
0810 19:48:06.999322 (+ 116us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:06.999736 (+ 414us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1043168}
W20260810 19:48:07.001485 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 90b6f76f0cec4f33879030958cbe89bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90b6f76f0cec4f33879030958cbe89bf already in progress: creating tablet
I20260810 19:48:07.002703 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 808) took 1032 ms. Trace:
I20260810 19:48:07.003645 10367 tablet_bootstrap.cc:654] T 988d87b2b00a459d9afc44ba0ae1961e P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:07.003135 10377 rpcz_store.cc:276] 0810 19:48:05.970372 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:05.970465 (+ 93us) service_pool.cc:224] Handling call
0810 19:48:07.002012 (+1031547us) ts_tablet_manager.cc:1151] Deleting tablet e750622b406c4783adf01bb1af6895de
0810 19:48:07.002130 (+ 118us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:07.002578 (+ 448us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1031211}
W20260810 19:48:07.004735 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet e750622b406c4783adf01bb1af6895de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e750622b406c4783adf01bb1af6895de already in progress: creating tablet
I20260810 19:48:06.997581 10366 raft_consensus.cc:385] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:07.005646 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e00c7d0fdf6741b5855eee8cf797b84a" } new_table_name: "default.Table_e10da6ead51548a985d3505c50a15bce" modify_external_catalogs: true
I20260810 19:48:07.005255 10366 raft_consensus.cc:740] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
W20260810 19:48:07.007591 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 6914b47e0cac4cd28ee4fd199684a280 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6914b47e0cac4cd28ee4fd199684a280 already in progress: creating tablet
I20260810 19:48:07.008764 12266 ts_tablet_manager.cc:1929] T ab27734e3d974260a77f1d94e5f534fe P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:07.008774 10377 tablet_replica.cc:333] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:07.007268 10366 consensus_queue.cc:260] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.010571 10377 raft_consensus.cc:2243] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:07.011132 12266 log.cc:1199] T ab27734e3d974260a77f1d94e5f534fe P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/ab27734e3d974260a77f1d94e5f534fe
I20260810 19:48:07.011569 12266 ts_tablet_manager.cc:1950] T ab27734e3d974260a77f1d94e5f534fe P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:07.012722 10366 ts_tablet_manager.cc:1434] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.016s user 0.004s sys 0.000s
I20260810 19:48:07.013619 10377 raft_consensus.cc:2272] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:07.014422 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet ab27734e3d974260a77f1d94e5f534fe (table default.Table_1954ac0ddba541af937bd2b421cb2f8e [id=bbf1b3708f9644d486aef32d1099aede]) successfully deleted
I20260810 19:48:07.016263 12338 raft_consensus.cc:493] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.016390 12338 raft_consensus.cc:515] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.016618 10366 tablet_bootstrap.cc:492] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:07.017066 12338 leader_election.cc:290] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:07.018004 9831 leader_election.cc:343] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: dcb3660108094399b36d19ea8e6b8308
I20260810 19:48:07.019690 10377 ts_tablet_manager.cc:1916] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:07.028595 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb3660108094399b36d19ea8e6b8308" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:07.053231 9611 leader_election.cc:343] T 8fadd6f84c75466287b318ed7018b071 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.053409 9611 leader_election.cc:304] T 8fadd6f84c75466287b318ed7018b071 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:07.053916 12407 raft_consensus.cc:2749] T 8fadd6f84c75466287b318ed7018b071 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:07.055209 9830 leader_election.cc:343] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.055356 9830 leader_election.cc:304] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:07.058073 12338 raft_consensus.cc:2749] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:07.060493 10068 leader_election.cc:343] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 00fe7d9a548a487d965d92b53cdf9250
I20260810 19:48:07.070389 12407 raft_consensus.cc:493] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.070581 12407 raft_consensus.cc:515] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:07.071355 12407 leader_election.cc:290] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:07.074118 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18cd8adaa065425c846bc791c05fa67d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:07.075330 9611 leader_election.cc:343] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.079502 10375 ts_tablet_manager.cc:1929] T dfea147ef3904ab49375def065c6f328 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:07.079747 10375 log.cc:1199] T dfea147ef3904ab49375def065c6f328 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/dfea147ef3904ab49375def065c6f328
I20260810 19:48:07.080188 10375 ts_tablet_manager.cc:1950] T dfea147ef3904ab49375def065c6f328 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:07.081035 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet dfea147ef3904ab49375def065c6f328 (table default.Table_44197dd0fe1e4c88b41c1e9996eaa4a2 [id=c6c90cd5058a4eb9985fc7df3ef5c79a]) successfully deleted
W20260810 19:48:07.081425 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 648ef608fa0c45cc8be4bad80c4200be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 648ef608fa0c45cc8be4bad80c4200be already in progress: creating tablet
W20260810 19:48:07.081751 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 27aca44685be4a0b92767d13bad15daf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 27aca44685be4a0b92767d13bad15daf already in progress: creating tablet
I20260810 19:48:07.082115 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3e50c2a587f045f090cdb0a281a1267f" } new_table_name: "default.Table_f283a0bdf6b94182a12f9b5f5dfe167a" modify_external_catalogs: true
I20260810 19:48:07.090346 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet b3754889e4574fc3a936ac31cc6f496a
I20260810 19:48:07.092793 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet b3754889e4574fc3a936ac31cc6f496a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:07.094272 10366 tablet_bootstrap.cc:654] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:07.096788 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet b3754889e4574fc3a936ac31cc6f496a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:07.097013 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet b3754889e4574fc3a936ac31cc6f496a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:07.098058 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet b3754889e4574fc3a936ac31cc6f496a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3754889e4574fc3a936ac31cc6f496a already in progress: creating tablet
I20260810 19:48:07.103124 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_935b71b999ed4687af77b56169ee4ecb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:07.103844 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_935b71b999ed4687af77b56169ee4ecb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:07.111439 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18cd8adaa065425c846bc791c05fa67d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:07.112416 9611 leader_election.cc:343] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.112567 9611 leader_election.cc:304] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:07.113108 12407 raft_consensus.cc:2749] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:07.114095 10367 tablet_bootstrap.cc:492] T 988d87b2b00a459d9afc44ba0ae1961e P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:07.114249 10367 ts_tablet_manager.cc:1403] T 988d87b2b00a459d9afc44ba0ae1961e P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.129s user 0.031s sys 0.051s
I20260810 19:48:07.115006 10367 raft_consensus.cc:359] T 988d87b2b00a459d9afc44ba0ae1961e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.115176 10367 raft_consensus.cc:385] T 988d87b2b00a459d9afc44ba0ae1961e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:07.115221 10367 raft_consensus.cc:740] T 988d87b2b00a459d9afc44ba0ae1961e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:07.115430 10367 consensus_queue.cc:260] T 988d87b2b00a459d9afc44ba0ae1961e P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.115907 10367 ts_tablet_manager.cc:1434] T 988d87b2b00a459d9afc44ba0ae1961e P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:07.116199 10367 tablet_bootstrap.cc:492] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:07.119779 10367 tablet_bootstrap.cc:654] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:07.136330 10366 tablet_bootstrap.cc:492] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:07.136737 10366 ts_tablet_manager.cc:1403] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.121s user 0.008s sys 0.000s
I20260810 19:48:07.137046 10370 tablet_bootstrap.cc:492] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:07.137243 10370 ts_tablet_manager.cc:1403] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.312s user 0.005s sys 0.000s
I20260810 19:48:07.138123 10370 raft_consensus.cc:359] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.138501 10370 raft_consensus.cc:385] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:07.138628 10370 raft_consensus.cc:740] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:07.138784 10366 raft_consensus.cc:359] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.138993 10370 consensus_queue.cc:260] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.139189 10366 raft_consensus.cc:385] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:07.139335 10366 raft_consensus.cc:740] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:07.139716 10370 ts_tablet_manager.cc:1434] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:07.139868 10366 consensus_queue.cc:260] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.141898 10370 tablet_bootstrap.cc:492] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:07.144048 10370 tablet_bootstrap.cc:654] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:07.146170 10068 consensus_peers.cc:597] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ebf33d82af9e494a8e85be8cba55d2c9. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:07.151551 10367 tablet_bootstrap.cc:492] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:07.151719 10367 ts_tablet_manager.cc:1403] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.036s user 0.015s sys 0.014s
I20260810 19:48:07.152567 10367 raft_consensus.cc:359] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.152761 10367 raft_consensus.cc:385] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:07.152822 10367 raft_consensus.cc:740] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:07.153029 10367 consensus_queue.cc:260] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.153554 10367 ts_tablet_manager.cc:1434] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:07.153861 10367 tablet_bootstrap.cc:492] T 9e861473094f42dfa22b9c00145ed1fe P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:07.155730 10367 tablet_bootstrap.cc:654] T 9e861473094f42dfa22b9c00145ed1fe P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:07.170060 10366 ts_tablet_manager.cc:1434] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.033s user 0.003s sys 0.000s
W20260810 19:48:07.172726 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 01df0725b38d4517b22df017b6c5e2e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01df0725b38d4517b22df017b6c5e2e7 already in progress: creating tablet
W20260810 19:48:07.173156 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 49a73b0637664821bcb44ba463baac18 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49a73b0637664821bcb44ba463baac18 already in progress: creating tablet
I20260810 19:48:07.173199 10375 tablet_replica.cc:333] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:07.173600 10375 raft_consensus.cc:2243] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:07.174054 10375 raft_consensus.cc:2272] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:07.174787 10375 ts_tablet_manager.cc:1916] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:07.178360 10366 tablet_bootstrap.cc:492] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
W20260810 19:48:07.182363 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4bc41ad892a247848f5d2c1a0d3333ef consensus state has no leader
I20260810 19:48:07.182971 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f6d50f80460c49978230429d978b40e6" } modify_external_catalogs: true
I20260810 19:48:07.183174 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f6d50f80460c49978230429d978b40e6" } modify_external_catalogs: true
I20260810 19:48:07.195082 10366 tablet_bootstrap.cc:654] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:07.213596 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet b704af46d0da4695a2aefd5dd17e0a7d
I20260810 19:48:07.214936 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet b704af46d0da4695a2aefd5dd17e0a7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:07.215778 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet b704af46d0da4695a2aefd5dd17e0a7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b704af46d0da4695a2aefd5dd17e0a7d already in progress: creating tablet
I20260810 19:48:07.218568 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet b704af46d0da4695a2aefd5dd17e0a7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:07.218669 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet b704af46d0da4695a2aefd5dd17e0a7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:07.218765 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_63c36107140a41da9c5d337a853cb5d3" } modify_external_catalogs: true
I20260810 19:48:07.219007 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_63c36107140a41da9c5d337a853cb5d3" } modify_external_catalogs: true
I20260810 19:48:07.220801 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_43b864f9a392475687c4ff23fe9dd13a" } new_table_name: "default.Table_0a1a76f241a1418ba5cb63ddec738374" modify_external_catalogs: true
W20260810 19:48:07.222708 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dc3164c171b84b04bc67c0218ece7e99 consensus state has no leader
I20260810 19:48:07.223004 9408 master_service.cc:960] ReplaceTablet: received request to replace tablet cbcaa7106df24aaeb07428b7b590e282 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:07.224586 12407 raft_consensus.cc:493] T d6f410a1659c40f08ac274e63ad01b3d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.224766 12407 raft_consensus.cc:515] T d6f410a1659c40f08ac274e63ad01b3d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.225502 12407 leader_election.cc:290] T d6f410a1659c40f08ac274e63ad01b3d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:07.226241 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f410a1659c40f08ac274e63ad01b3d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:07.226982 9611 leader_election.cc:343] T d6f410a1659c40f08ac274e63ad01b3d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.227043 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f410a1659c40f08ac274e63ad01b3d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:07.230743 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 988d87b2b00a459d9afc44ba0ae1961e consensus state has no leader
I20260810 19:48:07.231808 12313 raft_consensus.cc:493] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.231988 12313 raft_consensus.cc:515] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.232699 12313 leader_election.cc:290] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:07.233276 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c285518ed49d4ed68a6039f98db3b700" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:07.233850 9611 leader_election.cc:343] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:07.234207 9611 leader_election.cc:343] T d6f410a1659c40f08ac274e63ad01b3d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.234303 9611 leader_election.cc:304] T d6f410a1659c40f08ac274e63ad01b3d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:07.234337 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c285518ed49d4ed68a6039f98db3b700" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:07.234764 12313 raft_consensus.cc:2749] T d6f410a1659c40f08ac274e63ad01b3d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:07.234907 9611 leader_election.cc:343] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.235004 9611 leader_election.cc:304] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:07.235175 12313 raft_consensus.cc:2749] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:07.247306 10370 tablet_bootstrap.cc:492] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:07.247486 10370 ts_tablet_manager.cc:1403] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.106s user 0.000s sys 0.003s
I20260810 19:48:07.248365 10370 raft_consensus.cc:359] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.248564 10370 raft_consensus.cc:385] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:07.248621 10370 raft_consensus.cc:740] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:07.248912 10370 consensus_queue.cc:260] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.249578 10370 ts_tablet_manager.cc:1434] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260810 19:48:07.250587 10370 tablet_bootstrap.cc:492] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:07.252698 10370 tablet_bootstrap.cc:654] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:07.266954 10375 ts_tablet_manager.cc:1929] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260810 19:48:07.267246 10375 log.cc:1199] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/9714a8a1eeaf41d2bb01d3fa3ff7181d
I20260810 19:48:07.268136 10375 ts_tablet_manager.cc:1950] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:07.182297 10377 ts_tablet_manager.cc:1929] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:07.277704 10377 log.cc:1199] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/4b2b0f2fc93647f3bc1d79b4132c3703
I20260810 19:48:07.280813 10377 ts_tablet_manager.cc:1950] T 4b2b0f2fc93647f3bc1d79b4132c3703 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:07.283525 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 810) took 1248 ms. Trace:
I20260810 19:48:07.283740 10377 rpcz_store.cc:276] 0810 19:48:06.035551 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.035621 (+ 70us) service_pool.cc:224] Handling call
0810 19:48:07.008351 (+972730us) ts_tablet_manager.cc:1151] Deleting tablet 4b2b0f2fc93647f3bc1d79b4132c3703
0810 19:48:07.008365 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:07.116168 (+107803us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:07.182151 (+ 65983us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:07.283467 (+101316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":399104,"tablet-delete.queue_time_us":972338}
I20260810 19:48:07.285842 10370 tablet_bootstrap.cc:492] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:07.286029 10370 ts_tablet_manager.cc:1403] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.036s user 0.000s sys 0.003s
I20260810 19:48:07.286993 10370 raft_consensus.cc:359] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.287292 10370 raft_consensus.cc:385] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:07.287410 10370 raft_consensus.cc:740] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:07.287743 10370 consensus_queue.cc:260] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.288439 10370 ts_tablet_manager.cc:1434] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260810 19:48:07.289001 10370 tablet_bootstrap.cc:492] T db2b8038ee9747109b42510bba02faa9 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:07.290611 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0056243a8c8d42a3bfea00d5110ccc12" } new_table_name: "default.Table_bd99f8533af7419086a1ae12068ad426" modify_external_catalogs: true
I20260810 19:48:07.291874 10370 tablet_bootstrap.cc:654] T db2b8038ee9747109b42510bba02faa9 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:07.293547 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 4b2b0f2fc93647f3bc1d79b4132c3703 (table default.Table_d195688055bd4cfca1a9462585af71bc [id=64e1f507ae574ea6b7fa1627b8e7f4c3]) successfully deleted
W20260810 19:48:07.293547 9400 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 4bc41ad892a247848f5d2c1a0d3333ef (table default.Table_5566f9d152794e309dd817727a18e4cf [id=6aa7b61a3c6a419b8581e359ded42a50], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4bc41ad892a247848f5d2c1a0d3333ef consensus state has no leader
W20260810 19:48:07.295192 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 841f58b4e8f7465eaa7fa08629e0bc2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 841f58b4e8f7465eaa7fa08629e0bc2a already in progress: creating tablet
I20260810 19:48:07.296604 10370 tablet_bootstrap.cc:492] T db2b8038ee9747109b42510bba02faa9 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:07.296833 10370 ts_tablet_manager.cc:1403] T db2b8038ee9747109b42510bba02faa9 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.004s
W20260810 19:48:07.297264 9395 catalog_manager.cc:5017] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 21208dd824fe432fa307cbb88d37aaa2 because the tablet was not found. No further retry: Not found: Tablet not found: 21208dd824fe432fa307cbb88d37aaa2
I20260810 19:48:07.297829 10370 raft_consensus.cc:359] T db2b8038ee9747109b42510bba02faa9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.298149 10370 raft_consensus.cc:385] T db2b8038ee9747109b42510bba02faa9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:07.298250 10370 raft_consensus.cc:740] T db2b8038ee9747109b42510bba02faa9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:07.298895 10370 consensus_queue.cc:260] T db2b8038ee9747109b42510bba02faa9 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.299002 12313 raft_consensus.cc:493] T 82c3f619c76e40c583bfcdf2bb77fe42 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.299162 12313 raft_consensus.cc:515] T 82c3f619c76e40c583bfcdf2bb77fe42 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.299747 10370 ts_tablet_manager.cc:1434] T db2b8038ee9747109b42510bba02faa9 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 19:48:07.299844 12313 leader_election.cc:290] T 82c3f619c76e40c583bfcdf2bb77fe42 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:07.300688 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c3f619c76e40c583bfcdf2bb77fe42" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:07.297286 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a45add97e0e54dce85225e175ecbb45a consensus state has no leader
W20260810 19:48:07.301323 9611 leader_election.cc:343] T 82c3f619c76e40c583bfcdf2bb77fe42 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.306559 10159 raft_consensus.cc:3060] T db2b8038ee9747109b42510bba02faa9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:07.306691 10370 tablet_bootstrap.cc:492] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:07.308753 10370 tablet_bootstrap.cc:654] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:07.313781 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3531b1d4a9e04438a2ead5ab916c23fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:07.314646 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3531b1d4a9e04438a2ead5ab916c23fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:07.315546 10370 tablet_bootstrap.cc:492] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:07.315706 10370 ts_tablet_manager.cc:1403] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.003s
I20260810 19:48:07.316576 10370 raft_consensus.cc:359] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.316771 10370 raft_consensus.cc:385] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:07.316875 10370 raft_consensus.cc:740] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:07.317145 10370 consensus_queue.cc:260] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.317188 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b3fe10a412cb4c13851701b963a1d7ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:07.317843 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3fe10a412cb4c13851701b963a1d7ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:07.317929 10370 ts_tablet_manager.cc:1434] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260810 19:48:07.311076 9395 catalog_manager.cc:5017] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 476e762e46c04ae6bfef5e14df2d16e2 because the tablet was not found. No further retry: Not found: Tablet not found: 476e762e46c04ae6bfef5e14df2d16e2
I20260810 19:48:07.323864 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d (table default.Table_c35ddec630d942db9ba85f10a2f405ee [id=fd840f00bdc5477aaad0b7fa114870dd]) successfully deleted
I20260810 19:48:07.327720 12313 raft_consensus.cc:493] T ca733de7babe4343ab26dbca2c9020b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.327920 12313 raft_consensus.cc:515] T ca733de7babe4343ab26dbca2c9020b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.328037 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0a1983416c99454b889117130d83b254"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:07.328630 12313 leader_election.cc:290] T ca733de7babe4343ab26dbca2c9020b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:07.328667 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a1983416c99454b889117130d83b254 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:07.331022 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca733de7babe4343ab26dbca2c9020b2" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:07.331763 9611 leader_election.cc:343] T ca733de7babe4343ab26dbca2c9020b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.335283 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_12c2d074b668459b8fb2b34d33add2f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:07.335882 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12c2d074b668459b8fb2b34d33add2f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:07.340898 9941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca733de7babe4343ab26dbca2c9020b2" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:07.341001 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c3f619c76e40c583bfcdf2bb77fe42" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:07.341077 10377 tablet_replica.cc:333] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:07.341575 10377 raft_consensus.cc:2243] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:07.342818 10377 raft_consensus.cc:2272] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:07.344532 9611 leader_election.cc:343] T ca733de7babe4343ab26dbca2c9020b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.344681 9611 leader_election.cc:304] T ca733de7babe4343ab26dbca2c9020b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
W20260810 19:48:07.345161 9611 leader_election.cc:343] T 82c3f619c76e40c583bfcdf2bb77fe42 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.345299 9611 leader_election.cc:304] T 82c3f619c76e40c583bfcdf2bb77fe42 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:07.345664 12407 raft_consensus.cc:2749] T ca733de7babe4343ab26dbca2c9020b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:07.345840 12407 raft_consensus.cc:2749] T 82c3f619c76e40c583bfcdf2bb77fe42 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:07.342871 10366 tablet_bootstrap.cc:492] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:07.346547 10366 ts_tablet_manager.cc:1403] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.168s user 0.005s sys 0.000s
I20260810 19:48:07.347349 10366 raft_consensus.cc:359] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.347556 10366 raft_consensus.cc:385] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:07.347604 10366 raft_consensus.cc:740] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:07.347829 10366 consensus_queue.cc:260] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.348371 10366 ts_tablet_manager.cc:1434] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:07.350399 10366 tablet_bootstrap.cc:492] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:07.350477 11897 raft_consensus.cc:493] T 4dba7046bdfd41f1a2ad6f299a723776 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.350608 11897 raft_consensus.cc:515] T 4dba7046bdfd41f1a2ad6f299a723776 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.351200 11897 leader_election.cc:290] T 4dba7046bdfd41f1a2ad6f299a723776 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:07.351931 10366 tablet_bootstrap.cc:654] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:07.351894 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dba7046bdfd41f1a2ad6f299a723776" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:07.352535 9830 leader_election.cc:343] T 4dba7046bdfd41f1a2ad6f299a723776 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.354377 10377 ts_tablet_manager.cc:1916] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:07.358440 10367 tablet_bootstrap.cc:492] T 9e861473094f42dfa22b9c00145ed1fe P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:07.358916 10367 ts_tablet_manager.cc:1403] T 9e861473094f42dfa22b9c00145ed1fe P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.205s user 0.080s sys 0.107s
W20260810 19:48:07.362927 9831 leader_election.cc:343] T 4dba7046bdfd41f1a2ad6f299a723776 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 4dba7046bdfd41f1a2ad6f299a723776
I20260810 19:48:07.363072 9831 leader_election.cc:304] T 4dba7046bdfd41f1a2ad6f299a723776 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:07.363601 11897 raft_consensus.cc:2749] T 4dba7046bdfd41f1a2ad6f299a723776 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:07.366778 12313 raft_consensus.cc:493] T 60bd14fb8c2e40dc955352518d463ccb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.366961 12313 raft_consensus.cc:515] T 60bd14fb8c2e40dc955352518d463ccb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.367615 12313 leader_election.cc:290] T 60bd14fb8c2e40dc955352518d463ccb P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:07.368927 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_491e9a2223e9472a842709f9e9250766"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:07.369606 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_491e9a2223e9472a842709f9e9250766 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:07.373768 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60bd14fb8c2e40dc955352518d463ccb" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:07.374146 12489 tablet.cc:1724] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260810 19:48:07.374689 9611 leader_election.cc:343] T 60bd14fb8c2e40dc955352518d463ccb P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.376981 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3c9ceb27d8ed4f339574218044ba1f6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:07.377614 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c9ceb27d8ed4f339574218044ba1f6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:07.381847 12428 tablet.cc:1724] T db2b8038ee9747109b42510bba02faa9 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:07.383204 12497 tablet.cc:1724] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 19:48:07.394073 10029 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:48:07.394604 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2fd589ce44f442528ad417adff50cc0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:07.395299 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2fd589ce44f442528ad417adff50cc0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:07.395829 12489 tablet.cc:1724] T db2b8038ee9747109b42510bba02faa9 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:07.397820 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60bd14fb8c2e40dc955352518d463ccb" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:07.398614 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 2ac59875628e40ffb1385dedea2f3b9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ac59875628e40ffb1385dedea2f3b9d already in progress: creating tablet
W20260810 19:48:07.398655 9611 leader_election.cc:343] T 60bd14fb8c2e40dc955352518d463ccb P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.398792 9611 leader_election.cc:304] T 60bd14fb8c2e40dc955352518d463ccb P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:07.399127 12313 raft_consensus.cc:2749] T 60bd14fb8c2e40dc955352518d463ccb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:07.401779 10370 tablet_bootstrap.cc:492] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:48:07.402091 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 08ac9ae9eceb42b3880c4f35556994c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08ac9ae9eceb42b3880c4f35556994c7 already in progress: creating tablet
I20260810 19:48:07.403735 10370 tablet_bootstrap.cc:654] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:07.406728 12498 tablet.cc:1724] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 19:48:07.410674 10367 raft_consensus.cc:359] T 9e861473094f42dfa22b9c00145ed1fe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.410913 10367 raft_consensus.cc:385] T 9e861473094f42dfa22b9c00145ed1fe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:07.410970 10367 raft_consensus.cc:740] T 9e861473094f42dfa22b9c00145ed1fe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:07.411252 10367 consensus_queue.cc:260] T 9e861473094f42dfa22b9c00145ed1fe P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.413522 10367 ts_tablet_manager.cc:1434] T 9e861473094f42dfa22b9c00145ed1fe P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.054s user 0.002s sys 0.000s
I20260810 19:48:07.413857 10367 tablet_bootstrap.cc:492] T 1a393149727043f3a3c9f58aa051b065 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:07.413190 10375 tablet_replica.cc:333] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:07.427340 12313 raft_consensus.cc:493] T 5aa0f24443a34714a44137a77c12bbc3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.427556 12313 raft_consensus.cc:515] T 5aa0f24443a34714a44137a77c12bbc3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.428290 12313 leader_election.cc:290] T 5aa0f24443a34714a44137a77c12bbc3 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:07.429363 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa0f24443a34714a44137a77c12bbc3" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:07.430141 9611 leader_election.cc:343] T 5aa0f24443a34714a44137a77c12bbc3 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.437765 10367 tablet_bootstrap.cc:654] T 1a393149727043f3a3c9f58aa051b065 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:07.441704 10377 ts_tablet_manager.cc:1929] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:07.441857 10377 log.cc:1199] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/00fe7d9a548a487d965d92b53cdf9250
I20260810 19:48:07.442184 10377 ts_tablet_manager.cc:1950] T 00fe7d9a548a487d965d92b53cdf9250 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:07.444090 12313 raft_consensus.cc:493] T ee5f38d91bb349a9ae1da8ba69d2ddbc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.444243 12313 raft_consensus.cc:515] T ee5f38d91bb349a9ae1da8ba69d2ddbc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.444913 12313 leader_election.cc:290] T ee5f38d91bb349a9ae1da8ba69d2ddbc P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:07.445492 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5f38d91bb349a9ae1da8ba69d2ddbc" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:07.446122 9611 leader_election.cc:343] T ee5f38d91bb349a9ae1da8ba69d2ddbc P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.417671 10375 raft_consensus.cc:2243] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:07.450418 10375 pending_rounds.cc:70] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:07.450474 10375 pending_rounds.cc:77] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058701968252928 op_type: NO_OP noop_request { }
I20260810 19:48:07.450587 10375 raft_consensus.cc:2889] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:07.450686 10375 raft_consensus.cc:2272] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:07.429080 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa0f24443a34714a44137a77c12bbc3" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:07.453141 10377 tablet_replica.cc:333] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
W20260810 19:48:07.453151 9611 leader_election.cc:343] T 5aa0f24443a34714a44137a77c12bbc3 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.453311 9611 leader_election.cc:304] T 5aa0f24443a34714a44137a77c12bbc3 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:07.453672 10377 raft_consensus.cc:2243] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:07.431113 10370 tablet_bootstrap.cc:492] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:07.417724 12498 tablet.cc:1724] T db2b8038ee9747109b42510bba02faa9 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:07.454063 10370 ts_tablet_manager.cc:1403] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.052s user 0.001s sys 0.005s
I20260810 19:48:07.445993 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5f38d91bb349a9ae1da8ba69d2ddbc" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:07.454555 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 00fe7d9a548a487d965d92b53cdf9250 (table default.Table_2adfdcdb33f543d49ea6f361bf8a55c4 [id=cfd27e7efc8f4c529e7dace21742b656]) successfully deleted
W20260810 19:48:07.455063 9611 leader_election.cc:343] T ee5f38d91bb349a9ae1da8ba69d2ddbc P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.455173 9611 leader_election.cc:304] T ee5f38d91bb349a9ae1da8ba69d2ddbc P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:07.455405 12407 raft_consensus.cc:2749] T 5aa0f24443a34714a44137a77c12bbc3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:07.455556 12407 raft_consensus.cc:2749] T ee5f38d91bb349a9ae1da8ba69d2ddbc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:07.456596 10367 tablet_bootstrap.cc:492] T 1a393149727043f3a3c9f58aa051b065 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:07.456730 10367 ts_tablet_manager.cc:1403] T 1a393149727043f3a3c9f58aa051b065 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.000s
I20260810 19:48:07.457540 10367 raft_consensus.cc:359] T 1a393149727043f3a3c9f58aa051b065 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.457708 10367 raft_consensus.cc:385] T 1a393149727043f3a3c9f58aa051b065 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:07.457762 10367 raft_consensus.cc:740] T 1a393149727043f3a3c9f58aa051b065 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:07.457991 10367 consensus_queue.cc:260] T 1a393149727043f3a3c9f58aa051b065 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.460376 10375 ts_tablet_manager.cc:1916] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:07.463587 10370 raft_consensus.cc:359] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.464192 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1e8a017a12334fbba8f7ed4654d30c26"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:07.464975 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e8a017a12334fbba8f7ed4654d30c26 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:07.465138 10370 raft_consensus.cc:385] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:07.465256 10370 raft_consensus.cc:740] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:07.465605 10370 consensus_queue.cc:260] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.467538 10370 ts_tablet_manager.cc:1434] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.013s user 0.000s sys 0.002s
I20260810 19:48:07.467892 10370 tablet_bootstrap.cc:492] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:07.469973 10370 tablet_bootstrap.cc:654] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:07.472533 10367 ts_tablet_manager.cc:1434] T 1a393149727043f3a3c9f58aa051b065 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.016s user 0.002s sys 0.001s
I20260810 19:48:07.472832 10247 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:48:07.472947 10367 tablet_bootstrap.cc:492] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:07.474794 10367 tablet_bootstrap.cc:654] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:07.478113 12407 raft_consensus.cc:493] T 827dce05c192467589e2692fabd2a84e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.478281 12407 raft_consensus.cc:515] T 827dce05c192467589e2692fabd2a84e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.479007 12407 leader_election.cc:290] T 827dce05c192467589e2692fabd2a84e P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:07.479972 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827dce05c192467589e2692fabd2a84e" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:07.480010 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827dce05c192467589e2692fabd2a84e" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:07.480445 10377 raft_consensus.cc:2272] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:07.480690 9611 leader_election.cc:343] T 827dce05c192467589e2692fabd2a84e P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:07.480897 9611 leader_election.cc:343] T 827dce05c192467589e2692fabd2a84e P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.480975 9611 leader_election.cc:304] T 827dce05c192467589e2692fabd2a84e P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:07.481370 12407 raft_consensus.cc:2749] T 827dce05c192467589e2692fabd2a84e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:07.481405 10377 ts_tablet_manager.cc:1916] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:07.483775 10067 consensus_peers.cc:597] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5f30148b5c84f7cbdfabd0186611cc4. This is attempt 1: this message will repeat every 5th retry.
W20260810 19:48:07.497530 10067 consensus_peers.cc:597] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:07.500327 9412 master_service.cc:960] ReplaceTablet: received request to replace tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:07.504164 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 79841de1d91c4961bc0742d89d570a7f (DEFAULT_TABLE table=default.Table_0ce62d56d03f4f9aa5441e1150e8fc6a [id=b487a808ace14d7db75f49c6fc7d76e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.504689 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79841de1d91c4961bc0742d89d570a7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.504853 9410 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 410855f236004ad4b78839eb1c0c2f1f (table default.Table_44478e93cffb460aaa8df9115b799594 [id=1d363ce63686462f9f4c15669773ee22]). Expected version 1 got 0
I20260810 19:48:07.505088 9410 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet f3e3dde1c29e4275bafb27df63b117be (table default.Table_da45ba37a0804616b521723bc724e0f0 [id=d5afb5c8b2d042e5aec4a0721e2cae1d]). Expected version 1 got 0
I20260810 19:48:07.508327 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 79841de1d91c4961bc0742d89d570a7f (DEFAULT_TABLE table=default.Table_0ce62d56d03f4f9aa5441e1150e8fc6a [id=b487a808ace14d7db75f49c6fc7d76e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.508523 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 79841de1d91c4961bc0742d89d570a7f (DEFAULT_TABLE table=default.Table_0ce62d56d03f4f9aa5441e1150e8fc6a [id=b487a808ace14d7db75f49c6fc7d76e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.508659 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 56d73dcc5a8040748d26b8ab0385a1fe (DEFAULT_TABLE table=default.Table_2de6c377720f4c89a6fb761cad0efa2f [id=6c1793fbfb5041c4a3f4bda191d735b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.508812 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79841de1d91c4961bc0742d89d570a7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.508958 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79841de1d91c4961bc0742d89d570a7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.509025 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d73dcc5a8040748d26b8ab0385a1fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.514617 9410 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 18cd8adaa065425c846bc791c05fa67d (table default.Table_a1645668cf79415ca029a01169fbf874 [id=aec405416e584af6bfb8194b357d6dbc]). Expected version 3 got 0
I20260810 19:48:07.514968 9410 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet db2b8038ee9747109b42510bba02faa9 (table default.Table_2b20dee66e634a07bc9f2e2de90e8529 [id=452b19ee68bc463086780f6f72603483]). Expected version 1 got 0
I20260810 19:48:07.515157 9410 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 3840b035b88243ecad17865d4716fcfc (table default.Table_e1cc6dd116324bf385dbc82e56283cf7 [id=6bf4ac94189d476d9ab5778e69d0b14f]). Expected version 1 got 0
I20260810 19:48:07.515542 9407 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_f9dcbf84ccd243aebda13a2295238bf2 [id=4ed93ad00edc4b06ba6b845cfd726631] alter complete (version 2)
I20260810 19:48:07.516088 9415 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_908acdc21674469e937e4539876e0267 [id=de4d62ebb8c440a1a71ed57ac4f3c530] alter complete (version 1)
I20260810 19:48:07.518183 11828 raft_consensus.cc:493] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.518368 11828 raft_consensus.cc:515] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.519057 11828 leader_election.cc:290] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:07.519487 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4fb96dbc73be4091855b1cbbed3b9ce6" } modify_external_catalogs: true
I20260810 19:48:07.519696 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4fb96dbc73be4091855b1cbbed3b9ce6" } modify_external_catalogs: true
I20260810 19:48:07.519784 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2b20dc77954af7a203f357c746be29" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:07.519972 10068 leader_election.cc:343] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 2b2b20dc77954af7a203f357c746be29
I20260810 19:48:07.519987 9948 raft_consensus.cc:2468] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:07.520510 10067 leader_election.cc:304] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:07.520923 11828 raft_consensus.cc:2804] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:07.520996 11828 raft_consensus.cc:493] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:07.521055 11828 raft_consensus.cc:3060] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:07.524062 11828 raft_consensus.cc:515] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.525300 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet ae3e151180ae4d258d18365770acaaad with delete_type TABLET_DATA_DELETED (replaced by tablet 6dea3165feb842ecb58b7ace235abf38) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:07.525738 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e8a23221e8447bd83592c05c9d1149c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:07.525774 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b2b0f2fc93647f3bc1d79b4132c3703 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:05 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:07.525954 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet dcb3660108094399b36d19ea8e6b8308 with delete_type TABLET_DATA_DELETED (replaced by tablet f5fa6060b9ef48cea6830cd9d19424ea) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:07.525581 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet 00fe7d9a548a487d965d92b53cdf9250 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ed73161398f4f54a20a9173c18b4d3c) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:07.526114 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b2b20dc77954af7a203f357c746be29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:07.526400 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet 8455cb11388340beb6daa13fee06177a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:07.526268 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bddaf5b5fc1404e83b079ffa97e7321 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:07.527168 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2b20dc77954af7a203f357c746be29" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:07.527357 9948 raft_consensus.cc:3060] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:07.527486 10068 leader_election.cc:343] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 2b2b20dc77954af7a203f357c746be29
I20260810 19:48:07.527827 12407 raft_consensus.cc:493] T 19e2bf7b7d254894a07c5a75bf24e742 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.527958 12407 raft_consensus.cc:515] T 19e2bf7b7d254894a07c5a75bf24e742 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.528544 12407 leader_election.cc:290] T 19e2bf7b7d254894a07c5a75bf24e742 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:07.528648 9415 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.8.235.194:59637 (request call id 91) took 881 ms (client timeout 1000 ms). Trace:
W20260810 19:48:07.528785 9415 rpcz_store.cc:269] 0810 19:48:06.648367 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.687885 (+ 39518us) service_pool.cc:224] Handling call
0810 19:48:06.783158 (+ 95273us) spinlock_profiling.cc:243] Waited 94 ms on lock 0x616000041b54. stack: 00007f50aec1d326 00007f50aec1d0e0 00007f50adc4734d 00000000009a5774 00000000009a573d 00007f50be19c65d 00007f50be19c753 00007f50bad21ac1 00007f50c2afb40d 00007f50c2c84358 00007f50b966f1f6 00007f50b966ef25 00007f50b5d6061e 00007f50b5d5f4fe 00007f50b5d65738 00007f50b5d6609f
0810 19:48:07.528604 (+745446us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:48:07.007524 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 19:48:07.007643 (+ 119us) write_op.cc:432] Acquiring schema lock in shared mode
0810 19:48:07.007648 (+ 5us) write_op.cc:435] Acquired schema lock
0810 19:48:07.007651 (+ 3us) tablet.cc:662] Decoding operations
0810 19:48:07.007811 (+ 160us) write_op.cc:620] Acquiring the partition lock for write op
0810 19:48:07.007826 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0810 19:48:07.007831 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0810 19:48:07.007915 (+ 84us) tablet.cc:701] Row locks acquired
0810 19:48:07.007917 (+ 2us) write_op.cc:260] PREPARE: finished
0810 19:48:07.007961 (+ 44us) write_op.cc:270] Start()
0810 19:48:07.007999 (+ 38us) write_op.cc:276] Timestamp: P: 1786391287007937 usec, L: 0
0810 19:48:07.008003 (+ 4us) op_driver.cc:348] REPLICATION: starting
0810 19:48:07.008211 (+ 208us) log.cc:844] Serialized 356 byte log entry
0810 19:48:07.015429 (+ 7218us) op_driver.cc:464] REPLICATION: finished
0810 19:48:07.018243 (+ 2814us) write_op.cc:301] APPLY: starting
0810 19:48:07.018268 (+ 25us) tablet.cc:1367] starting BulkCheckPresence
0810 19:48:07.018350 (+ 82us) tablet.cc:1370] finished BulkCheckPresence
0810 19:48:07.018421 (+ 71us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 19:48:07.018489 (+ 68us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 19:48:07.018527 (+ 38us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 19:48:07.018536 (+ 9us) write_op.cc:312] APPLY: finished
0810 19:48:07.018632 (+ 96us) log.cc:844] Serialized 23 byte log entry
0810 19:48:07.018705 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:07.018728 (+ 23us) write_op.cc:454] Released schema lock
0810 19:48:07.018736 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 19:48:07.034841 (+ 16105us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:07.034849 (+ 8us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":18,"spinlock_wait_cycles":216280960,"child_traces":[["op",{"apply.queue_time_us":2733,"apply.run_cpu_time_us":578,"apply.run_wall_time_us":577,"num_ops":1,"prepare.queue_time_us":205088,"prepare.run_cpu_time_us":809,"prepare.run_wall_time_us":27298,"raft.queue_time_us":40,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":863,"replication_time_us":7389}]]}
I20260810 19:48:07.529186 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e2bf7b7d254894a07c5a75bf24e742" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:07.529455 9415 master_service.cc:960] ReplaceTablet: received request to replace tablet d77785d9bde843bc8366fe15d1b4fa18 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:07.529608 9941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e2bf7b7d254894a07c5a75bf24e742" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:07.529744 9611 leader_election.cc:343] T 19e2bf7b7d254894a07c5a75bf24e742 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:07.530146 9611 leader_election.cc:343] T 19e2bf7b7d254894a07c5a75bf24e742 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.530236 9611 leader_election.cc:304] T 19e2bf7b7d254894a07c5a75bf24e742 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:07.530642 12407 raft_consensus.cc:2749] T 19e2bf7b7d254894a07c5a75bf24e742 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:07.530920 9948 raft_consensus.cc:2468] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:07.531796 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet f85f3fa629764c79921a710739eea7ae with delete_type TABLET_DATA_DELETED (replaced by tablet 2892d9fcdda34167a532dde7ed398590) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:07.532024 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 4198f46be0194875aea6a7952321bc69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:07.532167 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 19e2bf7b7d254894a07c5a75bf24e742 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:07.532218 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet 31c2b9a4b8334e678b4632fc2f58dd0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:07.532413 12266 tablet_replica.cc:333] T f85f3fa629764c79921a710739eea7ae P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:07.532601 12266 raft_consensus.cc:2243] T f85f3fa629764c79921a710739eea7ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:07.532750 12266 raft_consensus.cc:2272] T f85f3fa629764c79921a710739eea7ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:07.532995 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet 63486cc3f8774a11827b1cc5f1c16332 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:07.533327 12266 ts_tablet_manager.cc:1916] T f85f3fa629764c79921a710739eea7ae P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:07.537209 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 85cc1fa48ad944e99b94834f017fe289 (DEFAULT_TABLE table=default.Table_14bad8f87ea44929a0de0f4351d51d20 [id=2bd96996272242c3b0f1bb8965320b8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.537340 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 85cc1fa48ad944e99b94834f017fe289 (DEFAULT_TABLE table=default.Table_14bad8f87ea44929a0de0f4351d51d20 [id=2bd96996272242c3b0f1bb8965320b8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.537708 10115 tablet_service.cc:1511] Processing CreateTablet for tablet 1063ea2fb28843f58b8c891e3b899c1e (DEFAULT_TABLE table=default.Table_e12745e4f4ed4e9d8c0af00601fa49a2 [id=352f11deb18d436d986218c3fba31d3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.537829 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85cc1fa48ad944e99b94834f017fe289. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.539033 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 37fde6f8739a4ec68d3484e8d8be0af8 (DEFAULT_TABLE table=default.Table_82769090fe3a4bc49bc9b6672448e6b7 [id=7d1a287d14184e0d841c8a7f9a26fb69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.539235 11828 leader_election.cc:290] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:07.539799 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 1063ea2fb28843f58b8c891e3b899c1e (DEFAULT_TABLE table=default.Table_e12745e4f4ed4e9d8c0af00601fa49a2 [id=352f11deb18d436d986218c3fba31d3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.540246 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1063ea2fb28843f58b8c891e3b899c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.541694 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet ab27734e3d974260a77f1d94e5f534fe with delete_type TABLET_DATA_DELETED (replaced by tablet f1c74666c3694ab881ba8ed452a73714) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:07.541975 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f21e03993e841ba901f1e9c176309b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:07.542434 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 1063ea2fb28843f58b8c891e3b899c1e (DEFAULT_TABLE table=default.Table_e12745e4f4ed4e9d8c0af00601fa49a2 [id=352f11deb18d436d986218c3fba31d3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.542623 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 85cc1fa48ad944e99b94834f017fe289 (DEFAULT_TABLE table=default.Table_14bad8f87ea44929a0de0f4351d51d20 [id=2bd96996272242c3b0f1bb8965320b8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.542850 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1063ea2fb28843f58b8c891e3b899c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.543020 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85cc1fa48ad944e99b94834f017fe289. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.543138 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 1cb0193bab3543d38ec5f6dc6a947b6e (DEFAULT_TABLE table=default.Table_d525715cfc784dae8f9b3f058b64db20 [id=4af81cee6f47433a8ec77d35808bc264]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.544935 10366 tablet_bootstrap.cc:492] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:07.545078 10366 ts_tablet_manager.cc:1403] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.195s user 0.026s sys 0.032s
I20260810 19:48:07.545851 10366 raft_consensus.cc:359] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.546021 10366 raft_consensus.cc:385] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:07.546077 10366 raft_consensus.cc:740] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:07.546458 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fadd6f84c75466287b318ed7018b071 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:53 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:07.546372 10366 consensus_queue.cc:260] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.546675 12505 raft_consensus.cc:493] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.546620 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 56d73dcc5a8040748d26b8ab0385a1fe (DEFAULT_TABLE table=default.Table_2de6c377720f4c89a6fb761cad0efa2f [id=6c1793fbfb5041c4a3f4bda191d735b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.546790 12505 raft_consensus.cc:515] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.546836 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 56d73dcc5a8040748d26b8ab0385a1fe (DEFAULT_TABLE table=default.Table_2de6c377720f4c89a6fb761cad0efa2f [id=6c1793fbfb5041c4a3f4bda191d735b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.546941 10366 ts_tablet_manager.cc:1434] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:07.547042 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d73dcc5a8040748d26b8ab0385a1fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.547205 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d73dcc5a8040748d26b8ab0385a1fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.547250 10366 tablet_bootstrap.cc:492] T 3582ed23ffdf4ff089952e29083e5425 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:07.547869 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd5cd2e4c104e45a81d2603c6f7d24a" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:07.548045 9711 raft_consensus.cc:2468] T 3fd5cd2e4c104e45a81d2603c6f7d24a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:07.548442 9831 leader_election.cc:304] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:07.548676 10366 tablet_bootstrap.cc:654] T 3582ed23ffdf4ff089952e29083e5425 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:07.548904 11897 raft_consensus.cc:2804] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:07.548979 11897 raft_consensus.cc:493] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:07.549036 11897 raft_consensus.cc:3060] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:07.552124 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 37fde6f8739a4ec68d3484e8d8be0af8 (DEFAULT_TABLE table=default.Table_82769090fe3a4bc49bc9b6672448e6b7 [id=7d1a287d14184e0d841c8a7f9a26fb69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.552295 11897 raft_consensus.cc:515] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.552521 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37fde6f8739a4ec68d3484e8d8be0af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.553143 11897 leader_election.cc:290] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:07.553620 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd5cd2e4c104e45a81d2603c6f7d24a" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:07.553795 9711 raft_consensus.cc:3060] T 3fd5cd2e4c104e45a81d2603c6f7d24a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:07.556707 9711 raft_consensus.cc:2468] T 3fd5cd2e4c104e45a81d2603c6f7d24a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:07.557190 9831 leader_election.cc:304] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:07.558598 11897 raft_consensus.cc:2804] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:07.558806 11897 raft_consensus.cc:697] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:07.559105 11897 consensus_queue.cc:237] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.560631 12505 leader_election.cc:290] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:07.561164 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd5cd2e4c104e45a81d2603c6f7d24a" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:07.562059 10366 tablet_bootstrap.cc:492] T 3582ed23ffdf4ff089952e29083e5425 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:07.562193 10366 ts_tablet_manager.cc:1403] T 3582ed23ffdf4ff089952e29083e5425 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20260810 19:48:07.562913 10366 raft_consensus.cc:359] T 3582ed23ffdf4ff089952e29083e5425 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.563083 10366 raft_consensus.cc:385] T 3582ed23ffdf4ff089952e29083e5425 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:07.563133 10366 raft_consensus.cc:740] T 3582ed23ffdf4ff089952e29083e5425 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
W20260810 19:48:07.563395 9830 leader_election.cc:343] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.563333 10366 consensus_queue.cc:260] T 3582ed23ffdf4ff089952e29083e5425 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.563884 10366 ts_tablet_manager.cc:1434] T 3582ed23ffdf4ff089952e29083e5425 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:07.564169 10366 tablet_bootstrap.cc:492] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:07.565657 10366 tablet_bootstrap.cc:654] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:07.566197 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 37fde6f8739a4ec68d3484e8d8be0af8 (DEFAULT_TABLE table=default.Table_82769090fe3a4bc49bc9b6672448e6b7 [id=7d1a287d14184e0d841c8a7f9a26fb69]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:07.567615 9410 catalog_manager.cc:5911] Failed to send AlterTable RPC for tablet 18cd8adaa065425c846bc791c05fa67d (table default.Table_a1645668cf79415ca029a01169fbf874 [id=aec405416e584af6bfb8194b357d6dbc], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet 18cd8adaa065425c846bc791c05fa67d consensus state has no leader
W20260810 19:48:07.569037 9410 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.8.235.193:43705 (request call id 115) took 817 ms (client timeout 1000 ms). Trace:
I20260810 19:48:07.569494 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet ca733de7babe4343ab26dbca2c9020b2 with delete_type TABLET_DATA_DELETED (replaced by tablet 264a65bd642648e59998fb55fb3c8de1) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:07.569753 9665 tablet_service.cc:1558] Processing DeleteTablet for tablet 827dce05c192467589e2692fabd2a84e with delete_type TABLET_DATA_DELETED (replaced by tablet 5a35be79a8924213ab860a9da04a598c) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:07.569957 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 82c3f619c76e40c583bfcdf2bb77fe42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:07.569727 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 39885c3e0adb4132945d507628f4f082 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:07.570240 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet 60bd14fb8c2e40dc955352518d463ccb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:53 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:07.570761 9410 rpcz_store.cc:269] 0810 19:48:06.751165 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.864531 (+113366us) service_pool.cc:224] Handling call
0810 19:48:06.884990 (+ 20459us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x616000041b54. stack: 00007f50aec1d326 00007f50aec1d0e0 00007f50adc4734d 00000000009a5774 00000000009a573d 00007f50be19c65d 00007f50be19c753 00007f50bad21ac1 00007f50c2afb40d 00007f50c2c84358 00007f50b966f1f6 00007f50b966ef25 00007f50b5d6061e 00007f50b5d5f4fe 00007f50b5d65738 00007f50b5d6609f
0810 19:48:07.568939 (+683949us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":20,"spinlock_wait_cycles":44707584}
I20260810 19:48:07.572606 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 1cb0193bab3543d38ec5f6dc6a947b6e (DEFAULT_TABLE table=default.Table_d525715cfc784dae8f9b3f058b64db20 [id=4af81cee6f47433a8ec77d35808bc264]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.573400 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 65605d404d42467ab6d7eabc8b685c3e (DEFAULT_TABLE table=default.Table_3fd0fd1fa532480fb2a10e99a8835b4c [id=dab1598a1dcf4539947dc460ce2c7554]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.574538 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cb0193bab3543d38ec5f6dc6a947b6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.579067 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 65605d404d42467ab6d7eabc8b685c3e (DEFAULT_TABLE table=default.Table_3fd0fd1fa532480fb2a10e99a8835b4c [id=dab1598a1dcf4539947dc460ce2c7554]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.579499 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65605d404d42467ab6d7eabc8b685c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.584249 9908 tablet_service.cc:1511] Processing CreateTablet for tablet c0b17ed76ac64dfaa9c99c3a6e618770 (DEFAULT_TABLE table=default.Table_1f4252825a324dc8a245a626aa10c7d1 [id=230e00855ce0400db6acf25c42d6d2cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.584662 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0b17ed76ac64dfaa9c99c3a6e618770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.586732 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 65605d404d42467ab6d7eabc8b685c3e (DEFAULT_TABLE table=default.Table_3fd0fd1fa532480fb2a10e99a8835b4c [id=dab1598a1dcf4539947dc460ce2c7554]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.587218 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65605d404d42467ab6d7eabc8b685c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.590178 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 964ff6e16c2e40fc8f96c10149fde70b (DEFAULT_TABLE table=default.Table_a94bb89d6b784e5ab463d0c2ae4778ca [id=c02b9eb42e484031b9d7394e7fe9941a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.590688 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964ff6e16c2e40fc8f96c10149fde70b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.595561 9669 tablet_service.cc:1511] Processing CreateTablet for tablet d0976c7855cb49c4ad4a4cf3b1ac1518 (DEFAULT_TABLE table=default.Table_2a7aefa4ff8c4818b970f0c8a127f276 [id=7b348a713e9843cca50d1cacf05bbd96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.595768 12106 raft_consensus.cc:493] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.595933 12106 raft_consensus.cc:515] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.596042 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0976c7855cb49c4ad4a4cf3b1ac1518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.596652 12106 leader_election.cc:290] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:07.599447 10068 leader_election.cc:343] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: ae3e151180ae4d258d18365770acaaad
I20260810 19:48:07.599491 10377 ts_tablet_manager.cc:1929] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:07.600728 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 5c992f9cb33843ad88556517b280912f (DEFAULT_TABLE table=default.Table_527eab54be8245589580b409f997f44c [id=fbd1b87fae5e4721a325ec0c7d4f750c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.601226 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c992f9cb33843ad88556517b280912f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.600684 10377 log.cc:1199] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/0dd49d6fa79e4677b753b6cf9117b02d
I20260810 19:48:07.602124 10377 ts_tablet_manager.cc:1950] T 0dd49d6fa79e4677b753b6cf9117b02d P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:07.602509 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 823) took 1179 ms. Trace:
I20260810 19:48:07.602600 10377 rpcz_store.cc:276] 0810 19:48:06.423839 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.423971 (+ 132us) service_pool.cc:224] Handling call
0810 19:48:07.453083 (+1029112us) ts_tablet_manager.cc:1151] Deleting tablet 0dd49d6fa79e4677b753b6cf9117b02d
0810 19:48:07.453092 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:07.579707 (+126615us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:07.599420 (+ 19713us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:07.602488 (+ 3068us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":980030}
I20260810 19:48:07.599993 9667 tablet_service.cc:1511] Processing CreateTablet for tablet c0b17ed76ac64dfaa9c99c3a6e618770 (DEFAULT_TABLE table=default.Table_1f4252825a324dc8a245a626aa10c7d1 [id=230e00855ce0400db6acf25c42d6d2cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.602939 10377 tablet_replica.cc:333] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:07.603129 10377 raft_consensus.cc:2243] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:07.603328 10377 raft_consensus.cc:2272] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:07.603113 12266 ts_tablet_manager.cc:1929] T f85f3fa629764c79921a710739eea7ae P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:07.603502 12266 log.cc:1199] T f85f3fa629764c79921a710739eea7ae P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/f85f3fa629764c79921a710739eea7ae
I20260810 19:48:07.603910 10377 ts_tablet_manager.cc:1916] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:07.603669 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0b17ed76ac64dfaa9c99c3a6e618770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.605163 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 0dd49d6fa79e4677b753b6cf9117b02d (table default.Table_ebe965457d0c46a39803fb5155a0bc0c [id=11015256d39042599eae0f05e96dca2d]) successfully deleted
I20260810 19:48:07.603965 12266 ts_tablet_manager.cc:1950] T f85f3fa629764c79921a710739eea7ae P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:07.605667 9896 tablet_service.cc:1511] Processing CreateTablet for tablet d0976c7855cb49c4ad4a4cf3b1ac1518 (DEFAULT_TABLE table=default.Table_2a7aefa4ff8c4818b970f0c8a127f276 [id=7b348a713e9843cca50d1cacf05bbd96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.605731 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 5c992f9cb33843ad88556517b280912f (DEFAULT_TABLE table=default.Table_527eab54be8245589580b409f997f44c [id=fbd1b87fae5e4721a325ec0c7d4f750c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.606074 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0976c7855cb49c4ad4a4cf3b1ac1518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.606492 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet f85f3fa629764c79921a710739eea7ae (table default.Table_aa5df7d93dfb4603b493ab5638468a59 [id=fadd6b8bf2244dfab48fdadb0d12b6fd]) successfully deleted
I20260810 19:48:07.610244 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 1cb0193bab3543d38ec5f6dc6a947b6e (DEFAULT_TABLE table=default.Table_d525715cfc784dae8f9b3f058b64db20 [id=4af81cee6f47433a8ec77d35808bc264]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.610543 12266 tablet_replica.cc:333] T 4198f46be0194875aea6a7952321bc69 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:07.610992 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cb0193bab3543d38ec5f6dc6a947b6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.611027 12266 raft_consensus.cc:2243] T 4198f46be0194875aea6a7952321bc69 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:07.611208 12266 raft_consensus.cc:2272] T 4198f46be0194875aea6a7952321bc69 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:07.612213 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c992f9cb33843ad88556517b280912f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.614689 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 964ff6e16c2e40fc8f96c10149fde70b (DEFAULT_TABLE table=default.Table_a94bb89d6b784e5ab463d0c2ae4778ca [id=c02b9eb42e484031b9d7394e7fe9941a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.615114 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964ff6e16c2e40fc8f96c10149fde70b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.619053 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37fde6f8739a4ec68d3484e8d8be0af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.611763 12266 ts_tablet_manager.cc:1916] T 4198f46be0194875aea6a7952321bc69 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:07.628932 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 81de4b3e05604a34b305ca0ad744d769 (DEFAULT_TABLE table=default.Table_af6e508271a340b0b1cc5e7a16cd66ff [id=20b357e0148844ba9434ec4cdcfff941]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.629415 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 81de4b3e05604a34b305ca0ad744d769 (DEFAULT_TABLE table=default.Table_af6e508271a340b0b1cc5e7a16cd66ff [id=20b357e0148844ba9434ec4cdcfff941]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.629711 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81de4b3e05604a34b305ca0ad744d769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.629808 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81de4b3e05604a34b305ca0ad744d769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.639065 10366 tablet_bootstrap.cc:492] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:07.639065 12266 ts_tablet_manager.cc:1929] T 4198f46be0194875aea6a7952321bc69 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:07.639186 12266 log.cc:1199] T 4198f46be0194875aea6a7952321bc69 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/4198f46be0194875aea6a7952321bc69
I20260810 19:48:07.639243 10366 ts_tablet_manager.cc:1403] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.075s user 0.008s sys 0.008s
I20260810 19:48:07.639605 12266 ts_tablet_manager.cc:1950] T 4198f46be0194875aea6a7952321bc69 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:07.640023 10366 raft_consensus.cc:359] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.640209 10366 raft_consensus.cc:385] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:07.640271 10366 raft_consensus.cc:740] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:07.640506 10366 consensus_queue.cc:260] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.641024 10366 ts_tablet_manager.cc:1434] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:07.641047 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 4198f46be0194875aea6a7952321bc69 (table default.Table_066ecd6fc0e0441eb69e39d946ba0b9a [id=f5ad4bd8b30e44e9b14bd6dfcc2bbb28]) successfully deleted
I20260810 19:48:07.641320 10366 tablet_bootstrap.cc:492] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:07.644874 12106 raft_consensus.cc:493] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.645020 12106 raft_consensus.cc:515] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.645359 12266 tablet_replica.cc:333] T 19e2bf7b7d254894a07c5a75bf24e742 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:07.645602 12266 raft_consensus.cc:2243] T 19e2bf7b7d254894a07c5a75bf24e742 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:07.645792 12266 raft_consensus.cc:2272] T 19e2bf7b7d254894a07c5a75bf24e742 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:07.646449 12266 ts_tablet_manager.cc:1916] T 19e2bf7b7d254894a07c5a75bf24e742 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:07.646873 10366 tablet_bootstrap.cc:654] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:07.554502 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd5cd2e4c104e45a81d2603c6f7d24a" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:07.650875 10118 tablet_service.cc:1511] Processing CreateTablet for tablet c0b17ed76ac64dfaa9c99c3a6e618770 (DEFAULT_TABLE table=default.Table_1f4252825a324dc8a245a626aa10c7d1 [id=230e00855ce0400db6acf25c42d6d2cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.651224 12106 leader_election.cc:290] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:07.531857 10067 leader_election.cc:304] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:07.652027 10127 tablet_service.cc:1511] Processing CreateTablet for tablet d0976c7855cb49c4ad4a4cf3b1ac1518 (DEFAULT_TABLE table=default.Table_2a7aefa4ff8c4818b970f0c8a127f276 [id=7b348a713e9843cca50d1cacf05bbd96]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:07.652726 10067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 120888us
I20260810 19:48:07.654004 12106 raft_consensus.cc:2804] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:07.654134 12106 raft_consensus.cc:697] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:07.654397 12106 consensus_queue.cc:237] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:07.656163 9830 leader_election.cc:343] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.658496 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3e151180ae4d258d18365770acaaad" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:07.658712 9948 raft_consensus.cc:2468] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:07.660207 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 964ff6e16c2e40fc8f96c10149fde70b (DEFAULT_TABLE table=default.Table_a94bb89d6b784e5ab463d0c2ae4778ca [id=c02b9eb42e484031b9d7394e7fe9941a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.661173 12407 raft_consensus.cc:493] T bafc42f0cdf94ebd823dfb678df8a83b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.661208 11897 raft_consensus.cc:493] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.661303 12407 raft_consensus.cc:515] T bafc42f0cdf94ebd823dfb678df8a83b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.661351 11897 raft_consensus.cc:515] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.661537 12266 ts_tablet_manager.cc:1929] T 19e2bf7b7d254894a07c5a75bf24e742 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:07.661629 12266 log.cc:1199] T 19e2bf7b7d254894a07c5a75bf24e742 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/19e2bf7b7d254894a07c5a75bf24e742
I20260810 19:48:07.661913 12266 ts_tablet_manager.cc:1950] T 19e2bf7b7d254894a07c5a75bf24e742 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:07.661955 11897 leader_election.cc:290] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:07.661955 12407 leader_election.cc:290] T bafc42f0cdf94ebd823dfb678df8a83b P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:07.663798 10366 tablet_bootstrap.cc:492] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:07.663937 10366 ts_tablet_manager.cc:1403] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.000s
I20260810 19:48:07.664143 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5394eadabf184158864921dd5d394828" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:07.664322 9711 raft_consensus.cc:2468] T 5394eadabf184158864921dd5d394828 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:07.664620 10366 raft_consensus.cc:359] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.664785 10366 raft_consensus.cc:385] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:07.664839 10366 raft_consensus.cc:740] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:07.664932 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 19e2bf7b7d254894a07c5a75bf24e742 (table default.Table_688c01e53a344393b3471974bad3b972 [id=7112ce97719c47919a3d24d1af7d07cd]) successfully deleted
I20260810 19:48:07.665051 10366 consensus_queue.cc:260] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.665359 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bafc42f0cdf94ebd823dfb678df8a83b" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:07.665580 10366 ts_tablet_manager.cc:1434] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:07.665871 10366 tablet_bootstrap.cc:492] T 0e967384768b4ec7956f1b508e8ab2af P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:07.664844 9831 leader_election.cc:304] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:07.666294 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8455cb11388340beb6daa13fee06177a" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:07.666486 9948 raft_consensus.cc:2468] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
W20260810 19:48:07.666500 9611 leader_election.cc:343] T bafc42f0cdf94ebd823dfb678df8a83b P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.666920 12338 raft_consensus.cc:2804] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260810 19:48:07.655390 10068 leader_election.cc:343] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 8455cb11388340beb6daa13fee06177a
I20260810 19:48:07.667090 12338 raft_consensus.cc:493] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260810 19:48:07.667351 10068 consensus_peers.cc:597] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0dd49d6fa79e4677b753b6cf9117b02d. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:07.667392 12338 raft_consensus.cc:3060] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:07.667593 10366 tablet_bootstrap.cc:654] T 0e967384768b4ec7956f1b508e8ab2af P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:07.671164 12338 raft_consensus.cc:515] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.672214 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5394eadabf184158864921dd5d394828" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:07.672403 9711 raft_consensus.cc:3060] T 5394eadabf184158864921dd5d394828 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:07.675433 9711 raft_consensus.cc:2468] T 5394eadabf184158864921dd5d394828 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:07.675966 9831 leader_election.cc:304] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:07.676213 11897 raft_consensus.cc:2804] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:07.676344 11897 raft_consensus.cc:697] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:07.676550 12338 leader_election.cc:290] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:07.676585 11897 consensus_queue.cc:237] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.659725 10367 tablet_bootstrap.cc:492] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:07.679646 12266 tablet_replica.cc:333] T 31c2b9a4b8334e678b4632fc2f58dd0c P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:07.680195 12266 raft_consensus.cc:2243] T 31c2b9a4b8334e678b4632fc2f58dd0c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:07.680675 12266 raft_consensus.cc:2272] T 31c2b9a4b8334e678b4632fc2f58dd0c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:07.681900 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 3b82e8164e5f4afc9ab57ea2b21ccf9e (DEFAULT_TABLE table=default.Table_b619c177222648b880c95d285975c0c6 [id=dd3dfd45f0b4418b846385e38a5282e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.682343 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b82e8164e5f4afc9ab57ea2b21ccf9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.683012 10367 ts_tablet_manager.cc:1403] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.210s user 0.003s sys 0.001s
I20260810 19:48:07.684451 10140 tablet_service.cc:1511] Processing CreateTablet for tablet f146f440c1174d348ed273d29145e815 (DEFAULT_TABLE table=default.Table_b15450030540496a8b6e252f5f57722c [id=fd632e7e6cd4416d992f41a2681f4c6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.685320 9906 tablet_service.cc:1511] Processing CreateTablet for tablet f146f440c1174d348ed273d29145e815 (DEFAULT_TABLE table=default.Table_b15450030540496a8b6e252f5f57722c [id=fd632e7e6cd4416d992f41a2681f4c6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.685708 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f146f440c1174d348ed273d29145e815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.687007 9667 tablet_service.cc:1511] Processing CreateTablet for tablet f146f440c1174d348ed273d29145e815 (DEFAULT_TABLE table=default.Table_b15450030540496a8b6e252f5f57722c [id=fd632e7e6cd4416d992f41a2681f4c6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.687367 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f146f440c1174d348ed273d29145e815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.688009 10366 tablet_bootstrap.cc:492] T 0e967384768b4ec7956f1b508e8ab2af P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:07.690762 10366 ts_tablet_manager.cc:1403] T 0e967384768b4ec7956f1b508e8ab2af P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.000s
I20260810 19:48:07.691304 12266 ts_tablet_manager.cc:1916] T 31c2b9a4b8334e678b4632fc2f58dd0c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:07.692442 10366 raft_consensus.cc:359] T 0e967384768b4ec7956f1b508e8ab2af P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.692768 10366 raft_consensus.cc:385] T 0e967384768b4ec7956f1b508e8ab2af P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:07.692896 10366 raft_consensus.cc:740] T 0e967384768b4ec7956f1b508e8ab2af P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:07.693953 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 8713212c586a4143b65ff044a67b8b72 (DEFAULT_TABLE table=default.Table_4fb96dbc73be4091855b1cbbed3b9ce6 [id=c72c64a09f73486abc4b2c6a72271d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.693743 10366 consensus_queue.cc:260] T 0e967384768b4ec7956f1b508e8ab2af P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.694393 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8713212c586a4143b65ff044a67b8b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.696072 10366 ts_tablet_manager.cc:1434] T 0e967384768b4ec7956f1b508e8ab2af P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260810 19:48:07.697319 10366 tablet_bootstrap.cc:492] T 5ba42032e7344423a0e86c55d613f27d P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:07.700042 10142 tablet_service.cc:1511] Processing CreateTablet for tablet 8713212c586a4143b65ff044a67b8b72 (DEFAULT_TABLE table=default.Table_4fb96dbc73be4091855b1cbbed3b9ce6 [id=c72c64a09f73486abc4b2c6a72271d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.702561 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 8713212c586a4143b65ff044a67b8b72 (DEFAULT_TABLE table=default.Table_4fb96dbc73be4091855b1cbbed3b9ce6 [id=c72c64a09f73486abc4b2c6a72271d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.702867 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 72d92f8b6565416c9da4e8d1ec7a6d50 (DEFAULT_TABLE table=default.Table_c35ddec630d942db9ba85f10a2f405ee [id=fd840f00bdc5477aaad0b7fa114870dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.703007 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8713212c586a4143b65ff044a67b8b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.703558 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 3b82e8164e5f4afc9ab57ea2b21ccf9e (DEFAULT_TABLE table=default.Table_b619c177222648b880c95d285975c0c6 [id=dd3dfd45f0b4418b846385e38a5282e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.706609 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 72d92f8b6565416c9da4e8d1ec7a6d50 (DEFAULT_TABLE table=default.Table_c35ddec630d942db9ba85f10a2f405ee [id=fd840f00bdc5477aaad0b7fa114870dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.707062 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72d92f8b6565416c9da4e8d1ec7a6d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.665901 10067 leader_election.cc:304] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:07.707631 11828 raft_consensus.cc:2804] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:07.708402 9413 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 988d87b2b00a459d9afc44ba0ae1961e (table default.Table_f283a0bdf6b94182a12f9b5f5dfe167a [id=f881fab647be45f786665629ab8baaee]). Expected version 1 got 0
I20260810 19:48:07.708645 9413 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet c285518ed49d4ed68a6039f98db3b700 (table default.Table_bb5a9a9ebfd340fba882f6db00cf2dac [id=4b0cbb23d570430bb2d95e9c1b27bb4d]). Expected version 1 got 0
I20260810 19:48:07.710479 9413 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 85f1c7a75aac4d6a9462af4def91eaa4 (table default.Table_08c83fc388864b6f8a1ed597dc70bffe [id=2d55615cd797441c8abf6ea5a64f2f9f]). Expected version 1 got 0
I20260810 19:48:07.709656 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d9f4c05ddfed4c938ab02d9f8507e119" } new_table_name: "default.Table_0bbfea1f106c4df1921c642928671792" modify_external_catalogs: true
I20260810 19:48:07.711192 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bafc42f0cdf94ebd823dfb678df8a83b" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:07.711673 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85cc1fa48ad944e99b94834f017fe289. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.712162 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 5c992f9cb33843ad88556517b280912f (DEFAULT_TABLE table=default.Table_527eab54be8245589580b409f997f44c [id=fbd1b87fae5e4721a325ec0c7d4f750c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.716629 10366 tablet_bootstrap.cc:654] T 5ba42032e7344423a0e86c55d613f27d P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:07.719364 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72d92f8b6565416c9da4e8d1ec7a6d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.722991 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b82e8164e5f4afc9ab57ea2b21ccf9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.723363 12266 ts_tablet_manager.cc:1929] T 31c2b9a4b8334e678b4632fc2f58dd0c P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:07.723547 12266 log.cc:1199] T 31c2b9a4b8334e678b4632fc2f58dd0c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/31c2b9a4b8334e678b4632fc2f58dd0c
I20260810 19:48:07.724243 12266 ts_tablet_manager.cc:1950] T 31c2b9a4b8334e678b4632fc2f58dd0c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:07.734270 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 3b82e8164e5f4afc9ab57ea2b21ccf9e (DEFAULT_TABLE table=default.Table_b619c177222648b880c95d285975c0c6 [id=dd3dfd45f0b4418b846385e38a5282e9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:07.735387 10068 consensus_peers.cc:597] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5f30148b5c84f7cbdfabd0186611cc4. This is attempt 1: this message will repeat every 5th retry.
W20260810 19:48:07.735558 10068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 64790.2us
W20260810 19:48:07.736469 9611 leader_election.cc:343] T bafc42f0cdf94ebd823dfb678df8a83b P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.736622 9611 leader_election.cc:304] T bafc42f0cdf94ebd823dfb678df8a83b P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:07.737617 10370 tablet_bootstrap.cc:492] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:07.737620 12407 raft_consensus.cc:2749] T bafc42f0cdf94ebd823dfb678df8a83b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:07.738085 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5394eadabf184158864921dd5d394828" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:07.738245 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5394eadabf184158864921dd5d394828" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:07.738492 11828 raft_consensus.cc:493] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:07.738632 11828 raft_consensus.cc:3060] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:07.738560 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 81de4b3e05604a34b305ca0ad744d769 (DEFAULT_TABLE table=default.Table_af6e508271a340b0b1cc5e7a16cd66ff [id=20b357e0148844ba9434ec4cdcfff941]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.741217 10370 ts_tablet_manager.cc:1403] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.270s user 0.001s sys 0.007s
I20260810 19:48:07.741519 11828 raft_consensus.cc:515] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.742233 11828 leader_election.cc:290] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:07.742552 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65605d404d42467ab6d7eabc8b685c3e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:07.743628 10068 leader_election.cc:343] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: ae3e151180ae4d258d18365770acaaad
I20260810 19:48:07.743897 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c992f9cb33843ad88556517b280912f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.744130 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f146f440c1174d348ed273d29145e815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.743412 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 72d92f8b6565416c9da4e8d1ec7a6d50 (DEFAULT_TABLE table=default.Table_c35ddec630d942db9ba85f10a2f405ee [id=fd840f00bdc5477aaad0b7fa114870dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.744580 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72d92f8b6565416c9da4e8d1ec7a6d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.752596 10142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8713212c586a4143b65ff044a67b8b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.754532 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964ff6e16c2e40fc8f96c10149fde70b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.754899 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37fde6f8739a4ec68d3484e8d8be0af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.756446 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b82e8164e5f4afc9ab57ea2b21ccf9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.756637 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 67d02a8eea444f3383f14a1e1f0e236b (DEFAULT_TABLE table=default.Table_63c36107140a41da9c5d337a853cb5d3 [id=d921f4a824ae4dd6b0b9dbb8310ff00a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.757094 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d02a8eea444f3383f14a1e1f0e236b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.758481 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0976c7855cb49c4ad4a4cf3b1ac1518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.759654 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 67d02a8eea444f3383f14a1e1f0e236b (DEFAULT_TABLE table=default.Table_63c36107140a41da9c5d337a853cb5d3 [id=d921f4a824ae4dd6b0b9dbb8310ff00a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.759961 10116 tablet_service.cc:1511] Processing CreateTablet for tablet f0d1c80754e74702b6ba2de4107a4fb6 (DEFAULT_TABLE table=default.Table_10e7f0eade344c0eb91ee0b576d39aae [id=a0935eb8f6104c86b4e3b5f6bd8c1f93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.760067 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d02a8eea444f3383f14a1e1f0e236b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.760376 10116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d1c80754e74702b6ba2de4107a4fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.762544 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81de4b3e05604a34b305ca0ad744d769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.762709 10120 tablet_service.cc:1511] Processing CreateTablet for tablet d41e89d919f34588a03c8bf831fbc123 (DEFAULT_TABLE table=default.Table_3fa3d0ea397e42ee85937bb679ac16e0 [id=8108c045fc644f7a91f890c0e22263a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.763167 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d41e89d919f34588a03c8bf831fbc123. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.766620 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 8988c60f2d8848d98d373813bdfc2228 (DEFAULT_TABLE table=default.Table_05bfdf726be7422081506c051724ef2c [id=31f6358a140542a089ae6e5e9e5f2632]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.767076 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8988c60f2d8848d98d373813bdfc2228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.767681 10370 raft_consensus.cc:359] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.767781 9667 tablet_service.cc:1511] Processing CreateTablet for tablet d41e89d919f34588a03c8bf831fbc123 (DEFAULT_TABLE table=default.Table_3fa3d0ea397e42ee85937bb679ac16e0 [id=8108c045fc644f7a91f890c0e22263a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.767903 10370 raft_consensus.cc:385] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:07.767987 10370 raft_consensus.cc:740] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:07.768170 12407 raft_consensus.cc:493] T 988d87b2b00a459d9afc44ba0ae1961e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.768261 10370 consensus_queue.cc:260] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.768314 12407 raft_consensus.cc:515] T 988d87b2b00a459d9afc44ba0ae1961e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.768458 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 8988c60f2d8848d98d373813bdfc2228 (DEFAULT_TABLE table=default.Table_05bfdf726be7422081506c051724ef2c [id=31f6358a140542a089ae6e5e9e5f2632]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.768194 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d41e89d919f34588a03c8bf831fbc123. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.769018 12407 leader_election.cc:290] T 988d87b2b00a459d9afc44ba0ae1961e P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:07.769665 10370 ts_tablet_manager.cc:1434] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20260810 19:48:07.770577 10370 tablet_bootstrap.cc:492] T 5394eadabf184158864921dd5d394828 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:07.770602 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 1a615a32f94949179de8e8ee8a444576 (DEFAULT_TABLE table=default.Table_fe3c84ad30eb4d57a6d20ec860c02286 [id=c401d03820c6453184e1da223c380872]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.771097 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a615a32f94949179de8e8ee8a444576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.772894 9941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988d87b2b00a459d9afc44ba0ae1961e" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:07.773298 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8988c60f2d8848d98d373813bdfc2228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.774950 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988d87b2b00a459d9afc44ba0ae1961e" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:07.776780 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1063ea2fb28843f58b8c891e3b899c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.778174 10367 raft_consensus.cc:359] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.778366 10367 raft_consensus.cc:385] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:07.778276 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 1a615a32f94949179de8e8ee8a444576 (DEFAULT_TABLE table=default.Table_fe3c84ad30eb4d57a6d20ec860c02286 [id=c401d03820c6453184e1da223c380872]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.778431 10367 raft_consensus.cc:740] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:07.778685 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a615a32f94949179de8e8ee8a444576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.778632 10367 consensus_queue.cc:260] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.778759 12266 tablet_replica.cc:333] T 4f21e03993e841ba901f1e9c176309b9 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:07.779127 10367 ts_tablet_manager.cc:1434] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.094s user 0.002s sys 0.000s
I20260810 19:48:07.779090 9658 tablet_service.cc:1511] Processing CreateTablet for tablet f0d1c80754e74702b6ba2de4107a4fb6 (DEFAULT_TABLE table=default.Table_10e7f0eade344c0eb91ee0b576d39aae [id=a0935eb8f6104c86b4e3b5f6bd8c1f93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.779520 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d1c80754e74702b6ba2de4107a4fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.779958 12266 raft_consensus.cc:2243] T 4f21e03993e841ba901f1e9c176309b9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:07.780124 12266 raft_consensus.cc:2272] T 4f21e03993e841ba901f1e9c176309b9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:07.780687 12266 ts_tablet_manager.cc:1916] T 4f21e03993e841ba901f1e9c176309b9 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:07.781386 10367 tablet_bootstrap.cc:492] T 8fce298689e9415a8860b8734d73b10a P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:07.781687 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0b17ed76ac64dfaa9c99c3a6e618770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.782382 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 31c2b9a4b8334e678b4632fc2f58dd0c (table default.Table_05b1dcc5bf9f412c87505d19c57d7025 [id=a6004b573d3e47feb446328fa64530f4]) successfully deleted
W20260810 19:48:07.782742 9397 catalog_manager.cc:5017] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet ab27734e3d974260a77f1d94e5f534fe because the tablet was not found. No further retry: Not found: Tablet not found: ab27734e3d974260a77f1d94e5f534fe
W20260810 19:48:07.784114 10068 consensus_peers.cc:597] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: da3d8ade850c4d36bd2756c36706195d. This is attempt 1: this message will repeat every 5th retry.
W20260810 19:48:07.784379 9611 leader_election.cc:343] T 988d87b2b00a459d9afc44ba0ae1961e P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.786228 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cb0193bab3543d38ec5f6dc6a947b6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.792243 12527 raft_consensus.cc:493] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.792490 12527 raft_consensus.cc:515] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.793365 12527 leader_election.cc:290] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:07.799093 12266 ts_tablet_manager.cc:1929] T 4f21e03993e841ba901f1e9c176309b9 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:07.799284 12266 log.cc:1199] T 4f21e03993e841ba901f1e9c176309b9 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/4f21e03993e841ba901f1e9c176309b9
I20260810 19:48:07.799657 12266 ts_tablet_manager.cc:1950] T 4f21e03993e841ba901f1e9c176309b9 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:07.805311 12266 tablet_replica.cc:333] T 8fadd6f84c75466287b318ed7018b071 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:07.805516 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 4f21e03993e841ba901f1e9c176309b9 (table default.Table_a5aa062540ad4b02bf89b59e8ebc8cd7 [id=6c0a50477acc489cb3a3895e7cda4eca]) successfully deleted
I20260810 19:48:07.805953 12266 raft_consensus.cc:2243] T 8fadd6f84c75466287b318ed7018b071 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:07.806206 12266 raft_consensus.cc:2272] T 8fadd6f84c75466287b318ed7018b071 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:07.806999 12266 ts_tablet_manager.cc:1916] T 8fadd6f84c75466287b318ed7018b071 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:07.812526 10367 tablet_bootstrap.cc:654] T 8fce298689e9415a8860b8734d73b10a P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:07.817082 12266 ts_tablet_manager.cc:1929] T 8fadd6f84c75466287b318ed7018b071 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 19:48:07.794339 10068 leader_election.cc:343] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 63486cc3f8774a11827b1cc5f1c16332
I20260810 19:48:07.805298 10067 leader_election.cc:304] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:07.805998 10375 ts_tablet_manager.cc:1929] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:07.819744 10375 log.cc:1199] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/9e8a23221e8447bd83592c05c9d1149c
I20260810 19:48:07.819744 12266 log.cc:1199] T 8fadd6f84c75466287b318ed7018b071 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/8fadd6f84c75466287b318ed7018b071
I20260810 19:48:07.820109 10375 ts_tablet_manager.cc:1950] T 9e8a23221e8447bd83592c05c9d1149c P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:07.820109 12266 ts_tablet_manager.cc:1950] T 8fadd6f84c75466287b318ed7018b071 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:07.820802 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 809) took 1058 ms. Trace:
I20260810 19:48:07.820889 10375 rpcz_store.cc:276] 0810 19:48:06.762770 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.763062 (+ 292us) service_pool.cc:224] Handling call
0810 19:48:07.403272 (+640210us) ts_tablet_manager.cc:1151] Deleting tablet 9e8a23221e8447bd83592c05c9d1149c
0810 19:48:07.412044 (+ 8772us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:07.663248 (+251204us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:07.804868 (+141620us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:07.820782 (+ 15914us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":639233}
I20260810 19:48:07.820981 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 8fadd6f84c75466287b318ed7018b071 (table default.Table_398b6d4ebbf742b99fad6aff42d2802b [id=453661c1f5834b56aad5d2d647338fc6]) successfully deleted
I20260810 19:48:07.821084 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63486cc3f8774a11827b1cc5f1c16332" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:07.821290 10375 tablet_replica.cc:333] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:07.821324 12266 tablet_replica.cc:333] T ca733de7babe4343ab26dbca2c9020b2 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:07.821486 10375 raft_consensus.cc:2243] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:07.821507 12266 raft_consensus.cc:2243] T ca733de7babe4343ab26dbca2c9020b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:07.821655 12266 raft_consensus.cc:2272] T ca733de7babe4343ab26dbca2c9020b2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:07.821767 10375 pending_rounds.cc:70] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:07.821825 10375 pending_rounds.cc:77] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058711193743360 op_type: NO_OP noop_request { }
I20260810 19:48:07.821924 10375 raft_consensus.cc:2889] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:07.822011 10375 raft_consensus.cc:2272] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:07.822007 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 9e8a23221e8447bd83592c05c9d1149c (table default.Table_943801654ea043f1b8740ea0215abc35 [id=5cf32f9df60d4b04a704522da9f7973d]) successfully deleted
I20260810 19:48:07.822053 12527 raft_consensus.cc:493] T 72b39babf851404c89adb317033015ec P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.815097 10370 tablet_bootstrap.cc:654] T 5394eadabf184158864921dd5d394828 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:07.822168 12527 raft_consensus.cc:515] T 72b39babf851404c89adb317033015ec P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.822008 11828 raft_consensus.cc:2804] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:07.822934 11828 raft_consensus.cc:493] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:07.823081 11828 raft_consensus.cc:3060] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:07.823850 12266 ts_tablet_manager.cc:1916] T ca733de7babe4343ab26dbca2c9020b2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:07.823875 10375 ts_tablet_manager.cc:1916] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:07.825959 11828 raft_consensus.cc:515] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.829645 12407 raft_consensus.cc:493] T 9e861473094f42dfa22b9c00145ed1fe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.829839 12407 raft_consensus.cc:515] T 9e861473094f42dfa22b9c00145ed1fe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.830530 12266 ts_tablet_manager.cc:1929] T ca733de7babe4343ab26dbca2c9020b2 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:07.830559 12407 leader_election.cc:290] T 9e861473094f42dfa22b9c00145ed1fe P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:07.830637 12266 log.cc:1199] T ca733de7babe4343ab26dbca2c9020b2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/ca733de7babe4343ab26dbca2c9020b2
I20260810 19:48:07.830940 12266 ts_tablet_manager.cc:1950] T ca733de7babe4343ab26dbca2c9020b2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
W20260810 19:48:07.828076 10067 leader_election.cc:343] T 72b39babf851404c89adb317033015ec P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 72b39babf851404c89adb317033015ec
W20260810 19:48:07.835117 10067 consensus_peers.cc:597] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 00fe7d9a548a487d965d92b53cdf9250. This is attempt 1: this message will repeat every 5th retry.
W20260810 19:48:07.835361 10068 leader_election.cc:343] T 72b39babf851404c89adb317033015ec P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 72b39babf851404c89adb317033015ec
I20260810 19:48:07.835633 10068 leader_election.cc:304] T 72b39babf851404c89adb317033015ec P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:07.836229 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e861473094f42dfa22b9c00145ed1fe" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:07.836386 10370 tablet_bootstrap.cc:492] T 5394eadabf184158864921dd5d394828 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:07.836521 10370 ts_tablet_manager.cc:1403] T 5394eadabf184158864921dd5d394828 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.066s user 0.006s sys 0.000s
I20260810 19:48:07.837383 10370 raft_consensus.cc:359] T 5394eadabf184158864921dd5d394828 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:07.837806 9611 leader_election.cc:343] T 9e861473094f42dfa22b9c00145ed1fe P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.839979 12266 tablet_replica.cc:333] T 827dce05c192467589e2692fabd2a84e P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:07.840272 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet ca733de7babe4343ab26dbca2c9020b2 (table default.Table_73a9257f3a444ce6a1e35cf5b4cddbd9 [id=5aaa48a6a5d94fef89881115cdd023ac]) successfully deleted
I20260810 19:48:07.828204 12527 leader_election.cc:290] T 72b39babf851404c89adb317033015ec P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:07.838403 12106 raft_consensus.cc:2749] T 72b39babf851404c89adb317033015ec P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:07.841646 10068 leader_election.cc:343] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 8455cb11388340beb6daa13fee06177a
I20260810 19:48:07.843681 11828 leader_election.cc:290] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:07.842487 10370 raft_consensus.cc:385] T 5394eadabf184158864921dd5d394828 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:07.821766 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3e151180ae4d258d18365770acaaad" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:07.846894 9948 raft_consensus.cc:3060] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:07.847033 12266 raft_consensus.cc:2243] T 827dce05c192467589e2692fabd2a84e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:07.847229 12266 raft_consensus.cc:2272] T 827dce05c192467589e2692fabd2a84e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:07.847514 10377 ts_tablet_manager.cc:1929] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:07.847628 10377 log.cc:1199] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/da3d8ade850c4d36bd2756c36706195d
I20260810 19:48:07.847568 9895 tablet_service.cc:1511] Processing CreateTablet for tablet f0d1c80754e74702b6ba2de4107a4fb6 (DEFAULT_TABLE table=default.Table_10e7f0eade344c0eb91ee0b576d39aae [id=a0935eb8f6104c86b4e3b5f6bd8c1f93]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:07.847714 9830 leader_election.cc:343] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.847833 12266 ts_tablet_manager.cc:1916] T 827dce05c192467589e2692fabd2a84e P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:07.847916 10377 ts_tablet_manager.cc:1950] T da3d8ade850c4d36bd2756c36706195d P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:07.847997 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d1c80754e74702b6ba2de4107a4fb6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:07.848074 9830 leader_election.cc:343] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.848220 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 822) took 1427 ms. Trace:
W20260810 19:48:07.849336 9611 leader_election.cc:343] T 988d87b2b00a459d9afc44ba0ae1961e P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.849458 9611 leader_election.cc:304] T 988d87b2b00a459d9afc44ba0ae1961e P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:07.850140 9883 tablet_service.cc:1511] Processing CreateTablet for tablet d41e89d919f34588a03c8bf831fbc123 (DEFAULT_TABLE table=default.Table_3fa3d0ea397e42ee85937bb679ac16e0 [id=8108c045fc644f7a91f890c0e22263a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.850531 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d41e89d919f34588a03c8bf831fbc123. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.850874 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 8988c60f2d8848d98d373813bdfc2228 (DEFAULT_TABLE table=default.Table_05bfdf726be7422081506c051724ef2c [id=31f6358a140542a089ae6e5e9e5f2632]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.851405 12407 raft_consensus.cc:2749] T 988d87b2b00a459d9afc44ba0ae1961e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:07.831821 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e861473094f42dfa22b9c00145ed1fe" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:07.833823 12338 raft_consensus.cc:493] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.852609 12338 raft_consensus.cc:515] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.853206 12338 leader_election.cc:290] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:07.853223 9611 leader_election.cc:343] T 9e861473094f42dfa22b9c00145ed1fe P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.853348 9611 leader_election.cc:304] T 9e861473094f42dfa22b9c00145ed1fe P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:07.853768 12407 raft_consensus.cc:2749] T 9e861473094f42dfa22b9c00145ed1fe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:07.853904 12313 raft_consensus.cc:493] T 1a393149727043f3a3c9f58aa051b065 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.854027 12313 raft_consensus.cc:515] T 1a393149727043f3a3c9f58aa051b065 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.827806 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 67d02a8eea444f3383f14a1e1f0e236b (DEFAULT_TABLE table=default.Table_63c36107140a41da9c5d337a853cb5d3 [id=d921f4a824ae4dd6b0b9dbb8310ff00a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.854416 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d02a8eea444f3383f14a1e1f0e236b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.854602 12313 leader_election.cc:290] T 1a393149727043f3a3c9f58aa051b065 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:07.854841 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45add97e0e54dce85225e175ecbb45a" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:07.855001 9711 raft_consensus.cc:2468] T a45add97e0e54dce85225e175ecbb45a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:07.855481 9831 leader_election.cc:304] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:07.856339 12266 ts_tablet_manager.cc:1929] T 827dce05c192467589e2692fabd2a84e P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:07.856340 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a393149727043f3a3c9f58aa051b065" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:07.857580 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a393149727043f3a3c9f58aa051b065" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:07.858546 10370 raft_consensus.cc:740] T 5394eadabf184158864921dd5d394828 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:07.858913 10370 consensus_queue.cc:260] T 5394eadabf184158864921dd5d394828 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.860577 12338 raft_consensus.cc:2804] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:07.860666 12338 raft_consensus.cc:493] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:07.860718 12338 raft_consensus.cc:3060] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:07.856928 9611 leader_election.cc:343] T 1a393149727043f3a3c9f58aa051b065 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.861949 12266 log.cc:1199] T 827dce05c192467589e2692fabd2a84e P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/827dce05c192467589e2692fabd2a84e
W20260810 19:48:07.862125 9611 leader_election.cc:343] T 1a393149727043f3a3c9f58aa051b065 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.862253 9611 leader_election.cc:304] T 1a393149727043f3a3c9f58aa051b065 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:07.862556 12266 ts_tablet_manager.cc:1950] T 827dce05c192467589e2692fabd2a84e P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:07.862661 12313 raft_consensus.cc:2749] T 1a393149727043f3a3c9f58aa051b065 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:07.839519 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8455cb11388340beb6daa13fee06177a" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:07.863461 9939 raft_consensus.cc:3060] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:07.864131 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 827dce05c192467589e2692fabd2a84e (table default.Table_dca6b457fbf744e089c4a583fca06cbb [id=4bce0610a04641ff86ab3af94e12e31d]) successfully deleted
I20260810 19:48:07.864558 12266 tablet_replica.cc:333] T 82c3f619c76e40c583bfcdf2bb77fe42 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:07.864816 12266 raft_consensus.cc:2243] T 82c3f619c76e40c583bfcdf2bb77fe42 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:07.865167 12463 raft_consensus.cc:493] T 0e967384768b4ec7956f1b508e8ab2af P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.865284 12463 raft_consensus.cc:515] T 0e967384768b4ec7956f1b508e8ab2af P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.865031 12266 raft_consensus.cc:2272] T 82c3f619c76e40c583bfcdf2bb77fe42 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:07.866148 12266 ts_tablet_manager.cc:1916] T 82c3f619c76e40c583bfcdf2bb77fe42 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:07.866837 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 1a615a32f94949179de8e8ee8a444576 (DEFAULT_TABLE table=default.Table_fe3c84ad30eb4d57a6d20ec860c02286 [id=c401d03820c6453184e1da223c380872]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:07.848305 10377 rpcz_store.cc:276] 0810 19:48:06.421249 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.421349 (+ 100us) service_pool.cc:224] Handling call
0810 19:48:07.602892 (+1181543us) ts_tablet_manager.cc:1151] Deleting tablet da3d8ade850c4d36bd2756c36706195d
0810 19:48:07.602902 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:07.643345 (+ 40443us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:07.847443 (+204098us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:07.848202 (+ 759us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1128458}
I20260810 19:48:07.867455 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 827) took 1390 ms. Trace:
I20260810 19:48:07.867539 10377 rpcz_store.cc:276] 0810 19:48:06.477191 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.477265 (+ 74us) service_pool.cc:224] Handling call
0810 19:48:07.867352 (+1390087us) ts_tablet_manager.cc:1151] Deleting tablet 971e9abee86444a7a9e923b0962ae751
0810 19:48:07.867361 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:07.867435 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1389789}
I20260810 19:48:07.867916 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 828) took 1367 ms. Trace:
I20260810 19:48:07.867990 10377 rpcz_store.cc:276] 0810 19:48:06.500522 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.500692 (+ 170us) service_pool.cc:224] Handling call
0810 19:48:07.867804 (+1367112us) ts_tablet_manager.cc:1151] Deleting tablet 648ef608fa0c45cc8be4bad80c4200be
0810 19:48:07.867814 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:07.867900 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1366901}
I20260810 19:48:07.821309 9945 raft_consensus.cc:2468] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:07.868331 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 829) took 1350 ms. Trace:
I20260810 19:48:07.868410 10377 rpcz_store.cc:276] 0810 19:48:06.517746 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.517805 (+ 59us) service_pool.cc:224] Handling call
0810 19:48:07.868206 (+1350401us) ts_tablet_manager.cc:1151] Deleting tablet 27aca44685be4a0b92767d13bad15daf
0810 19:48:07.868215 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:07.868314 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1350191}
I20260810 19:48:07.868593 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8988c60f2d8848d98d373813bdfc2228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.868714 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 832) took 1246 ms. Trace:
I20260810 19:48:07.868783 10377 rpcz_store.cc:276] 0810 19:48:06.621905 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.621991 (+ 86us) service_pool.cc:224] Handling call
0810 19:48:07.868620 (+1246629us) ts_tablet_manager.cc:1151] Deleting tablet 01df0725b38d4517b22df017b6c5e2e7
0810 19:48:07.868630 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:07.868699 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1246419}
I20260810 19:48:07.869001 10377 tablet_replica.cc:333] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:07.869160 10377 raft_consensus.cc:2243] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:07.869340 10377 raft_consensus.cc:2272] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:07.870436 9939 raft_consensus.cc:2468] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:07.873414 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet da3d8ade850c4d36bd2756c36706195d (table default.Table_07cbcdfa939f47f0a8f10f834f5ce596 [id=51fc4051f8ac425e9b6b5f86acf32827]) successfully deleted
W20260810 19:48:07.873740 9395 catalog_manager.cc:5017] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 971e9abee86444a7a9e923b0962ae751 because the tablet was not found. No further retry: Not found: Tablet not found: 971e9abee86444a7a9e923b0962ae751
I20260810 19:48:07.873934 12463 leader_election.cc:290] T 0e967384768b4ec7956f1b508e8ab2af P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:07.874040 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 648ef608fa0c45cc8be4bad80c4200be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 648ef608fa0c45cc8be4bad80c4200be already in progress: creating tablet
W20260810 19:48:07.874302 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 27aca44685be4a0b92767d13bad15daf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 27aca44685be4a0b92767d13bad15daf already in progress: creating tablet
W20260810 19:48:07.874577 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 01df0725b38d4517b22df017b6c5e2e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01df0725b38d4517b22df017b6c5e2e7 already in progress: creating tablet
W20260810 19:48:07.875056 9831 leader_election.cc:343] T 0e967384768b4ec7956f1b508e8ab2af P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 0e967384768b4ec7956f1b508e8ab2af
I20260810 19:48:07.876734 10377 ts_tablet_manager.cc:1916] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:07.878669 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a615a32f94949179de8e8ee8a444576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:07.878930 10366 tablet_bootstrap.cc:492] T 5ba42032e7344423a0e86c55d613f27d P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:07.879052 10366 ts_tablet_manager.cc:1403] T 5ba42032e7344423a0e86c55d613f27d P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.182s user 0.005s sys 0.000s
I20260810 19:48:07.880447 12266 ts_tablet_manager.cc:1929] T 82c3f619c76e40c583bfcdf2bb77fe42 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:07.880550 12266 log.cc:1199] T 82c3f619c76e40c583bfcdf2bb77fe42 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/82c3f619c76e40c583bfcdf2bb77fe42
I20260810 19:48:07.880856 12266 ts_tablet_manager.cc:1950] T 82c3f619c76e40c583bfcdf2bb77fe42 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:07.881783 9948 raft_consensus.cc:2468] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:07.883301 12097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e: Bootstrap replayed 1/1 log segments. Stats: ops{read=578 overwritten=0 applied=572 ignored=0} inserts{seen=547 ignored=0} mutations{seen=643 ignored=0} orphaned_commits=0. Pending: 6 replicates
I20260810 19:48:07.871999 12338 raft_consensus.cc:515] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.884388 12097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e: Bootstrap complete.
I20260810 19:48:07.885038 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45add97e0e54dce85225e175ecbb45a" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:07.885255 9711 raft_consensus.cc:3060] T a45add97e0e54dce85225e175ecbb45a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:07.888029 9711 raft_consensus.cc:2468] T a45add97e0e54dce85225e175ecbb45a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:07.890486 9831 leader_election.cc:304] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:07.890799 12463 raft_consensus.cc:2804] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:07.890920 12463 raft_consensus.cc:697] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:07.892514 10366 raft_consensus.cc:359] T 5ba42032e7344423a0e86c55d613f27d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.892685 10366 raft_consensus.cc:385] T 5ba42032e7344423a0e86c55d613f27d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:07.892736 10366 raft_consensus.cc:740] T 5ba42032e7344423a0e86c55d613f27d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:07.892941 10366 consensus_queue.cc:260] T 5ba42032e7344423a0e86c55d613f27d P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.893450 10366 ts_tablet_manager.cc:1434] T 5ba42032e7344423a0e86c55d613f27d P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
I20260810 19:48:07.893748 10366 tablet_bootstrap.cc:492] T 15c070c23de34348ad3426c894e11022 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:07.893819 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 82c3f619c76e40c583bfcdf2bb77fe42 (table default.Table_267ef2e8b32c47328dd2094f69e0940d [id=0f7622612fec444b93d9454f31849cd7]) successfully deleted
I20260810 19:48:07.894200 12266 tablet_replica.cc:333] T 39885c3e0adb4132945d507628f4f082 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:07.894433 12266 raft_consensus.cc:2243] T 39885c3e0adb4132945d507628f4f082 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:07.894729 12266 raft_consensus.cc:2272] T 39885c3e0adb4132945d507628f4f082 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:07.894873 12463 consensus_queue.cc:237] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.895550 12266 ts_tablet_manager.cc:1916] T 39885c3e0adb4132945d507628f4f082 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:07.903918 10366 tablet_bootstrap.cc:654] T 15c070c23de34348ad3426c894e11022 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:07.908381 12266 ts_tablet_manager.cc:1929] T 39885c3e0adb4132945d507628f4f082 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:07.892510 12097 raft_consensus.cc:359] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [term 1 FOLLOWER]: Replica starting. Triggering 6 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } }
I20260810 19:48:07.911476 12266 log.cc:1199] T 39885c3e0adb4132945d507628f4f082 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/39885c3e0adb4132945d507628f4f082
I20260810 19:48:07.914727 12266 ts_tablet_manager.cc:1950] T 39885c3e0adb4132945d507628f4f082 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:07.916533 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 39885c3e0adb4132945d507628f4f082 (table default.Table_2502bd78450e4b1b940e7f64a514dc85 [id=76cdf98e49ae4acb8b64ca07d0e28e8c]) successfully deleted
I20260810 19:48:07.917017 12266 tablet_replica.cc:333] T 60bd14fb8c2e40dc955352518d463ccb P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:07.917281 12266 raft_consensus.cc:2243] T 60bd14fb8c2e40dc955352518d463ccb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:07.918356 12266 raft_consensus.cc:2272] T 60bd14fb8c2e40dc955352518d463ccb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:07.919061 12266 ts_tablet_manager.cc:1916] T 60bd14fb8c2e40dc955352518d463ccb P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:07.920625 12338 leader_election.cc:290] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:07.860158 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45add97e0e54dce85225e175ecbb45a" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:07.869267 10067 leader_election.cc:304] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:48:07.931262 10067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 62024.9us
I20260810 19:48:07.931691 10067 leader_election.cc:304] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:07.875784 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e967384768b4ec7956f1b508e8ab2af" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:07.932134 10067 leader_election.cc:304] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:07.921693 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45add97e0e54dce85225e175ecbb45a" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:07.932555 12106 raft_consensus.cc:2804] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:07.932634 12106 raft_consensus.cc:493] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:07.932691 12106 raft_consensus.cc:3060] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:07.934058 9830 leader_election.cc:343] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:07.934502 9830 leader_election.cc:343] T 0e967384768b4ec7956f1b508e8ab2af P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.934628 9830 leader_election.cc:304] T 0e967384768b4ec7956f1b508e8ab2af P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:07.934842 12097 raft_consensus.cc:740] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f52c40e347e24ab4b3129e7064f4a43e, State: Initialized, Role: FOLLOWER
W20260810 19:48:07.935016 9830 leader_election.cc:343] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.935590 12106 raft_consensus.cc:515] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.935729 12097 consensus_queue.cc:260] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 572, Last appended: 1.578, Last appended by leader: 578, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } }
I20260810 19:48:07.936218 12106 leader_election.cc:290] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:07.936370 12106 raft_consensus.cc:2804] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:07.938216 12266 ts_tablet_manager.cc:1929] T 60bd14fb8c2e40dc955352518d463ccb P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:07.938434 12266 log.cc:1199] T 60bd14fb8c2e40dc955352518d463ccb P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/60bd14fb8c2e40dc955352518d463ccb
I20260810 19:48:07.938805 12266 ts_tablet_manager.cc:1950] T 60bd14fb8c2e40dc955352518d463ccb P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:07.939572 12527 raft_consensus.cc:2804] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:07.939695 12527 raft_consensus.cc:697] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:07.939967 12527 consensus_queue.cc:237] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.940477 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 60bd14fb8c2e40dc955352518d463ccb (table default.Table_e9290dde7b6e467584d7cdf7b0ceae58 [id=72ed9704a69b4a26a1edd95ad525650a]) successfully deleted
I20260810 19:48:07.941089 12106 raft_consensus.cc:697] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:07.941905 12106 consensus_queue.cc:237] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.942749 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63486cc3f8774a11827b1cc5f1c16332" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:07.942958 9948 raft_consensus.cc:3060] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:07.945983 9948 raft_consensus.cc:2468] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
W20260810 19:48:07.946949 10068 leader_election.cc:343] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 63486cc3f8774a11827b1cc5f1c16332
I20260810 19:48:07.947279 11828 raft_consensus.cc:493] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.948693 11828 raft_consensus.cc:515] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.949297 11828 leader_election.cc:290] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:07.949685 12463 raft_consensus.cc:2749] T 0e967384768b4ec7956f1b508e8ab2af P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:07.949874 12463 raft_consensus.cc:493] T 3582ed23ffdf4ff089952e29083e5425 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:07.949976 12463 raft_consensus.cc:515] T 3582ed23ffdf4ff089952e29083e5425 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.950209 10067 leader_election.cc:304] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:07.950888 12463 leader_election.cc:290] T 3582ed23ffdf4ff089952e29083e5425 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:07.950984 11828 raft_consensus.cc:2804] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:07.951100 11828 raft_consensus.cc:697] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:07.951316 11828 consensus_queue.cc:237] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:07.952059 9831 leader_election.cc:343] T 3582ed23ffdf4ff089952e29083e5425 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 3582ed23ffdf4ff089952e29083e5425
I20260810 19:48:07.952683 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3582ed23ffdf4ff089952e29083e5425" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:07.952777 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bddaf5b5fc1404e83b079ffa97e7321" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:07.952914 10068 leader_election.cc:343] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 0bddaf5b5fc1404e83b079ffa97e7321
I20260810 19:48:07.953105 9948 raft_consensus.cc:2468] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
W20260810 19:48:07.953351 9830 leader_election.cc:343] T 3582ed23ffdf4ff089952e29083e5425 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:07.953470 9830 leader_election.cc:304] T 3582ed23ffdf4ff089952e29083e5425 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:07.953589 10067 leader_election.cc:304] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:07.953954 12527 raft_consensus.cc:2804] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:07.953953 12463 raft_consensus.cc:2749] T 3582ed23ffdf4ff089952e29083e5425 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:07.954020 12527 raft_consensus.cc:493] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:07.954071 12527 raft_consensus.cc:3060] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:07.956838 12527 raft_consensus.cc:515] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.958211 12527 leader_election.cc:290] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:07.961510 10068 leader_election.cc:343] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 0bddaf5b5fc1404e83b079ffa97e7321
I20260810 19:48:07.962251 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bddaf5b5fc1404e83b079ffa97e7321" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:07.962498 9948 raft_consensus.cc:3060] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:07.963570 12540 sys_catalog.cc:455] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } } }
I20260810 19:48:07.964874 12540 sys_catalog.cc:458] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [sys.catalog]: This master's current role is: FOLLOWER
I20260810 19:48:07.965859 12097 sys_catalog.cc:565] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 19:48:07.970222 11934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5268e710af3c43ddab70eb7dd1aaa575" candidate_term: 2 candidate_status { last_received { term: 1 index: 952 } } ignore_live_leader: false dest_uuid: "f52c40e347e24ab4b3129e7064f4a43e" is_pre_election: true
W20260810 19:48:07.971292 11934 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33644 (request call id 1) took 3060 ms (client timeout 596 ms). Trace:
W20260810 19:48:07.971529 11934 rpcz_store.cc:269] 0810 19:48:04.911142 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.911208 (+ 66us) service_pool.cc:224] Handling call
0810 19:48:07.971237 (+3060029us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:48:07.972631 11936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5268e710af3c43ddab70eb7dd1aaa575" candidate_term: 2 candidate_status { last_received { term: 1 index: 952 } } ignore_live_leader: false dest_uuid: "f52c40e347e24ab4b3129e7064f4a43e" is_pre_election: true
W20260810 19:48:07.973023 11936 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33644 (request call id 0) took 3723 ms (client timeout 596 ms). Trace:
W20260810 19:48:07.973161 11936 rpcz_store.cc:269] 0810 19:48:04.249256 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.249320 (+ 64us) service_pool.cc:224] Handling call
0810 19:48:07.972990 (+3723670us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:48:07.979592 9948 raft_consensus.cc:2468] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:07.980430 10067 leader_election.cc:304] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:07.980790 10366 tablet_bootstrap.cc:492] T 15c070c23de34348ad3426c894e11022 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:07.980967 10366 ts_tablet_manager.cc:1403] T 15c070c23de34348ad3426c894e11022 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.087s user 0.004s sys 0.000s
I20260810 19:48:07.981087 11828 raft_consensus.cc:2804] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:07.981266 11828 raft_consensus.cc:697] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:07.981554 11828 consensus_queue.cc:237] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.981859 10366 raft_consensus.cc:359] T 15c070c23de34348ad3426c894e11022 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.982057 10366 raft_consensus.cc:385] T 15c070c23de34348ad3426c894e11022 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:07.982116 10366 raft_consensus.cc:740] T 15c070c23de34348ad3426c894e11022 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:07.982399 10366 consensus_queue.cc:260] T 15c070c23de34348ad3426c894e11022 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:07.982970 10366 ts_tablet_manager.cc:1434] T 15c070c23de34348ad3426c894e11022 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 19:48:07.986593 10370 ts_tablet_manager.cc:1434] T 5394eadabf184158864921dd5d394828 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.150s user 0.002s sys 0.000s
I20260810 19:48:07.987684 10377 ts_tablet_manager.cc:1929] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260810 19:48:07.988605 10370 tablet_bootstrap.cc:492] T 4dba7046bdfd41f1a2ad6f299a723776 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:07.991405 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 09f09289a4c84e25b84c10abef3799c3
I20260810 19:48:07.992060 9416 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:56048 (request call id 1043) took 1170 ms. Trace:
I20260810 19:48:07.992270 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet 09f09289a4c84e25b84c10abef3799c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:07 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:07.992197 9416 rpcz_store.cc:276] 0810 19:48:06.821542 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:07.182722 (+361180us) service_pool.cc:224] Handling call
0810 19:48:07.183290 (+ 568us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 19:48:07.183437 (+ 147us) catalog_manager.cc:2841] Modifying in-memory table state
0810 19:48:07.183524 (+ 87us) catalog_manager.cc:2850] Locking tablets
0810 19:48:07.499621 (+316097us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 19:48:07.991137 (+491516us) catalog_manager.cc:2882] Removing table from by-name map
0810 19:48:07.991246 (+ 109us) catalog_manager.cc:2898] Committing in-memory state
0810 19:48:07.991316 (+ 70us) catalog_manager.cc:2902] Aborting table tasks
0810 19:48:07.992016 (+ 700us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:48:07.505682 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 19:48:07.505802 (+ 120us) write_op.cc:432] Acquiring schema lock in shared mode
0810 19:48:07.505808 (+ 6us) write_op.cc:435] Acquired schema lock
0810 19:48:07.505811 (+ 3us) tablet.cc:662] Decoding operations
0810 19:48:07.505925 (+ 114us) write_op.cc:620] Acquiring the partition lock for write op
0810 19:48:07.505942 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0810 19:48:07.505946 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0810 19:48:07.506067 (+ 121us) tablet.cc:701] Row locks acquired
0810 19:48:07.506070 (+ 3us) write_op.cc:260] PREPARE: finished
0810 19:48:07.506114 (+ 44us) write_op.cc:270] Start()
0810 19:48:07.506148 (+ 34us) write_op.cc:276] Timestamp: P: 1786391287506091 usec, L: 0
0810 19:48:07.506152 (+ 4us) op_driver.cc:348] REPLICATION: starting
0810 19:48:07.506385 (+ 233us) log.cc:844] Serialized 762 byte log entry
0810 19:48:07.989093 (+482708us) op_driver.cc:464] REPLICATION: finished
0810 19:48:07.989450 (+ 357us) write_op.cc:301] APPLY: starting
0810 19:48:07.989475 (+ 25us) tablet.cc:1367] starting BulkCheckPresence
0810 19:48:07.989532 (+ 57us) tablet.cc:1370] finished BulkCheckPresence
0810 19:48:07.989566 (+ 34us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 19:48:07.989659 (+ 93us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 19:48:07.989698 (+ 39us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 19:48:07.989706 (+ 8us) write_op.cc:312] APPLY: finished
0810 19:48:07.989808 (+ 102us) log.cc:844] Serialized 29 byte log entry
0810 19:48:07.989888 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:07.989914 (+ 26us) write_op.cc:454] Released schema lock
0810 19:48:07.989923 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 19:48:07.990012 (+ 89us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:07.990016 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":292,"apply.run_cpu_time_us":553,"apply.run_wall_time_us":553,"num_ops":2,"prepare.queue_time_us":5272,"prepare.run_cpu_time_us":783,"prepare.run_wall_time_us":783,"replication_time_us":482893}]]}
I20260810 19:48:07.993443 10377 log.cc:1199] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/9714a8a1eeaf41d2bb01d3fa3ff7181d
I20260810 19:48:07.993944 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet cbcaa7106df24aaeb07428b7b590e282
I20260810 19:48:07.994009 10377 ts_tablet_manager.cc:1950] T 9714a8a1eeaf41d2bb01d3fa3ff7181d P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:07.994501 9408 catalog_manager.cc:6807] ReplaceTablet: tablet cbcaa7106df24aaeb07428b7b590e282 deleted and replaced by tablet 978695f755c9493db750d81a0c4680f5
I20260810 19:48:07.994932 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 833) took 1371 ms. Trace:
I20260810 19:48:07.994951 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet cbcaa7106df24aaeb07428b7b590e282 with delete_type TABLET_DATA_DELETED (replaced by tablet 978695f755c9493db750d81a0c4680f5) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:07.995023 10377 rpcz_store.cc:276] 0810 19:48:06.623208 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.623296 (+ 88us) service_pool.cc:224] Handling call
0810 19:48:07.868964 (+1245668us) ts_tablet_manager.cc:1151] Deleting tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d
0810 19:48:07.868971 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:07.915789 (+ 46818us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:07.987611 (+ 71822us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:07.994908 (+ 7297us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1245459}
I20260810 19:48:07.995431 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 831) took 1389 ms. Trace:
I20260810 19:48:07.995496 10377 rpcz_store.cc:276] 0810 19:48:06.605777 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.626516 (+ 20739us) service_pool.cc:224] Handling call
0810 19:48:07.995304 (+1368788us) ts_tablet_manager.cc:1151] Deleting tablet 49a73b0637664821bcb44ba463baac18
0810 19:48:07.995316 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:07.995417 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1357898}
I20260810 19:48:07.995806 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 834) took 1326 ms. Trace:
I20260810 19:48:07.995873 10377 rpcz_store.cc:276] 0810 19:48:06.669065 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.669162 (+ 97us) service_pool.cc:224] Handling call
0810 19:48:07.995689 (+1326527us) ts_tablet_manager.cc:1151] Deleting tablet 08ac9ae9eceb42b3880c4f35556994c7
0810 19:48:07.995698 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:07.995787 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1326128}
I20260810 19:48:07.996140 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 835) took 1320 ms. Trace:
I20260810 19:48:07.996192 10377 rpcz_store.cc:276] 0810 19:48:06.676159 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.676232 (+ 73us) service_pool.cc:224] Handling call
0810 19:48:07.996055 (+1319823us) ts_tablet_manager.cc:1151] Deleting tablet 2ac59875628e40ffb1385dedea2f3b9d
0810 19:48:07.996063 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:07.996129 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1310561}
I20260810 19:48:07.996454 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 836) took 1236 ms. Trace:
I20260810 19:48:07.996518 10377 rpcz_store.cc:276] 0810 19:48:06.760423 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.761469 (+ 1046us) service_pool.cc:224] Handling call
0810 19:48:07.996365 (+1234896us) ts_tablet_manager.cc:1151] Deleting tablet aaaeafe4afb8454baf2e141a00da8ee3
0810 19:48:07.996372 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:07.996440 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1168087}
I20260810 19:48:07.996631 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 09f09289a4c84e25b84c10abef3799c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:07 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:07.996721 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet cbcaa7106df24aaeb07428b7b590e282 with delete_type TABLET_DATA_DELETED (replaced by tablet 978695f755c9493db750d81a0c4680f5) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:07.996810 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 838) took 1102 ms. Trace:
I20260810 19:48:07.996872 10377 rpcz_store.cc:276] 0810 19:48:06.894261 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.894344 (+ 83us) service_pool.cc:224] Handling call
0810 19:48:07.996698 (+1102354us) ts_tablet_manager.cc:1151] Deleting tablet ab27734e3d974260a77f1d94e5f534fe
0810 19:48:07.996706 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:07.996795 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1102160}
I20260810 19:48:07.996953 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 9714a8a1eeaf41d2bb01d3fa3ff7181d (table default.Table_c35ddec630d942db9ba85f10a2f405ee [id=fd840f00bdc5477aaad0b7fa114870dd]) successfully deleted
W20260810 19:48:07.997242 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 49a73b0637664821bcb44ba463baac18 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49a73b0637664821bcb44ba463baac18 already in progress: creating tablet
W20260810 19:48:07.997526 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 08ac9ae9eceb42b3880c4f35556994c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08ac9ae9eceb42b3880c4f35556994c7 already in progress: creating tablet
I20260810 19:48:07.978644 11937 raft_consensus.cc:1217] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.570->[1.571-1.932] Dedup: 1.578->[1.579-1.932]
W20260810 19:48:07.997654 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 09f09289a4c84e25b84c10abef3799c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09f09289a4c84e25b84c10abef3799c3 already in progress: creating tablet
W20260810 19:48:07.997762 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 2ac59875628e40ffb1385dedea2f3b9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ac59875628e40ffb1385dedea2f3b9d already in progress: creating tablet
W20260810 19:48:07.997920 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet cbcaa7106df24aaeb07428b7b590e282 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cbcaa7106df24aaeb07428b7b590e282 already in progress: creating tablet
W20260810 19:48:07.998029 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet aaaeafe4afb8454baf2e141a00da8ee3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aaaeafe4afb8454baf2e141a00da8ee3 already in progress: creating tablet
I20260810 19:48:07.999783 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5
I20260810 19:48:08.000413 9412 catalog_manager.cc:6807] ReplaceTablet: tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5 deleted and replaced by tablet bef956a173084e7698a37dddc574ea65
I20260810 19:48:08.000901 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5 with delete_type TABLET_DATA_DELETED (replaced by tablet bef956a173084e7698a37dddc574ea65) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:08.002008 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5 with delete_type TABLET_DATA_DELETED (replaced by tablet bef956a173084e7698a37dddc574ea65) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:08.002272 12266 tablet_replica.cc:333] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:08.002250 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5 with delete_type TABLET_DATA_DELETED (replaced by tablet bef956a173084e7698a37dddc574ea65) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:08.002499 12266 raft_consensus.cc:2243] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:08.002717 12266 raft_consensus.cc:2272] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:08.003371 12266 ts_tablet_manager.cc:1916] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:08.004573 9901 tablet_service.cc:1558] Processing DeleteTablet for tablet cbcaa7106df24aaeb07428b7b590e282 with delete_type TABLET_DATA_DELETED (replaced by tablet 978695f755c9493db750d81a0c4680f5) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:08.007218 12313 raft_consensus.cc:493] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:08.007359 12313 raft_consensus.cc:515] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.007990 12313 leader_election.cc:290] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:08.009404 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4571e0c723f74c828220b33116fed9e9" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:08.010088 9611 leader_election.cc:343] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:08.010412 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4571e0c723f74c828220b33116fed9e9" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:08.010259 12266 ts_tablet_manager.cc:1929] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:08.010679 12266 log.cc:1199] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/0d8e8e1b5f3f452f8fdfe5a42fd021a5
I20260810 19:48:08.011170 12266 ts_tablet_manager.cc:1950] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
W20260810 19:48:08.011344 9611 leader_election.cc:343] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:08.011451 9611 leader_election.cc:304] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:08.011860 12313 raft_consensus.cc:2749] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:08.012099 10370 tablet_bootstrap.cc:654] T 4dba7046bdfd41f1a2ad6f299a723776 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:08.012441 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5 (table default.Table_b46992ec81974f6caad1ea769640dcf1 [id=d6d2d95e5e9f4e10a7d5a8153e66e4b6]) successfully deleted
I20260810 19:48:08.014487 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 09f09289a4c84e25b84c10abef3799c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:07 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:08.016010 10366 tablet_bootstrap.cc:492] T 4c75af1e592042f5a4d442b82a539c94 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:08.020922 10366 tablet_bootstrap.cc:654] T 4c75af1e592042f5a4d442b82a539c94 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:08.024708 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 67d02a8eea444f3383f14a1e1f0e236b
I20260810 19:48:08.025583 9421 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:56048 (request call id 1044) took 1134 ms. Trace:
I20260810 19:48:08.025946 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet 67d02a8eea444f3383f14a1e1f0e236b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:07 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:08.025981 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 67d02a8eea444f3383f14a1e1f0e236b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:07 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:08.025700 9421 rpcz_store.cc:276] 0810 19:48:06.890966 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:07.214294 (+323328us) service_pool.cc:224] Handling call
0810 19:48:07.218686 (+ 4392us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x616000041b54. stack: 00007f50aec1d326 00007f50aec1d0e0 00007f50adc4734d 00000000009a5774 00000000009a573d 00007f50be19c65d 00007f50be19c753 00007f50bad21ac1 00007f50c2afb40d 00007f50c2c8ab06 00007f50b96739d6 00007f50b9673705 00007f50b5d6061e 00007f50b5d5f4fe 00007f50b5d65738 00007f50b5d6609f
0810 19:48:07.219143 (+ 457us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 19:48:07.219321 (+ 178us) catalog_manager.cc:2841] Modifying in-memory table state
0810 19:48:07.219430 (+ 109us) catalog_manager.cc:2850] Locking tablets
0810 19:48:07.501901 (+282471us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 19:48:08.024459 (+522558us) catalog_manager.cc:2882] Removing table from by-name map
0810 19:48:08.024571 (+ 112us) catalog_manager.cc:2898] Committing in-memory state
0810 19:48:08.024627 (+ 56us) catalog_manager.cc:2902] Aborting table tasks
0810 19:48:08.025448 (+ 821us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:48:07.533660 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 19:48:07.533779 (+ 119us) write_op.cc:432] Acquiring schema lock in shared mode
0810 19:48:07.533786 (+ 7us) write_op.cc:435] Acquired schema lock
0810 19:48:07.533788 (+ 2us) tablet.cc:662] Decoding operations
0810 19:48:07.533911 (+ 123us) write_op.cc:620] Acquiring the partition lock for write op
0810 19:48:07.533921 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0810 19:48:07.533926 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0810 19:48:07.534073 (+ 147us) tablet.cc:701] Row locks acquired
0810 19:48:07.534076 (+ 3us) write_op.cc:260] PREPARE: finished
0810 19:48:07.534125 (+ 49us) write_op.cc:270] Start()
0810 19:48:07.534165 (+ 40us) write_op.cc:276] Timestamp: P: 1786391287534099 usec, L: 0
0810 19:48:07.534169 (+ 4us) op_driver.cc:348] REPLICATION: starting
0810 19:48:07.534468 (+ 299us) log.cc:844] Serialized 762 byte log entry
0810 19:48:08.023084 (+488616us) op_driver.cc:464] REPLICATION: finished
0810 19:48:08.023263 (+ 179us) write_op.cc:301] APPLY: starting
0810 19:48:08.023283 (+ 20us) tablet.cc:1367] starting BulkCheckPresence
0810 19:48:08.023379 (+ 96us) tablet.cc:1370] finished BulkCheckPresence
0810 19:48:08.023418 (+ 39us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 19:48:08.023529 (+ 111us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 19:48:08.023571 (+ 42us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 19:48:08.023579 (+ 8us) write_op.cc:312] APPLY: finished
0810 19:48:08.023691 (+ 112us) log.cc:844] Serialized 29 byte log entry
0810 19:48:08.023774 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:08.023798 (+ 24us) write_op.cc:454] Released schema lock
0810 19:48:08.023806 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 19:48:08.023899 (+ 93us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:08.023903 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":9412224,"child_traces":[["op",{"apply.queue_time_us":116,"apply.run_cpu_time_us":626,"apply.run_wall_time_us":625,"num_ops":2,"prepare.queue_time_us":31082,"prepare.run_cpu_time_us":966,"prepare.run_wall_time_us":984,"replication_time_us":488873}]]}
I20260810 19:48:08.026572 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 8a7212453dab49fa9372c628b80219c9
W20260810 19:48:08.026768 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 67d02a8eea444f3383f14a1e1f0e236b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67d02a8eea444f3383f14a1e1f0e236b already in progress: creating tablet
I20260810 19:48:08.027261 9420 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:56048 (request call id 1038) took 1247 ms. Trace:
I20260810 19:48:08.027565 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a7212453dab49fa9372c628b80219c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:08.027374 9420 rpcz_store.cc:276] 0810 19:48:06.779447 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.892865 (+113418us) service_pool.cc:224] Handling call
0810 19:48:06.893381 (+ 516us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 19:48:06.893532 (+ 151us) catalog_manager.cc:2841] Modifying in-memory table state
0810 19:48:06.893608 (+ 76us) catalog_manager.cc:2850] Locking tablets
0810 19:48:07.502055 (+608447us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 19:48:08.026394 (+524339us) catalog_manager.cc:2882] Removing table from by-name map
0810 19:48:08.026482 (+ 88us) catalog_manager.cc:2898] Committing in-memory state
0810 19:48:08.026521 (+ 39us) catalog_manager.cc:2902] Aborting table tasks
0810 19:48:08.027194 (+ 673us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:48:07.534688 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 19:48:07.534785 (+ 97us) write_op.cc:432] Acquiring schema lock in shared mode
0810 19:48:07.534790 (+ 5us) write_op.cc:435] Acquired schema lock
0810 19:48:07.534793 (+ 3us) tablet.cc:662] Decoding operations
0810 19:48:07.534928 (+ 135us) write_op.cc:620] Acquiring the partition lock for write op
0810 19:48:07.534937 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0810 19:48:07.534942 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0810 19:48:07.535038 (+ 96us) tablet.cc:701] Row locks acquired
0810 19:48:07.535040 (+ 2us) write_op.cc:260] PREPARE: finished
0810 19:48:07.535084 (+ 44us) write_op.cc:270] Start()
0810 19:48:07.535116 (+ 32us) write_op.cc:276] Timestamp: P: 1786391287535061 usec, L: 0
0810 19:48:07.535123 (+ 7us) op_driver.cc:348] REPLICATION: starting
0810 19:48:07.535286 (+ 163us) log.cc:844] Serialized 731 byte log entry
0810 19:48:08.023183 (+487897us) op_driver.cc:464] REPLICATION: finished
0810 19:48:08.023997 (+ 814us) write_op.cc:301] APPLY: starting
0810 19:48:08.024009 (+ 12us) tablet.cc:1367] starting BulkCheckPresence
0810 19:48:08.024050 (+ 41us) tablet.cc:1370] finished BulkCheckPresence
0810 19:48:08.024084 (+ 34us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 19:48:08.024139 (+ 55us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 19:48:08.024168 (+ 29us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 19:48:08.024175 (+ 7us) write_op.cc:312] APPLY: finished
0810 19:48:08.024236 (+ 61us) log.cc:844] Serialized 29 byte log entry
0810 19:48:08.024278 (+ 42us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:08.024305 (+ 27us) write_op.cc:454] Released schema lock
0810 19:48:08.024311 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":12544,"child_traces":[["op",{"apply.queue_time_us":779,"apply.run_cpu_time_us":371,"apply.run_wall_time_us":371,"mutex_wait_us":297,"num_ops":2,"prepare.queue_time_us":32110,"prepare.run_cpu_time_us":661,"prepare.run_wall_time_us":659,"replication_time_us":488042}]]}
I20260810 19:48:08.029250 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a7212453dab49fa9372c628b80219c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:08.030057 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 8a7212453dab49fa9372c628b80219c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a7212453dab49fa9372c628b80219c9 already in progress: creating tablet
I20260810 19:48:08.031867 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 8713212c586a4143b65ff044a67b8b72
I20260810 19:48:08.032678 9407 master_service.cc:960] ReplaceTablet: received request to replace tablet 8455cb11388340beb6daa13fee06177a from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:08.032846 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 8713212c586a4143b65ff044a67b8b72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:07 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:08.032876 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet 8713212c586a4143b65ff044a67b8b72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:07 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:08.033528 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 8713212c586a4143b65ff044a67b8b72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8713212c586a4143b65ff044a67b8b72 already in progress: creating tablet
I20260810 19:48:08.035502 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet d77785d9bde843bc8366fe15d1b4fa18
I20260810 19:48:08.036067 9415 catalog_manager.cc:6807] ReplaceTablet: tablet d77785d9bde843bc8366fe15d1b4fa18 deleted and replaced by tablet 041844571695425eb6de69d251dffcf0
I20260810 19:48:08.036250 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet d77785d9bde843bc8366fe15d1b4fa18 with delete_type TABLET_DATA_DELETED (replaced by tablet 041844571695425eb6de69d251dffcf0) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:08.036482 12266 tablet_replica.cc:333] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:08.036499 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet d77785d9bde843bc8366fe15d1b4fa18 with delete_type TABLET_DATA_DELETED (replaced by tablet 041844571695425eb6de69d251dffcf0) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:08.037308 9410 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 5394eadabf184158864921dd5d394828 (table default.Table_c5cc7d3e97ae4d02952905907354f9a3 [id=2d447d5da0e74e0885490174fc0f929d]). Expected version 1 got 0
I20260810 19:48:08.037938 9410 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 3e8ae48a2fb548358176abefe1ee3baa (table default.Table_9cb0cc2a8f724781a638706ddcc2c085 [id=12db110e89e04d40bdb05ec61fd5e3b6]). Expected version 1 got 0
I20260810 19:48:08.050168 10375 ts_tablet_manager.cc:1929] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:08.050385 10375 log.cc:1199] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/da3d8ade850c4d36bd2756c36706195d
I20260810 19:48:08.057324 10375 ts_tablet_manager.cc:1950] T da3d8ade850c4d36bd2756c36706195d P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:08.057683 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 810) took 1294 ms. Trace:
I20260810 19:48:08.057754 10375 rpcz_store.cc:276] 0810 19:48:06.762869 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.763373 (+ 504us) service_pool.cc:224] Handling call
0810 19:48:07.821238 (+1057865us) ts_tablet_manager.cc:1151] Deleting tablet da3d8ade850c4d36bd2756c36706195d
0810 19:48:07.821248 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:07.839133 (+ 17885us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:07.842191 (+ 3058us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:08.057665 (+215474us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1057737}
I20260810 19:48:08.058161 10375 tablet_replica.cc:333] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:08.058405 10375 raft_consensus.cc:2243] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:08.058378 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet da3d8ade850c4d36bd2756c36706195d (table default.Table_07cbcdfa939f47f0a8f10f834f5ce596 [id=51fc4051f8ac425e9b6b5f86acf32827]) successfully deleted
I20260810 19:48:08.058756 10375 pending_rounds.cc:70] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:08.058840 10375 pending_rounds.cc:77] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058709853413376 op_type: NO_OP noop_request { }
I20260810 19:48:08.058955 10375 raft_consensus.cc:2889] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:08.059048 10375 raft_consensus.cc:2272] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:08.059729 10375 ts_tablet_manager.cc:1916] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:08.073745 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_908acdc21674469e937e4539876e0267" } new_table_name: "default.Table_92979ca12b07474b8e621122d23568a7" modify_external_catalogs: true
I20260810 19:48:08.075378 10370 tablet_bootstrap.cc:492] T 4dba7046bdfd41f1a2ad6f299a723776 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:08.075551 10370 ts_tablet_manager.cc:1403] T 4dba7046bdfd41f1a2ad6f299a723776 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.087s user 0.004s sys 0.000s
I20260810 19:48:08.075539 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0a1983416c99454b889117130d83b254" } modify_external_catalogs: true
I20260810 19:48:08.075739 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0a1983416c99454b889117130d83b254" } modify_external_catalogs: true
I20260810 19:48:08.076404 10370 raft_consensus.cc:359] T 4dba7046bdfd41f1a2ad6f299a723776 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.076601 10370 raft_consensus.cc:385] T 4dba7046bdfd41f1a2ad6f299a723776 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:08.076648 10370 raft_consensus.cc:740] T 4dba7046bdfd41f1a2ad6f299a723776 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:08.076714 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9cb0cc2a8f724781a638706ddcc2c085" } new_table_name: "default.Table_eb9f78456c6e44de9695e8fe65c3e119" modify_external_catalogs: true
I20260810 19:48:08.076882 10370 consensus_queue.cc:260] T 4dba7046bdfd41f1a2ad6f299a723776 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.077385 10370 ts_tablet_manager.cc:1434] T 4dba7046bdfd41f1a2ad6f299a723776 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260810 19:48:08.078015 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet ab27734e3d974260a77f1d94e5f534fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab27734e3d974260a77f1d94e5f534fe already in progress: creating tablet
W20260810 19:48:08.078444 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet b3754889e4574fc3a936ac31cc6f496a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3754889e4574fc3a936ac31cc6f496a already in progress: creating tablet
W20260810 19:48:08.078809 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet b704af46d0da4695a2aefd5dd17e0a7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b704af46d0da4695a2aefd5dd17e0a7d already in progress: creating tablet
I20260810 19:48:08.078929 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_401a35fefca043648cdea5f454f66840" } new_table_name: "default.Table_6cf0e640c54b4c6aa2a0d1c2f9b7debb" modify_external_catalogs: true
I20260810 19:48:08.080472 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_56f3340c93684c45bacea55059a03455"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:08.081071 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56f3340c93684c45bacea55059a03455 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:08.082963 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e63fa9c3c1be48f7b248cea033e5f5f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:08.083546 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e63fa9c3c1be48f7b248cea033e5f5f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:08.085880 12266 raft_consensus.cc:2243] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:08.086280 12266 pending_rounds.cc:70] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4: Trying to abort 1 pending ops.
I20260810 19:48:08.086360 12266 pending_rounds.cc:77] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7317058715621863424 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "d77785d9bde843bc8366fe15d1b4fa18" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 2 new_table_name: "default.Table_3e78e13c8ecc464eb6af12a2bc3f2eba" dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" new_extra_config { } }
I20260810 19:48:08.086819 12266 raft_consensus.cc:2272] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:08.087554 12266 ts_tablet_manager.cc:1916] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:08.090436 9416 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 410855f236004ad4b78839eb1c0c2f1f (table default.Table_44478e93cffb460aaa8df9115b799594 [id=1d363ce63686462f9f4c15669773ee22]). Expected version 1 got 0
I20260810 19:48:08.094475 12266 ts_tablet_manager.cc:1929] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:08.094717 12266 log.cc:1199] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/d77785d9bde843bc8366fe15d1b4fa18
I20260810 19:48:08.095158 12266 ts_tablet_manager.cc:1950] T d77785d9bde843bc8366fe15d1b4fa18 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:08.095954 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet d77785d9bde843bc8366fe15d1b4fa18 (table default.Table_3e78e13c8ecc464eb6af12a2bc3f2eba [id=1af2d06c44b643e28d28bb080cd5eef8]) successfully deleted
W20260810 19:48:08.098886 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3bf9486839474b2a8ddff3a49b4fda2a consensus state has no leader
I20260810 19:48:08.101568 9413 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_2b20dee66e634a07bc9f2e2de90e8529 [id=452b19ee68bc463086780f6f72603483] alter complete (version 1)
I20260810 19:48:08.108661 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_252f2578ecab482bb7255aa483e17833" } new_table_name: "default.Table_3feacdb8009f4526828a9306b20f4341" modify_external_catalogs: true
I20260810 19:48:08.112460 9410 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_bd99f8533af7419086a1ae12068ad426 [id=374cf9ed870c448fbbdad7050d0d11f9] alter complete (version 3)
I20260810 19:48:08.116137 12313 raft_consensus.cc:493] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:08.116330 12313 raft_consensus.cc:515] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.117089 12313 leader_election.cc:290] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:08.113512 10370 tablet_bootstrap.cc:492] T 3bf9486839474b2a8ddff3a49b4fda2a P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:08.117990 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f1c7a75aac4d6a9462af4def91eaa4" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:08.119961 9611 leader_election.cc:343] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:08.121012 10370 tablet_bootstrap.cc:654] T 3bf9486839474b2a8ddff3a49b4fda2a P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:08.122893 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_eb19a51e41b04a3b8262fe84b188adde"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:08.123708 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb19a51e41b04a3b8262fe84b188adde in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:08.138461 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_361836440e714f89b85618c3ec886efa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:08.139216 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_361836440e714f89b85618c3ec886efa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:08.148876 10068 consensus_peers.cc:597] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 00fe7d9a548a487d965d92b53cdf9250. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:08.145246 12585 tablet.cc:1724] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:08.021453 10029 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:48:08.034200 9901 tablet_service.cc:1558] Processing DeleteTablet for tablet 8713212c586a4143b65ff044a67b8b72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:07 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:08.036374 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet d77785d9bde843bc8366fe15d1b4fa18 with delete_type TABLET_DATA_DELETED (replaced by tablet 041844571695425eb6de69d251dffcf0) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:08.044699 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 67d02a8eea444f3383f14a1e1f0e236b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:07 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:08.072847 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a7212453dab49fa9372c628b80219c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:08.078858 10377 tablet_replica.cc:333] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:08.088362 11897 raft_consensus.cc:493] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:08.160060 11897 raft_consensus.cc:515] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.160894 11897 leader_election.cc:290] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:08.091621 9831 consensus_peers.cc:597] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260810 19:48:08.161092 9831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 69530.8us
I20260810 19:48:08.162495 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f1c7a75aac4d6a9462af4def91eaa4" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:08.163897 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf9486839474b2a8ddff3a49b4fda2a" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:08.164048 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf9486839474b2a8ddff3a49b4fda2a" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:08.164263 9715 raft_consensus.cc:2468] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
W20260810 19:48:08.164923 9830 leader_election.cc:343] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:08.165529 9831 leader_election.cc:304] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
W20260810 19:48:08.166057 9611 leader_election.cc:343] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:08.166180 9611 leader_election.cc:304] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:08.166754 12407 raft_consensus.cc:2749] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:08.166976 11897 raft_consensus.cc:2804] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:08.167064 11897 raft_consensus.cc:493] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:08.167155 11897 raft_consensus.cc:3060] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:08.170794 11897 raft_consensus.cc:515] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.172029 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf9486839474b2a8ddff3a49b4fda2a" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:08.172231 9715 raft_consensus.cc:3060] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:08.176084 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf9486839474b2a8ddff3a49b4fda2a" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
W20260810 19:48:08.176805 9830 leader_election.cc:343] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:08.177423 12585 tablet.cc:1724] T d77785d9bde843bc8366fe15d1b4fa18 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:08.177680 11897 leader_election.cc:290] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:08.179479 9715 raft_consensus.cc:2468] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:08.180121 10366 tablet_bootstrap.cc:492] T 4c75af1e592042f5a4d442b82a539c94 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:08.180094 9831 leader_election.cc:304] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:08.180299 10366 ts_tablet_manager.cc:1403] T 4c75af1e592042f5a4d442b82a539c94 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.164s user 0.004s sys 0.000s
I20260810 19:48:08.180699 12338 raft_consensus.cc:2804] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:08.180832 12338 raft_consensus.cc:697] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:08.181066 12338 consensus_queue.cc:237] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.181262 10366 raft_consensus.cc:359] T 4c75af1e592042f5a4d442b82a539c94 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.181445 10366 raft_consensus.cc:385] T 4c75af1e592042f5a4d442b82a539c94 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:08.181491 10366 raft_consensus.cc:740] T 4c75af1e592042f5a4d442b82a539c94 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:08.181725 10366 consensus_queue.cc:260] T 4c75af1e592042f5a4d442b82a539c94 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.182677 10366 ts_tablet_manager.cc:1434] T 4c75af1e592042f5a4d442b82a539c94 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:08.182848 10377 raft_consensus.cc:2243] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:08.183004 10366 tablet_bootstrap.cc:492] T 896b7cfdb0ca4904aaeafa13ff19365e P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:08.183043 10377 raft_consensus.cc:2272] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:08.183678 10377 ts_tablet_manager.cc:1916] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:08.185139 10366 tablet_bootstrap.cc:654] T 896b7cfdb0ca4904aaeafa13ff19365e P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:08.185597 11828 raft_consensus.cc:493] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:08.185740 11828 raft_consensus.cc:515] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.186439 11828 leader_election.cc:290] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:08.187080 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb3660108094399b36d19ea8e6b8308" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:08.187276 9939 raft_consensus.cc:2468] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:08.188176 10067 leader_election.cc:304] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:08.188772 11828 raft_consensus.cc:2804] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:08.188846 11828 raft_consensus.cc:493] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:08.188897 11828 raft_consensus.cc:3060] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:08.191782 11828 raft_consensus.cc:515] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.194913 11828 leader_election.cc:290] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:08.195256 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb3660108094399b36d19ea8e6b8308" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:08.195436 9939 raft_consensus.cc:3060] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:08.199012 9939 raft_consensus.cc:2468] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:08.199589 10067 leader_election.cc:304] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:08.200459 12505 raft_consensus.cc:493] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:08.200582 12505 raft_consensus.cc:515] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.201153 12505 leader_election.cc:290] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:08.202967 10068 leader_election.cc:343] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: dcb3660108094399b36d19ea8e6b8308
I20260810 19:48:08.203485 11828 raft_consensus.cc:2804] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:08.203800 11828 raft_consensus.cc:697] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:08.204123 11828 consensus_queue.cc:237] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.205323 10377 ts_tablet_manager.cc:1929] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:08.205360 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33aa8be266a434cba899da7514c47e9" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:08.205454 10377 log.cc:1199] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/ae3e151180ae4d258d18365770acaaad
I20260810 19:48:08.205590 9710 raft_consensus.cc:2468] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:08.205770 10377 ts_tablet_manager.cc:1950] T ae3e151180ae4d258d18365770acaaad P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:08.206619 9831 leader_election.cc:304] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:08.206893 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33aa8be266a434cba899da7514c47e9" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:08.207379 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet ae3e151180ae4d258d18365770acaaad (table default.Table_250f18957ff84ad58246dfec016f0abf [id=197d5993ea8643288fe8814a51e4bfd4]) successfully deleted
I20260810 19:48:08.207532 12505 raft_consensus.cc:2804] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:08.207602 12505 raft_consensus.cc:493] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:08.207660 12505 raft_consensus.cc:3060] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:08.209538 9830 leader_election.cc:343] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:08.210378 9395 catalog_manager.cc:5017] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 9e8a23221e8447bd83592c05c9d1149c because the tablet was not found. No further retry: Not found: Tablet not found: 9e8a23221e8447bd83592c05c9d1149c
W20260810 19:48:08.210728 9395 catalog_manager.cc:5017] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 4b2b0f2fc93647f3bc1d79b4132c3703 because the tablet was not found. No further retry: Not found: Tablet not found: 4b2b0f2fc93647f3bc1d79b4132c3703
I20260810 19:48:08.215303 10377 tablet_replica.cc:333] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:08.215548 10377 raft_consensus.cc:2243] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:08.215715 10377 raft_consensus.cc:2272] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:08.216275 10377 ts_tablet_manager.cc:1916] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:08.215335 12505 raft_consensus.cc:515] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.218302 12505 leader_election.cc:290] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:08.103472 12575 tablet.cc:1724] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:08.219655 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33aa8be266a434cba899da7514c47e9" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
W20260810 19:48:08.222740 9830 leader_election.cc:343] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:08.223618 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33aa8be266a434cba899da7514c47e9" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:08.223843 9710 raft_consensus.cc:3060] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:08.224920 10068 leader_election.cc:343] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: dcb3660108094399b36d19ea8e6b8308
I20260810 19:48:08.227213 9710 raft_consensus.cc:2468] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:08.228628 9831 leader_election.cc:304] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:08.229015 12505 raft_consensus.cc:2804] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:08.229261 12505 raft_consensus.cc:697] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:08.229627 12505 consensus_queue.cc:237] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.230650 10377 ts_tablet_manager.cc:1929] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:08.230779 10377 log.cc:1199] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/dcb3660108094399b36d19ea8e6b8308
I20260810 19:48:08.231101 10377 ts_tablet_manager.cc:1950] T dcb3660108094399b36d19ea8e6b8308 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:08.231572 10377 tablet_replica.cc:333] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:08.231760 10377 raft_consensus.cc:2243] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:08.231699 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet dcb3660108094399b36d19ea8e6b8308 (table default.Table_9d569d756be84460b1b78812a13b95ad [id=14e993ddf3b646098d6d3a3e24d01b07]) successfully deleted
I20260810 19:48:08.231904 10377 raft_consensus.cc:2272] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:08.232405 10377 ts_tablet_manager.cc:1916] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:08.233645 12575 tablet.cc:1724] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:08.238655 10366 tablet_bootstrap.cc:492] T 896b7cfdb0ca4904aaeafa13ff19365e P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:08.238814 10366 ts_tablet_manager.cc:1403] T 896b7cfdb0ca4904aaeafa13ff19365e P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.056s user 0.003s sys 0.002s
I20260810 19:48:08.239692 12527 raft_consensus.cc:493] T 5394eadabf184158864921dd5d394828 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:08.239686 10366 raft_consensus.cc:359] T 896b7cfdb0ca4904aaeafa13ff19365e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.239856 10366 raft_consensus.cc:385] T 896b7cfdb0ca4904aaeafa13ff19365e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:08.239841 12527 raft_consensus.cc:515] T 5394eadabf184158864921dd5d394828 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.239929 10366 raft_consensus.cc:740] T 896b7cfdb0ca4904aaeafa13ff19365e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:08.240127 10366 consensus_queue.cc:260] T 896b7cfdb0ca4904aaeafa13ff19365e P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.240532 12527 leader_election.cc:290] T 5394eadabf184158864921dd5d394828 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:08.240643 10366 ts_tablet_manager.cc:1434] T 896b7cfdb0ca4904aaeafa13ff19365e P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:08.240921 10366 tablet_bootstrap.cc:492] T 648ef608fa0c45cc8be4bad80c4200be P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:08.243498 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5394eadabf184158864921dd5d394828" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:08.243506 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5394eadabf184158864921dd5d394828" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:08.243750 9710 raft_consensus.cc:2393] T 5394eadabf184158864921dd5d394828 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eadde59fd6504d679e47f03a60c64bb0 in current term 1: Already voted for candidate 6986ed920dcb4af29a5eeeda6f671691 in this term.
I20260810 19:48:08.244647 10068 leader_election.cc:304] T 5394eadabf184158864921dd5d394828 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:08.245090 12527 raft_consensus.cc:3060] T 5394eadabf184158864921dd5d394828 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:08.247982 12527 raft_consensus.cc:2749] T 5394eadabf184158864921dd5d394828 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:08.252923 10377 ts_tablet_manager.cc:1929] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:08.253062 10377 log.cc:1199] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/2b2b20dc77954af7a203f357c746be29
I20260810 19:48:08.253347 10377 ts_tablet_manager.cc:1950] T 2b2b20dc77954af7a203f357c746be29 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:08.253841 10377 tablet_replica.cc:333] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:08.255136 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 2b2b20dc77954af7a203f357c746be29 (table default.Table_0de524b66ecf4dea8ab5e6b87c4f6261 [id=4de43e2ae0424104aa75c5d872b72d3a]) successfully deleted
I20260810 19:48:08.256553 10375 ts_tablet_manager.cc:1929] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:08.256827 10377 raft_consensus.cc:2243] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:08.257025 10377 raft_consensus.cc:2272] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:08.257560 10377 ts_tablet_manager.cc:1916] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:08.272282 10377 ts_tablet_manager.cc:1929] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:08.272437 10377 log.cc:1199] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/8455cb11388340beb6daa13fee06177a
I20260810 19:48:08.272717 10377 ts_tablet_manager.cc:1950] T 8455cb11388340beb6daa13fee06177a P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:08.273216 10377 tablet_replica.cc:333] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:08.273398 10377 raft_consensus.cc:2243] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:08.273554 10377 raft_consensus.cc:2272] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:08.274014 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 8455cb11388340beb6daa13fee06177a (table default.Table_9fc2f929c6aa4ff286e66b35f18da641 [id=2a56448ab2544b8ca7a6a49841520fc4]) successfully deleted
I20260810 19:48:08.274115 10377 ts_tablet_manager.cc:1916] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:08.274734 9397 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 3bf9486839474b2a8ddff3a49b4fda2a (table default.Table_0bbfea1f106c4df1921c642928671792 [id=d628448cf7b94ebab79194e81fcaf040], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3bf9486839474b2a8ddff3a49b4fda2a consensus state has no leader
I20260810 19:48:08.290799 10377 ts_tablet_manager.cc:1929] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:08.290940 10377 log.cc:1199] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/0bddaf5b5fc1404e83b079ffa97e7321
I20260810 19:48:08.291266 10377 ts_tablet_manager.cc:1950] T 0bddaf5b5fc1404e83b079ffa97e7321 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:08.291802 10377 tablet_replica.cc:333] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:08.291930 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 0bddaf5b5fc1404e83b079ffa97e7321 (table default.Table_5bdde0f42da34c6f99e8462d17affb30 [id=7c6a3df13ef44571a127a5ef2e73683a]) successfully deleted
I20260810 19:48:08.292016 10377 raft_consensus.cc:2243] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:08.292171 10377 raft_consensus.cc:2272] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:08.292754 10377 ts_tablet_manager.cc:1916] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:08.293154 12584 tablet.cc:1724] T 3e8ae48a2fb548358176abefe1ee3baa P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260810 19:48:08.302146 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2daf9e86dff44999ae8975529cd6014f consensus state has no leader
I20260810 19:48:08.304165 9416 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_87ca145e91d149a68ef630e3a29795b4 [id=fd9deda7275b423b9f9c85aa22dde728] alter complete (version 2)
I20260810 19:48:08.305739 10377 ts_tablet_manager.cc:1929] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:08.305871 10377 log.cc:1199] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/63486cc3f8774a11827b1cc5f1c16332
I20260810 19:48:08.306165 10377 ts_tablet_manager.cc:1950] T 63486cc3f8774a11827b1cc5f1c16332 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:08.306732 10377 tablet_replica.cc:333] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:08.306965 10377 raft_consensus.cc:2243] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:08.307296 10377 raft_consensus.cc:2272] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:08.307899 10377 ts_tablet_manager.cc:1916] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:08.314009 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet bafc42f0cdf94ebd823dfb678df8a83b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:08.314281 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a393149727043f3a3c9f58aa051b065 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:08.314433 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e861473094f42dfa22b9c00145ed1fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:08.314532 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aa0f24443a34714a44137a77c12bbc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:08.314741 12266 tablet_replica.cc:333] T bafc42f0cdf94ebd823dfb678df8a83b P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:08.314841 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 63486cc3f8774a11827b1cc5f1c16332 (table default.Table_f1a090bd6e0042b58f8b6f478fc4fb11 [id=2e90b67006f344688d2b021965d8abdf]) successfully deleted
I20260810 19:48:08.314951 12266 raft_consensus.cc:2243] T bafc42f0cdf94ebd823dfb678df8a83b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:08.315109 12266 raft_consensus.cc:2272] T bafc42f0cdf94ebd823dfb678df8a83b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:08.315699 12266 ts_tablet_manager.cc:1916] T bafc42f0cdf94ebd823dfb678df8a83b P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:08.319016 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet ee5f38d91bb349a9ae1da8ba69d2ddbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:08.320096 9416 master_service.cc:960] ReplaceTablet: received request to replace tablet 08f78560ec9f465c94ef08fa2f067c0d from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:08.322870 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 4dba7046bdfd41f1a2ad6f299a723776 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:08.323160 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet dcb3660108094399b36d19ea8e6b8308 with delete_type TABLET_DATA_DELETED (replaced by tablet f5fa6060b9ef48cea6830cd9d19424ea) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:08.326813 12266 ts_tablet_manager.cc:1929] T bafc42f0cdf94ebd823dfb678df8a83b P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:08.327064 12266 log.cc:1199] T bafc42f0cdf94ebd823dfb678df8a83b P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/bafc42f0cdf94ebd823dfb678df8a83b
I20260810 19:48:08.327442 12266 ts_tablet_manager.cc:1950] T bafc42f0cdf94ebd823dfb678df8a83b P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:08.328773 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet bafc42f0cdf94ebd823dfb678df8a83b (table default.Table_f0bb702e0c7148519ccd7a84a5e9e574 [id=df54120a0a0140fe9561db53b23364b9]) successfully deleted
I20260810 19:48:08.329280 12266 tablet_replica.cc:333] T 1a393149727043f3a3c9f58aa051b065 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:08.329556 12266 raft_consensus.cc:2243] T 1a393149727043f3a3c9f58aa051b065 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:08.329803 12266 raft_consensus.cc:2272] T 1a393149727043f3a3c9f58aa051b065 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:08.330540 12266 ts_tablet_manager.cc:1916] T 1a393149727043f3a3c9f58aa051b065 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:08.339860 12266 ts_tablet_manager.cc:1929] T 1a393149727043f3a3c9f58aa051b065 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:08.342898 10375 log.cc:1199] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/b5f30148b5c84f7cbdfabd0186611cc4
I20260810 19:48:08.343401 10375 ts_tablet_manager.cc:1950] T b5f30148b5c84f7cbdfabd0186611cc4 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:08.344432 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 811) took 1581 ms. Trace:
I20260810 19:48:08.344545 10375 rpcz_store.cc:276] 0810 19:48:06.762972 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.763623 (+ 651us) service_pool.cc:224] Handling call
0810 19:48:08.058103 (+1294480us) ts_tablet_manager.cc:1151] Deleting tablet b5f30148b5c84f7cbdfabd0186611cc4
0810 19:48:08.058115 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:08.239506 (+181391us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:08.256487 (+ 16981us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:08.344403 (+ 87916us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1294335}
I20260810 19:48:08.263340 10370 tablet_bootstrap.cc:492] T 3bf9486839474b2a8ddff3a49b4fda2a P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:08.288220 12585 tablet.cc:1724] T 3e8ae48a2fb548358176abefe1ee3baa P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:08.345057 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet b5f30148b5c84f7cbdfabd0186611cc4 (table default.Table_6d2e6ad78a7841e891fae5f687a3c392 [id=ff056c9a5dc14ebdac724d8e39e6c7bb]) successfully deleted
I20260810 19:48:08.345151 10370 ts_tablet_manager.cc:1403] T 3bf9486839474b2a8ddff3a49b4fda2a P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.232s user 0.002s sys 0.002s
I20260810 19:48:08.305804 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet da3d8ade850c4d36bd2756c36706195d with delete_type TABLET_DATA_DELETED (replaced by tablet 87bbcc651d034e2a826478b805792e48) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:08.306715 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet 63486cc3f8774a11827b1cc5f1c16332 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:08.306838 10136 tablet_service.cc:1558] Processing DeleteTablet for tablet 72b39babf851404c89adb317033015ec with delete_type TABLET_DATA_DELETED (replaced by tablet 676004738985441985278313d6064530) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:08.306954 10142 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e8a23221e8447bd83592c05c9d1149c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:08.307037 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet ae3e151180ae4d258d18365770acaaad with delete_type TABLET_DATA_DELETED (replaced by tablet 6dea3165feb842ecb58b7ace235abf38) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:08.306416 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet 8455cb11388340beb6daa13fee06177a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:08.307276 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b2b20dc77954af7a203f357c746be29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:08.307400 10139 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bddaf5b5fc1404e83b079ffa97e7321 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:08.346525 10370 raft_consensus.cc:359] T 3bf9486839474b2a8ddff3a49b4fda2a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.346881 10370 raft_consensus.cc:385] T 3bf9486839474b2a8ddff3a49b4fda2a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:08.346979 10370 raft_consensus.cc:740] T 3bf9486839474b2a8ddff3a49b4fda2a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:08.347285 10370 consensus_queue.cc:260] T 3bf9486839474b2a8ddff3a49b4fda2a P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.347860 10370 ts_tablet_manager.cc:1434] T 3bf9486839474b2a8ddff3a49b4fda2a P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:48:08.347870 12266 log.cc:1199] T 1a393149727043f3a3c9f58aa051b065 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/1a393149727043f3a3c9f58aa051b065
I20260810 19:48:08.348183 12266 ts_tablet_manager.cc:1950] T 1a393149727043f3a3c9f58aa051b065 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:08.348263 10370 tablet_bootstrap.cc:492] T 3fd5cd2e4c104e45a81d2603c6f7d24a P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:08.350049 10370 tablet_bootstrap.cc:654] T 3fd5cd2e4c104e45a81d2603c6f7d24a P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:08.350006 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 1a393149727043f3a3c9f58aa051b065 (table default.Table_f752dd58f7fe415f85280cbb9adb306c [id=8f9c3952ab4b4930943001c3d43d6d7d]) successfully deleted
I20260810 19:48:08.354696 12266 tablet_replica.cc:333] T 9e861473094f42dfa22b9c00145ed1fe P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:08.355300 12266 raft_consensus.cc:2243] T 9e861473094f42dfa22b9c00145ed1fe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:08.355834 12266 raft_consensus.cc:2272] T 9e861473094f42dfa22b9c00145ed1fe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:08.356712 12266 ts_tablet_manager.cc:1916] T 9e861473094f42dfa22b9c00145ed1fe P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:08.358537 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 016b91706e1543c289d44fcf48caed9d consensus state has no leader
I20260810 19:48:08.362528 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_8a282f3711fd421e8bc72d1d4f182b41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:08.354307 10377 ts_tablet_manager.cc:1929] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260810 19:48:08.363277 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a282f3711fd421e8bc72d1d4f182b41 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:08.363404 10377 log.cc:1199] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/0d8e8e1b5f3f452f8fdfe5a42fd021a5
I20260810 19:48:08.363835 10377 ts_tablet_manager.cc:1950] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:08.364136 9791 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:48:08.364753 10377 tablet_replica.cc:333] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:08.364985 10377 raft_consensus.cc:2243] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:08.365381 10377 raft_consensus.cc:2272] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:08.366566 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5 (table default.Table_b46992ec81974f6caad1ea769640dcf1 [id=d6d2d95e5e9f4e10a7d5a8153e66e4b6]) successfully deleted
I20260810 19:48:08.366539 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_46ab7791bf4847469769843a6a77f9ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:08.366948 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet cbcaa7106df24aaeb07428b7b590e282 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cbcaa7106df24aaeb07428b7b590e282 already in progress: creating tablet
W20260810 19:48:08.367223 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 09f09289a4c84e25b84c10abef3799c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09f09289a4c84e25b84c10abef3799c3 already in progress: creating tablet
W20260810 19:48:08.367498 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 8713212c586a4143b65ff044a67b8b72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8713212c586a4143b65ff044a67b8b72 already in progress: creating tablet
I20260810 19:48:08.369243 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_58338522359643389f4a12b2958ceaea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:08.369781 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_58338522359643389f4a12b2958ceaea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:08.370900 10377 ts_tablet_manager.cc:1916] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:08.373282 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 808) took 1610 ms. Trace:
I20260810 19:48:08.373374 10375 rpcz_store.cc:276] 0810 19:48:06.762636 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.771863 (+ 9227us) service_pool.cc:224] Handling call
0810 19:48:08.373142 (+1601279us) ts_tablet_manager.cc:1151] Deleting tablet aaaeafe4afb8454baf2e141a00da8ee3
0810 19:48:08.373153 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:08.373261 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1600679}
I20260810 19:48:08.373761 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0b279a130f3c4984abe5bacf80bac674"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:08.373867 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet aaaeafe4afb8454baf2e141a00da8ee3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aaaeafe4afb8454baf2e141a00da8ee3 already in progress: creating tablet
W20260810 19:48:08.374328 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b279a130f3c4984abe5bacf80bac674 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:08.367219 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46ab7791bf4847469769843a6a77f9ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:08.377907 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_82f2c0a512b5433ea617e4710d530233"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:08.378495 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82f2c0a512b5433ea617e4710d530233 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:08.379916 12266 ts_tablet_manager.cc:1929] T 9e861473094f42dfa22b9c00145ed1fe P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:08.380553 12266 log.cc:1199] T 9e861473094f42dfa22b9c00145ed1fe P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/9e861473094f42dfa22b9c00145ed1fe
I20260810 19:48:08.381117 12266 ts_tablet_manager.cc:1950] T 9e861473094f42dfa22b9c00145ed1fe P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:08.381342 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 812) took 1585 ms. Trace:
I20260810 19:48:08.381453 10375 rpcz_store.cc:276] 0810 19:48:06.795794 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.795863 (+ 69us) service_pool.cc:224] Handling call
0810 19:48:08.381203 (+1585340us) ts_tablet_manager.cc:1151] Deleting tablet 9fb544dff4eb4642b7e282657ae15d19
0810 19:48:08.381214 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:08.381314 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1585026}
W20260810 19:48:08.382071 9395 catalog_manager.cc:5017] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 9fb544dff4eb4642b7e282657ae15d19 because the tablet was not found. No further retry: Not found: Tablet not found: 9fb544dff4eb4642b7e282657ae15d19
I20260810 19:48:08.382385 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 9e861473094f42dfa22b9c00145ed1fe (table default.Table_cc256890a9a1416588021bfab5b9ee71 [id=33b51db437384acc95b35bc1868227e1]) successfully deleted
I20260810 19:48:08.382725 12609 tablet.cc:1724] T 3e8ae48a2fb548358176abefe1ee3baa P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:08.383183 12266 tablet_replica.cc:333] T 5aa0f24443a34714a44137a77c12bbc3 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:08.383765 12266 raft_consensus.cc:2243] T 5aa0f24443a34714a44137a77c12bbc3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:08.384266 12266 raft_consensus.cc:2272] T 5aa0f24443a34714a44137a77c12bbc3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:08.385114 12266 ts_tablet_manager.cc:1916] T 5aa0f24443a34714a44137a77c12bbc3 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:08.385847 12463 consensus_queue.cc:1048] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:08.390129 12609 tablet.cc:1724] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:08.392024 10377 ts_tablet_manager.cc:1929] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:08.392171 10377 log.cc:1199] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/d77785d9bde843bc8366fe15d1b4fa18
I20260810 19:48:08.392554 10377 ts_tablet_manager.cc:1950] T d77785d9bde843bc8366fe15d1b4fa18 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:08.393234 12505 raft_consensus.cc:493] T 5ba42032e7344423a0e86c55d613f27d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:08.393455 12505 raft_consensus.cc:515] T 5ba42032e7344423a0e86c55d613f27d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.394981 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba42032e7344423a0e86c55d613f27d" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:08.395138 9831 leader_election.cc:343] T 5ba42032e7344423a0e86c55d613f27d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 5ba42032e7344423a0e86c55d613f27d
W20260810 19:48:08.395738 9830 leader_election.cc:343] T 5ba42032e7344423a0e86c55d613f27d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:08.395848 9830 leader_election.cc:304] T 5ba42032e7344423a0e86c55d613f27d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:08.396090 12463 raft_consensus.cc:2749] T 5ba42032e7344423a0e86c55d613f27d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:08.396231 12505 leader_election.cc:290] T 5ba42032e7344423a0e86c55d613f27d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:08.397719 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet d77785d9bde843bc8366fe15d1b4fa18 (table default.Table_3e78e13c8ecc464eb6af12a2bc3f2eba [id=1af2d06c44b643e28d28bb080cd5eef8]) successfully deleted
I20260810 19:48:08.398077 10119 tablet_service.cc:1511] Processing CreateTablet for tablet d2c0965589b24476bfa7291e2013b38f (DEFAULT_TABLE table=default.Table_1e8a017a12334fbba8f7ed4654d30c26 [id=2c1be0c0220f40cfa800c02b98fe3124]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.398607 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2c0965589b24476bfa7291e2013b38f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.398623 9896 tablet_service.cc:1511] Processing CreateTablet for tablet d2c0965589b24476bfa7291e2013b38f (DEFAULT_TABLE table=default.Table_1e8a017a12334fbba8f7ed4654d30c26 [id=2c1be0c0220f40cfa800c02b98fe3124]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.399072 10366 tablet_bootstrap.cc:654] T 648ef608fa0c45cc8be4bad80c4200be P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:08.399045 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 5ee6027c32f6492398110a82d75b9b7e (DEFAULT_TABLE table=default.Table_12c2d074b668459b8fb2b34d33add2f1 [id=1e616e5777564dfba71a7d29be811476]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.399685 9418 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 4571e0c723f74c828220b33116fed9e9 (table default.Table_d9d83336ef124c2da242e77391b001c0 [id=8dbf3227e8ae402aa46b9b31b715faa6]). Expected version 1 got 0
I20260810 19:48:08.401818 9412 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 5394eadabf184158864921dd5d394828 (table default.Table_c5cc7d3e97ae4d02952905907354f9a3 [id=2d447d5da0e74e0885490174fc0f929d]). Expected version 1 got 0
I20260810 19:48:08.402657 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 5ee6027c32f6492398110a82d75b9b7e (DEFAULT_TABLE table=default.Table_12c2d074b668459b8fb2b34d33add2f1 [id=1e616e5777564dfba71a7d29be811476]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.403077 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ee6027c32f6492398110a82d75b9b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.406121 10115 tablet_service.cc:1511] Processing CreateTablet for tablet 53bfac43413347cc8d596169e6daa274 (DEFAULT_TABLE table=default.Table_0a1983416c99454b889117130d83b254 [id=7787b166c7e441e9bafc30625f271713]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.406446 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2c0965589b24476bfa7291e2013b38f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.406518 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53bfac43413347cc8d596169e6daa274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.406536 10377 tablet_replica.cc:333] T 4dba7046bdfd41f1a2ad6f299a723776 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:08.406723 10377 raft_consensus.cc:2243] T 4dba7046bdfd41f1a2ad6f299a723776 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:08.406896 10377 raft_consensus.cc:2272] T 4dba7046bdfd41f1a2ad6f299a723776 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:08.410537 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ee6027c32f6492398110a82d75b9b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.414645 10377 ts_tablet_manager.cc:1916] T 4dba7046bdfd41f1a2ad6f299a723776 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:08.416644 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 53bfac43413347cc8d596169e6daa274 (DEFAULT_TABLE table=default.Table_0a1983416c99454b889117130d83b254 [id=7787b166c7e441e9bafc30625f271713]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.417065 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53bfac43413347cc8d596169e6daa274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.426856 10370 tablet_bootstrap.cc:492] T 3fd5cd2e4c104e45a81d2603c6f7d24a P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:08.427009 10370 ts_tablet_manager.cc:1403] T 3fd5cd2e4c104e45a81d2603c6f7d24a P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.079s user 0.003s sys 0.000s
I20260810 19:48:08.427860 10370 raft_consensus.cc:359] T 3fd5cd2e4c104e45a81d2603c6f7d24a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.428030 10370 raft_consensus.cc:385] T 3fd5cd2e4c104e45a81d2603c6f7d24a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:08.428071 10370 raft_consensus.cc:740] T 3fd5cd2e4c104e45a81d2603c6f7d24a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:08.429396 10375 tablet_replica.cc:333] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:08.429585 10375 raft_consensus.cc:2243] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:08.429848 10375 pending_rounds.cc:70] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:08.429884 10375 pending_rounds.cc:77] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058709753180160 op_type: NO_OP noop_request { }
I20260810 19:48:08.429970 10375 raft_consensus.cc:2889] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:08.430038 10375 raft_consensus.cc:2272] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:08.393853 9658 tablet_service.cc:1511] Processing CreateTablet for tablet d2c0965589b24476bfa7291e2013b38f (DEFAULT_TABLE table=default.Table_1e8a017a12334fbba8f7ed4654d30c26 [id=2c1be0c0220f40cfa800c02b98fe3124]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.432457 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2c0965589b24476bfa7291e2013b38f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:08.434229 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 67d02a8eea444f3383f14a1e1f0e236b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67d02a8eea444f3383f14a1e1f0e236b already in progress: creating tablet
W20260810 19:48:08.434602 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 8a7212453dab49fa9372c628b80219c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a7212453dab49fa9372c628b80219c9 already in progress: creating tablet
I20260810 19:48:08.394692 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 5ee6027c32f6492398110a82d75b9b7e (DEFAULT_TABLE table=default.Table_12c2d074b668459b8fb2b34d33add2f1 [id=1e616e5777564dfba71a7d29be811476]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.438371 12505 raft_consensus.cc:493] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:08.438531 12505 raft_consensus.cc:515] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.438688 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ee6027c32f6492398110a82d75b9b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.439636 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2798f122e0624af6971fc8317244e5ae" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:08.439833 9715 raft_consensus.cc:2468] T 2798f122e0624af6971fc8317244e5ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:08.440279 12505 leader_election.cc:290] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:08.440315 9831 leader_election.cc:304] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:08.430672 10375 ts_tablet_manager.cc:1916] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:08.440222 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2798f122e0624af6971fc8317244e5ae" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:08.448827 9830 leader_election.cc:343] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:08.425155 12266 ts_tablet_manager.cc:1929] T 5aa0f24443a34714a44137a77c12bbc3 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:08.449193 12266 log.cc:1199] T 5aa0f24443a34714a44137a77c12bbc3 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/5aa0f24443a34714a44137a77c12bbc3
I20260810 19:48:08.449676 12266 ts_tablet_manager.cc:1950] T 5aa0f24443a34714a44137a77c12bbc3 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:08.450156 12463 raft_consensus.cc:2804] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:08.380673 10367 tablet_bootstrap.cc:492] T 8fce298689e9415a8860b8734d73b10a P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:08.450352 12463 raft_consensus.cc:493] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:08.450490 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 5aa0f24443a34714a44137a77c12bbc3 (table default.Table_6487065cb4a442eebc88bd267aede484 [id=27c3951fbb3e4e4fb7bb119cec174eb1]) successfully deleted
I20260810 19:48:08.450510 10367 ts_tablet_manager.cc:1403] T 8fce298689e9415a8860b8734d73b10a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.669s user 0.025s sys 0.000s
I20260810 19:48:08.450577 12463 raft_consensus.cc:3060] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:08.450871 12266 tablet_replica.cc:333] T ee5f38d91bb349a9ae1da8ba69d2ddbc P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:08.451083 12266 raft_consensus.cc:2243] T ee5f38d91bb349a9ae1da8ba69d2ddbc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:08.451303 12266 raft_consensus.cc:2272] T ee5f38d91bb349a9ae1da8ba69d2ddbc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:08.452031 12266 ts_tablet_manager.cc:1916] T ee5f38d91bb349a9ae1da8ba69d2ddbc P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:08.453483 12463 raft_consensus.cc:515] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.453804 11897 consensus_queue.cc:1048] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:08.454948 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 53bfac43413347cc8d596169e6daa274 (DEFAULT_TABLE table=default.Table_0a1983416c99454b889117130d83b254 [id=7787b166c7e441e9bafc30625f271713]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.455358 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53bfac43413347cc8d596169e6daa274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.459398 10115 tablet_service.cc:1511] Processing CreateTablet for tablet 2067e0b1bf2841a2920b0e57ebd1780d (DEFAULT_TABLE table=default.Table_b3fe10a412cb4c13851701b963a1d7ae [id=4d161ebd9fcd445180fb1a161320af25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.460580 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 2067e0b1bf2841a2920b0e57ebd1780d (DEFAULT_TABLE table=default.Table_b3fe10a412cb4c13851701b963a1d7ae [id=4d161ebd9fcd445180fb1a161320af25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.461090 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2067e0b1bf2841a2920b0e57ebd1780d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.463160 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 9ae6d231840342fb8bb3493d0525c95b (DEFAULT_TABLE table=default.Table_2027bd0223534a0ca3dd111a68b7e6cb [id=bfdd600b7c9a478e8c6d339286873a0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.461895 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 9ae6d231840342fb8bb3493d0525c95b (DEFAULT_TABLE table=default.Table_2027bd0223534a0ca3dd111a68b7e6cb [id=bfdd600b7c9a478e8c6d339286873a0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.463570 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae6d231840342fb8bb3493d0525c95b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.463905 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 5c637a1138ef43f9ac67bb7e72a0ab1b (DEFAULT_TABLE table=default.Table_4dd3d4c4497546b28df06251099213a0 [id=03d9f7802e534d7fa029bd82bc0ddb10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.464306 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c637a1138ef43f9ac67bb7e72a0ab1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.462886 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2067e0b1bf2841a2920b0e57ebd1780d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.463304 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 5c637a1138ef43f9ac67bb7e72a0ab1b (DEFAULT_TABLE table=default.Table_4dd3d4c4497546b28df06251099213a0 [id=03d9f7802e534d7fa029bd82bc0ddb10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.469347 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c637a1138ef43f9ac67bb7e72a0ab1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.470438 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae6d231840342fb8bb3493d0525c95b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.471776 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 5c637a1138ef43f9ac67bb7e72a0ab1b (DEFAULT_TABLE table=default.Table_4dd3d4c4497546b28df06251099213a0 [id=03d9f7802e534d7fa029bd82bc0ddb10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.472237 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c637a1138ef43f9ac67bb7e72a0ab1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.472724 9416 catalog_manager.cc:5719] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:08.473310 9416 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 5394eadabf184158864921dd5d394828 (table default.Table_c5cc7d3e97ae4d02952905907354f9a3 [id=2d447d5da0e74e0885490174fc0f929d]). Expected version 1 got 0
I20260810 19:48:08.473734 9416 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 410855f236004ad4b78839eb1c0c2f1f (table default.Table_44478e93cffb460aaa8df9115b799594 [id=1d363ce63686462f9f4c15669773ee22]). Expected version 1 got 0
I20260810 19:48:08.474018 9416 catalog_manager.cc:5719] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:08.475615 9416 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet a45add97e0e54dce85225e175ecbb45a (table default.Table_0a1a76f241a1418ba5cb63ddec738374 [id=c580a677dcab41d9892011258d5993d7]). Expected version 3 got 0
I20260810 19:48:08.478766 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 9ae6d231840342fb8bb3493d0525c95b (DEFAULT_TABLE table=default.Table_2027bd0223534a0ca3dd111a68b7e6cb [id=bfdd600b7c9a478e8c6d339286873a0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.479485 10377 ts_tablet_manager.cc:1929] T 4dba7046bdfd41f1a2ad6f299a723776 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:08.479615 10377 log.cc:1199] T 4dba7046bdfd41f1a2ad6f299a723776 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/4dba7046bdfd41f1a2ad6f299a723776
I20260810 19:48:08.479956 10377 ts_tablet_manager.cc:1950] T 4dba7046bdfd41f1a2ad6f299a723776 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
W20260810 19:48:08.480647 10068 consensus_peers.cc:597] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b2b20dc77954af7a203f357c746be29. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:08.481172 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 4dba7046bdfd41f1a2ad6f299a723776 (table default.Table_074b525586d74c169b286124d5849cd2 [id=4dd4fbd829aa40048810c5a338d1b741]) successfully deleted
I20260810 19:48:08.481972 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 2067e0b1bf2841a2920b0e57ebd1780d (DEFAULT_TABLE table=default.Table_b3fe10a412cb4c13851701b963a1d7ae [id=4d161ebd9fcd445180fb1a161320af25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.479494 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae6d231840342fb8bb3493d0525c95b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.484763 12266 ts_tablet_manager.cc:1929] T ee5f38d91bb349a9ae1da8ba69d2ddbc P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:08.489928 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2798f122e0624af6971fc8317244e5ae" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
W20260810 19:48:08.490607 9830 leader_election.cc:343] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:08.491217 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2067e0b1bf2841a2920b0e57ebd1780d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.489416 9709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2798f122e0624af6971fc8317244e5ae" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:08.498283 12266 log.cc:1199] T ee5f38d91bb349a9ae1da8ba69d2ddbc P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/ee5f38d91bb349a9ae1da8ba69d2ddbc
I20260810 19:48:08.498348 9709 raft_consensus.cc:3060] T 2798f122e0624af6971fc8317244e5ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:08.499127 12266 ts_tablet_manager.cc:1950] T ee5f38d91bb349a9ae1da8ba69d2ddbc P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:08.501932 9709 raft_consensus.cc:2468] T 2798f122e0624af6971fc8317244e5ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:08.504701 12463 leader_election.cc:290] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:08.506551 9831 leader_election.cc:304] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:08.515736 12463 raft_consensus.cc:2804] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:08.516666 12463 raft_consensus.cc:697] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:08.517268 12463 consensus_queue.cc:237] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:08.524047 9395 catalog_manager.cc:5017] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet dcb3660108094399b36d19ea8e6b8308 because the tablet was not found. No further retry: Not found: Tablet not found: dcb3660108094399b36d19ea8e6b8308
I20260810 19:48:08.524051 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet ee5f38d91bb349a9ae1da8ba69d2ddbc (table default.Table_0a16454a2da548e3a7130a52dbd5143a [id=b1b37ac7ddef44d7b86d2d668527a046]) successfully deleted
I20260810 19:48:08.525068 10122 tablet_service.cc:1511] Processing CreateTablet for tablet c4b73f20efbd42afba837896167f2fb4 (DEFAULT_TABLE table=default.Table_5194334e6036419bb0a2bdb9a0db856f [id=46efdd87b6ab445fa7e49939bd3a8778]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.531972 9901 tablet_service.cc:1511] Processing CreateTablet for tablet c4b73f20efbd42afba837896167f2fb4 (DEFAULT_TABLE table=default.Table_5194334e6036419bb0a2bdb9a0db856f [id=46efdd87b6ab445fa7e49939bd3a8778]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.532655 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b73f20efbd42afba837896167f2fb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.451287 10367 raft_consensus.cc:359] T 8fce298689e9415a8860b8734d73b10a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.533529 10367 raft_consensus.cc:385] T 8fce298689e9415a8860b8734d73b10a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:08.533629 10367 raft_consensus.cc:740] T 8fce298689e9415a8860b8734d73b10a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:08.533926 10367 consensus_queue.cc:260] T 8fce298689e9415a8860b8734d73b10a P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.534674 10367 ts_tablet_manager.cc:1434] T 8fce298689e9415a8860b8734d73b10a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.084s user 0.002s sys 0.000s
I20260810 19:48:08.534999 10367 tablet_bootstrap.cc:492] T 5654c48929564a96a55ed0444c9e1a04 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:08.536492 10367 tablet_bootstrap.cc:654] T 5654c48929564a96a55ed0444c9e1a04 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:08.475910 9416 catalog_manager.cc:5719] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:08.550727 9416 catalog_manager.cc:5719] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:08.551316 9416 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 3bf9486839474b2a8ddff3a49b4fda2a (table default.Table_0bbfea1f106c4df1921c642928671792 [id=d628448cf7b94ebab79194e81fcaf040]). Expected version 1 got 0
I20260810 19:48:08.551219 10370 consensus_queue.cc:260] T 3fd5cd2e4c104e45a81d2603c6f7d24a P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.551512 11828 raft_consensus.cc:493] T 3fd5cd2e4c104e45a81d2603c6f7d24a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:08.551717 11828 raft_consensus.cc:515] T 3fd5cd2e4c104e45a81d2603c6f7d24a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.553299 9709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd5cd2e4c104e45a81d2603c6f7d24a" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:08.553787 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd5cd2e4c104e45a81d2603c6f7d24a" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:08.555016 10068 leader_election.cc:304] T 3fd5cd2e4c104e45a81d2603c6f7d24a P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:08.555639 12628 raft_consensus.cc:493] T 4dba7046bdfd41f1a2ad6f299a723776 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:08.555791 11828 leader_election.cc:290] T 3fd5cd2e4c104e45a81d2603c6f7d24a P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:08.555821 12628 raft_consensus.cc:515] T 4dba7046bdfd41f1a2ad6f299a723776 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.556298 11828 raft_consensus.cc:2749] T 3fd5cd2e4c104e45a81d2603c6f7d24a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:08.556557 12628 leader_election.cc:290] T 4dba7046bdfd41f1a2ad6f299a723776 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:08.557484 10067 leader_election.cc:343] T 4dba7046bdfd41f1a2ad6f299a723776 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 4dba7046bdfd41f1a2ad6f299a723776
W20260810 19:48:08.559041 10068 leader_election.cc:343] T 4dba7046bdfd41f1a2ad6f299a723776 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 4dba7046bdfd41f1a2ad6f299a723776
I20260810 19:48:08.559216 10068 leader_election.cc:304] T 4dba7046bdfd41f1a2ad6f299a723776 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:08.560122 11828 raft_consensus.cc:2749] T 4dba7046bdfd41f1a2ad6f299a723776 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:08.579491 10366 tablet_bootstrap.cc:492] T 648ef608fa0c45cc8be4bad80c4200be P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:08.579663 10366 ts_tablet_manager.cc:1403] T 648ef608fa0c45cc8be4bad80c4200be P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.339s user 0.049s sys 0.012s
I20260810 19:48:08.580403 10366 raft_consensus.cc:359] T 648ef608fa0c45cc8be4bad80c4200be P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.580601 10366 raft_consensus.cc:385] T 648ef608fa0c45cc8be4bad80c4200be P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:08.580659 10366 raft_consensus.cc:740] T 648ef608fa0c45cc8be4bad80c4200be P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:08.580888 10366 consensus_queue.cc:260] T 648ef608fa0c45cc8be4bad80c4200be P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.581384 10366 ts_tablet_manager.cc:1434] T 648ef608fa0c45cc8be4bad80c4200be P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:08.581687 10366 tablet_bootstrap.cc:492] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:08.583711 10366 tablet_bootstrap.cc:654] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:08.583684 9657 tablet_service.cc:1511] Processing CreateTablet for tablet c4b73f20efbd42afba837896167f2fb4 (DEFAULT_TABLE table=default.Table_5194334e6036419bb0a2bdb9a0db856f [id=46efdd87b6ab445fa7e49939bd3a8778]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.584163 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b73f20efbd42afba837896167f2fb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.584406 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 09fb69ed5fd140feb5c350d81f516a89 (DEFAULT_TABLE table=default.Table_c7237012cc364cdb979f78d0515aa38c [id=838ecc163bbc4ea39f3cbd27974c9c30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.584678 12584 tablet.cc:1724] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:08.563726 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_7d33c55d27f1420687645eee2eb63539"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:08.585203 12606 tablet.cc:1724] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 19:48:08.585283 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d33c55d27f1420687645eee2eb63539 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:08.566075 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_92979ca12b07474b8e621122d23568a7" } modify_external_catalogs: true
I20260810 19:48:08.590852 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_92979ca12b07474b8e621122d23568a7" } modify_external_catalogs: true
I20260810 19:48:08.572431 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f0a3683ed3074e529e9eff3dc1509f6d" } modify_external_catalogs: true
I20260810 19:48:08.591120 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f0a3683ed3074e529e9eff3dc1509f6d" } modify_external_catalogs: true
I20260810 19:48:08.572813 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f283a0bdf6b94182a12f9b5f5dfe167a" } modify_external_catalogs: true
I20260810 19:48:08.592347 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f283a0bdf6b94182a12f9b5f5dfe167a" } modify_external_catalogs: true
I20260810 19:48:08.579082 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_68efca25ddd74752b30341b528693d1f" } modify_external_catalogs: true
I20260810 19:48:08.593557 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_68efca25ddd74752b30341b528693d1f" } modify_external_catalogs: true
I20260810 19:48:08.579532 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_25a140564d68481997cc263696b5b066" } new_table_name: "default.Table_4472eab2daae4fa3bb3d75571f71e306" modify_external_catalogs: true
I20260810 19:48:08.580559 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_fbf29712bafa4a6390afd942219d24fa" } new_table_name: "default.Table_0bc47e5b3fca489388c060450b75e0f3" modify_external_catalogs: true
I20260810 19:48:08.602303 9416 catalog_manager.cc:5719] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:08.602767 9416 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet b33aa8be266a434cba899da7514c47e9 (table default.Table_40317d27e3de4c7ebbe4a80239f78899 [id=4e38b3a52c3549889893d804ab0dfb89]). Expected version 2 got 0
I20260810 19:48:08.605302 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b73f20efbd42afba837896167f2fb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.606609 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 09fb69ed5fd140feb5c350d81f516a89 (DEFAULT_TABLE table=default.Table_c7237012cc364cdb979f78d0515aa38c [id=838ecc163bbc4ea39f3cbd27974c9c30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.607067 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09fb69ed5fd140feb5c350d81f516a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.610424 10142 tablet_service.cc:1511] Processing CreateTablet for tablet a1628a2a930a4819818df3ea480ab4db (DEFAULT_TABLE table=default.Table_1b436c9645b44aaaa1f939d9c544bdf3 [id=68641130e17a489caad195cbe3307fc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.610561 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 7ab917ae3d8d4196ac473a27a7b523bb (DEFAULT_TABLE table=default.Table_2d0ec1a5e759420f928fae1e1cb94c03 [id=0f929bf06c7b428588d63696143f5816]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.611125 10140 tablet_service.cc:1511] Processing CreateTablet for tablet 907926085b7e483f9f6b18cf051ee601 (DEFAULT_TABLE table=default.Table_935b71b999ed4687af77b56169ee4ecb [id=3b307dc554a541439a81e55acdfe03d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.611485 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 7ab917ae3d8d4196ac473a27a7b523bb (DEFAULT_TABLE table=default.Table_2d0ec1a5e759420f928fae1e1cb94c03 [id=0f929bf06c7b428588d63696143f5816]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.611591 9669 tablet_service.cc:1511] Processing CreateTablet for tablet a1628a2a930a4819818df3ea480ab4db (DEFAULT_TABLE table=default.Table_1b436c9645b44aaaa1f939d9c544bdf3 [id=68641130e17a489caad195cbe3307fc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.611861 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ab917ae3d8d4196ac473a27a7b523bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.612355 9892 tablet_service.cc:1511] Processing CreateTablet for tablet a1628a2a930a4819818df3ea480ab4db (DEFAULT_TABLE table=default.Table_1b436c9645b44aaaa1f939d9c544bdf3 [id=68641130e17a489caad195cbe3307fc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.612443 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 95905d5c18b94759893f6caada96e79e (DEFAULT_TABLE table=default.Table_2fd589ce44f442528ad417adff50cc0a [id=95c478c2559e4533a7f05f8c70e28904]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.612813 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1628a2a930a4819818df3ea480ab4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.612813 10137 tablet_service.cc:1511] Processing CreateTablet for tablet f864e82e2aa843ed867c6b95da2127ed (DEFAULT_TABLE table=default.Table_c8ffb29225064887b4bedaef7c9e4d90 [id=60617e058752453995c46838c1a23e65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.613067 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1628a2a930a4819818df3ea480ab4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.614595 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 907926085b7e483f9f6b18cf051ee601 (DEFAULT_TABLE table=default.Table_935b71b999ed4687af77b56169ee4ecb [id=3b307dc554a541439a81e55acdfe03d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.614620 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 7ab917ae3d8d4196ac473a27a7b523bb (DEFAULT_TABLE table=default.Table_2d0ec1a5e759420f928fae1e1cb94c03 [id=0f929bf06c7b428588d63696143f5816]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.614976 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 907926085b7e483f9f6b18cf051ee601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.615005 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ab917ae3d8d4196ac473a27a7b523bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.618629 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 95905d5c18b94759893f6caada96e79e (DEFAULT_TABLE table=default.Table_2fd589ce44f442528ad417adff50cc0a [id=95c478c2559e4533a7f05f8c70e28904]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.618788 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 907926085b7e483f9f6b18cf051ee601 (DEFAULT_TABLE table=default.Table_935b71b999ed4687af77b56169ee4ecb [id=3b307dc554a541439a81e55acdfe03d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.619021 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95905d5c18b94759893f6caada96e79e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.619151 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 907926085b7e483f9f6b18cf051ee601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.622661 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 95905d5c18b94759893f6caada96e79e (DEFAULT_TABLE table=default.Table_2fd589ce44f442528ad417adff50cc0a [id=95c478c2559e4533a7f05f8c70e28904]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.623090 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95905d5c18b94759893f6caada96e79e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.626678 9902 tablet_service.cc:1511] Processing CreateTablet for tablet f864e82e2aa843ed867c6b95da2127ed (DEFAULT_TABLE table=default.Table_c8ffb29225064887b4bedaef7c9e4d90 [id=60617e058752453995c46838c1a23e65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.629570 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09fb69ed5fd140feb5c350d81f516a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.635397 9669 tablet_service.cc:1511] Processing CreateTablet for tablet f864e82e2aa843ed867c6b95da2127ed (DEFAULT_TABLE table=default.Table_c8ffb29225064887b4bedaef7c9e4d90 [id=60617e058752453995c46838c1a23e65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.635838 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f864e82e2aa843ed867c6b95da2127ed. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:08.643149 9830 consensus_peers.cc:597] T 3fd5cd2e4c104e45a81d2603c6f7d24a P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:08.643501 12505 consensus_queue.cc:1048] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:08.646057 10145 tablet_service.cc:1511] Processing CreateTablet for tablet c6142276b28447b5854a27cd007edb04 (DEFAULT_TABLE table=default.Table_3531b1d4a9e04438a2ead5ab916c23fc [id=e722b626e7674003a665cbb5138fae06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.646062 9657 tablet_service.cc:1511] Processing CreateTablet for tablet f1c74666c3694ab881ba8ed452a73714 (DEFAULT_TABLE table=default.Table_1954ac0ddba541af937bd2b421cb2f8e [id=bbf1b3708f9644d486aef32d1099aede]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.646539 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6142276b28447b5854a27cd007edb04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.646543 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c74666c3694ab881ba8ed452a73714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.646783 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 870b9f9adb9e4a519e9b3c57b70a2ad5 (DEFAULT_TABLE table=default.Table_3c9ceb27d8ed4f339574218044ba1f6b [id=7db3caef9ae2431393e321b2b9a12039]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.649063 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f864e82e2aa843ed867c6b95da2127ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.650242 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 485bd72ffedf4bc0a9d69838625910a4 (DEFAULT_TABLE table=default.Table_3684e48baa2d4e58b5907a7503e5a6ac [id=052965f1829d4592a1820a2fc693b046]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.650596 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 09fb69ed5fd140feb5c350d81f516a89 (DEFAULT_TABLE table=default.Table_c7237012cc364cdb979f78d0515aa38c [id=838ecc163bbc4ea39f3cbd27974c9c30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.650622 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 870b9f9adb9e4a519e9b3c57b70a2ad5 (DEFAULT_TABLE table=default.Table_3c9ceb27d8ed4f339574218044ba1f6b [id=7db3caef9ae2431393e321b2b9a12039]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.651005 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 870b9f9adb9e4a519e9b3c57b70a2ad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.652187 9890 tablet_service.cc:1511] Processing CreateTablet for tablet d1f88b5c7685407590a1677dfa0ea697 (DEFAULT_TABLE table=default.Table_491e9a2223e9472a842709f9e9250766 [id=ab250fc427124161a758653c54014424]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.652801 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 870b9f9adb9e4a519e9b3c57b70a2ad5 (DEFAULT_TABLE table=default.Table_3c9ceb27d8ed4f339574218044ba1f6b [id=7db3caef9ae2431393e321b2b9a12039]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.653188 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 870b9f9adb9e4a519e9b3c57b70a2ad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.654090 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 902b453dd22a4f09994169275e1c8dc0 (DEFAULT_TABLE table=default.Table_9d8436304429432aaa15c2dd270e9082 [id=f4056947e666409b872f3e4c04a27027]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.655426 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 485bd72ffedf4bc0a9d69838625910a4 (DEFAULT_TABLE table=default.Table_3684e48baa2d4e58b5907a7503e5a6ac [id=052965f1829d4592a1820a2fc693b046]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.655790 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 870b9f9adb9e4a519e9b3c57b70a2ad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.655797 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 485bd72ffedf4bc0a9d69838625910a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.656672 10120 tablet_service.cc:1511] Processing CreateTablet for tablet 485bd72ffedf4bc0a9d69838625910a4 (DEFAULT_TABLE table=default.Table_3684e48baa2d4e58b5907a7503e5a6ac [id=052965f1829d4592a1820a2fc693b046]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.657037 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 485bd72ffedf4bc0a9d69838625910a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.658644 9664 tablet_service.cc:1511] Processing CreateTablet for tablet d1f88b5c7685407590a1677dfa0ea697 (DEFAULT_TABLE table=default.Table_491e9a2223e9472a842709f9e9250766 [id=ab250fc427124161a758653c54014424]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.659169 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1f88b5c7685407590a1677dfa0ea697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.659538 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1f88b5c7685407590a1677dfa0ea697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.662101 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 485bd72ffedf4bc0a9d69838625910a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.662660 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 902b453dd22a4f09994169275e1c8dc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.662632 10118 tablet_service.cc:1511] Processing CreateTablet for tablet d1f88b5c7685407590a1677dfa0ea697 (DEFAULT_TABLE table=default.Table_491e9a2223e9472a842709f9e9250766 [id=ab250fc427124161a758653c54014424]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.662636 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 902b453dd22a4f09994169275e1c8dc0 (DEFAULT_TABLE table=default.Table_9d8436304429432aaa15c2dd270e9082 [id=f4056947e666409b872f3e4c04a27027]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.662998 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 902b453dd22a4f09994169275e1c8dc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.663023 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1f88b5c7685407590a1677dfa0ea697. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:08.666904 10067 consensus_peers.cc:597] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b2b20dc77954af7a203f357c746be29. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:08.667409 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09fb69ed5fd140feb5c350d81f516a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.667749 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 902b453dd22a4f09994169275e1c8dc0 (DEFAULT_TABLE table=default.Table_9d8436304429432aaa15c2dd270e9082 [id=f4056947e666409b872f3e4c04a27027]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.668151 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 902b453dd22a4f09994169275e1c8dc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.676447 12505 raft_consensus.cc:493] T 896b7cfdb0ca4904aaeafa13ff19365e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:08.676620 12505 raft_consensus.cc:515] T 896b7cfdb0ca4904aaeafa13ff19365e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.677358 12505 leader_election.cc:290] T 896b7cfdb0ca4904aaeafa13ff19365e P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:08.678076 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896b7cfdb0ca4904aaeafa13ff19365e" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:08.678843 9830 leader_election.cc:343] T 896b7cfdb0ca4904aaeafa13ff19365e P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:08.681294 9896 tablet_service.cc:1511] Processing CreateTablet for tablet c6142276b28447b5854a27cd007edb04 (DEFAULT_TABLE table=default.Table_3531b1d4a9e04438a2ead5ab916c23fc [id=e722b626e7674003a665cbb5138fae06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.681723 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6142276b28447b5854a27cd007edb04. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:08.682919 9831 leader_election.cc:343] T 896b7cfdb0ca4904aaeafa13ff19365e P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 896b7cfdb0ca4904aaeafa13ff19365e
I20260810 19:48:08.683034 9831 leader_election.cc:304] T 896b7cfdb0ca4904aaeafa13ff19365e P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:08.683462 12505 raft_consensus.cc:2749] T 896b7cfdb0ca4904aaeafa13ff19365e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:08.676606 9901 tablet_service.cc:1511] Processing CreateTablet for tablet f1c74666c3694ab881ba8ed452a73714 (DEFAULT_TABLE table=default.Table_1954ac0ddba541af937bd2b421cb2f8e [id=bbf1b3708f9644d486aef32d1099aede]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.692368 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c74666c3694ab881ba8ed452a73714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.695183 9669 tablet_service.cc:1511] Processing CreateTablet for tablet c6142276b28447b5854a27cd007edb04 (DEFAULT_TABLE table=default.Table_3531b1d4a9e04438a2ead5ab916c23fc [id=e722b626e7674003a665cbb5138fae06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.695652 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6142276b28447b5854a27cd007edb04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.700321 12585 tablet.cc:1724] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:08.705296 10122 tablet_service.cc:1511] Processing CreateTablet for tablet f1c74666c3694ab881ba8ed452a73714 (DEFAULT_TABLE table=default.Table_1954ac0ddba541af937bd2b421cb2f8e [id=bbf1b3708f9644d486aef32d1099aede]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.705750 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c74666c3694ab881ba8ed452a73714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.722873 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 53bfac43413347cc8d596169e6daa274
I20260810 19:48:08.723582 9408 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:56048 (request call id 1060) took 1307 ms. Trace:
I20260810 19:48:08.723722 9408 rpcz_store.cc:276] 0810 19:48:07.415933 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:07.994737 (+578804us) service_pool.cc:224] Handling call
0810 19:48:08.075434 (+ 80697us) spinlock_profiling.cc:243] Waited 80.4 ms on lock 0x616000041b54. stack: 00007f50aec1d326 00007f50aec1d0e0 00007f50adc4734d 00000000009a5774 00000000009a573d 00007f50be19c65d 00007f50be19c753 00007f50bad21ac1 00007f50c2afb40d 00007f50c2c8ab06 00007f50b96739d6 00007f50b9673705 00007f50b5d6061e 00007f50b5d5f4fe 00007f50b5d65738 00007f50b5d6609f
0810 19:48:08.075859 (+ 425us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 19:48:08.076112 (+ 253us) catalog_manager.cc:2841] Modifying in-memory table state
0810 19:48:08.076181 (+ 69us) catalog_manager.cc:2850] Locking tablets
0810 19:48:08.394516 (+318335us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 19:48:08.722641 (+328125us) catalog_manager.cc:2882] Removing table from by-name map
0810 19:48:08.722735 (+ 94us) catalog_manager.cc:2898] Committing in-memory state
0810 19:48:08.722778 (+ 43us) catalog_manager.cc:2902] Aborting table tasks
0810 19:48:08.723528 (+ 750us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 19:48:08.404214 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 19:48:08.404358 (+ 144us) write_op.cc:432] Acquiring schema lock in shared mode
0810 19:48:08.404365 (+ 7us) write_op.cc:435] Acquired schema lock
0810 19:48:08.404368 (+ 3us) tablet.cc:662] Decoding operations
0810 19:48:08.404488 (+ 120us) write_op.cc:620] Acquiring the partition lock for write op
0810 19:48:08.404499 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0810 19:48:08.404504 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0810 19:48:08.404838 (+ 334us) tablet.cc:701] Row locks acquired
0810 19:48:08.404841 (+ 3us) write_op.cc:260] PREPARE: finished
0810 19:48:08.404888 (+ 47us) write_op.cc:270] Start()
0810 19:48:08.404928 (+ 40us) write_op.cc:276] Timestamp: P: 1786391288404841 usec, L: 0
0810 19:48:08.404932 (+ 4us) op_driver.cc:348] REPLICATION: starting
0810 19:48:08.563385 (+158453us) log.cc:844] Serialized 731 byte log entry
0810 19:48:08.564071 (+ 686us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x616000041b54. stack: 00007f50aec1d326 00007f50aec1d0e0 00007f50adc4734d 00000000009a5774 00000000009a573d 00000000009a510a 00007f50bacf3ec2 00007f50bc10f9f5 00007f50bc10e519 00007f50bc116940 00007f50bc11674d 0000000000aaf86c 00007f50aec6384f 00007f50aec66b4b 00007f50aec669c8 0000000000aaf86c
0810 19:48:08.720671 (+156600us) op_driver.cc:464] REPLICATION: finished
0810 19:48:08.720810 (+ 139us) write_op.cc:301] APPLY: starting
0810 19:48:08.720831 (+ 21us) tablet.cc:1367] starting BulkCheckPresence
0810 19:48:08.720884 (+ 53us) tablet.cc:1370] finished BulkCheckPresence
0810 19:48:08.720887 (+ 3us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 19:48:08.721072 (+ 185us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 19:48:08.721109 (+ 37us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 19:48:08.721117 (+ 8us) write_op.cc:312] APPLY: finished
0810 19:48:08.721249 (+ 132us) log.cc:844] Serialized 29 byte log entry
0810 19:48:08.721347 (+ 98us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:08.721368 (+ 21us) write_op.cc:454] Released schema lock
0810 19:48:08.721377 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 19:48:08.721463 (+ 86us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:08.721468 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":184934144,"child_traces":[["op",{"apply.queue_time_us":35,"apply.run_cpu_time_us":648,"apply.run_wall_time_us":647,"num_ops":2,"prepare.queue_time_us":8849,"prepare.run_cpu_time_us":1724,"prepare.run_wall_time_us":159903,"replication_time_us":315700,"spinlock_wait_cycles":363839872}]]}
I20260810 19:48:08.724372 9412 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_92979ca12b07474b8e621122d23568a7 [id=de4d62ebb8c440a1a71ed57ac4f3c530] alter complete (version 2)
I20260810 19:48:08.724627 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7459a9ef6579436aaf36362612271ccb" } new_table_name: "default.Table_f20810abc0f44bb38f36eb0c1cf7012f" modify_external_catalogs: true
I20260810 19:48:08.726011 9412 master_service.cc:960] ReplaceTablet: received request to replace tablet 1a615a32f94949179de8e8ee8a444576 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:08.726387 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b15450030540496a8b6e252f5f57722c" } new_table_name: "default.Table_2a2f0955fc9941f38e534579ede9c4e3" modify_external_catalogs: true
I20260810 19:48:08.726519 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet b8a7c2857add422281542e7f187979ab
I20260810 19:48:08.727219 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1c8f04aee36e49eaaac50ad68deb2303"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:08.727793 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c8f04aee36e49eaaac50ad68deb2303 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:08.728943 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 988d87b2b00a459d9afc44ba0ae1961e
I20260810 19:48:08.729677 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c41427d1476b48f7acf16d9656f70cd4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:08.730295 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c41427d1476b48f7acf16d9656f70cd4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:08.730453 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2798f122e0624af6971fc8317244e5ae consensus state has no leader
I20260810 19:48:08.730562 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet dcb3660108094399b36d19ea8e6b8308 with delete_type TABLET_DATA_DELETED (replaced by tablet f5fa6060b9ef48cea6830cd9d19424ea) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:08.730738 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet cbcaa7106df24aaeb07428b7b590e282 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:08.730825 10120 tablet_service.cc:1558] Processing DeleteTablet for tablet 4dba7046bdfd41f1a2ad6f299a723776 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:08.731036 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet 988d87b2b00a459d9afc44ba0ae1961e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:08.731225 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet f42e9b00e3da4d73b4beb1b325f09f4a from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:08.731220 10127 tablet_service.cc:1558] Processing DeleteTablet for tablet 53bfac43413347cc8d596169e6daa274 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:08.731418 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet b8a7c2857add422281542e7f187979ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:08.731494 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 33f2ea0d46f44fca88e16ea83ad67bc2
I20260810 19:48:08.732254 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_af6e508271a340b0b1cc5e7a16cd66ff" } new_table_name: "default.Table_f1b9a2a5ef6a45d9b4bad8e0c6b1cecb" modify_external_catalogs: true
W20260810 19:48:08.733582 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3b9f29803809462a9b8b64b03eed040b consensus state has no leader
I20260810 19:48:08.733986 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c2abc74b620d478fb6d85ef97ff23e9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:08.734505 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2abc74b620d478fb6d85ef97ff23e9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:08.737562 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet b8a7c2857add422281542e7f187979ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:08.737730 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 988d87b2b00a459d9afc44ba0ae1961e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:08.737949 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 33f2ea0d46f44fca88e16ea83ad67bc2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:08.739240 12266 tablet_replica.cc:333] T 988d87b2b00a459d9afc44ba0ae1961e P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:08.739485 12266 raft_consensus.cc:2243] T 988d87b2b00a459d9afc44ba0ae1961e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:08.739653 12266 raft_consensus.cc:2272] T 988d87b2b00a459d9afc44ba0ae1961e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:08.740290 12266 ts_tablet_manager.cc:1916] T 988d87b2b00a459d9afc44ba0ae1961e P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:08.740793 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 53bfac43413347cc8d596169e6daa274 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:08.743757 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet b8a7c2857add422281542e7f187979ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8a7c2857add422281542e7f187979ab already in progress: creating tablet
I20260810 19:48:08.744838 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet 33f2ea0d46f44fca88e16ea83ad67bc2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:08.745836 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 53bfac43413347cc8d596169e6daa274 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:08.746079 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet b8a7c2857add422281542e7f187979ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:08.746237 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 988d87b2b00a459d9afc44ba0ae1961e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:08.746884 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 33f2ea0d46f44fca88e16ea83ad67bc2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:48:08.747664 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 53bfac43413347cc8d596169e6daa274 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53bfac43413347cc8d596169e6daa274 already in progress: creating tablet
W20260810 19:48:08.747972 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet b8a7c2857add422281542e7f187979ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8a7c2857add422281542e7f187979ab already in progress: creating tablet
W20260810 19:48:08.748176 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 988d87b2b00a459d9afc44ba0ae1961e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 988d87b2b00a459d9afc44ba0ae1961e already in progress: creating tablet
W20260810 19:48:08.748383 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 33f2ea0d46f44fca88e16ea83ad67bc2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33f2ea0d46f44fca88e16ea83ad67bc2 already in progress: creating tablet
I20260810 19:48:08.751972 12505 raft_consensus.cc:493] T 15c070c23de34348ad3426c894e11022 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:08.752213 12505 raft_consensus.cc:515] T 15c070c23de34348ad3426c894e11022 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.752972 12505 leader_election.cc:290] T 15c070c23de34348ad3426c894e11022 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:08.756873 12266 ts_tablet_manager.cc:1929] T 988d87b2b00a459d9afc44ba0ae1961e P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:08.759011 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c070c23de34348ad3426c894e11022" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:08.760349 12266 log.cc:1199] T 988d87b2b00a459d9afc44ba0ae1961e P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/988d87b2b00a459d9afc44ba0ae1961e
W20260810 19:48:08.760339 10068 consensus_peers.cc:597] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8455cb11388340beb6daa13fee06177a. This is attempt 1: this message will repeat every 5th retry.
W20260810 19:48:08.760816 9830 leader_election.cc:343] T 15c070c23de34348ad3426c894e11022 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:08.763422 12266 ts_tablet_manager.cc:1950] T 988d87b2b00a459d9afc44ba0ae1961e P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
W20260810 19:48:08.763504 9831 leader_election.cc:343] T 15c070c23de34348ad3426c894e11022 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 15c070c23de34348ad3426c894e11022
I20260810 19:48:08.763741 9831 leader_election.cc:304] T 15c070c23de34348ad3426c894e11022 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:08.764226 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 988d87b2b00a459d9afc44ba0ae1961e (table default.Table_f283a0bdf6b94182a12f9b5f5dfe167a [id=f881fab647be45f786665629ab8baaee]) successfully deleted
I20260810 19:48:08.764254 12505 raft_consensus.cc:2749] T 15c070c23de34348ad3426c894e11022 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:08.764843 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 33f2ea0d46f44fca88e16ea83ad67bc2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33f2ea0d46f44fca88e16ea83ad67bc2 already in progress: creating tablet
W20260810 19:48:08.765157 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 53bfac43413347cc8d596169e6daa274 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53bfac43413347cc8d596169e6daa274 already in progress: creating tablet
W20260810 19:48:08.778123 10067 consensus_peers.cc:597] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ae3e151180ae4d258d18365770acaaad. This is attempt 1: this message will repeat every 5th retry.
W20260810 19:48:08.779374 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet efbe1ac330634c9485f7a44164ff7395 consensus state has no leader
W20260810 19:48:08.781737 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f146f440c1174d348ed273d29145e815 consensus state has no leader
I20260810 19:48:08.782214 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_28a63f09c01a4b8e9a26f2ef2f1a9f47"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:08.782722 9407 master_service.cc:960] ReplaceTablet: received request to replace tablet b853bf6bbc7845bc9cfa6347687582e2 from {username='slave'} at 127.0.0.1:56048
W20260810 19:48:08.782886 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28a63f09c01a4b8e9a26f2ef2f1a9f47 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:08.783334 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_8a47860f929d46cb8ddfa5e32149fa6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:08.783895 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a47860f929d46cb8ddfa5e32149fa6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:08.785336 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_6493b63f37da467b9c631e0081ffceef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:08.785916 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6493b63f37da467b9c631e0081ffceef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:08.787149 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 81de4b3e05604a34b305ca0ad744d769 consensus state has no leader
I20260810 19:48:08.787683 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1c4e773fcacd46aeba353887d84c38e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:08.788216 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c4e773fcacd46aeba353887d84c38e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:08.789551 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 7d93fd6556b146ca8933a6dc0a2357e8
I20260810 19:48:08.790614 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet f42e9b00e3da4d73b4beb1b325f09f4a
I20260810 19:48:08.790654 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d93fd6556b146ca8933a6dc0a2357e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:08.790735 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d93fd6556b146ca8933a6dc0a2357e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:08.791129 9410 catalog_manager.cc:6807] ReplaceTablet: tablet f42e9b00e3da4d73b4beb1b325f09f4a deleted and replaced by tablet 054c725b88c34372a922fc5be27c35a0
I20260810 19:48:08.791669 10377 tablet_replica.cc:333] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:08.791859 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet f42e9b00e3da4d73b4beb1b325f09f4a with delete_type TABLET_DATA_DELETED (replaced by tablet 054c725b88c34372a922fc5be27c35a0) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:08.791882 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet f42e9b00e3da4d73b4beb1b325f09f4a with delete_type TABLET_DATA_DELETED (replaced by tablet 054c725b88c34372a922fc5be27c35a0) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:08.791885 10377 raft_consensus.cc:2243] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:08.793095 9669 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d93fd6556b146ca8933a6dc0a2357e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:08.793252 10377 raft_consensus.cc:2272] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:08.793573 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet f42e9b00e3da4d73b4beb1b325f09f4a with delete_type TABLET_DATA_DELETED (replaced by tablet 054c725b88c34372a922fc5be27c35a0) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:08.794184 10247 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:48:08.795964 10377 ts_tablet_manager.cc:1916] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:08.798702 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2dc3f79aafc540d89741b2a66d692f94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:08.799409 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2dc3f79aafc540d89741b2a66d692f94 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:08.801077 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_aa25198fe4c1478d8b8b6cb8dd18252f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:08.801630 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa25198fe4c1478d8b8b6cb8dd18252f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:08.808431 10377 ts_tablet_manager.cc:1929] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260810 19:48:08.808576 10377 log.cc:1199] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/7d93fd6556b146ca8933a6dc0a2357e8
I20260810 19:48:08.808976 10377 ts_tablet_manager.cc:1950] T 7d93fd6556b146ca8933a6dc0a2357e8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:08.810875 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 7d93fd6556b146ca8933a6dc0a2357e8 (table default.Table_92979ca12b07474b8e621122d23568a7 [id=de4d62ebb8c440a1a71ed57ac4f3c530]) successfully deleted
W20260810 19:48:08.811237 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet f42e9b00e3da4d73b4beb1b325f09f4a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f42e9b00e3da4d73b4beb1b325f09f4a already in progress: creating tablet
I20260810 19:48:08.813374 12266 tablet_replica.cc:333] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:08.815985 12266 raft_consensus.cc:2243] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:08.816480 12266 raft_consensus.cc:2272] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:08.817066 10068 consensus_peers.cc:597] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0bddaf5b5fc1404e83b079ffa97e7321. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:08.817703 12266 ts_tablet_manager.cc:1916] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:08.824680 10067 consensus_peers.cc:597] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 63486cc3f8774a11827b1cc5f1c16332. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:08.841284 10370 ts_tablet_manager.cc:1434] T 3fd5cd2e4c104e45a81d2603c6f7d24a P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.414s user 0.003s sys 0.000s
W20260810 19:48:08.849447 9395 catalog_manager.cc:5123] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): alter failed for tablet d77785d9bde843bc8366fe15d1b4fa18 (table default.Table_3e78e13c8ecc464eb6af12a2bc3f2eba [id=1af2d06c44b643e28d28bb080cd5eef8]),no further retry: Not found: Tablet not found: d77785d9bde843bc8366fe15d1b4fa18
W20260810 19:48:08.851445 10067 consensus_peers.cc:597] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0bddaf5b5fc1404e83b079ffa97e7321. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:08.854795 9408 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 5394eadabf184158864921dd5d394828 (table default.Table_c5cc7d3e97ae4d02952905907354f9a3 [id=2d447d5da0e74e0885490174fc0f929d]). Expected version 1 got 0
I20260810 19:48:08.855062 9408 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 3bf9486839474b2a8ddff3a49b4fda2a (table default.Table_0bbfea1f106c4df1921c642928671792 [id=d628448cf7b94ebab79194e81fcaf040]). Expected version 1 got 0
I20260810 19:48:08.855667 9416 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_eb9f78456c6e44de9695e8fe65c3e119 [id=12db110e89e04d40bdb05ec61fd5e3b6] alter complete (version 2)
I20260810 19:48:08.845721 10370 tablet_bootstrap.cc:492] T 2798f122e0624af6971fc8317244e5ae P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:48:08.857355 10067 consensus_peers.cc:597] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8455cb11388340beb6daa13fee06177a. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:08.859577 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ba42032e7344423a0e86c55d613f27d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:05 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:08.859850 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet 15c070c23de34348ad3426c894e11022 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:08.860008 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e967384768b4ec7956f1b508e8ab2af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:08.860239 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet d77785d9bde843bc8366fe15d1b4fa18 with delete_type TABLET_DATA_DELETED (replaced by tablet 041844571695425eb6de69d251dffcf0) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:08.861732 10377 tablet_replica.cc:333] T 5ba42032e7344423a0e86c55d613f27d P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:08.861974 10377 raft_consensus.cc:2243] T 5ba42032e7344423a0e86c55d613f27d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:08.862154 10377 raft_consensus.cc:2272] T 5ba42032e7344423a0e86c55d613f27d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:08.862789 10377 ts_tablet_manager.cc:1916] T 5ba42032e7344423a0e86c55d613f27d P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:08.863927 9420 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 5394eadabf184158864921dd5d394828 (table default.Table_c5cc7d3e97ae4d02952905907354f9a3 [id=2d447d5da0e74e0885490174fc0f929d]). Expected version 1 got 0
I20260810 19:48:08.864171 9420 catalog_manager.cc:5719] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:08.864468 10367 tablet_bootstrap.cc:492] T 5654c48929564a96a55ed0444c9e1a04 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:08.864585 9420 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 2798f122e0624af6971fc8317244e5ae (table default.Table_0bc47e5b3fca489388c060450b75e0f3 [id=83524cb8be1d482695223aeaaa578a13]). Expected version 1 got 0
I20260810 19:48:08.864629 10367 ts_tablet_manager.cc:1403] T 5654c48929564a96a55ed0444c9e1a04 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.330s user 0.003s sys 0.000s
I20260810 19:48:08.867987 9890 tablet_service.cc:1511] Processing CreateTablet for tablet 68e21d5737e84136a6fdeacb75c632e2 (DEFAULT_TABLE table=default.Table_82f2c0a512b5433ea617e4710d530233 [id=e489d895eea94767befe0a15ba19abf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.869776 12407 raft_consensus.cc:493] T 8fce298689e9415a8860b8734d73b10a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:08.869959 12407 raft_consensus.cc:515] T 8fce298689e9415a8860b8734d73b10a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.870227 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68e21d5737e84136a6fdeacb75c632e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.870705 12407 leader_election.cc:290] T 8fce298689e9415a8860b8734d73b10a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:08.872468 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce298689e9415a8860b8734d73b10a" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:08.872516 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce298689e9415a8860b8734d73b10a" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:08.873092 9611 leader_election.cc:343] T 8fce298689e9415a8860b8734d73b10a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:08.873380 9611 leader_election.cc:343] T 8fce298689e9415a8860b8734d73b10a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:08.873461 9611 leader_election.cc:304] T 8fce298689e9415a8860b8734d73b10a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:08.873999 12407 raft_consensus.cc:2749] T 8fce298689e9415a8860b8734d73b10a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:08.879108 10142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1628a2a930a4819818df3ea480ab4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.882637 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ab917ae3d8d4196ac473a27a7b523bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.882905 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f864e82e2aa843ed867c6b95da2127ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.883551 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 1a615a32f94949179de8e8ee8a444576
I20260810 19:48:08.884048 9412 catalog_manager.cc:6807] ReplaceTablet: tablet 1a615a32f94949179de8e8ee8a444576 deleted and replaced by tablet 44e5c597335a4795b8dbb708af7726ee
I20260810 19:48:08.885182 9408 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_0844c946c41146f38e51790cd8baed2a [id=4830b444314a4bb6a605cb73432e772f] alter complete (version 1)
I20260810 19:48:08.887329 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a615a32f94949179de8e8ee8a444576 with delete_type TABLET_DATA_DELETED (replaced by tablet 44e5c597335a4795b8dbb708af7726ee) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:08.887522 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 648ef608fa0c45cc8be4bad80c4200be with delete_type TABLET_DATA_DELETED (replaced by tablet 67d02a8eea444f3383f14a1e1f0e236b) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:08.887986 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 100202b65e024863b9099ae7fcf73201 (DEFAULT_TABLE table=default.Table_46ab7791bf4847469769843a6a77f9ef [id=7b457fad468546239f0f0b56e2d3614a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.888422 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 100202b65e024863b9099ae7fcf73201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.888561 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 68e21d5737e84136a6fdeacb75c632e2 (DEFAULT_TABLE table=default.Table_82f2c0a512b5433ea617e4710d530233 [id=e489d895eea94767befe0a15ba19abf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.888864 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95905d5c18b94759893f6caada96e79e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.894560 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 907926085b7e483f9f6b18cf051ee601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.894447 10377 ts_tablet_manager.cc:1929] T 5ba42032e7344423a0e86c55d613f27d P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:08.894713 10377 log.cc:1199] T 5ba42032e7344423a0e86c55d613f27d P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/5ba42032e7344423a0e86c55d613f27d
I20260810 19:48:08.898393 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c75af1e592042f5a4d442b82a539c94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:08.900104 10377 ts_tablet_manager.cc:1950] T 5ba42032e7344423a0e86c55d613f27d P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:08.900647 10377 tablet_replica.cc:333] T 15c070c23de34348ad3426c894e11022 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:08.900854 10377 raft_consensus.cc:2243] T 15c070c23de34348ad3426c894e11022 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:08.901034 10377 raft_consensus.cc:2272] T 15c070c23de34348ad3426c894e11022 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:08.901643 10377 ts_tablet_manager.cc:1916] T 15c070c23de34348ad3426c894e11022 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:08.902026 9420 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 5394eadabf184158864921dd5d394828 (table default.Table_c5cc7d3e97ae4d02952905907354f9a3 [id=2d447d5da0e74e0885490174fc0f929d]). Expected version 1 got 0
I20260810 19:48:08.903674 10139 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a615a32f94949179de8e8ee8a444576 with delete_type TABLET_DATA_DELETED (replaced by tablet 44e5c597335a4795b8dbb708af7726ee) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:08.903966 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 5ba42032e7344423a0e86c55d613f27d (table default.Table_c6af56cc89144541a50f07ce309f7aaf [id=0bbc6397fe1b49cb894bb0e50af006fc]) successfully deleted
I20260810 19:48:08.904386 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 896b7cfdb0ca4904aaeafa13ff19365e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:08.905004 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet 3582ed23ffdf4ff089952e29083e5425 with delete_type TABLET_DATA_DELETED (replaced by tablet 8503d5162548463bae22402fdc4c502a) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:08.905587 10370 tablet_bootstrap.cc:654] T 2798f122e0624af6971fc8317244e5ae P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:08.906978 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 100202b65e024863b9099ae7fcf73201 (DEFAULT_TABLE table=default.Table_46ab7791bf4847469769843a6a77f9ef [id=7b457fad468546239f0f0b56e2d3614a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.907759 11897 raft_consensus.cc:493] T 648ef608fa0c45cc8be4bad80c4200be P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:08.907907 11897 raft_consensus.cc:515] T 648ef608fa0c45cc8be4bad80c4200be P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.908321 9657 tablet_service.cc:1511] Processing CreateTablet for tablet c8ceb3be44e741f080358cc2bcf91219 (DEFAULT_TABLE table=default.Table_eb19a51e41b04a3b8262fe84b188adde [id=9754517d89e14b028462cc08f8cb620b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.908545 11897 leader_election.cc:290] T 648ef608fa0c45cc8be4bad80c4200be P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:08.909612 9664 tablet_service.cc:1511] Processing CreateTablet for tablet d857efeee4d3442ca065221e3095d421 (DEFAULT_TABLE table=default.Table_58338522359643389f4a12b2958ceaea [id=7aa1da4aa51f412f97bf04e4be70279a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.909747 9907 tablet_service.cc:1511] Processing CreateTablet for tablet d857efeee4d3442ca065221e3095d421 (DEFAULT_TABLE table=default.Table_58338522359643389f4a12b2958ceaea [id=7aa1da4aa51f412f97bf04e4be70279a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.910306 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d857efeee4d3442ca065221e3095d421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.914637 9913 tablet_service.cc:1511] Processing CreateTablet for tablet dee05338a75f43be8eb2546d06dd8068 (DEFAULT_TABLE table=default.Table_361836440e714f89b85618c3ec886efa [id=54f257a8ae8546b9b86153a0831c469b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.915143 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dee05338a75f43be8eb2546d06dd8068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.919061 9892 tablet_service.cc:1511] Processing CreateTablet for tablet c8ceb3be44e741f080358cc2bcf91219 (DEFAULT_TABLE table=default.Table_eb19a51e41b04a3b8262fe84b188adde [id=9754517d89e14b028462cc08f8cb620b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:08.922012 9830 consensus_peers.cc:597] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:08.922525 10377 ts_tablet_manager.cc:1929] T 15c070c23de34348ad3426c894e11022 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:08.922629 10377 log.cc:1199] T 15c070c23de34348ad3426c894e11022 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/15c070c23de34348ad3426c894e11022
I20260810 19:48:08.922955 10377 ts_tablet_manager.cc:1950] T 15c070c23de34348ad3426c894e11022 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:08.923426 10377 tablet_replica.cc:333] T 0e967384768b4ec7956f1b508e8ab2af P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:08.923696 10377 raft_consensus.cc:2243] T 0e967384768b4ec7956f1b508e8ab2af P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:08.923848 10377 raft_consensus.cc:2272] T 0e967384768b4ec7956f1b508e8ab2af P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:08.924403 10377 ts_tablet_manager.cc:1916] T 0e967384768b4ec7956f1b508e8ab2af P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:08.906364 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 68e21d5737e84136a6fdeacb75c632e2 (DEFAULT_TABLE table=default.Table_82f2c0a512b5433ea617e4710d530233 [id=e489d895eea94767befe0a15ba19abf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.936187 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68e21d5737e84136a6fdeacb75c632e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.937676 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 15c070c23de34348ad3426c894e11022 (table default.Table_511b7773a9034830ad84841ad4c71063 [id=b69a88eb84db49daa3c6a51ca2c6e4d7]) successfully deleted
I20260810 19:48:08.941694 10377 ts_tablet_manager.cc:1929] T 0e967384768b4ec7956f1b508e8ab2af P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:08.906785 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 100202b65e024863b9099ae7fcf73201 (DEFAULT_TABLE table=default.Table_46ab7791bf4847469769843a6a77f9ef [id=7b457fad468546239f0f0b56e2d3614a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.916869 10136 tablet_service.cc:1511] Processing CreateTablet for tablet d857efeee4d3442ca065221e3095d421 (DEFAULT_TABLE table=default.Table_58338522359643389f4a12b2958ceaea [id=7aa1da4aa51f412f97bf04e4be70279a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.942195 10377 log.cc:1199] T 0e967384768b4ec7956f1b508e8ab2af P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/0e967384768b4ec7956f1b508e8ab2af
I20260810 19:48:08.942575 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d857efeee4d3442ca065221e3095d421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.943404 10377 ts_tablet_manager.cc:1950] T 0e967384768b4ec7956f1b508e8ab2af P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:08.946141 10377 tablet_replica.cc:333] T 648ef608fa0c45cc8be4bad80c4200be P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:08.946825 10377 raft_consensus.cc:2243] T 648ef608fa0c45cc8be4bad80c4200be P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:08.947356 10377 raft_consensus.cc:2272] T 648ef608fa0c45cc8be4bad80c4200be P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:08.949922 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_94f87f0129ca4a07aab816a9f28e00e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:08.950739 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94f87f0129ca4a07aab816a9f28e00e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:08.950843 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_97b0b4e69a6a4a56bf37ba9561c5271e" } modify_external_catalogs: true
I20260810 19:48:08.951014 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_97b0b4e69a6a4a56bf37ba9561c5271e" } modify_external_catalogs: true
I20260810 19:48:08.952158 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f0a4eda8c4a944db84e6b258924f1494" } modify_external_catalogs: true
I20260810 19:48:08.952351 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f0a4eda8c4a944db84e6b258924f1494" } modify_external_catalogs: true
I20260810 19:48:08.953814 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d525715cfc784dae8f9b3f058b64db20" } modify_external_catalogs: true
I20260810 19:48:08.953976 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d525715cfc784dae8f9b3f058b64db20" } modify_external_catalogs: true
I20260810 19:48:08.917335 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648ef608fa0c45cc8be4bad80c4200be" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:08.954799 9830 leader_election.cc:343] T 648ef608fa0c45cc8be4bad80c4200be P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:08.955377 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_aa25198fe4c1478d8b8b6cb8dd18252f" } new_table_name: "default.Table_09625e5e21414c2d98d6f8c454f00573" modify_external_catalogs: true
I20260810 19:48:08.956637 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_83e700e09b2a43c3b2133def7eb871bc" } modify_external_catalogs: true
I20260810 19:48:08.956794 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_83e700e09b2a43c3b2133def7eb871bc" } modify_external_catalogs: true
I20260810 19:48:08.956883 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 0e967384768b4ec7956f1b508e8ab2af (table default.Table_5043edeafbb047c6a7619f91323879c2 [id=6287581e5dad45b4b7fd481e9ae5eae3]) successfully deleted
W20260810 19:48:08.957540 9395 catalog_manager.cc:5017] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet d77785d9bde843bc8366fe15d1b4fa18 because the tablet was not found. No further retry: Not found: Tablet not found: d77785d9bde843bc8366fe15d1b4fa18
I20260810 19:48:08.959609 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2a2f0955fc9941f38e534579ede9c4e3" } new_table_name: "default.Table_2845bb7ac75a49d99483ac3cf7d96171" modify_external_catalogs: true
I20260810 19:48:08.961686 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 100202b65e024863b9099ae7fcf73201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.917845 10115 tablet_service.cc:1511] Processing CreateTablet for tablet c8ceb3be44e741f080358cc2bcf91219 (DEFAULT_TABLE table=default.Table_eb19a51e41b04a3b8262fe84b188adde [id=9754517d89e14b028462cc08f8cb620b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:08.962702 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8ceb3be44e741f080358cc2bcf91219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:08.968155 10367 raft_consensus.cc:359] T 5654c48929564a96a55ed0444c9e1a04 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.968392 10367 raft_consensus.cc:385] T 5654c48929564a96a55ed0444c9e1a04 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:08.968437 10367 raft_consensus.cc:740] T 5654c48929564a96a55ed0444c9e1a04 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:08.968683 10367 consensus_queue.cc:260] T 5654c48929564a96a55ed0444c9e1a04 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.969556 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet da807b279a8e47f3a7bb7b773c04b558
I20260810 19:48:08.970556 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet da807b279a8e47f3a7bb7b773c04b558 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:08.971123 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet da807b279a8e47f3a7bb7b773c04b558 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:08.976121 12597 consensus_queue.cc:1048] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:08.978685 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a615a32f94949179de8e8ee8a444576 with delete_type TABLET_DATA_DELETED (replaced by tablet 44e5c597335a4795b8dbb708af7726ee) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:08.979862 9715 raft_consensus.cc:1275] T 2798f122e0624af6971fc8317244e5ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Refusing update from remote peer 6986ed920dcb4af29a5eeeda6f671691: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 19:48:08.981263 12597 consensus_queue.cc:1048] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 19:48:08.984450 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a4d1b6bac3604a60811b457a55b1c528 has no consensus state
W20260810 19:48:08.985024 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f146f440c1174d348ed273d29145e815 consensus state has no leader
I20260810 19:48:08.985455 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 1cb0193bab3543d38ec5f6dc6a947b6e
I20260810 19:48:08.986279 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 2d72c72f90964f34bbc2232118dc5172
I20260810 19:48:08.987071 10367 ts_tablet_manager.cc:1434] T 5654c48929564a96a55ed0444c9e1a04 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.122s user 0.003s sys 0.000s
I20260810 19:48:08.987442 10367 tablet_bootstrap.cc:492] T 05059ef70a8e440ca2988bfeb610645d P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:08.987649 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cb0193bab3543d38ec5f6dc6a947b6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:08.987742 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d72c72f90964f34bbc2232118dc5172 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:08.988726 10370 tablet_bootstrap.cc:492] T 2798f122e0624af6971fc8317244e5ae P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:08.988868 10370 ts_tablet_manager.cc:1403] T 2798f122e0624af6971fc8317244e5ae P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.143s user 0.003s sys 0.000s
I20260810 19:48:08.989882 10370 raft_consensus.cc:359] T 2798f122e0624af6971fc8317244e5ae P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.990056 10370 raft_consensus.cc:385] T 2798f122e0624af6971fc8317244e5ae P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:08.990114 10370 raft_consensus.cc:740] T 2798f122e0624af6971fc8317244e5ae P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:08.990728 10370 consensus_queue.cc:260] T 2798f122e0624af6971fc8317244e5ae P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:08.991899 10370 ts_tablet_manager.cc:1434] T 2798f122e0624af6971fc8317244e5ae P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 19:48:08.992486 10370 tablet_bootstrap.cc:492] T a45add97e0e54dce85225e175ecbb45a P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:08.998054 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a17890eaff5e43ae907d41f49b34d92f" } new_table_name: "default.Table_17da09d8f7e645d3b872f1eddb047dcc" modify_external_catalogs: true
I20260810 19:48:08.999965 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e897b6492b3e40feb25bfd4dcc970908" } new_table_name: "default.Table_aeb03a48b99a47d4be0992328d571794" modify_external_catalogs: true
I20260810 19:48:09.000519 12266 ts_tablet_manager.cc:1929] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260810 19:48:09.000959 10370 tablet_bootstrap.cc:654] T a45add97e0e54dce85225e175ecbb45a P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:09.001243 12266 log.cc:1199] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/7d93fd6556b146ca8933a6dc0a2357e8
I20260810 19:48:09.001698 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cb0193bab3543d38ec5f6dc6a947b6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:09.001825 10366 tablet_bootstrap.cc:492] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:09.001974 10366 ts_tablet_manager.cc:1403] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.420s user 0.065s sys 0.081s
I20260810 19:48:09.002413 12266 ts_tablet_manager.cc:1950] T 7d93fd6556b146ca8933a6dc0a2357e8 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:09.002810 10366 raft_consensus.cc:359] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.002995 10366 raft_consensus.cc:385] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:09.003049 10366 raft_consensus.cc:740] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:09.003263 10366 consensus_queue.cc:260] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.003793 10366 ts_tablet_manager.cc:1434] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 19:48:09.005340 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_5f2085e8097146c1a9f517a1e25fdaa4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:09.006801 9416 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 5394eadabf184158864921dd5d394828 (table default.Table_c5cc7d3e97ae4d02952905907354f9a3 [id=2d447d5da0e74e0885490174fc0f929d]). Expected version 1 got 0
I20260810 19:48:09.006765 9413 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 2798f122e0624af6971fc8317244e5ae (table default.Table_0bc47e5b3fca489388c060450b75e0f3 [id=83524cb8be1d482695223aeaaa578a13]). Expected version 1 got 0
I20260810 19:48:09.007910 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 9e37ab519ffe4791ab276a9fc0d96ead
W20260810 19:48:09.008420 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f2085e8097146c1a9f517a1e25fdaa4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:09.010902 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4472eab2daae4fa3bb3d75571f71e306" } modify_external_catalogs: true
I20260810 19:48:09.011217 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4472eab2daae4fa3bb3d75571f71e306" } modify_external_catalogs: true
I20260810 19:48:09.011402 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_d838f9cc6228427c9a67fd48d4c2d318"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:09.012034 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d838f9cc6228427c9a67fd48d4c2d318 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:09.012650 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d72c72f90964f34bbc2232118dc5172 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:09.013846 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_eb594b7df948469bb3034f8c2d03e351"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:09.014237 10370 tablet_bootstrap.cc:492] T a45add97e0e54dce85225e175ecbb45a P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:09.014468 10370 ts_tablet_manager.cc:1403] T a45add97e0e54dce85225e175ecbb45a P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.001s
I20260810 19:48:09.015043 9415 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 2798f122e0624af6971fc8317244e5ae (table default.Table_0bc47e5b3fca489388c060450b75e0f3 [id=83524cb8be1d482695223aeaaa578a13]). Expected version 1 got 0
W20260810 19:48:09.015188 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb594b7df948469bb3034f8c2d03e351 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:09.015226 10370 raft_consensus.cc:359] T a45add97e0e54dce85225e175ecbb45a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.015403 10370 raft_consensus.cc:385] T a45add97e0e54dce85225e175ecbb45a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:09.015452 10370 raft_consensus.cc:740] T a45add97e0e54dce85225e175ecbb45a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:09.015677 10370 consensus_queue.cc:260] T a45add97e0e54dce85225e175ecbb45a P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.016247 10370 ts_tablet_manager.cc:1434] T a45add97e0e54dce85225e175ecbb45a P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:09.017524 9407 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet a45add97e0e54dce85225e175ecbb45a (table default.Table_0a1a76f241a1418ba5cb63ddec738374 [id=c580a677dcab41d9892011258d5993d7]). Expected version 3 got 0
I20260810 19:48:09.018929 10370 tablet_bootstrap.cc:492] T 3582ed23ffdf4ff089952e29083e5425 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:09.020475 10370 tablet_bootstrap.cc:654] T 3582ed23ffdf4ff089952e29083e5425 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:09.021138 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e12745e4f4ed4e9d8c0af00601fa49a2" } new_table_name: "default.Table_90310d8b2bed4f8b9d5887663db44a58" modify_external_catalogs: true
I20260810 19:48:09.022378 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e37ab519ffe4791ab276a9fc0d96ead with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:09.023365 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cb0193bab3543d38ec5f6dc6a947b6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:09.026897 9407 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet a45add97e0e54dce85225e175ecbb45a (table default.Table_0a1a76f241a1418ba5cb63ddec738374 [id=c580a677dcab41d9892011258d5993d7]). Expected version 3 got 0
I20260810 19:48:09.028903 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet da807b279a8e47f3a7bb7b773c04b558 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:09.029699 12597 raft_consensus.cc:493] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:09.032263 9407 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet a45add97e0e54dce85225e175ecbb45a (table default.Table_0a1a76f241a1418ba5cb63ddec738374 [id=c580a677dcab41d9892011258d5993d7]). Expected version 3 got 0
I20260810 19:48:09.035210 10377 ts_tablet_manager.cc:1916] T 648ef608fa0c45cc8be4bad80c4200be P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:09.036152 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e37ab519ffe4791ab276a9fc0d96ead with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:09.042761 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_6fee6c03a97344f2bca65780c5a8245a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:09.043710 10375 ts_tablet_manager.cc:1929] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:09.043867 10375 log.cc:1199] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/0dd49d6fa79e4677b753b6cf9117b02d
I20260810 19:48:09.044863 10375 ts_tablet_manager.cc:1950] T 0dd49d6fa79e4677b753b6cf9117b02d P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
W20260810 19:48:09.045749 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6fee6c03a97344f2bca65780c5a8245a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:09.045795 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 813) took 2249 ms. Trace:
I20260810 19:48:09.045902 10375 rpcz_store.cc:276] 0810 19:48:06.796533 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.796641 (+ 108us) service_pool.cc:224] Handling call
0810 19:48:08.429337 (+1632696us) ts_tablet_manager.cc:1151] Deleting tablet 0dd49d6fa79e4677b753b6cf9117b02d
0810 19:48:08.429348 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:08.823422 (+394074us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:09.043630 (+220208us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:09.045768 (+ 2138us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1632357}
I20260810 19:48:09.046486 10375 tablet_replica.cc:333] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:09.046465 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 0dd49d6fa79e4677b753b6cf9117b02d (table default.Table_ebe965457d0c46a39803fb5155a0bc0c [id=11015256d39042599eae0f05e96dca2d]) successfully deleted
I20260810 19:48:09.046694 10375 raft_consensus.cc:2243] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:09.047304 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_47b3a69e4e0047e6b59c1f92cc57e4f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:09.047519 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2a0560033896430eaaafc8913343fbe7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:09.047945 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47b3a69e4e0047e6b59c1f92cc57e4f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:09.047951 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a0560033896430eaaafc8913343fbe7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:09.034197 12597 raft_consensus.cc:515] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.058212 10366 tablet_bootstrap.cc:492] T f3600d0528164850973cb296aaf6910f P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:09.060220 10366 tablet_bootstrap.cc:654] T f3600d0528164850973cb296aaf6910f P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:09.078514 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d72c72f90964f34bbc2232118dc5172 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:09.079752 10151 raft_consensus.cc:3060] T a45add97e0e54dce85225e175ecbb45a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:09.082273 10377 ts_tablet_manager.cc:1929] T 648ef608fa0c45cc8be4bad80c4200be P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 19:48:09.082880 9831 leader_election.cc:343] T 648ef608fa0c45cc8be4bad80c4200be P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 648ef608fa0c45cc8be4bad80c4200be
I20260810 19:48:09.083003 9831 leader_election.cc:304] T 648ef608fa0c45cc8be4bad80c4200be P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:09.083072 10377 log.cc:1199] T 648ef608fa0c45cc8be4bad80c4200be P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/648ef608fa0c45cc8be4bad80c4200be
W20260810 19:48:09.083577 9831 raft_consensus.cc:2686] T 648ef608fa0c45cc8be4bad80c4200be P 6986ed920dcb4af29a5eeeda6f671691: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 19:48:09.083952 12463 consensus_queue.cc:1048] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:09.084354 10377 ts_tablet_manager.cc:1950] T 648ef608fa0c45cc8be4bad80c4200be P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:09.085737 10366 tablet_bootstrap.cc:492] T f3600d0528164850973cb296aaf6910f P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
W20260810 19:48:09.085850 10068 consensus_peers.cc:597] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 63486cc3f8774a11827b1cc5f1c16332. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:09.085875 10366 ts_tablet_manager.cc:1403] T f3600d0528164850973cb296aaf6910f P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.001s
I20260810 19:48:09.086711 10366 raft_consensus.cc:359] T f3600d0528164850973cb296aaf6910f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.086881 10366 raft_consensus.cc:385] T f3600d0528164850973cb296aaf6910f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:09.086933 10366 raft_consensus.cc:740] T f3600d0528164850973cb296aaf6910f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:09.087118 10366 consensus_queue.cc:260] T f3600d0528164850973cb296aaf6910f P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.087410 10377 tablet_replica.cc:333] T 896b7cfdb0ca4904aaeafa13ff19365e P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:09.087669 10366 ts_tablet_manager.cc:1434] T f3600d0528164850973cb296aaf6910f P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 19:48:09.087952 10366 tablet_bootstrap.cc:492] T 39885c3e0adb4132945d507628f4f082 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:09.008556 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68e21d5737e84136a6fdeacb75c632e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.088326 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d857efeee4d3442ca065221e3095d421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.009080 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fce298689e9415a8860b8734d73b10a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:09.009400 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e37ab519ffe4791ab276a9fc0d96ead with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:09.020701 9665 tablet_service.cc:1558] Processing DeleteTablet for tablet 5654c48929564a96a55ed0444c9e1a04 with delete_type TABLET_DATA_DELETED (replaced by tablet e87fd882e6b6413480a0cb06aee74722) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:09.089574 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 648ef608fa0c45cc8be4bad80c4200be (table default.Table_63c36107140a41da9c5d337a853cb5d3 [id=d921f4a824ae4dd6b0b9dbb8310ff00a]) successfully deleted
I20260810 19:48:09.089329 10366 tablet_bootstrap.cc:654] T 39885c3e0adb4132945d507628f4f082 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:09.090065 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8ceb3be44e741f080358cc2bcf91219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.093705 12527 raft_consensus.cc:493] T 3bf9486839474b2a8ddff3a49b4fda2a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:09.093874 12527 raft_consensus.cc:515] T 3bf9486839474b2a8ddff3a49b4fda2a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.094444 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 100202b65e024863b9099ae7fcf73201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.094542 12527 leader_election.cc:290] T 3bf9486839474b2a8ddff3a49b4fda2a P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:09.095293 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf9486839474b2a8ddff3a49b4fda2a" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:09.096771 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf9486839474b2a8ddff3a49b4fda2a" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:09.097015 9710 raft_consensus.cc:2393] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eadde59fd6504d679e47f03a60c64bb0 in current term 1: Already voted for candidate 6986ed920dcb4af29a5eeeda6f671691 in this term.
I20260810 19:48:09.097438 10068 leader_election.cc:304] T 3bf9486839474b2a8ddff3a49b4fda2a P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:09.097949 12527 raft_consensus.cc:3060] T 3bf9486839474b2a8ddff3a49b4fda2a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:09.088140 10377 raft_consensus.cc:2243] T 896b7cfdb0ca4904aaeafa13ff19365e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:09.099128 10366 tablet_bootstrap.cc:492] T 39885c3e0adb4132945d507628f4f082 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:09.099242 10377 raft_consensus.cc:2272] T 896b7cfdb0ca4904aaeafa13ff19365e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:09.099773 10366 ts_tablet_manager.cc:1403] T 39885c3e0adb4132945d507628f4f082 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.001s
I20260810 19:48:09.100206 10377 ts_tablet_manager.cc:1916] T 896b7cfdb0ca4904aaeafa13ff19365e P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:09.100529 10366 raft_consensus.cc:359] T 39885c3e0adb4132945d507628f4f082 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.100688 10366 raft_consensus.cc:385] T 39885c3e0adb4132945d507628f4f082 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:09.100739 10366 raft_consensus.cc:740] T 39885c3e0adb4132945d507628f4f082 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:09.100724 12527 raft_consensus.cc:2749] T 3bf9486839474b2a8ddff3a49b4fda2a P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:09.100948 10366 consensus_queue.cc:260] T 39885c3e0adb4132945d507628f4f082 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.101505 10366 ts_tablet_manager.cc:1434] T 39885c3e0adb4132945d507628f4f082 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:09.101797 10366 tablet_bootstrap.cc:492] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:09.106483 10377 ts_tablet_manager.cc:1929] T 896b7cfdb0ca4904aaeafa13ff19365e P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:09.106608 10377 log.cc:1199] T 896b7cfdb0ca4904aaeafa13ff19365e P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/896b7cfdb0ca4904aaeafa13ff19365e
I20260810 19:48:09.106534 10367 tablet_bootstrap.cc:654] T 05059ef70a8e440ca2988bfeb610645d P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:09.106887 10377 ts_tablet_manager.cc:1950] T 896b7cfdb0ca4904aaeafa13ff19365e P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:09.107400 10377 tablet_replica.cc:333] T 4c75af1e592042f5a4d442b82a539c94 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:09.107539 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 896b7cfdb0ca4904aaeafa13ff19365e (table default.Table_9ae3537027a04f86aa62a86f5668fe12 [id=376702dd80dd4e91b7e35a056f4ec452]) successfully deleted
I20260810 19:48:09.107601 10377 raft_consensus.cc:2243] T 4c75af1e592042f5a4d442b82a539c94 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:09.107753 10377 raft_consensus.cc:2272] T 4c75af1e592042f5a4d442b82a539c94 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:09.108793 10367 tablet_bootstrap.cc:492] T 05059ef70a8e440ca2988bfeb610645d P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:09.108925 10367 ts_tablet_manager.cc:1403] T 05059ef70a8e440ca2988bfeb610645d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.122s user 0.003s sys 0.000s
I20260810 19:48:09.109651 10367 raft_consensus.cc:359] T 05059ef70a8e440ca2988bfeb610645d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.109822 10367 raft_consensus.cc:385] T 05059ef70a8e440ca2988bfeb610645d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:09.109879 10367 raft_consensus.cc:740] T 05059ef70a8e440ca2988bfeb610645d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:09.110118 10367 consensus_queue.cc:260] T 05059ef70a8e440ca2988bfeb610645d P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.110059 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 7d93fd6556b146ca8933a6dc0a2357e8 (table default.Table_92979ca12b07474b8e621122d23568a7 [id=de4d62ebb8c440a1a71ed57ac4f3c530]) successfully deleted
I20260810 19:48:09.110682 10367 ts_tablet_manager.cc:1434] T 05059ef70a8e440ca2988bfeb610645d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:09.110965 10367 tablet_bootstrap.cc:492] T 81aabb5656e7472f9223fd7acf10e43c P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:09.112457 10367 tablet_bootstrap.cc:654] T 81aabb5656e7472f9223fd7acf10e43c P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:09.112767 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68916e2568f4527a181342cdc728001" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:09.113152 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68916e2568f4527a181342cdc728001" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:09.113330 9710 raft_consensus.cc:2468] T e68916e2568f4527a181342cdc728001 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:09.114964 10377 ts_tablet_manager.cc:1916] T 4c75af1e592042f5a4d442b82a539c94 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:09.115540 9669 tablet_service.cc:1511] Processing CreateTablet for tablet dee05338a75f43be8eb2546d06dd8068 (DEFAULT_TABLE table=default.Table_361836440e714f89b85618c3ec886efa [id=54f257a8ae8546b9b86153a0831c469b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.115949 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dee05338a75f43be8eb2546d06dd8068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.116284 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 041844571695425eb6de69d251dffcf0 (DEFAULT_TABLE table=default.Table_3e78e13c8ecc464eb6af12a2bc3f2eba [id=1af2d06c44b643e28d28bb080cd5eef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.116632 10366 tablet_bootstrap.cc:654] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:09.116632 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 041844571695425eb6de69d251dffcf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.118681 10367 tablet_bootstrap.cc:492] T 81aabb5656e7472f9223fd7acf10e43c P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:09.118815 10367 ts_tablet_manager.cc:1403] T 81aabb5656e7472f9223fd7acf10e43c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260810 19:48:09.119187 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 6d9a7b19ea944e73b38e56a240650dbf (DEFAULT_TABLE table=default.Table_56f3340c93684c45bacea55059a03455 [id=d84d28101464475882b819bf878566f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.119606 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d9a7b19ea944e73b38e56a240650dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.119522 10367 raft_consensus.cc:359] T 81aabb5656e7472f9223fd7acf10e43c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.119683 10367 raft_consensus.cc:385] T 81aabb5656e7472f9223fd7acf10e43c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:09.119727 10367 raft_consensus.cc:740] T 81aabb5656e7472f9223fd7acf10e43c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:09.122532 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8ceb3be44e741f080358cc2bcf91219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.122656 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 3800b7ac3ec0421ebc0404ce50cc12bd (DEFAULT_TABLE table=default.Table_8a282f3711fd421e8bc72d1d4f182b41 [id=b2804eab493a42a7ab199c1aad4c0a62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.123095 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3800b7ac3ec0421ebc0404ce50cc12bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.127806 9665 tablet_service.cc:1511] Processing CreateTablet for tablet 6d9a7b19ea944e73b38e56a240650dbf (DEFAULT_TABLE table=default.Table_56f3340c93684c45bacea55059a03455 [id=d84d28101464475882b819bf878566f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.128294 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d9a7b19ea944e73b38e56a240650dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.112648 12597 leader_election.cc:290] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:09.113591 9830 leader_election.cc:343] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:09.131162 9831 leader_election.cc:304] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:09.131615 12463 raft_consensus.cc:2804] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:09.131700 12463 raft_consensus.cc:493] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:09.131779 12463 raft_consensus.cc:3060] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:09.132498 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 89f3e57177014d6999ecf02eb2c07e8a consensus state has no leader
I20260810 19:48:09.134176 9418 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet e68916e2568f4527a181342cdc728001 (table default.Table_3e7715bf0f8c41e3bd4964a0f918c9ea [id=3babf53bc29e4d4f9be8b2c19be6e2bd]). Expected version 2 got 0
I20260810 19:48:09.134708 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 3800b7ac3ec0421ebc0404ce50cc12bd (DEFAULT_TABLE table=default.Table_8a282f3711fd421e8bc72d1d4f182b41 [id=b2804eab493a42a7ab199c1aad4c0a62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.135075 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e337292d09af43c7877689c7d13490de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:09.135532 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3800b7ac3ec0421ebc0404ce50cc12bd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:09.135690 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e337292d09af43c7877689c7d13490de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:09.137033 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cef05a75108049aeba6eb1ef44d64f33 consensus state has no leader
I20260810 19:48:09.137405 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a49e1248aac4485dbe3017d35ed27b9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:09.138023 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a49e1248aac4485dbe3017d35ed27b9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:09.138629 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 6d9a7b19ea944e73b38e56a240650dbf (DEFAULT_TABLE table=default.Table_56f3340c93684c45bacea55059a03455 [id=d84d28101464475882b819bf878566f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.139034 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d9a7b19ea944e73b38e56a240650dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.139009 10367 consensus_queue.cc:260] T 81aabb5656e7472f9223fd7acf10e43c P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.139569 10367 ts_tablet_manager.cc:1434] T 81aabb5656e7472f9223fd7acf10e43c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.021s user 0.001s sys 0.000s
I20260810 19:48:09.139849 10367 tablet_bootstrap.cc:492] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:09.141269 10367 tablet_bootstrap.cc:654] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:09.143258 12463 raft_consensus.cc:515] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.143980 12463 leader_election.cc:290] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:09.145385 10366 tablet_bootstrap.cc:492] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:09.145517 10366 ts_tablet_manager.cc:1403] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.000s
I20260810 19:48:09.147827 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_900335c602834059af9add51cc89f115"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:09.148437 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_900335c602834059af9add51cc89f115 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:09.149242 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 3b9f29803809462a9b8b64b03eed040b
W20260810 19:48:09.150233 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1063ea2fb28843f58b8c891e3b899c1e consensus state has no leader
I20260810 19:48:09.152020 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68916e2568f4527a181342cdc728001" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:09.151999 10366 raft_consensus.cc:359] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.152186 10366 raft_consensus.cc:385] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:09.152251 10366 raft_consensus.cc:740] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:09.152468 10366 consensus_queue.cc:260] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:09.152696 9830 consensus_peers.cc:597] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:09.153228 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b9f29803809462a9b8b64b03eed040b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:09.153251 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68916e2568f4527a181342cdc728001" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:09.153719 9420 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet e68916e2568f4527a181342cdc728001 (table default.Table_3e7715bf0f8c41e3bd4964a0f918c9ea [id=3babf53bc29e4d4f9be8b2c19be6e2bd]). Expected version 2 got 0
I20260810 19:48:09.153981 9420 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet a45add97e0e54dce85225e175ecbb45a (table default.Table_0a1a76f241a1418ba5cb63ddec738374 [id=c580a677dcab41d9892011258d5993d7]). Expected version 3 got 0
I20260810 19:48:09.155727 9412 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 2798f122e0624af6971fc8317244e5ae (table default.Table_0bc47e5b3fca489388c060450b75e0f3 [id=83524cb8be1d482695223aeaaa578a13]). Expected version 1 got 0
I20260810 19:48:09.155980 10366 ts_tablet_manager.cc:1434] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260810 19:48:09.156291 10366 tablet_bootstrap.cc:492] T 839dcdb448d14a8f8e452145ccf41263 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
W20260810 19:48:09.158569 9830 leader_election.cc:343] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:09.158776 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet f3600d0528164850973cb296aaf6910f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:09.158871 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet 39885c3e0adb4132945d507628f4f082 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:09.161988 10144 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b9f29803809462a9b8b64b03eed040b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:09.162617 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 041844571695425eb6de69d251dffcf0 (DEFAULT_TABLE table=default.Table_3e78e13c8ecc464eb6af12a2bc3f2eba [id=1af2d06c44b643e28d28bb080cd5eef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.163163 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 041844571695425eb6de69d251dffcf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.164016 9420 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 81aabb5656e7472f9223fd7acf10e43c (table default.Table_3c331b2bd94d4303a3de78c1369771bc [id=f9a169cfd328466b908bc057a70a9668]). Expected version 2 got 0
I20260810 19:48:09.152282 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b9f29803809462a9b8b64b03eed040b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:09.165277 9715 raft_consensus.cc:3060] T e68916e2568f4527a181342cdc728001 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:09.166088 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 05059ef70a8e440ca2988bfeb610645d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:09.168103 9715 raft_consensus.cc:2468] T e68916e2568f4527a181342cdc728001 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:09.168571 9831 leader_election.cc:304] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:09.168965 11897 raft_consensus.cc:2804] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:09.169085 11897 raft_consensus.cc:697] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:09.169158 10366 tablet_bootstrap.cc:654] T 839dcdb448d14a8f8e452145ccf41263 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:09.169332 11897 consensus_queue.cc:237] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.170414 10375 pending_rounds.cc:70] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:09.170565 10375 pending_rounds.cc:77] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058707015528448 op_type: NO_OP noop_request { }
I20260810 19:48:09.170683 10375 raft_consensus.cc:2889] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:09.170775 10375 raft_consensus.cc:2272] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:09.171398 10375 ts_tablet_manager.cc:1916] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:09.174206 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet f42e9b00e3da4d73b4beb1b325f09f4a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f42e9b00e3da4d73b4beb1b325f09f4a already in progress: creating tablet
W20260810 19:48:09.175094 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 1a615a32f94949179de8e8ee8a444576 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a615a32f94949179de8e8ee8a444576 already in progress: creating tablet
W20260810 19:48:09.175844 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet da807b279a8e47f3a7bb7b773c04b558 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da807b279a8e47f3a7bb7b773c04b558 already in progress: creating tablet
W20260810 19:48:09.176491 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 1cb0193bab3543d38ec5f6dc6a947b6e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1cb0193bab3543d38ec5f6dc6a947b6e already in progress: creating tablet
I20260810 19:48:09.178840 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2027bd0223534a0ca3dd111a68b7e6cb" } modify_external_catalogs: true
I20260810 19:48:09.179059 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2027bd0223534a0ca3dd111a68b7e6cb" } modify_external_catalogs: true
I20260810 19:48:09.180572 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ddcd4e092322448382923cf180ac286a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:09.181192 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ddcd4e092322448382923cf180ac286a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:09.182875 10068 consensus_peers.cc:597] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ae3e151180ae4d258d18365770acaaad. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:09.184842 9420 master_service.cc:960] ReplaceTablet: received request to replace tablet 224bce6be88842c0a26df57326f34442 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:09.186667 10377 ts_tablet_manager.cc:1929] T 4c75af1e592042f5a4d442b82a539c94 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:09.195326 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 041844571695425eb6de69d251dffcf0 (DEFAULT_TABLE table=default.Table_3e78e13c8ecc464eb6af12a2bc3f2eba [id=1af2d06c44b643e28d28bb080cd5eef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.195968 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 041844571695425eb6de69d251dffcf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.197899 10377 log.cc:1199] T 4c75af1e592042f5a4d442b82a539c94 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/4c75af1e592042f5a4d442b82a539c94
I20260810 19:48:09.198449 12407 raft_consensus.cc:493] T 05059ef70a8e440ca2988bfeb610645d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:09.198534 10377 ts_tablet_manager.cc:1950] T 4c75af1e592042f5a4d442b82a539c94 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:09.198611 12407 raft_consensus.cc:515] T 05059ef70a8e440ca2988bfeb610645d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.199059 10377 tablet_replica.cc:333] T 3582ed23ffdf4ff089952e29083e5425 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:09.199280 10377 raft_consensus.cc:2243] T 3582ed23ffdf4ff089952e29083e5425 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:09.199290 12407 leader_election.cc:290] T 05059ef70a8e440ca2988bfeb610645d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:09.199570 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_527eab54be8245589580b409f997f44c" } new_table_name: "default.Table_27a6a78e4c8a45e48980dc24640fc4e7" modify_external_catalogs: true
I20260810 19:48:09.200438 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b40fd0d57ea4b71aeef2d66f4958ac8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:09.201192 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 2e0ca51bb8664f53b1c8ec2ad324c0e4 (DEFAULT_TABLE table=default.Table_0b279a130f3c4984abe5bacf80bac674 [id=ca6494aabe46476293aa4bf48e593e7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.201308 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 3800b7ac3ec0421ebc0404ce50cc12bd (DEFAULT_TABLE table=default.Table_8a282f3711fd421e8bc72d1d4f182b41 [id=b2804eab493a42a7ab199c1aad4c0a62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.201676 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e0ca51bb8664f53b1c8ec2ad324c0e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.201761 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3800b7ac3ec0421ebc0404ce50cc12bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.203100 12667 tablet.cc:1724] T 2798f122e0624af6971fc8317244e5ae P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:09.203589 12407 raft_consensus.cc:493] T 5654c48929564a96a55ed0444c9e1a04 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:09.203717 12407 raft_consensus.cc:515] T 5654c48929564a96a55ed0444c9e1a04 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.204341 12407 leader_election.cc:290] T 5654c48929564a96a55ed0444c9e1a04 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:09.204311 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05059ef70a8e440ca2988bfeb610645d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:09.204131 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 2d72c72f90964f34bbc2232118dc5172 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d72c72f90964f34bbc2232118dc5172 already in progress: creating tablet
W20260810 19:48:09.204917 9611 leader_election.cc:343] T 05059ef70a8e440ca2988bfeb610645d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:09.210562 10377 raft_consensus.cc:2272] T 3582ed23ffdf4ff089952e29083e5425 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:09.211256 10377 ts_tablet_manager.cc:1916] T 3582ed23ffdf4ff089952e29083e5425 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:09.215579 12266 tablet_replica.cc:333] T 8fce298689e9415a8860b8734d73b10a P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:09.215879 12266 raft_consensus.cc:2243] T 8fce298689e9415a8860b8734d73b10a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:09.216117 12266 raft_consensus.cc:2272] T 8fce298689e9415a8860b8734d73b10a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:09.222062 9415 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet a45add97e0e54dce85225e175ecbb45a (table default.Table_0a1a76f241a1418ba5cb63ddec738374 [id=c580a677dcab41d9892011258d5993d7]). Expected version 3 got 0
I20260810 19:48:09.224429 9415 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 2798f122e0624af6971fc8317244e5ae (table default.Table_0bc47e5b3fca489388c060450b75e0f3 [id=83524cb8be1d482695223aeaaa578a13]). Expected version 1 got 0
I20260810 19:48:09.226106 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e3cc34ea975e4aba9c86b3ddd40060af" } modify_external_catalogs: true
I20260810 19:48:09.226367 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e3cc34ea975e4aba9c86b3ddd40060af" } modify_external_catalogs: true
I20260810 19:48:09.232383 9421 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet a45add97e0e54dce85225e175ecbb45a (table default.Table_0a1a76f241a1418ba5cb63ddec738374 [id=c580a677dcab41d9892011258d5993d7]). Expected version 3 got 0
I20260810 19:48:09.233382 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_24f01441a6eb478e88b5144c56003edb" } modify_external_catalogs: true
I20260810 19:48:09.233601 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_24f01441a6eb478e88b5144c56003edb" } modify_external_catalogs: true
I20260810 19:48:09.236918 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 2e0ca51bb8664f53b1c8ec2ad324c0e4 (DEFAULT_TABLE table=default.Table_0b279a130f3c4984abe5bacf80bac674 [id=ca6494aabe46476293aa4bf48e593e7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.237453 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e0ca51bb8664f53b1c8ec2ad324c0e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.237649 9675 tablet_service.cc:1511] Processing CreateTablet for tablet bef956a173084e7698a37dddc574ea65 (DEFAULT_TABLE table=default.Table_b46992ec81974f6caad1ea769640dcf1 [id=d6d2d95e5e9f4e10a7d5a8153e66e4b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.238086 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bef956a173084e7698a37dddc574ea65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.254565 9665 tablet_service.cc:1511] Processing CreateTablet for tablet 978695f755c9493db750d81a0c4680f5 (DEFAULT_TABLE table=default.Table_99130c853a87452b82439a60971c2d1b [id=a61b27909b65459793d63e8c8bae4d58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.255756 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 978695f755c9493db750d81a0c4680f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.260123 10367 tablet_bootstrap.cc:492] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:09.262781 9664 tablet_service.cc:1511] Processing CreateTablet for tablet ff5f6f11d153478e958321e82423b5b1 (DEFAULT_TABLE table=default.Table_e63fa9c3c1be48f7b248cea033e5f5f5 [id=2c13b616a8de46999ff7878f5567a255]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.266986 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5f6f11d153478e958321e82423b5b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.260308 10367 ts_tablet_manager.cc:1403] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.121s user 0.008s sys 0.003s
I20260810 19:48:09.275121 10367 raft_consensus.cc:359] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.275446 10367 raft_consensus.cc:385] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:09.275548 10367 raft_consensus.cc:740] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:09.275884 10367 consensus_queue.cc:260] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.276659 10367 ts_tablet_manager.cc:1434] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:09.279188 10367 tablet_bootstrap.cc:492] T 6ea318eddd8349a79d27ce5746f03798 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:09.280864 10367 tablet_bootstrap.cc:654] T 6ea318eddd8349a79d27ce5746f03798 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:09.284684 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_99130c853a87452b82439a60971c2d1b" } new_table_name: "default.Table_c99b8dcecc604805abab5632c6a9a490" modify_external_catalogs: true
I20260810 19:48:09.285185 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 155b48f454e74ca9bb7007f584231a37
I20260810 19:48:09.285606 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 224bce6be88842c0a26df57326f34442
I20260810 19:48:09.288101 9420 catalog_manager.cc:6807] ReplaceTablet: tablet 224bce6be88842c0a26df57326f34442 deleted and replaced by tablet 34fb654d56f249c8a0353c495802250b
W20260810 19:48:09.285933 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5c992f9cb33843ad88556517b280912f consensus state has no leader
I20260810 19:48:09.285604 9408 master_service.cc:960] ReplaceTablet: received request to replace tablet d6f410a1659c40f08ac274e63ad01b3d from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:09.286146 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 9ae6d231840342fb8bb3493d0525c95b
I20260810 19:48:09.286628 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_bb5a9a9ebfd340fba882f6db00cf2dac" } modify_external_catalogs: true
I20260810 19:48:09.290686 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_bb5a9a9ebfd340fba882f6db00cf2dac" } modify_external_catalogs: true
I20260810 19:48:09.299767 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 224bce6be88842c0a26df57326f34442 with delete_type TABLET_DATA_DELETED (replaced by tablet 34fb654d56f249c8a0353c495802250b) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:09.300096 10367 tablet_bootstrap.cc:492] T 6ea318eddd8349a79d27ce5746f03798 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:09.300311 10367 ts_tablet_manager.cc:1403] T 6ea318eddd8349a79d27ce5746f03798 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.001s
I20260810 19:48:09.301102 10367 raft_consensus.cc:359] T 6ea318eddd8349a79d27ce5746f03798 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.301385 10367 raft_consensus.cc:385] T 6ea318eddd8349a79d27ce5746f03798 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:09.301750 10367 raft_consensus.cc:740] T 6ea318eddd8349a79d27ce5746f03798 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:09.302299 10367 consensus_queue.cc:260] T 6ea318eddd8349a79d27ce5746f03798 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.303124 10367 ts_tablet_manager.cc:1434] T 6ea318eddd8349a79d27ce5746f03798 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260810 19:48:09.303783 10367 tablet_bootstrap.cc:492] T 64470598ccec45a7ae3e3c77fe4b9518 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:09.306522 10367 tablet_bootstrap.cc:654] T 64470598ccec45a7ae3e3c77fe4b9518 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:09.307799 9398 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet f146f440c1174d348ed273d29145e815 (table default.Table_2845bb7ac75a49d99483ac3cf7d96171 [id=fd632e7e6cd4416d992f41a2681f4c6a], current schema version=4) failed: Not found: failed to reset TS proxy: No leader found: Tablet f146f440c1174d348ed273d29145e815 consensus state has no leader
I20260810 19:48:09.308285 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet 155b48f454e74ca9bb7007f584231a37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:09.323065 10377 ts_tablet_manager.cc:1929] T 3582ed23ffdf4ff089952e29083e5425 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:09.323232 10377 log.cc:1199] T 3582ed23ffdf4ff089952e29083e5425 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/3582ed23ffdf4ff089952e29083e5425
I20260810 19:48:09.323220 12597 consensus_queue.cc:1048] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:09.325173 10367 tablet_bootstrap.cc:492] T 64470598ccec45a7ae3e3c77fe4b9518 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:09.325351 10367 ts_tablet_manager.cc:1403] T 64470598ccec45a7ae3e3c77fe4b9518 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.003s
I20260810 19:48:09.326238 10367 raft_consensus.cc:359] T 64470598ccec45a7ae3e3c77fe4b9518 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.326452 10367 raft_consensus.cc:385] T 64470598ccec45a7ae3e3c77fe4b9518 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:09.326500 10367 raft_consensus.cc:740] T 64470598ccec45a7ae3e3c77fe4b9518 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:09.326701 10367 consensus_queue.cc:260] T 64470598ccec45a7ae3e3c77fe4b9518 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.327208 10367 ts_tablet_manager.cc:1434] T 64470598ccec45a7ae3e3c77fe4b9518 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:09.327510 10367 tablet_bootstrap.cc:492] T f6f9eb86c6c84b4a84d109d4741238e1 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:09.333984 10367 tablet_bootstrap.cc:654] T f6f9eb86c6c84b4a84d109d4741238e1 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:09.214465 9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5654c48929564a96a55ed0444c9e1a04" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:09.335933 9611 leader_election.cc:343] T 5654c48929564a96a55ed0444c9e1a04 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:09.347111 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_73a9257f3a444ce6a1e35cf5b4cddbd9" } new_table_name: "default.Table_99d4dfcac15d4d91b42b2a250bd58fc8" modify_external_catalogs: true
I20260810 19:48:09.348886 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6d1b8db821cb42e987c905dc22630abc" } new_table_name: "default.Table_49874ce88a0c4acdaa34f448fe452b06" modify_external_catalogs: true
I20260810 19:48:09.352072 10367 tablet_bootstrap.cc:492] T f6f9eb86c6c84b4a84d109d4741238e1 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:09.352248 10367 ts_tablet_manager.cc:1403] T f6f9eb86c6c84b4a84d109d4741238e1 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.025s user 0.010s sys 0.002s
I20260810 19:48:09.353075 10367 raft_consensus.cc:359] T f6f9eb86c6c84b4a84d109d4741238e1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.353276 10367 raft_consensus.cc:385] T f6f9eb86c6c84b4a84d109d4741238e1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:09.353328 10367 raft_consensus.cc:740] T f6f9eb86c6c84b4a84d109d4741238e1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:09.353559 10367 consensus_queue.cc:260] T f6f9eb86c6c84b4a84d109d4741238e1 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.354070 10367 ts_tablet_manager.cc:1434] T f6f9eb86c6c84b4a84d109d4741238e1 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:09.354424 10367 tablet_bootstrap.cc:492] T 444b49a69c8245b6944a76d53041154c P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:09.356259 10367 tablet_bootstrap.cc:654] T 444b49a69c8245b6944a76d53041154c P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:09.358955 10377 ts_tablet_manager.cc:1950] T 3582ed23ffdf4ff089952e29083e5425 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:09.360337 10377 tablet_replica.cc:333] T f3600d0528164850973cb296aaf6910f P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:09.360572 10377 raft_consensus.cc:2243] T f3600d0528164850973cb296aaf6910f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:09.360466 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_10470b028a754435980ba9eb9ccce17f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:09.360740 10377 raft_consensus.cc:2272] T f3600d0528164850973cb296aaf6910f P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:09.361116 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10470b028a754435980ba9eb9ccce17f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:09.362160 10377 ts_tablet_manager.cc:1916] T f3600d0528164850973cb296aaf6910f P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:09.362640 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_bd99f8533af7419086a1ae12068ad426" } modify_external_catalogs: true
I20260810 19:48:09.362872 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_bd99f8533af7419086a1ae12068ad426" } modify_external_catalogs: true
I20260810 19:48:09.364363 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a28fa71d285e4fde898d3502384445e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:09.364719 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ae6d231840342fb8bb3493d0525c95b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:09.364959 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a28fa71d285e4fde898d3502384445e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:09.366508 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f7443dd3f2454ff39faa8eba8fbbb53c" } new_table_name: "default.Table_4d107d4bc3e54048b0109bcb4f5cb9f1" modify_external_catalogs: true
I20260810 19:48:09.367363 12664 tablet.cc:1724] T 2798f122e0624af6971fc8317244e5ae P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:09.370196 10367 tablet_bootstrap.cc:492] T 444b49a69c8245b6944a76d53041154c P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:09.370436 10367 ts_tablet_manager.cc:1403] T 444b49a69c8245b6944a76d53041154c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.002s
I20260810 19:48:09.371495 10367 raft_consensus.cc:359] T 444b49a69c8245b6944a76d53041154c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.371735 10367 raft_consensus.cc:385] T 444b49a69c8245b6944a76d53041154c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:09.371827 10367 raft_consensus.cc:740] T 444b49a69c8245b6944a76d53041154c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:09.372126 10367 consensus_queue.cc:260] T 444b49a69c8245b6944a76d53041154c P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.372690 10367 ts_tablet_manager.cc:1434] T 444b49a69c8245b6944a76d53041154c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:09.373016 10367 tablet_bootstrap.cc:492] T 3680db3f1a5945a89c1198eb4849e58c P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:09.374853 10367 tablet_bootstrap.cc:654] T 3680db3f1a5945a89c1198eb4849e58c P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:09.385861 10367 tablet_bootstrap.cc:492] T 3680db3f1a5945a89c1198eb4849e58c P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:09.386109 10367 ts_tablet_manager.cc:1403] T 3680db3f1a5945a89c1198eb4849e58c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.003s
I20260810 19:48:09.386960 10367 raft_consensus.cc:359] T 3680db3f1a5945a89c1198eb4849e58c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.387220 10367 raft_consensus.cc:385] T 3680db3f1a5945a89c1198eb4849e58c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:09.387338 10367 raft_consensus.cc:740] T 3680db3f1a5945a89c1198eb4849e58c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:09.387598 10367 consensus_queue.cc:260] T 3680db3f1a5945a89c1198eb4849e58c P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.388137 10367 ts_tablet_manager.cc:1434] T 3680db3f1a5945a89c1198eb4849e58c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260810 19:48:09.388475 10367 tablet_bootstrap.cc:492] T 253f302c00cc42ff84076b0c17f7670a P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:09.390174 10367 tablet_bootstrap.cc:654] T 253f302c00cc42ff84076b0c17f7670a P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:09.203404 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05059ef70a8e440ca2988bfeb610645d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:09.205466 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5654c48929564a96a55ed0444c9e1a04" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:09.261973 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 978695f755c9493db750d81a0c4680f5 (DEFAULT_TABLE table=default.Table_99130c853a87452b82439a60971c2d1b [id=a61b27909b65459793d63e8c8bae4d58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.394910 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 978695f755c9493db750d81a0c4680f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.397341 12407 raft_consensus.cc:493] T f6f9eb86c6c84b4a84d109d4741238e1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:09.397486 12407 raft_consensus.cc:515] T f6f9eb86c6c84b4a84d109d4741238e1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.398172 12407 leader_election.cc:290] T f6f9eb86c6c84b4a84d109d4741238e1 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:09.263319 10137 tablet_service.cc:1511] Processing CreateTablet for tablet bef956a173084e7698a37dddc574ea65 (DEFAULT_TABLE table=default.Table_b46992ec81974f6caad1ea769640dcf1 [id=d6d2d95e5e9f4e10a7d5a8153e66e4b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.291419 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet 155b48f454e74ca9bb7007f584231a37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:09.291947 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet 224bce6be88842c0a26df57326f34442 with delete_type TABLET_DATA_DELETED (replaced by tablet 34fb654d56f249c8a0353c495802250b) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:09.292414 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ae6d231840342fb8bb3493d0525c95b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:09.371244 10067 consensus_peers.cc:597] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dcb3660108094399b36d19ea8e6b8308. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:09.399222 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bef956a173084e7698a37dddc574ea65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.399134 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f9eb86c6c84b4a84d109d4741238e1" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:09.400684 9611 leader_election.cc:343] T f6f9eb86c6c84b4a84d109d4741238e1 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:09.402901 12266 ts_tablet_manager.cc:1916] T 8fce298689e9415a8860b8734d73b10a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:09.404647 10367 tablet_bootstrap.cc:492] T 253f302c00cc42ff84076b0c17f7670a P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:09.404815 10367 ts_tablet_manager.cc:1403] T 253f302c00cc42ff84076b0c17f7670a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.005s
I20260810 19:48:09.405530 10367 raft_consensus.cc:359] T 253f302c00cc42ff84076b0c17f7670a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.405694 10367 raft_consensus.cc:385] T 253f302c00cc42ff84076b0c17f7670a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:09.405756 10367 raft_consensus.cc:740] T 253f302c00cc42ff84076b0c17f7670a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:09.405995 10367 consensus_queue.cc:260] T 253f302c00cc42ff84076b0c17f7670a P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.406612 10367 ts_tablet_manager.cc:1434] T 253f302c00cc42ff84076b0c17f7670a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:09.406924 10367 tablet_bootstrap.cc:492] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:09.410792 10377 ts_tablet_manager.cc:1929] T f3600d0528164850973cb296aaf6910f P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:09.410928 10377 log.cc:1199] T f3600d0528164850973cb296aaf6910f P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/f3600d0528164850973cb296aaf6910f
I20260810 19:48:09.411262 10377 ts_tablet_manager.cc:1950] T f3600d0528164850973cb296aaf6910f P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:09.411739 10377 tablet_replica.cc:333] T 39885c3e0adb4132945d507628f4f082 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:09.413738 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet d6f410a1659c40f08ac274e63ad01b3d
I20260810 19:48:09.411942 10377 raft_consensus.cc:2243] T 39885c3e0adb4132945d507628f4f082 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:09.414244 9408 catalog_manager.cc:6807] ReplaceTablet: tablet d6f410a1659c40f08ac274e63ad01b3d deleted and replaced by tablet 60798f21222443c69bacf4a799a33c8f
I20260810 19:48:09.414276 10377 raft_consensus.cc:2272] T 39885c3e0adb4132945d507628f4f082 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:09.414958 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet d6f410a1659c40f08ac274e63ad01b3d with delete_type TABLET_DATA_DELETED (replaced by tablet 60798f21222443c69bacf4a799a33c8f) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:09.416574 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 978695f755c9493db750d81a0c4680f5 consensus state has no leader
I20260810 19:48:09.417042 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_515f62a16a5945a7bced9e1a802a0a49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:09.417763 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_515f62a16a5945a7bced9e1a802a0a49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:09.423188 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet c285518ed49d4ed68a6039f98db3b700
I20260810 19:48:09.424281 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet c285518ed49d4ed68a6039f98db3b700 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:09.425863 9830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.195:43797, user_credentials={real_user=slave}} blocked reactor thread for 240209us
I20260810 19:48:09.426745 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 4c75af1e592042f5a4d442b82a539c94 (table default.Table_b15ce9ec2404408f8f8e74743a8cce0d [id=d26dfd722c9448a0a299198ccf217edc]) successfully deleted
I20260810 19:48:09.427246 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_09dc7c9d841f4f87a4451a93337fc43a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:09.427922 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09dc7c9d841f4f87a4451a93337fc43a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:09.428524 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet fb7364664adb424384f6b646d9e423eb
I20260810 19:48:09.372193 10139 tablet_service.cc:1511] Processing CreateTablet for tablet ff5f6f11d153478e958321e82423b5b1 (DEFAULT_TABLE table=default.Table_e63fa9c3c1be48f7b248cea033e5f5f5 [id=2c13b616a8de46999ff7878f5567a255]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:09.389496 10068 consensus_peers.cc:597] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dcb3660108094399b36d19ea8e6b8308. This is attempt 1: this message will repeat every 5th retry.
W20260810 19:48:09.430298 9611 leader_election.cc:343] T 05059ef70a8e440ca2988bfeb610645d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:09.430493 9611 leader_election.cc:304] T 05059ef70a8e440ca2988bfeb610645d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:09.430779 12407 raft_consensus.cc:2749] T 05059ef70a8e440ca2988bfeb610645d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:09.430925 9611 leader_election.cc:343] T 5654c48929564a96a55ed0444c9e1a04 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:09.431026 9611 leader_election.cc:304] T 5654c48929564a96a55ed0444c9e1a04 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:09.431514 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f9eb86c6c84b4a84d109d4741238e1" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:09.431983 12407 raft_consensus.cc:2749] T 5654c48929564a96a55ed0444c9e1a04 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:09.432448 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ea8b681a37ff4a1596ff78f93ef12192"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:09.433225 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea8b681a37ff4a1596ff78f93ef12192 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:09.434486 9611 leader_election.cc:343] T f6f9eb86c6c84b4a84d109d4741238e1 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:09.434618 9611 leader_election.cc:304] T f6f9eb86c6c84b4a84d109d4741238e1 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:09.438905 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet d6f410a1659c40f08ac274e63ad01b3d with delete_type TABLET_DATA_DELETED (replaced by tablet 60798f21222443c69bacf4a799a33c8f) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:09.439937 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5f6f11d153478e958321e82423b5b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.440217 10367 tablet_bootstrap.cc:654] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:09.441639 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet c285518ed49d4ed68a6039f98db3b700 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:09.442283 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet fb7364664adb424384f6b646d9e423eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:09.390666 10115 tablet_service.cc:1511] Processing CreateTablet for tablet dee05338a75f43be8eb2546d06dd8068 (DEFAULT_TABLE table=default.Table_361836440e714f89b85618c3ec886efa [id=54f257a8ae8546b9b86153a0831c469b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.448712 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 3582ed23ffdf4ff089952e29083e5425 (table default.Table_4fb96dbc73be4091855b1cbbed3b9ce6 [id=c72c64a09f73486abc4b2c6a72271d57]) successfully deleted
W20260810 19:48:09.449139 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 1a615a32f94949179de8e8ee8a444576 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a615a32f94949179de8e8ee8a444576 already in progress: creating tablet
W20260810 19:48:09.449517 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 1cb0193bab3543d38ec5f6dc6a947b6e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1cb0193bab3543d38ec5f6dc6a947b6e already in progress: creating tablet
W20260810 19:48:09.449826 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet da807b279a8e47f3a7bb7b773c04b558 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da807b279a8e47f3a7bb7b773c04b558 already in progress: creating tablet
W20260810 19:48:09.450101 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 9e37ab519ffe4791ab276a9fc0d96ead because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e37ab519ffe4791ab276a9fc0d96ead already in progress: creating tablet
W20260810 19:48:09.450451 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 2d72c72f90964f34bbc2232118dc5172 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d72c72f90964f34bbc2232118dc5172 already in progress: creating tablet
W20260810 19:48:09.450788 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 3b9f29803809462a9b8b64b03eed040b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b9f29803809462a9b8b64b03eed040b already in progress: creating tablet
I20260810 19:48:09.451834 10370 tablet_bootstrap.cc:492] T 3582ed23ffdf4ff089952e29083e5425 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:09.452067 10370 ts_tablet_manager.cc:1403] T 3582ed23ffdf4ff089952e29083e5425 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.433s user 0.021s sys 0.028s
I20260810 19:48:09.452957 10370 raft_consensus.cc:359] T 3582ed23ffdf4ff089952e29083e5425 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.454917 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet f3600d0528164850973cb296aaf6910f (table default.Table_a02900865d894a1dbfdb42b50ca8ebbf [id=d772b7f40fc3470ebbfe9442d8c44185]) successfully deleted
I20260810 19:48:09.456434 10366 tablet_bootstrap.cc:492] T 839dcdb448d14a8f8e452145ccf41263 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:09.456652 10366 ts_tablet_manager.cc:1403] T 839dcdb448d14a8f8e452145ccf41263 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.300s user 0.001s sys 0.025s
I20260810 19:48:09.457593 10370 raft_consensus.cc:385] T 3582ed23ffdf4ff089952e29083e5425 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:09.457791 12695 raft_consensus.cc:2749] T f6f9eb86c6c84b4a84d109d4741238e1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:09.458055 10370 raft_consensus.cc:740] T 3582ed23ffdf4ff089952e29083e5425 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
W20260810 19:48:09.458914 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 264a65bd642648e59998fb55fb3c8de1 consensus state has no leader
I20260810 19:48:09.460029 10377 ts_tablet_manager.cc:1916] T 39885c3e0adb4132945d507628f4f082 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:09.461035 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 34fb654d56f249c8a0353c495802250b has no consensus state
I20260810 19:48:09.461333 9420 master_service.cc:960] ReplaceTablet: received request to replace tablet 0df786b887de4d7dbf1881e4944e3b68 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:09.461993 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet fb7b722c43ee4b8698b19b2b6c1b401d
I20260810 19:48:09.462438 10370 consensus_queue.cc:260] T 3582ed23ffdf4ff089952e29083e5425 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:09.462775 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9f01a22232504d80a827e3d1ea0452a3 consensus state has no leader
I20260810 19:48:09.468904 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 2e0ca51bb8664f53b1c8ec2ad324c0e4 (DEFAULT_TABLE table=default.Table_0b279a130f3c4984abe5bacf80bac674 [id=ca6494aabe46476293aa4bf48e593e7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.469395 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e0ca51bb8664f53b1c8ec2ad324c0e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.473845 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet fb7b722c43ee4b8698b19b2b6c1b401d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:09.475081 10366 raft_consensus.cc:359] T 839dcdb448d14a8f8e452145ccf41263 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.475267 10366 raft_consensus.cc:385] T 839dcdb448d14a8f8e452145ccf41263 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:09.475324 10366 raft_consensus.cc:740] T 839dcdb448d14a8f8e452145ccf41263 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:09.475513 10366 consensus_queue.cc:260] T 839dcdb448d14a8f8e452145ccf41263 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.476008 10366 ts_tablet_manager.cc:1434] T 839dcdb448d14a8f8e452145ccf41263 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.019s user 0.000s sys 0.000s
I20260810 19:48:09.476275 10366 tablet_bootstrap.cc:492] T 639c824ba4834734a4ebfd558181bebe P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:09.477901 10366 tablet_bootstrap.cc:654] T 639c824ba4834734a4ebfd558181bebe P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:09.482935 9901 tablet_service.cc:1511] Processing CreateTablet for tablet bef956a173084e7698a37dddc574ea65 (DEFAULT_TABLE table=default.Table_b46992ec81974f6caad1ea769640dcf1 [id=d6d2d95e5e9f4e10a7d5a8153e66e4b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.483400 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bef956a173084e7698a37dddc574ea65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.486891 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_d7913fe68d904485a11092e9ad64f6b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:09.487665 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7913fe68d904485a11092e9ad64f6b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:09.492794 9416 catalog_manager.cc:5719] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:09.493301 9416 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet e68916e2568f4527a181342cdc728001 (table default.Table_3e7715bf0f8c41e3bd4964a0f918c9ea [id=3babf53bc29e4d4f9be8b2c19be6e2bd]). Expected version 2 got 0
I20260810 19:48:09.498345 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0d6d2481df1040f5b9cfc18cd9c7bfb2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:09.498809 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 8ab74d7fd2fe485d935aef4076382add (DEFAULT_TABLE table=default.Table_5f2085e8097146c1a9f517a1e25fdaa4 [id=68feab722c3e4650bee88cd836b78a36]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:09.498978 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d6d2481df1040f5b9cfc18cd9c7bfb2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:09.499275 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab74d7fd2fe485d935aef4076382add. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.500332 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3c43fbb6bc7f4a38b470a011714cd243" } modify_external_catalogs: true
I20260810 19:48:09.500532 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3c43fbb6bc7f4a38b470a011714cd243" } modify_external_catalogs: true
I20260810 19:48:09.500990 10370 ts_tablet_manager.cc:1434] T 3582ed23ffdf4ff089952e29083e5425 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.049s user 0.002s sys 0.000s
I20260810 19:48:09.501487 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 6ab4a94ad4a64380b2e185327bbe0d0d (DEFAULT_TABLE table=default.Table_6493b63f37da467b9c631e0081ffceef [id=7c8fd18532594199912a7f43aca43edb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.501704 9665 tablet_service.cc:1511] Processing CreateTablet for tablet fc0bd0bc22e645b89e2b18ed036298c3 (DEFAULT_TABLE table=default.Table_1c4e773fcacd46aeba353887d84c38e8 [id=b8fbe895faaf43d3b59bce23847b4c7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.501890 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ab4a94ad4a64380b2e185327bbe0d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.502110 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc0bd0bc22e645b89e2b18ed036298c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.502207 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a70894bcda4548a783ceb79c8f531e1f" } new_table_name: "default.Table_4991ce51db974981906a99b9ae07d391" modify_external_catalogs: true
I20260810 19:48:09.503566 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1db8b75e5c4f4810a2f97750a130c2cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:09.504103 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1db8b75e5c4f4810a2f97750a130c2cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:09.504927 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 6ab4a94ad4a64380b2e185327bbe0d0d (DEFAULT_TABLE table=default.Table_6493b63f37da467b9c631e0081ffceef [id=7c8fd18532594199912a7f43aca43edb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.505306 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5f059e9b730d466a8e8e0437ac1edbe8" } modify_external_catalogs: true
I20260810 19:48:09.505468 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5f059e9b730d466a8e8e0437ac1edbe8" } modify_external_catalogs: true
I20260810 19:48:09.505839 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 451bb238285a401b8bd83241a83c68bd (DEFAULT_TABLE table=default.Table_2a0560033896430eaaafc8913343fbe7 [id=d2fdb326b6204ae4a137b2dfba3ce7b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.506717 10140 tablet_service.cc:1511] Processing CreateTablet for tablet 862da24ad6694bfeb2c51504d888730d (DEFAULT_TABLE table=default.Table_2dc3f79aafc540d89741b2a66d692f94 [id=6e76fc8ca1814b11b97404f8db3859d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.507195 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 8ab74d7fd2fe485d935aef4076382add (DEFAULT_TABLE table=default.Table_5f2085e8097146c1a9f517a1e25fdaa4 [id=68feab722c3e4650bee88cd836b78a36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.508061 10142 tablet_service.cc:1511] Processing CreateTablet for tablet fc0bd0bc22e645b89e2b18ed036298c3 (DEFAULT_TABLE table=default.Table_1c4e773fcacd46aeba353887d84c38e8 [id=b8fbe895faaf43d3b59bce23847b4c7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.508306 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet fb7b722c43ee4b8698b19b2b6c1b401d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:09.509649 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 155b48f454e74ca9bb7007f584231a37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:09.510083 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 224bce6be88842c0a26df57326f34442 with delete_type TABLET_DATA_DELETED (replaced by tablet 34fb654d56f249c8a0353c495802250b) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:09.510692 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 978695f755c9493db750d81a0c4680f5 (DEFAULT_TABLE table=default.Table_99130c853a87452b82439a60971c2d1b [id=a61b27909b65459793d63e8c8bae4d58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.511157 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 978695f755c9493db750d81a0c4680f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.511961 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_64330e94154d430cb01bbb074ce28065"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:09.512692 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64330e94154d430cb01bbb074ce28065 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:09.514153 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b49066c0180a40fa822769164b05dcf5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:09.514724 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b49066c0180a40fa822769164b05dcf5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:09.514902 10144 tablet_service.cc:1558] Processing DeleteTablet for tablet fb7364664adb424384f6b646d9e423eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:09.515300 10370 tablet_bootstrap.cc:492] T 896b7cfdb0ca4904aaeafa13ff19365e P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:09.516196 12667 tablet.cc:1724] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:09.517141 12664 tablet.cc:1724] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:09.519876 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 862da24ad6694bfeb2c51504d888730d (DEFAULT_TABLE table=default.Table_2dc3f79aafc540d89741b2a66d692f94 [id=6e76fc8ca1814b11b97404f8db3859d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.520331 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862da24ad6694bfeb2c51504d888730d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.522676 9913 tablet_service.cc:1511] Processing CreateTablet for tablet ff5f6f11d153478e958321e82423b5b1 (DEFAULT_TABLE table=default.Table_e63fa9c3c1be48f7b248cea033e5f5f5 [id=2c13b616a8de46999ff7878f5567a255]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.523207 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5f6f11d153478e958321e82423b5b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.524183 9669 tablet_service.cc:1511] Processing CreateTablet for tablet ad31c57d589140879a476bb85ee53ef2 (DEFAULT_TABLE table=default.Table_d838f9cc6228427c9a67fd48d4c2d318 [id=9c968dc2f79049989d23acc777b9b009]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.524478 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 16c191e46dcf4d39b217ff343fbe209f (DEFAULT_TABLE table=default.Table_94f87f0129ca4a07aab816a9f28e00e3 [id=f70dac08b991428183a2d88e1b35de5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.525279 9658 tablet_service.cc:1511] Processing CreateTablet for tablet a4d1b6bac3604a60811b457a55b1c528 (DEFAULT_TABLE table=default.Table_09625e5e21414c2d98d6f8c454f00573 [id=bbbc6ed8775a43b09308409100a5d300]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.525507 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 0cd227ad250d45978eaa4178ddcfd4e6 (DEFAULT_TABLE table=default.Table_c2abc74b620d478fb6d85ef97ff23e9f [id=40bfbb1d94b0493e842806fbd9b06e2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.527897 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ae6d231840342fb8bb3493d0525c95b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:09.528332 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet d6f410a1659c40f08ac274e63ad01b3d with delete_type TABLET_DATA_DELETED (replaced by tablet 60798f21222443c69bacf4a799a33c8f) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:09.528581 9408 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_0bc47e5b3fca489388c060450b75e0f3 [id=83524cb8be1d482695223aeaaa578a13] alter complete (version 1)
I20260810 19:48:09.528746 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet c285518ed49d4ed68a6039f98db3b700 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:09.529063 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet fb7364664adb424384f6b646d9e423eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:09.529645 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet fb7b722c43ee4b8698b19b2b6c1b401d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:09.531201 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 8ab74d7fd2fe485d935aef4076382add (DEFAULT_TABLE table=default.Table_5f2085e8097146c1a9f517a1e25fdaa4 [id=68feab722c3e4650bee88cd836b78a36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.531710 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab74d7fd2fe485d935aef4076382add. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.536101 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ea318eddd8349a79d27ce5746f03798 with delete_type TABLET_DATA_DELETED (replaced by tablet e7ea2f50f9f9423b99af3bd190cfd5a5) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:09.542387 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ab4a94ad4a64380b2e185327bbe0d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.543182 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 451bb238285a401b8bd83241a83c68bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.543656 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862da24ad6694bfeb2c51504d888730d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.543807 12664 tablet.cc:1724] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 19:48:09.544396 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dee05338a75f43be8eb2546d06dd8068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.549947 10375 ts_tablet_manager.cc:1929] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:09.550066 10375 log.cc:1199] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/ebf33d82af9e494a8e85be8cba55d2c9
W20260810 19:48:09.550442 12539 lock_manager.cc:585] Waited 1 seconds to obtain row lock on key '<redacted>' (key hash 8315486395571335991) tablet 00000000000000000000000000000000 cur holder 0x617000033380
I20260810 19:48:09.550983 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 451bb238285a401b8bd83241a83c68bd (DEFAULT_TABLE table=default.Table_2a0560033896430eaaafc8913343fbe7 [id=d2fdb326b6204ae4a137b2dfba3ce7b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.560396 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab74d7fd2fe485d935aef4076382add. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.566447 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet b9b567b3338845e4a37cff2a955056ae
W20260810 19:48:09.566715 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3fca05565d6b4a289c58a1c84d0d4c13 consensus state has no leader
I20260810 19:48:09.566493 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 23234c7580b64b55b4e62ded19d187d9
I20260810 19:48:09.567673 10142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc0bd0bc22e645b89e2b18ed036298c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.571614 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet b9b567b3338845e4a37cff2a955056ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:09.571949 10375 ts_tablet_manager.cc:1950] T ebf33d82af9e494a8e85be8cba55d2c9 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:09.572301 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 814) took 2775 ms. Trace:
I20260810 19:48:09.572491 10375 rpcz_store.cc:276] 0810 19:48:06.797094 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.797157 (+ 63us) service_pool.cc:224] Handling call
0810 19:48:09.046429 (+2249272us) ts_tablet_manager.cc:1151] Deleting tablet ebf33d82af9e494a8e85be8cba55d2c9
0810 19:48:09.046442 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:09.389507 (+343065us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:09.549895 (+160388us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:09.572282 (+ 22387us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":277,"tablet-delete.queue_time_us":2249128}
I20260810 19:48:09.572882 10375 tablet_replica.cc:333] T 965395b5072e4d47adac504e22a8d484 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:09.573539 10375 raft_consensus.cc:2243] T 965395b5072e4d47adac504e22a8d484 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:09.573719 10375 raft_consensus.cc:2272] T 965395b5072e4d47adac504e22a8d484 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:09.574491 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad31c57d589140879a476bb85ee53ef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.575100 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cd227ad250d45978eaa4178ddcfd4e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.575224 10122 tablet_service.cc:1511] Processing CreateTablet for tablet ad31c57d589140879a476bb85ee53ef2 (DEFAULT_TABLE table=default.Table_d838f9cc6228427c9a67fd48d4c2d318 [id=9c968dc2f79049989d23acc777b9b009]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.575546 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16c191e46dcf4d39b217ff343fbe209f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.575703 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad31c57d589140879a476bb85ee53ef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.576040 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4d1b6bac3604a60811b457a55b1c528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.578758 10140 tablet_service.cc:1511] Processing CreateTablet for tablet 16c191e46dcf4d39b217ff343fbe209f (DEFAULT_TABLE table=default.Table_94f87f0129ca4a07aab816a9f28e00e3 [id=f70dac08b991428183a2d88e1b35de5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.578994 10375 ts_tablet_manager.cc:1916] T 965395b5072e4d47adac504e22a8d484 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:09.579255 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16c191e46dcf4d39b217ff343fbe209f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.582558 12667 tablet.cc:1724] T a45add97e0e54dce85225e175ecbb45a P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 19:48:09.583765 12407 raft_consensus.cc:493] T 253f302c00cc42ff84076b0c17f7670a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:09.583913 12407 raft_consensus.cc:515] T 253f302c00cc42ff84076b0c17f7670a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.584570 12407 leader_election.cc:290] T 253f302c00cc42ff84076b0c17f7670a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:09.589681 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253f302c00cc42ff84076b0c17f7670a" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:09.590461 9611 leader_election.cc:343] T 253f302c00cc42ff84076b0c17f7670a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:09.590806 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 451bb238285a401b8bd83241a83c68bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.591820 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 23234c7580b64b55b4e62ded19d187d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:09.594856 10367 tablet_bootstrap.cc:492] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:09.595117 10367 ts_tablet_manager.cc:1403] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.188s user 0.003s sys 0.001s
I20260810 19:48:09.603761 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253f302c00cc42ff84076b0c17f7670a" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:09.604302 9611 leader_election.cc:343] T 253f302c00cc42ff84076b0c17f7670a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:09.604441 9611 leader_election.cc:304] T 253f302c00cc42ff84076b0c17f7670a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:09.604839 12407 raft_consensus.cc:2749] T 253f302c00cc42ff84076b0c17f7670a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:09.606268 10367 raft_consensus.cc:359] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.606633 10367 raft_consensus.cc:385] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:09.607168 10370 tablet_bootstrap.cc:654] T 896b7cfdb0ca4904aaeafa13ff19365e P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:09.613983 9883 tablet_service.cc:1511] Processing CreateTablet for tablet ad31c57d589140879a476bb85ee53ef2 (DEFAULT_TABLE table=default.Table_d838f9cc6228427c9a67fd48d4c2d318 [id=9c968dc2f79049989d23acc777b9b009]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.614500 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad31c57d589140879a476bb85ee53ef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.615427 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 451bb238285a401b8bd83241a83c68bd (DEFAULT_TABLE table=default.Table_2a0560033896430eaaafc8913343fbe7 [id=d2fdb326b6204ae4a137b2dfba3ce7b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.615815 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 451bb238285a401b8bd83241a83c68bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.617480 10367 raft_consensus.cc:740] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:09.617825 10367 consensus_queue.cc:260] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.618645 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 862da24ad6694bfeb2c51504d888730d (DEFAULT_TABLE table=default.Table_2dc3f79aafc540d89741b2a66d692f94 [id=6e76fc8ca1814b11b97404f8db3859d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.619062 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862da24ad6694bfeb2c51504d888730d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.608506 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet 3582ed23ffdf4ff089952e29083e5425 with delete_type TABLET_DATA_DELETED (replaced by tablet 8503d5162548463bae22402fdc4c502a) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:09.613983 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 6ab4a94ad4a64380b2e185327bbe0d0d (DEFAULT_TABLE table=default.Table_6493b63f37da467b9c631e0081ffceef [id=7c8fd18532594199912a7f43aca43edb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.622916 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ab4a94ad4a64380b2e185327bbe0d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.630203 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1bc09ade1e7c4459a7ee8927ee4e6873" } modify_external_catalogs: true
I20260810 19:48:09.630460 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1bc09ade1e7c4459a7ee8927ee4e6873" } modify_external_catalogs: true
I20260810 19:48:09.632655 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f11b6cec3ddf4b339b5f90841b7b3d8b" } modify_external_catalogs: true
I20260810 19:48:09.632855 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f11b6cec3ddf4b339b5f90841b7b3d8b" } modify_external_catalogs: true
I20260810 19:48:09.632897 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 16c191e46dcf4d39b217ff343fbe209f (DEFAULT_TABLE table=default.Table_94f87f0129ca4a07aab816a9f28e00e3 [id=f70dac08b991428183a2d88e1b35de5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.633301 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16c191e46dcf4d39b217ff343fbe209f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.634837 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c72aea77b3334c4a9e7920c3d64f53db" } new_table_name: "default.Table_3ed9bf4f04b84f50a6c180549217eaef" modify_external_catalogs: true
I20260810 19:48:09.637068 10367 ts_tablet_manager.cc:1434] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.042s user 0.002s sys 0.000s
I20260810 19:48:09.637817 10367 tablet_bootstrap.cc:492] T d7595dbb46b6441dbb811611da116791 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:09.638672 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 748b792882eb45aebedc63a5348257d4 (DEFAULT_TABLE table=default.Table_8a47860f929d46cb8ddfa5e32149fa6d [id=f8455a70bc664b6989c00fc7ecfef10b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.642814 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 748b792882eb45aebedc63a5348257d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.639565 9666 tablet_service.cc:1511] Processing CreateTablet for tablet c877b31aa6554df7b2a08b697d86447e (DEFAULT_TABLE table=default.Table_28a63f09c01a4b8e9a26f2ef2f1a9f47 [id=f171c954225a4272a311f4cf693d553f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.643796 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c877b31aa6554df7b2a08b697d86447e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.644683 9687 tablet_service.cc:1511] Processing CreateTablet for tablet fb9950c69605416e9e784b41ed77f9cf (DEFAULT_TABLE table=default.Table_1c8f04aee36e49eaaac50ad68deb2303 [id=e8cf6f98fc554ad79fb4333be8f5ddb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.645139 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb9950c69605416e9e784b41ed77f9cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.647296 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 788c2879a50c4acbb3fdde4833d9d9e3 (DEFAULT_TABLE table=default.Table_47b3a69e4e0047e6b59c1f92cc57e4f6 [id=078cf6fc366445b98ee5cac0aa9ce31d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.647624 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788c2879a50c4acbb3fdde4833d9d9e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.652009 9659 tablet_service.cc:1511] Processing CreateTablet for tablet 054c725b88c34372a922fc5be27c35a0 (DEFAULT_TABLE table=default.Table_cadbbfe4f5d04095b599c4f15a26eae5 [id=5969227134794b0da0ce049c943e7151]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.652415 9659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 054c725b88c34372a922fc5be27c35a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.654096 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 44e5c597335a4795b8dbb708af7726ee (DEFAULT_TABLE table=default.Table_fe3c84ad30eb4d57a6d20ec860c02286 [id=c401d03820c6453184e1da223c380872]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.654493 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44e5c597335a4795b8dbb708af7726ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.656903 12463 raft_consensus.cc:493] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:09.656970 9668 tablet_service.cc:1511] Processing CreateTablet for tablet 0f2a1ce4229340318460b50be053be39 (DEFAULT_TABLE table=default.Table_c41427d1476b48f7acf16d9656f70cd4 [id=93510d3fe05a4fae8549b6794b08dfd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.657073 12463 raft_consensus.cc:515] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.657323 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f2a1ce4229340318460b50be053be39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.657824 12463 leader_election.cc:290] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:09.657882 12266 ts_tablet_manager.cc:1929] T 8fce298689e9415a8860b8734d73b10a P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:09.658010 12266 log.cc:1199] T 8fce298689e9415a8860b8734d73b10a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/8fce298689e9415a8860b8734d73b10a
W20260810 19:48:09.658713 9831 leader_election.cc:343] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 9b40fd0d57ea4b71aeef2d66f4958ac8
I20260810 19:48:09.659322 10159 raft_consensus.cc:3060] T 2798f122e0624af6971fc8317244e5ae P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:09.663229 9395 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.8.235.195:43797, user_credentials={real_user=slave}} blocked reactor thread for 47661us
I20260810 19:48:09.663618 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_afff95e937d74160a65a9df332c769c9" } new_table_name: "default.Table_3ca7c069a1d34227aca0af884fac1b5b" modify_external_catalogs: true
I20260810 19:48:09.664254 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 73a2e6a512224caa892ac7541131349f
I20260810 19:48:09.663676 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet ebf33d82af9e494a8e85be8cba55d2c9 (table default.Table_998c14b0e9e14df48d3d4367f7c3b941 [id=19618281529d4843b4e58733646f0e08]) successfully deleted
I20260810 19:48:09.667958 10375 ts_tablet_manager.cc:1929] T 965395b5072e4d47adac504e22a8d484 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:09.668090 10375 log.cc:1199] T 965395b5072e4d47adac504e22a8d484 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/965395b5072e4d47adac504e22a8d484
I20260810 19:48:09.668386 10375 ts_tablet_manager.cc:1950] T 965395b5072e4d47adac504e22a8d484 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:09.671741 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_280138e880a1458097134a0bbe980773" } new_table_name: "default.Table_6e74a7d4265049a294b9be77b39e0d80" modify_external_catalogs: true
I20260810 19:48:09.672215 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3531b1d4a9e04438a2ead5ab916c23fc" } new_table_name: "default.Table_11b9e297e91844cebe879c69f2b920b9" modify_external_catalogs: true
I20260810 19:48:09.672592 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0b279a130f3c4984abe5bacf80bac674" } modify_external_catalogs: true
I20260810 19:48:09.673038 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_05f9785f4f5a4404a794f70ab8a399b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:09.673617 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_05f9785f4f5a4404a794f70ab8a399b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:09.674103 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_13e20dfd1cf0474498db046286dfbb77"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:09.674626 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13e20dfd1cf0474498db046286dfbb77 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:09.675300 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0b279a130f3c4984abe5bacf80bac674" } modify_external_catalogs: true
I20260810 19:48:09.679309 10377 ts_tablet_manager.cc:1929] T 39885c3e0adb4132945d507628f4f082 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:09.679466 10377 log.cc:1199] T 39885c3e0adb4132945d507628f4f082 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/39885c3e0adb4132945d507628f4f082
I20260810 19:48:09.679818 10377 ts_tablet_manager.cc:1950] T 39885c3e0adb4132945d507628f4f082 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:09.680359 10377 tablet_replica.cc:333] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:09.680562 10377 raft_consensus.cc:2243] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:09.681037 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_6e6e84d564374432900236d3124c5094"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:09.681770 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e6e84d564374432900236d3124c5094 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:09.683130 10370 tablet_bootstrap.cc:492] T 896b7cfdb0ca4904aaeafa13ff19365e P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:09.685639 10366 tablet_bootstrap.cc:492] T 639c824ba4834734a4ebfd558181bebe P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:09.688041 12463 consensus_queue.cc:1048] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:09.700749 12505 consensus_queue.cc:1048] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:09.710285 10366 ts_tablet_manager.cc:1403] T 639c824ba4834734a4ebfd558181bebe P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.234s user 0.004s sys 0.000s
I20260810 19:48:09.711385 10366 raft_consensus.cc:359] T 639c824ba4834734a4ebfd558181bebe P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.711690 10366 raft_consensus.cc:385] T 639c824ba4834734a4ebfd558181bebe P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:09.711793 10366 raft_consensus.cc:740] T 639c824ba4834734a4ebfd558181bebe P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:09.712092 10366 consensus_queue.cc:260] T 639c824ba4834734a4ebfd558181bebe P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.692214 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet b9b567b3338845e4a37cff2a955056ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:09.717068 10370 ts_tablet_manager.cc:1403] T 896b7cfdb0ca4904aaeafa13ff19365e P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.202s user 0.003s sys 0.001s
I20260810 19:48:09.692873 10127 tablet_service.cc:1511] Processing CreateTablet for tablet c877b31aa6554df7b2a08b697d86447e (DEFAULT_TABLE table=default.Table_28a63f09c01a4b8e9a26f2ef2f1a9f47 [id=f171c954225a4272a311f4cf693d553f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.696096 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 748b792882eb45aebedc63a5348257d4 (DEFAULT_TABLE table=default.Table_8a47860f929d46cb8ddfa5e32149fa6d [id=f8455a70bc664b6989c00fc7ecfef10b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.696352 10144 tablet_service.cc:1558] Processing DeleteTablet for tablet 23234c7580b64b55b4e62ded19d187d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:09.696671 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 0cd227ad250d45978eaa4178ddcfd4e6 (DEFAULT_TABLE table=default.Table_c2abc74b620d478fb6d85ef97ff23e9f [id=40bfbb1d94b0493e842806fbd9b06e2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.697294 10118 tablet_service.cc:1511] Processing CreateTablet for tablet fb9950c69605416e9e784b41ed77f9cf (DEFAULT_TABLE table=default.Table_1c8f04aee36e49eaaac50ad68deb2303 [id=e8cf6f98fc554ad79fb4333be8f5ddb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.697803 10120 tablet_service.cc:1511] Processing CreateTablet for tablet a2ff1ed4870c4276a6af5201e75ab8f0 (DEFAULT_TABLE table=default.Table_7d33c55d27f1420687645eee2eb63539 [id=536f38cb702948acb4b816e9afa55249]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.698330 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 788c2879a50c4acbb3fdde4833d9d9e3 (DEFAULT_TABLE table=default.Table_47b3a69e4e0047e6b59c1f92cc57e4f6 [id=078cf6fc366445b98ee5cac0aa9ce31d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.698868 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 054c725b88c34372a922fc5be27c35a0 (DEFAULT_TABLE table=default.Table_cadbbfe4f5d04095b599c4f15a26eae5 [id=5969227134794b0da0ce049c943e7151]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.698904 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 44e5c597335a4795b8dbb708af7726ee (DEFAULT_TABLE table=default.Table_fe3c84ad30eb4d57a6d20ec860c02286 [id=c401d03820c6453184e1da223c380872]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.699364 10116 tablet_service.cc:1511] Processing CreateTablet for tablet 22aca7822fb745c083efba03a045769e (DEFAULT_TABLE table=default.Table_eb594b7df948469bb3034f8c2d03e351 [id=a0e1ce83e30747aa88bd7b5201b42b4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.699800 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet 73a2e6a512224caa892ac7541131349f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:09.699918 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 0f2a1ce4229340318460b50be053be39 (DEFAULT_TABLE table=default.Table_c41427d1476b48f7acf16d9656f70cd4 [id=93510d3fe05a4fae8549b6794b08dfd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.692292 10136 tablet_service.cc:1511] Processing CreateTablet for tablet a4d1b6bac3604a60811b457a55b1c528 (DEFAULT_TABLE table=default.Table_09625e5e21414c2d98d6f8c454f00573 [id=bbbc6ed8775a43b09308409100a5d300]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.722754 9901 tablet_service.cc:1511] Processing CreateTablet for tablet fc0bd0bc22e645b89e2b18ed036298c3 (DEFAULT_TABLE table=default.Table_1c4e773fcacd46aeba353887d84c38e8 [id=b8fbe895faaf43d3b59bce23847b4c7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.723342 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc0bd0bc22e645b89e2b18ed036298c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.727164 10370 raft_consensus.cc:359] T 896b7cfdb0ca4904aaeafa13ff19365e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.727469 10370 raft_consensus.cc:385] T 896b7cfdb0ca4904aaeafa13ff19365e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:09.727560 10370 raft_consensus.cc:740] T 896b7cfdb0ca4904aaeafa13ff19365e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:09.727891 10370 consensus_queue.cc:260] T 896b7cfdb0ca4904aaeafa13ff19365e P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.728478 10370 ts_tablet_manager.cc:1434] T 896b7cfdb0ca4904aaeafa13ff19365e P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:09.742726 10366 ts_tablet_manager.cc:1434] T 639c824ba4834734a4ebfd558181bebe P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.032s user 0.000s sys 0.002s
W20260810 19:48:09.750058 9830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.195:43797, user_credentials={real_user=slave}} blocked reactor thread for 49247us
I20260810 19:48:09.752521 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 0cd227ad250d45978eaa4178ddcfd4e6 (DEFAULT_TABLE table=default.Table_c2abc74b620d478fb6d85ef97ff23e9f [id=40bfbb1d94b0493e842806fbd9b06e2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.752772 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet b9b567b3338845e4a37cff2a955056ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:09.752522 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 748b792882eb45aebedc63a5348257d4 (DEFAULT_TABLE table=default.Table_8a47860f929d46cb8ddfa5e32149fa6d [id=f8455a70bc664b6989c00fc7ecfef10b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.753320 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet 23234c7580b64b55b4e62ded19d187d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:09.761300 9892 tablet_service.cc:1511] Processing CreateTablet for tablet c877b31aa6554df7b2a08b697d86447e (DEFAULT_TABLE table=default.Table_28a63f09c01a4b8e9a26f2ef2f1a9f47 [id=f171c954225a4272a311f4cf693d553f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.762207 9907 tablet_service.cc:1511] Processing CreateTablet for tablet fb9950c69605416e9e784b41ed77f9cf (DEFAULT_TABLE table=default.Table_1c8f04aee36e49eaaac50ad68deb2303 [id=e8cf6f98fc554ad79fb4333be8f5ddb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.762609 9883 tablet_service.cc:1511] Processing CreateTablet for tablet a2ff1ed4870c4276a6af5201e75ab8f0 (DEFAULT_TABLE table=default.Table_7d33c55d27f1420687645eee2eb63539 [id=536f38cb702948acb4b816e9afa55249]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.763423 9890 tablet_service.cc:1511] Processing CreateTablet for tablet 788c2879a50c4acbb3fdde4833d9d9e3 (DEFAULT_TABLE table=default.Table_47b3a69e4e0047e6b59c1f92cc57e4f6 [id=078cf6fc366445b98ee5cac0aa9ce31d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.764156 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 054c725b88c34372a922fc5be27c35a0 (DEFAULT_TABLE table=default.Table_cadbbfe4f5d04095b599c4f15a26eae5 [id=5969227134794b0da0ce049c943e7151]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.764921 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 44e5c597335a4795b8dbb708af7726ee (DEFAULT_TABLE table=default.Table_fe3c84ad30eb4d57a6d20ec860c02286 [id=c401d03820c6453184e1da223c380872]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.765878 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 22aca7822fb745c083efba03a045769e (DEFAULT_TABLE table=default.Table_eb594b7df948469bb3034f8c2d03e351 [id=a0e1ce83e30747aa88bd7b5201b42b4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.766225 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22aca7822fb745c083efba03a045769e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.766429 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c877b31aa6554df7b2a08b697d86447e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.769390 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb9950c69605416e9e784b41ed77f9cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.773358 10366 tablet_bootstrap.cc:492] T a78960e1f2164c848297411b9273ac64 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:09.773845 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 0f2a1ce4229340318460b50be053be39 (DEFAULT_TABLE table=default.Table_c41427d1476b48f7acf16d9656f70cd4 [id=93510d3fe05a4fae8549b6794b08dfd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.774250 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f2a1ce4229340318460b50be053be39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.774772 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 748b792882eb45aebedc63a5348257d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.778546 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cd227ad250d45978eaa4178ddcfd4e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.779438 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788c2879a50c4acbb3fdde4833d9d9e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.782236 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2ff1ed4870c4276a6af5201e75ab8f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.782578 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44e5c597335a4795b8dbb708af7726ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.786252 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 054c725b88c34372a922fc5be27c35a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.804682 10366 tablet_bootstrap.cc:654] T a78960e1f2164c848297411b9273ac64 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:09.820025 9397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.254:33891, user_credentials={real_user=slave}} blocked reactor thread for 161660us
I20260810 19:48:09.829622 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b40fd0d57ea4b71aeef2d66f4958ac8" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:09.830679 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 39885c3e0adb4132945d507628f4f082 (table default.Table_2502bd78450e4b1b940e7f64a514dc85 [id=76cdf98e49ae4acb8b64ca07d0e28e8c]) successfully deleted
I20260810 19:48:09.691562 9677 tablet_service.cc:1511] Processing CreateTablet for tablet a2ff1ed4870c4276a6af5201e75ab8f0 (DEFAULT_TABLE table=default.Table_7d33c55d27f1420687645eee2eb63539 [id=536f38cb702948acb4b816e9afa55249]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.691928 9663 tablet_service.cc:1511] Processing CreateTablet for tablet 22aca7822fb745c083efba03a045769e (DEFAULT_TABLE table=default.Table_eb594b7df948469bb3034f8c2d03e351 [id=a0e1ce83e30747aa88bd7b5201b42b4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.718539 12407 raft_consensus.cc:493] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:09.778523 12695 raft_consensus.cc:493] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:09.820976 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 73a2e6a512224caa892ac7541131349f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:09.838287 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2ff1ed4870c4276a6af5201e75ab8f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.838943 12407 raft_consensus.cc:515] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.851162 12407 leader_election.cc:290] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:09.851316 12407 raft_consensus.cc:493] T 81aabb5656e7472f9223fd7acf10e43c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:09.851432 12407 raft_consensus.cc:515] T 81aabb5656e7472f9223fd7acf10e43c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.851976 12407 leader_election.cc:290] T 81aabb5656e7472f9223fd7acf10e43c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:09.852087 12407 raft_consensus.cc:493] T 444b49a69c8245b6944a76d53041154c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:09.852173 12407 raft_consensus.cc:515] T 444b49a69c8245b6944a76d53041154c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.852636 12407 leader_election.cc:290] T 444b49a69c8245b6944a76d53041154c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:09.838997 12695 raft_consensus.cc:515] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.853302 12695 leader_election.cc:290] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:09.853763 9663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22aca7822fb745c083efba03a045769e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.798301 10367 tablet_bootstrap.cc:654] T d7595dbb46b6441dbb811611da116791 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:09.805399 9913 tablet_service.cc:1511] Processing CreateTablet for tablet a4d1b6bac3604a60811b457a55b1c528 (DEFAULT_TABLE table=default.Table_09625e5e21414c2d98d6f8c454f00573 [id=bbbc6ed8775a43b09308409100a5d300]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:09.860183 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4d1b6bac3604a60811b457a55b1c528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.749675 10377 raft_consensus.cc:2272] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:09.805708 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet 73a2e6a512224caa892ac7541131349f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:09.862169 10377 ts_tablet_manager.cc:1916] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:09.845265 12266 ts_tablet_manager.cc:1950] T 8fce298689e9415a8860b8734d73b10a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:09.872185 12266 tablet_replica.cc:333] T 5654c48929564a96a55ed0444c9e1a04 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:09.872556 12266 raft_consensus.cc:2243] T 5654c48929564a96a55ed0444c9e1a04 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:09.872809 12266 raft_consensus.cc:2272] T 5654c48929564a96a55ed0444c9e1a04 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:09.873515 12266 ts_tablet_manager.cc:1916] T 5654c48929564a96a55ed0444c9e1a04 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:09.884531 9941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cf30d2d79f404798378ab01af53b8c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:09.885000 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cf30d2d79f404798378ab01af53b8c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:09.885938 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81aabb5656e7472f9223fd7acf10e43c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:09.886739 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444b49a69c8245b6944a76d53041154c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:09.888000 10151 raft_consensus.cc:3060] T 3fd5cd2e4c104e45a81d2603c6f7d24a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:09.890826 10029 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:48:09.897646 10171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3840b035b88243ecad17865d4716fcfc" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:09.898634 9611 leader_election.cc:343] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:09.898965 9611 leader_election.cc:343] T 81aabb5656e7472f9223fd7acf10e43c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:09.899221 9611 leader_election.cc:343] T 444b49a69c8245b6944a76d53041154c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:09.899427 9611 leader_election.cc:343] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:09.899631 9611 leader_election.cc:343] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:09.899750 9611 leader_election.cc:304] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:09.900350 12728 raft_consensus.cc:2749] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:09.901427 11897 raft_consensus.cc:493] T 839dcdb448d14a8f8e452145ccf41263 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:09.901587 11897 raft_consensus.cc:515] T 839dcdb448d14a8f8e452145ccf41263 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:09.917929 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c6142276b28447b5854a27cd007edb04 consensus state has no leader
I20260810 19:48:09.918525 9413 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_0bbfea1f106c4df1921c642928671792 [id=d628448cf7b94ebab79194e81fcaf040] alter complete (version 1)
I20260810 19:48:09.920094 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_14f61231a449417485b40e77c36c2044"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:09.920728 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_14f61231a449417485b40e77c36c2044 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:09.921967 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0292c3214aa84c40ace16760f414d912 consensus state has no leader
I20260810 19:48:09.925335 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 60e99cd75ada470380ab69da60ddac77
I20260810 19:48:09.926604 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_56ed643105684c67b9ee649bcbbb993c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:09.927280 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56ed643105684c67b9ee649bcbbb993c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:09.928979 9830 leader_election.cc:343] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:09.929212 9830 leader_election.cc:304] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:09.929553 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_56f3340c93684c45bacea55059a03455" } new_table_name: "default.Table_b75eaa5b58264b5281c2d648b8917164" modify_external_catalogs: true
I20260810 19:48:09.930647 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_01dc43c2a0894d7683e627655cd4c0b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:09.931139 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_01dc43c2a0894d7683e627655cd4c0b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:09.932024 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet 60e99cd75ada470380ab69da60ddac77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:09.932478 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3feacdb8009f4526828a9306b20f4341" } modify_external_catalogs: true
I20260810 19:48:09.932646 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3feacdb8009f4526828a9306b20f4341" } modify_external_catalogs: true
W20260810 19:48:09.935011 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5f593e2ff4ef467da4a1b2dacd17c899 consensus state has no leader
I20260810 19:48:09.935405 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7f9b257fef5e41f4b0e67f3aab8efd7d" } modify_external_catalogs: true
I20260810 19:48:09.935566 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7f9b257fef5e41f4b0e67f3aab8efd7d" } modify_external_catalogs: true
W20260810 19:48:09.937114 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da08cce6487740649e20f452531cc403 consensus state has no leader
I20260810 19:48:09.937517 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0a8cc6e2f1d54fff9f1b64a59e7ee6d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:09.938078 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a8cc6e2f1d54fff9f1b64a59e7ee6d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:09.939177 12695 raft_consensus.cc:493] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:09.939338 12695 raft_consensus.cc:515] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:09.940047 12695 leader_election.cc:290] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:09.941004 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639c824ba4834734a4ebfd558181bebe" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:09.941926 9611 leader_election.cc:343] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:09.942365 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a7e0ec86fb03487094c665f2cf62bb9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:09.943112 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7e0ec86fb03487094c665f2cf62bb9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:09.948097 11897 leader_election.cc:290] T 839dcdb448d14a8f8e452145ccf41263 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:09.948472 9941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81aabb5656e7472f9223fd7acf10e43c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:09.953187 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 8fce298689e9415a8860b8734d73b10a (table default.Table_987f321d06054ef782d6aa76b7be0ae9 [id=4c476fd4be224f719254ec5da0f5e2ee]) successfully deleted
W20260810 19:48:09.953585 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 9e37ab519ffe4791ab276a9fc0d96ead because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e37ab519ffe4791ab276a9fc0d96ead already in progress: creating tablet
I20260810 19:48:09.954412 12751 tablet.cc:1724] T a45add97e0e54dce85225e175ecbb45a P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 19:48:09.955824 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 64470598ccec45a7ae3e3c77fe4b9518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:53 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:09.957862 9941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639c824ba4834734a4ebfd558181bebe" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:09.958118 9941 raft_consensus.cc:2468] T 639c824ba4834734a4ebfd558181bebe P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
W20260810 19:48:09.959057 9611 leader_election.cc:343] T 81aabb5656e7472f9223fd7acf10e43c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:09.959205 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 815) took 3155 ms. Trace:
I20260810 19:48:09.959338 9611 leader_election.cc:304] T 81aabb5656e7472f9223fd7acf10e43c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:09.959299 10375 rpcz_store.cc:276] 0810 19:48:06.803387 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.803450 (+ 63us) service_pool.cc:224] Handling call
0810 19:48:09.572828 (+2769378us) ts_tablet_manager.cc:1151] Deleting tablet 965395b5072e4d47adac504e22a8d484
0810 19:48:09.572839 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:09.640699 (+ 67860us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:09.667882 (+ 27183us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:09.959181 (+291299us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2769157}
I20260810 19:48:09.959721 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 816) took 3066 ms. Trace:
I20260810 19:48:09.959724 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 965395b5072e4d47adac504e22a8d484 (table default.Table_4ba52e1a6c3b42688033e6fd1cdcd7ae [id=a88614b26dcb4c16bd100a55431569c8]) successfully deleted
I20260810 19:48:09.959810 10375 rpcz_store.cc:276] 0810 19:48:06.893083 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:06.893156 (+ 73us) service_pool.cc:224] Handling call
0810 19:48:09.959595 (+3066439us) ts_tablet_manager.cc:1151] Deleting tablet ab27734e3d974260a77f1d94e5f534fe
0810 19:48:09.959605 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:09.959703 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3007833}
I20260810 19:48:09.960005 12695 raft_consensus.cc:2749] T 81aabb5656e7472f9223fd7acf10e43c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:09.960166 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 817) took 2863 ms. Trace:
I20260810 19:48:09.960235 10375 rpcz_store.cc:276] 0810 19:48:07.096583 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:07.096716 (+ 133us) service_pool.cc:224] Handling call
0810 19:48:09.960054 (+2863338us) ts_tablet_manager.cc:1151] Deleting tablet b3754889e4574fc3a936ac31cc6f496a
0810 19:48:09.960063 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:09.960151 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2863081}
W20260810 19:48:09.960391 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet ab27734e3d974260a77f1d94e5f534fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab27734e3d974260a77f1d94e5f534fe already in progress: creating tablet
I20260810 19:48:09.960558 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 818) took 2742 ms. Trace:
W20260810 19:48:09.960637 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet b3754889e4574fc3a936ac31cc6f496a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3754889e4574fc3a936ac31cc6f496a already in progress: creating tablet
I20260810 19:48:09.960639 10375 rpcz_store.cc:276] 0810 19:48:07.218407 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:07.218490 (+ 83us) service_pool.cc:224] Handling call
0810 19:48:09.960461 (+2741971us) ts_tablet_manager.cc:1151] Deleting tablet b704af46d0da4695a2aefd5dd17e0a7d
0810 19:48:09.960471 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:09.960542 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2741731}
I20260810 19:48:09.960927 10375 tablet_replica.cc:333] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
W20260810 19:48:09.961010 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet b704af46d0da4695a2aefd5dd17e0a7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b704af46d0da4695a2aefd5dd17e0a7d already in progress: creating tablet
I20260810 19:48:09.961123 10375 raft_consensus.cc:2243] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:09.961450 10375 pending_rounds.cc:70] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:09.961508 10375 pending_rounds.cc:77] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058711276367872 op_type: NO_OP noop_request { }
I20260810 19:48:09.961608 10375 raft_consensus.cc:2889] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:09.961696 10375 raft_consensus.cc:2272] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:09.965795 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c877b31aa6554df7b2a08b697d86447e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.966605 10116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22aca7822fb745c083efba03a045769e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.969957 12742 tablet.cc:1724] T 3bf9486839474b2a8ddff3a49b4fda2a P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:09.970515 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2ff1ed4870c4276a6af5201e75ab8f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.970769 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cd227ad250d45978eaa4178ddcfd4e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.970969 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb9950c69605416e9e784b41ed77f9cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.971130 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788c2879a50c4acbb3fdde4833d9d9e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.971287 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 748b792882eb45aebedc63a5348257d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.972455 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44e5c597335a4795b8dbb708af7726ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.972918 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4d1b6bac3604a60811b457a55b1c528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.962294 10375 ts_tablet_manager.cc:1916] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:09.974429 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 054c725b88c34372a922fc5be27c35a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.978441 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f2a1ce4229340318460b50be053be39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:09.999145 10370 tablet_bootstrap.cc:492] T 839dcdb448d14a8f8e452145ccf41263 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:10.001000 10370 tablet_bootstrap.cc:654] T 839dcdb448d14a8f8e452145ccf41263 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:10.001202 12753 tablet.cc:1724] T 2798f122e0624af6971fc8317244e5ae P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:09.917847 12728 raft_consensus.cc:493] T 3680db3f1a5945a89c1198eb4849e58c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:10.021904 12705 raft_consensus.cc:493] T 896b7cfdb0ca4904aaeafa13ff19365e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:10.022199 12705 raft_consensus.cc:515] T 896b7cfdb0ca4904aaeafa13ff19365e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.023663 12705 leader_election.cc:290] T 896b7cfdb0ca4904aaeafa13ff19365e P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:10.026854 9830 raft_consensus.cc:2686] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P 6986ed920dcb4af29a5eeeda6f671691: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260810 19:48:10.027199 9830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.195:43797, user_credentials={real_user=slave}} blocked reactor thread for 98239us
W20260810 19:48:10.027761 10068 leader_election.cc:343] T 896b7cfdb0ca4904aaeafa13ff19365e P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 896b7cfdb0ca4904aaeafa13ff19365e
I20260810 19:48:10.034578 12664 tablet.cc:1724] T 5394eadabf184158864921dd5d394828 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:10.052832 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839dcdb448d14a8f8e452145ccf41263" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:10.054541 12742 tablet.cc:1724] T 5394eadabf184158864921dd5d394828 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:10.059738 9410 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_0a1a76f241a1418ba5cb63ddec738374 [id=c580a677dcab41d9892011258d5993d7] alter complete (version 3)
W20260810 19:48:10.060627 9830 leader_election.cc:343] T 839dcdb448d14a8f8e452145ccf41263 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:10.061997 9410 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 2798f122e0624af6971fc8317244e5ae (table default.Table_0bc47e5b3fca489388c060450b75e0f3 [id=83524cb8be1d482695223aeaaa578a13]). Expected version 1 got 0
I20260810 19:48:10.062624 12751 tablet.cc:1724] T 410855f236004ad4b78839eb1c0c2f1f P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:10.063493 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_8f2b600b476e4a3ea8e7a450dad062a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:09.982455 12695 raft_consensus.cc:493] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:10.063944 12695 raft_consensus.cc:515] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:10.064210 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f2b600b476e4a3ea8e7a450dad062a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:10.064620 12695 leader_election.cc:290] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:09.985219 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 444b49a69c8245b6944a76d53041154c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:09.961423 9611 leader_election.cc:304] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:10.065172 12695 raft_consensus.cc:2804] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:10.065243 12695 raft_consensus.cc:493] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:10.065301 12695 raft_consensus.cc:3060] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:10.065897 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_aeddf7c6df8a47eaaf1ff9da8fefc3d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:10.066542 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aeddf7c6df8a47eaaf1ff9da8fefc3d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:10.066936 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet dbef3b19330d42779bf0a62ec742bfcb from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:10.068190 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8828e8ce833344fbbf4fa80b95fb29aa" } modify_external_catalogs: true
I20260810 19:48:10.068269 12695 raft_consensus.cc:515] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.068413 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8828e8ce833344fbbf4fa80b95fb29aa" } modify_external_catalogs: true
I20260810 19:48:10.068985 12695 leader_election.cc:290] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:10.069041 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6d9a7b19ea944e73b38e56a240650dbf consensus state has no leader
W20260810 19:48:10.069278 9611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 107880us
I20260810 19:48:10.069330 9408 master_service.cc:960] ReplaceTablet: received request to replace tablet 1cb0193bab3543d38ec5f6dc6a947b6e from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:10.069794 9408 master_service.cc:960] ReplaceTablet: received request to replace tablet 27aca44685be4a0b92767d13bad15daf from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:10.008700 12407 raft_consensus.cc:493] T 64470598ccec45a7ae3e3c77fe4b9518 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:10.070366 12407 raft_consensus.cc:515] T 64470598ccec45a7ae3e3c77fe4b9518 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.071085 12407 leader_election.cc:290] T 64470598ccec45a7ae3e3c77fe4b9518 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:10.071708 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639c824ba4834734a4ebfd558181bebe" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
W20260810 19:48:10.072206 9611 leader_election.cc:343] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:10.072557 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64470598ccec45a7ae3e3c77fe4b9518" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:10.073148 9611 leader_election.cc:343] T 64470598ccec45a7ae3e3c77fe4b9518 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:09.998545 9946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444b49a69c8245b6944a76d53041154c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:09.999162 10375 ts_tablet_manager.cc:1929] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:10.076731 10375 log.cc:1199] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/00fe7d9a548a487d965d92b53cdf9250
I20260810 19:48:10.077231 10375 ts_tablet_manager.cc:1950] T 00fe7d9a548a487d965d92b53cdf9250 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:10.078279 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 821) took 2553 ms. Trace:
I20260810 19:48:10.009965 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 253f302c00cc42ff84076b0c17f7670a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:10.078504 10375 rpcz_store.cc:276] 0810 19:48:07.525146 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:07.525520 (+ 374us) service_pool.cc:224] Handling call
0810 19:48:09.960857 (+2435337us) ts_tablet_manager.cc:1151] Deleting tablet 00fe7d9a548a487d965d92b53cdf9250
0810 19:48:09.960867 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:09.995968 (+ 35101us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:09.999111 (+ 3143us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:10.078252 (+ 79141us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2434786}
I20260810 19:48:10.010015 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet f6f9eb86c6c84b4a84d109d4741238e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:10.079046 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 841) took 2086 ms. Trace:
I20260810 19:48:10.079098 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 00fe7d9a548a487d965d92b53cdf9250 (table default.Table_2adfdcdb33f543d49ea6f361bf8a55c4 [id=cfd27e7efc8f4c529e7dace21742b656]) successfully deleted
I20260810 19:48:10.079128 10375 rpcz_store.cc:276] 0810 19:48:07.992144 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:07.992202 (+ 58us) service_pool.cc:224] Handling call
0810 19:48:10.078909 (+2086707us) ts_tablet_manager.cc:1151] Deleting tablet 09f09289a4c84e25b84c10abef3799c3
0810 19:48:10.078920 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:10.079028 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2086497}
I20260810 19:48:10.079459 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 842) took 2084 ms. Trace:
W20260810 19:48:10.079559 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 09f09289a4c84e25b84c10abef3799c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09f09289a4c84e25b84c10abef3799c3 already in progress: creating tablet
I20260810 19:48:10.079537 10375 rpcz_store.cc:276] 0810 19:48:07.994837 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:07.994896 (+ 59us) service_pool.cc:224] Handling call
0810 19:48:10.079360 (+2084464us) ts_tablet_manager.cc:1151] Deleting tablet cbcaa7106df24aaeb07428b7b590e282
0810 19:48:10.079369 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:10.079444 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2084296}
I20260810 19:48:10.079829 10375 tablet_replica.cc:333] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
W20260810 19:48:10.079895 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet cbcaa7106df24aaeb07428b7b590e282 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cbcaa7106df24aaeb07428b7b590e282 already in progress: creating tablet
I20260810 19:48:10.080022 10375 raft_consensus.cc:2243] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:10.080196 10375 raft_consensus.cc:2272] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:10.080796 10375 ts_tablet_manager.cc:1916] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:10.085178 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet 896b7cfdb0ca4904aaeafa13ff19365e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:10.092602 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 60e99cd75ada470380ab69da60ddac77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:10.097398 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 839dcdb448d14a8f8e452145ccf41263 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:10.098057 12407 raft_consensus.cc:493] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:10.098304 9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3840b035b88243ecad17865d4716fcfc" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:10.012151 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet 60e99cd75ada470380ab69da60ddac77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:10.010466 12728 raft_consensus.cc:515] T 3680db3f1a5945a89c1198eb4849e58c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.099157 12728 leader_election.cc:290] T 3680db3f1a5945a89c1198eb4849e58c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:10.098249 12407 raft_consensus.cc:515] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.099974 12407 leader_election.cc:290] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:10.012188 9677 tablet_service.cc:1558] Processing DeleteTablet for tablet 3680db3f1a5945a89c1198eb4849e58c with delete_type TABLET_DATA_DELETED (replaced by tablet 33f2ea0d46f44fca88e16ea83ad67bc2) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:10.033124 10367 tablet_bootstrap.cc:492] T d7595dbb46b6441dbb811611da116791 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:10.100416 10367 ts_tablet_manager.cc:1403] T d7595dbb46b6441dbb811611da116791 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.463s user 0.008s sys 0.000s
I20260810 19:48:10.101240 10367 raft_consensus.cc:359] T d7595dbb46b6441dbb811611da116791 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.101418 10367 raft_consensus.cc:385] T d7595dbb46b6441dbb811611da116791 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:10.101468 10367 raft_consensus.cc:740] T d7595dbb46b6441dbb811611da116791 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:10.101679 10367 consensus_queue.cc:260] T d7595dbb46b6441dbb811611da116791 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.102236 10367 ts_tablet_manager.cc:1434] T d7595dbb46b6441dbb811611da116791 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 19:48:10.105469 10367 tablet_bootstrap.cc:492] T f2606854f9954f2ea10610aeb1e60368 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:10.106472 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e3dde1c29e4275bafb27df63b117be" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:10.107206 12664 tablet.cc:1724] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 19:48:10.108469 9397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.254:33891, user_credentials={real_user=slave}} blocked reactor thread for 50168.4us
I20260810 19:48:10.108355 10367 tablet_bootstrap.cc:654] T f2606854f9954f2ea10610aeb1e60368 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:10.114902 9948 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 0.507s user 0.005s sys 0.010s
W20260810 19:48:10.115128 9948 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 0.507s user 0.005s sys 0.010s
W20260810 19:48:10.122661 9831 leader_election.cc:343] T 839dcdb448d14a8f8e452145ccf41263 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 839dcdb448d14a8f8e452145ccf41263
I20260810 19:48:10.122848 9831 leader_election.cc:304] T 839dcdb448d14a8f8e452145ccf41263 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:10.123775 12597 raft_consensus.cc:2749] T 839dcdb448d14a8f8e452145ccf41263 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:10.124892 12463 consensus_queue.cc:1048] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:10.125103 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_58338522359643389f4a12b2958ceaea" } new_table_name: "default.Table_e916b40c39f5472392d206dfce08a8dc" modify_external_catalogs: true
I20260810 19:48:10.125444 12266 ts_tablet_manager.cc:1929] T 5654c48929564a96a55ed0444c9e1a04 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:10.125563 12266 log.cc:1199] T 5654c48929564a96a55ed0444c9e1a04 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/5654c48929564a96a55ed0444c9e1a04
I20260810 19:48:10.125860 12266 ts_tablet_manager.cc:1950] T 5654c48929564a96a55ed0444c9e1a04 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:10.127591 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 918) took 1108 ms. Trace:
I20260810 19:48:10.128412 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b46992ec81974f6caad1ea769640dcf1" } new_table_name: "default.Table_e9c516dfdc1042a283064b3839f0d7ca" modify_external_catalogs: true
I20260810 19:48:10.131073 12266 rpcz_store.cc:276] 0810 19:48:09.019479 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.020626 (+ 1147us) service_pool.cc:224] Handling call
0810 19:48:09.872124 (+851498us) ts_tablet_manager.cc:1151] Deleting tablet 5654c48929564a96a55ed0444c9e1a04
0810 19:48:09.872136 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:10.111137 (+239001us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:10.125360 (+ 14223us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:10.127568 (+ 2208us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":783478}
I20260810 19:48:10.131805 12266 tablet_replica.cc:333] T 05059ef70a8e440ca2988bfeb610645d P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:10.132020 12266 raft_consensus.cc:2243] T 05059ef70a8e440ca2988bfeb610645d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:10.132190 12266 raft_consensus.cc:2272] T 05059ef70a8e440ca2988bfeb610645d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:10.132774 12266 ts_tablet_manager.cc:1916] T 05059ef70a8e440ca2988bfeb610645d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:10.133330 10377 ts_tablet_manager.cc:1929] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:10.133445 10377 log.cc:1199] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/9b40fd0d57ea4b71aeef2d66f4958ac8
I20260810 19:48:10.133730 10377 ts_tablet_manager.cc:1950] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:10.133841 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 5654c48929564a96a55ed0444c9e1a04 (table default.Table_f90f1a0c22fa4781812518f44c9d7b17 [id=d12cb82567fd409988672b04a2e05a5b]) successfully deleted
W20260810 19:48:10.134195 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 3b9f29803809462a9b8b64b03eed040b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b9f29803809462a9b8b64b03eed040b already in progress: creating tablet
I20260810 19:48:10.140236 10366 tablet_bootstrap.cc:492] T a78960e1f2164c848297411b9273ac64 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:10.140391 10366 ts_tablet_manager.cc:1403] T a78960e1f2164c848297411b9273ac64 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.367s user 0.004s sys 0.005s
I20260810 19:48:10.141237 10366 raft_consensus.cc:359] T a78960e1f2164c848297411b9273ac64 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.141418 10366 raft_consensus.cc:385] T a78960e1f2164c848297411b9273ac64 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:10.141469 10366 raft_consensus.cc:740] T a78960e1f2164c848297411b9273ac64 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:10.141664 10366 consensus_queue.cc:260] T a78960e1f2164c848297411b9273ac64 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.143008 10370 tablet_bootstrap.cc:492] T 839dcdb448d14a8f8e452145ccf41263 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:10.143921 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639c824ba4834734a4ebfd558181bebe" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:10.144165 9931 raft_consensus.cc:3060] T 639c824ba4834734a4ebfd558181bebe P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:10.146391 9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64470598ccec45a7ae3e3c77fe4b9518" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:10.149817 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e3dde1c29e4275bafb27df63b117be" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:10.152907 9931 raft_consensus.cc:2468] T 639c824ba4834734a4ebfd558181bebe P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:48:10.156627 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3680db3f1a5945a89c1198eb4849e58c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:10.149298 10067 leader_election.cc:343] T 896b7cfdb0ca4904aaeafa13ff19365e P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 896b7cfdb0ca4904aaeafa13ff19365e
I20260810 19:48:10.164522 10067 leader_election.cc:304] T 896b7cfdb0ca4904aaeafa13ff19365e P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:10.164996 12705 raft_consensus.cc:2749] T 896b7cfdb0ca4904aaeafa13ff19365e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:10.162106 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3680db3f1a5945a89c1198eb4849e58c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:10.164311 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e47086440ef4a249f1eed23db655879" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:10.174233 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1abca061cc224f4b966955e5b949b622"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:10.174902 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1abca061cc224f4b966955e5b949b622 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:10.163328 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e47086440ef4a249f1eed23db655879" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:10.175544 10370 ts_tablet_manager.cc:1403] T 839dcdb448d14a8f8e452145ccf41263 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.176s user 0.005s sys 0.005s
I20260810 19:48:10.176369 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a22a70d0868e4274a3a9384539baf907"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:10.176911 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a22a70d0868e4274a3a9384539baf907 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:10.176966 9611 leader_election.cc:343] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:10.177182 9611 leader_election.cc:343] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:10.177361 9611 leader_election.cc:343] T 444b49a69c8245b6944a76d53041154c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:10.177444 9611 leader_election.cc:304] T 444b49a69c8245b6944a76d53041154c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:10.178586 10370 raft_consensus.cc:359] T 839dcdb448d14a8f8e452145ccf41263 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.178771 10370 raft_consensus.cc:385] T 839dcdb448d14a8f8e452145ccf41263 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:10.178838 10370 raft_consensus.cc:740] T 839dcdb448d14a8f8e452145ccf41263 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:10.179047 10370 consensus_queue.cc:260] T 839dcdb448d14a8f8e452145ccf41263 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.179430 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 9b40fd0d57ea4b71aeef2d66f4958ac8 (table default.Table_b1aaf42f1f01402f9f92aabf33808cd4 [id=27df62a1199844dd88c52fdd4757529c]) successfully deleted
I20260810 19:48:10.179497 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 98eecd32a2cb4980aec7838b94eaf222 (DEFAULT_TABLE table=default.Table_64330e94154d430cb01bbb074ce28065 [id=1eafba97a7034d88bb68cc61c283b456]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.179608 10124 tablet_service.cc:1511] Processing CreateTablet for tablet f1300e3450204afc8951ed28341270cc (DEFAULT_TABLE table=default.Table_09dc7c9d841f4f87a4451a93337fc43a [id=70e010c611234805b620e242b04f8ad6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:10.179708 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 155b48f454e74ca9bb7007f584231a37 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 155b48f454e74ca9bb7007f584231a37 already in progress: creating tablet
I20260810 19:48:10.179939 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98eecd32a2cb4980aec7838b94eaf222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.158538 10377 tablet_replica.cc:333] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
W20260810 19:48:10.179961 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 224bce6be88842c0a26df57326f34442 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 224bce6be88842c0a26df57326f34442 already in progress: creating tablet
I20260810 19:48:10.180114 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1300e3450204afc8951ed28341270cc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:10.180182 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 9ae6d231840342fb8bb3493d0525c95b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ae6d231840342fb8bb3493d0525c95b already in progress: creating tablet
W20260810 19:48:10.180444 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet d6f410a1659c40f08ac274e63ad01b3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6f410a1659c40f08ac274e63ad01b3d already in progress: creating tablet
W20260810 19:48:10.180668 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet c285518ed49d4ed68a6039f98db3b700 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c285518ed49d4ed68a6039f98db3b700 already in progress: creating tablet
W20260810 19:48:10.180863 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet fb7364664adb424384f6b646d9e423eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb7364664adb424384f6b646d9e423eb already in progress: creating tablet
I20260810 19:48:10.181185 9416 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_44478e93cffb460aaa8df9115b799594 [id=1d363ce63686462f9f4c15669773ee22] alter complete (version 1)
I20260810 19:48:10.183187 9416 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 639c824ba4834734a4ebfd558181bebe (table default.Table_35ada13f5f5a41b0a93a57276b7756d9 [id=fa3844f34a5b4d55b6e87ec2164eb8fb]). Expected version 2 got 0
I20260810 19:48:10.186636 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 92c1f13f235a4ba696bd794af135bcba (DEFAULT_TABLE table=default.Table_1db8b75e5c4f4810a2f97750a130c2cf [id=695cecaa12a14f609a50df2fbfda683f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.187011 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c1f13f235a4ba696bd794af135bcba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.188750 10377 raft_consensus.cc:2243] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 [term 2 LEADER]: Raft consensus shutting down.
I20260810 19:48:10.190037 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 98eecd32a2cb4980aec7838b94eaf222 (DEFAULT_TABLE table=default.Table_64330e94154d430cb01bbb074ce28065 [id=1eafba97a7034d88bb68cc61c283b456]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.190161 9668 tablet_service.cc:1511] Processing CreateTablet for tablet 92c1f13f235a4ba696bd794af135bcba (DEFAULT_TABLE table=default.Table_1db8b75e5c4f4810a2f97750a130c2cf [id=695cecaa12a14f609a50df2fbfda683f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.190217 9677 tablet_service.cc:1511] Processing CreateTablet for tablet 98eecd32a2cb4980aec7838b94eaf222 (DEFAULT_TABLE table=default.Table_64330e94154d430cb01bbb074ce28065 [id=1eafba97a7034d88bb68cc61c283b456]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.190420 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 76cd3adb759342c0b2d34f956a81c9e0 (DEFAULT_TABLE table=default.Table_515f62a16a5945a7bced9e1a802a0a49 [id=97d6d1420ddd4daa92ac5bd8716a1fdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.190611 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c1f13f235a4ba696bd794af135bcba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.190502 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98eecd32a2cb4980aec7838b94eaf222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.190665 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 7a51811b14da4cddbea05f0cf30aad9b (DEFAULT_TABLE table=default.Table_e337292d09af43c7877689c7d13490de [id=de9c1be5c14846a6a61609f5efc1ee0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.191011 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a51811b14da4cddbea05f0cf30aad9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.190964 9898 tablet_service.cc:1511] Processing CreateTablet for tablet f1300e3450204afc8951ed28341270cc (DEFAULT_TABLE table=default.Table_09dc7c9d841f4f87a4451a93337fc43a [id=70e010c611234805b620e242b04f8ad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.191282 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1300e3450204afc8951ed28341270cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.194437 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76cd3adb759342c0b2d34f956a81c9e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.194644 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 1836e760dff14a1981d660a9ab33e026 (DEFAULT_TABLE table=default.Table_a28fa71d285e4fde898d3502384445e5 [id=b576c81e0105423baf16af8a48dfa316]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.195006 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1836e760dff14a1981d660a9ab33e026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.197680 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 76cd3adb759342c0b2d34f956a81c9e0 (DEFAULT_TABLE table=default.Table_515f62a16a5945a7bced9e1a802a0a49 [id=97d6d1420ddd4daa92ac5bd8716a1fdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.197728 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 3194d795b1ee4b17bd91c27bb6a86fb8 (DEFAULT_TABLE table=default.Table_ea8b681a37ff4a1596ff78f93ef12192 [id=c4e31ad76279491ea5051bd6ed05b5bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.198033 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76cd3adb759342c0b2d34f956a81c9e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.198490 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3194d795b1ee4b17bd91c27bb6a86fb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.198704 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98eecd32a2cb4980aec7838b94eaf222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.203925 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 3194d795b1ee4b17bd91c27bb6a86fb8 (DEFAULT_TABLE table=default.Table_ea8b681a37ff4a1596ff78f93ef12192 [id=c4e31ad76279491ea5051bd6ed05b5bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.204161 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 0c6565aebe894508b4cbbcd3cd0a849a (DEFAULT_TABLE table=default.Table_a49e1248aac4485dbe3017d35ed27b9d [id=e875cf37caf448b8b21d8c419f01d921]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.204330 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3194d795b1ee4b17bd91c27bb6a86fb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.204509 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c6565aebe894508b4cbbcd3cd0a849a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.206589 10136 tablet_service.cc:1511] Processing CreateTablet for tablet b871027259d54ca68f0f03560703f9d7 (DEFAULT_TABLE table=default.Table_ddcd4e092322448382923cf180ac286a [id=1cb3547835c843ef92b2144ffe572bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.206712 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 76cd3adb759342c0b2d34f956a81c9e0 (DEFAULT_TABLE table=default.Table_515f62a16a5945a7bced9e1a802a0a49 [id=97d6d1420ddd4daa92ac5bd8716a1fdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.206945 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b871027259d54ca68f0f03560703f9d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.207099 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76cd3adb759342c0b2d34f956a81c9e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.208666 10116 tablet_service.cc:1511] Processing CreateTablet for tablet 3194d795b1ee4b17bd91c27bb6a86fb8 (DEFAULT_TABLE table=default.Table_ea8b681a37ff4a1596ff78f93ef12192 [id=c4e31ad76279491ea5051bd6ed05b5bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.209009 10116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3194d795b1ee4b17bd91c27bb6a86fb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.209913 10120 tablet_service.cc:1511] Processing CreateTablet for tablet e2ecf7e4eb5f467789a784ad27e68907 (DEFAULT_TABLE table=default.Table_10470b028a754435980ba9eb9ccce17f [id=ac86b99a0bb348b3a0dd09400ed96bb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.210248 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ecf7e4eb5f467789a784ad27e68907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.210616 9890 tablet_service.cc:1511] Processing CreateTablet for tablet 92c1f13f235a4ba696bd794af135bcba (DEFAULT_TABLE table=default.Table_1db8b75e5c4f4810a2f97750a130c2cf [id=695cecaa12a14f609a50df2fbfda683f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.211004 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c1f13f235a4ba696bd794af135bcba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.214679 9666 tablet_service.cc:1511] Processing CreateTablet for tablet e2ecf7e4eb5f467789a784ad27e68907 (DEFAULT_TABLE table=default.Table_10470b028a754435980ba9eb9ccce17f [id=ac86b99a0bb348b3a0dd09400ed96bb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.214794 12407 raft_consensus.cc:2749] T 444b49a69c8245b6944a76d53041154c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:10.215178 9611 leader_election.cc:343] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:10.216074 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 34fb654d56f249c8a0353c495802250b (DEFAULT_TABLE table=default.Table_4d107d4bc3e54048b0109bcb4f5cb9f1 [id=a759e03a91744db9b9c7294728094d7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.216429 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34fb654d56f249c8a0353c495802250b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.216953 9892 tablet_service.cc:1511] Processing CreateTablet for tablet e2ecf7e4eb5f467789a784ad27e68907 (DEFAULT_TABLE table=default.Table_10470b028a754435980ba9eb9ccce17f [id=ac86b99a0bb348b3a0dd09400ed96bb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.217303 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ecf7e4eb5f467789a784ad27e68907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.222018 10118 tablet_service.cc:1511] Processing CreateTablet for tablet fe8fd79775ed44f99544694629039d26 (DEFAULT_TABLE table=default.Table_b49066c0180a40fa822769164b05dcf5 [id=b736c0c9597c4bedb2a02c82c749f096]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.222412 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe8fd79775ed44f99544694629039d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.215310 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ecf7e4eb5f467789a784ad27e68907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.216241 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 0c6565aebe894508b4cbbcd3cd0a849a (DEFAULT_TABLE table=default.Table_a49e1248aac4485dbe3017d35ed27b9d [id=e875cf37caf448b8b21d8c419f01d921]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.224531 9611 leader_election.cc:304] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:10.216775 9664 tablet_service.cc:1511] Processing CreateTablet for tablet b871027259d54ca68f0f03560703f9d7 (DEFAULT_TABLE table=default.Table_ddcd4e092322448382923cf180ac286a [id=1cb3547835c843ef92b2144ffe572bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.224792 12407 raft_consensus.cc:2749] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:10.216250 9688 tablet_service.cc:1511] Processing CreateTablet for tablet f1300e3450204afc8951ed28341270cc (DEFAULT_TABLE table=default.Table_09dc7c9d841f4f87a4451a93337fc43a [id=70e010c611234805b620e242b04f8ad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.217521 9668 tablet_service.cc:1511] Processing CreateTablet for tablet 7a51811b14da4cddbea05f0cf30aad9b (DEFAULT_TABLE table=default.Table_e337292d09af43c7877689c7d13490de [id=de9c1be5c14846a6a61609f5efc1ee0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.218590 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 1836e760dff14a1981d660a9ab33e026 (DEFAULT_TABLE table=default.Table_a28fa71d285e4fde898d3502384445e5 [id=b576c81e0105423baf16af8a48dfa316]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:10.225208 9611 leader_election.cc:343] T 64470598ccec45a7ae3e3c77fe4b9518 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:10.219282 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 34fb654d56f249c8a0353c495802250b (DEFAULT_TABLE table=default.Table_4d107d4bc3e54048b0109bcb4f5cb9f1 [id=a759e03a91744db9b9c7294728094d7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.225312 9611 leader_election.cc:304] T 64470598ccec45a7ae3e3c77fe4b9518 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:10.225535 12407 raft_consensus.cc:2749] T 64470598ccec45a7ae3e3c77fe4b9518 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:10.226002 9611 leader_election.cc:343] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:10.226145 9611 leader_election.cc:304] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:10.226699 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34fb654d56f249c8a0353c495802250b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.226833 10366 ts_tablet_manager.cc:1434] T a78960e1f2164c848297411b9273ac64 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.086s user 0.001s sys 0.001s
I20260810 19:48:10.230067 10377 raft_consensus.cc:2272] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:10.230897 10377 ts_tablet_manager.cc:1916] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:10.233351 10370 ts_tablet_manager.cc:1434] T 839dcdb448d14a8f8e452145ccf41263 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.058s user 0.002s sys 0.000s
I20260810 19:48:10.233770 10247 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:48:10.234508 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 0c6565aebe894508b4cbbcd3cd0a849a (DEFAULT_TABLE table=default.Table_a49e1248aac4485dbe3017d35ed27b9d [id=e875cf37caf448b8b21d8c419f01d921]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.234655 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1836e760dff14a1981d660a9ab33e026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.234901 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c6565aebe894508b4cbbcd3cd0a849a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.237998 12767 tablet.cc:1724] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:10.238442 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b871027259d54ca68f0f03560703f9d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.242688 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 7a51811b14da4cddbea05f0cf30aad9b (DEFAULT_TABLE table=default.Table_e337292d09af43c7877689c7d13490de [id=de9c1be5c14846a6a61609f5efc1ee0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.243088 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a51811b14da4cddbea05f0cf30aad9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.243680 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c6565aebe894508b4cbbcd3cd0a849a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.243728 9898 tablet_service.cc:1511] Processing CreateTablet for tablet b871027259d54ca68f0f03560703f9d7 (DEFAULT_TABLE table=default.Table_ddcd4e092322448382923cf180ac286a [id=1cb3547835c843ef92b2144ffe572bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.244143 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b871027259d54ca68f0f03560703f9d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.250731 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 1836e760dff14a1981d660a9ab33e026 (DEFAULT_TABLE table=default.Table_a28fa71d285e4fde898d3502384445e5 [id=b576c81e0105423baf16af8a48dfa316]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.251127 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1836e760dff14a1981d660a9ab33e026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.257258 10370 tablet_bootstrap.cc:492] T e68916e2568f4527a181342cdc728001 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:10.259979 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1300e3450204afc8951ed28341270cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.260880 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 34fb654d56f249c8a0353c495802250b (DEFAULT_TABLE table=default.Table_4d107d4bc3e54048b0109bcb4f5cb9f1 [id=a759e03a91744db9b9c7294728094d7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.261271 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34fb654d56f249c8a0353c495802250b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.262566 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a51811b14da4cddbea05f0cf30aad9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.263393 10370 tablet_bootstrap.cc:654] T e68916e2568f4527a181342cdc728001 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:10.263669 12704 tablet.cc:1724] T 5394eadabf184158864921dd5d394828 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:10.265785 12774 tablet.cc:1724] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:10.273010 9895 tablet_service.cc:1511] Processing CreateTablet for tablet fe8fd79775ed44f99544694629039d26 (DEFAULT_TABLE table=default.Table_b49066c0180a40fa822769164b05dcf5 [id=b736c0c9597c4bedb2a02c82c749f096]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.273476 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe8fd79775ed44f99544694629039d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.273412 9908 tablet_service.cc:1511] Processing CreateTablet for tablet a428dda7304f4403b804e4edefa9bd1e (DEFAULT_TABLE table=default.Table_900335c602834059af9add51cc89f115 [id=7ac6895ec78444f9aca775a79191ff24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.273777 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a428dda7304f4403b804e4edefa9bd1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.283649 12705 raft_consensus.cc:493] T 3582ed23ffdf4ff089952e29083e5425 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:10.283812 12705 raft_consensus.cc:515] T 3582ed23ffdf4ff089952e29083e5425 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.284507 12705 leader_election.cc:290] T 3582ed23ffdf4ff089952e29083e5425 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:10.285737 10067 leader_election.cc:343] T 3582ed23ffdf4ff089952e29083e5425 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 3582ed23ffdf4ff089952e29083e5425
W20260810 19:48:10.286175 10068 leader_election.cc:343] T 3582ed23ffdf4ff089952e29083e5425 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 3582ed23ffdf4ff089952e29083e5425
I20260810 19:48:10.286296 10068 leader_election.cc:304] T 3582ed23ffdf4ff089952e29083e5425 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:10.287086 12705 raft_consensus.cc:2749] T 3582ed23ffdf4ff089952e29083e5425 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:10.289454 10367 tablet_bootstrap.cc:492] T f2606854f9954f2ea10610aeb1e60368 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:10.289690 10367 ts_tablet_manager.cc:1403] T f2606854f9954f2ea10610aeb1e60368 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.184s user 0.007s sys 0.008s
I20260810 19:48:10.290580 10367 raft_consensus.cc:359] T f2606854f9954f2ea10610aeb1e60368 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.290768 10367 raft_consensus.cc:385] T f2606854f9954f2ea10610aeb1e60368 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:10.290819 10367 raft_consensus.cc:740] T f2606854f9954f2ea10610aeb1e60368 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:10.291513 10130 tablet_service.cc:1511] Processing CreateTablet for tablet a428dda7304f4403b804e4edefa9bd1e (DEFAULT_TABLE table=default.Table_900335c602834059af9add51cc89f115 [id=7ac6895ec78444f9aca775a79191ff24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.291962 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a428dda7304f4403b804e4edefa9bd1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.291033 10367 consensus_queue.cc:260] T f2606854f9954f2ea10610aeb1e60368 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.292834 10367 ts_tablet_manager.cc:1434] T f2606854f9954f2ea10610aeb1e60368 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:48:10.293151 10367 tablet_bootstrap.cc:492] T 56fa5de3bf7142b2b0978f9190091f33 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:10.297353 9687 tablet_service.cc:1511] Processing CreateTablet for tablet a428dda7304f4403b804e4edefa9bd1e (DEFAULT_TABLE table=default.Table_900335c602834059af9add51cc89f115 [id=7ac6895ec78444f9aca775a79191ff24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.297891 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a428dda7304f4403b804e4edefa9bd1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.298884 9896 tablet_service.cc:1511] Processing CreateTablet for tablet aa0f178c951848ff80a90e2944e19f51 (DEFAULT_TABLE table=default.Table_0d6d2481df1040f5b9cfc18cd9c7bfb2 [id=436203eac3364be2967d7af1f7908683]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.299286 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0f178c951848ff80a90e2944e19f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.310727 9664 tablet_service.cc:1511] Processing CreateTablet for tablet fe8fd79775ed44f99544694629039d26 (DEFAULT_TABLE table=default.Table_b49066c0180a40fa822769164b05dcf5 [id=b736c0c9597c4bedb2a02c82c749f096]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.311975 10120 tablet_service.cc:1511] Processing CreateTablet for tablet aa0f178c951848ff80a90e2944e19f51 (DEFAULT_TABLE table=default.Table_0d6d2481df1040f5b9cfc18cd9c7bfb2 [id=436203eac3364be2967d7af1f7908683]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.312520 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0f178c951848ff80a90e2944e19f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.315752 10370 tablet_bootstrap.cc:492] T e68916e2568f4527a181342cdc728001 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:10.316991 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 60798f21222443c69bacf4a799a33c8f (DEFAULT_TABLE table=default.Table_82e33c23f0d84cbc9203727b5216d5b9 [id=36e72d60ff074c289171c16d86625441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.317435 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60798f21222443c69bacf4a799a33c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.321273 12266 ts_tablet_manager.cc:1929] T 05059ef70a8e440ca2988bfeb610645d P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:10.321504 12266 log.cc:1199] T 05059ef70a8e440ca2988bfeb610645d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/05059ef70a8e440ca2988bfeb610645d
I20260810 19:48:10.321980 12266 ts_tablet_manager.cc:1950] T 05059ef70a8e440ca2988bfeb610645d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:10.322448 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 923) took 1156 ms. Trace:
I20260810 19:48:10.322646 10367 tablet_bootstrap.cc:654] T 56fa5de3bf7142b2b0978f9190091f33 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:10.322965 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe8fd79775ed44f99544694629039d26. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:10.323771 9395 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 871f8793e77845399a2e0ae7407adc75 (table default.Table_92455999000f47609f8b7df3aa63031b [id=def3a181132246f79f2589a3c7c5331f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 871f8793e77845399a2e0ae7407adc75 consensus state has no leader
W20260810 19:48:10.332744 9830 consensus_peers.cc:597] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:10.335852 10366 tablet_bootstrap.cc:492] T 4198f46be0194875aea6a7952321bc69 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:10.322614 12266 rpcz_store.cc:276] 0810 19:48:09.165951 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.166021 (+ 70us) service_pool.cc:224] Handling call
0810 19:48:10.131758 (+965737us) ts_tablet_manager.cc:1151] Deleting tablet 05059ef70a8e440ca2988bfeb610645d
0810 19:48:10.131766 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:10.156587 (+ 24821us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:10.321197 (+164610us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:10.322427 (+ 1230us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":965546}
I20260810 19:48:10.337702 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 930) took 1038 ms. Trace:
I20260810 19:48:10.337764 10366 tablet_bootstrap.cc:654] T 4198f46be0194875aea6a7952321bc69 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:10.337932 12266 rpcz_store.cc:276] 0810 19:48:09.299623 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.299687 (+ 64us) service_pool.cc:224] Handling call
0810 19:48:10.337578 (+1037891us) ts_tablet_manager.cc:1151] Deleting tablet 224bce6be88842c0a26df57326f34442
0810 19:48:10.337589 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:10.337681 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1037566}
I20260810 19:48:10.338465 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 929) took 1039 ms. Trace:
I20260810 19:48:10.338608 12266 rpcz_store.cc:276] 0810 19:48:09.299325 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.308209 (+ 8884us) service_pool.cc:224] Handling call
0810 19:48:10.338348 (+1030139us) ts_tablet_manager.cc:1151] Deleting tablet 155b48f454e74ca9bb7007f584231a37
0810 19:48:10.338358 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:10.338446 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1026024}
I20260810 19:48:10.339038 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 931) took 1039 ms. Trace:
I20260810 19:48:10.339303 12266 rpcz_store.cc:276] 0810 19:48:09.299870 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.364646 (+ 64776us) service_pool.cc:224] Handling call
0810 19:48:10.338933 (+974287us) ts_tablet_manager.cc:1151] Deleting tablet 9ae6d231840342fb8bb3493d0525c95b
0810 19:48:10.338941 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:10.339021 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":974074}
I20260810 19:48:10.339674 12266 tablet_replica.cc:333] T d6f410a1659c40f08ac274e63ad01b3d P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:10.339943 12266 raft_consensus.cc:2243] T d6f410a1659c40f08ac274e63ad01b3d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:10.339968 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 05059ef70a8e440ca2988bfeb610645d (table default.Table_39297078d5434aed9d01e90ff26623c8 [id=79f209949d0247619f04d8faa6f4568f]) successfully deleted
I20260810 19:48:10.340168 12266 raft_consensus.cc:2272] T d6f410a1659c40f08ac274e63ad01b3d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:10.340524 10370 ts_tablet_manager.cc:1403] T e68916e2568f4527a181342cdc728001 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.107s user 0.001s sys 0.003s
I20260810 19:48:10.340770 12266 ts_tablet_manager.cc:1916] T d6f410a1659c40f08ac274e63ad01b3d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:10.343075 10370 raft_consensus.cc:359] T e68916e2568f4527a181342cdc728001 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.343351 10370 raft_consensus.cc:385] T e68916e2568f4527a181342cdc728001 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:10.343454 10370 raft_consensus.cc:740] T e68916e2568f4527a181342cdc728001 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:10.343828 10370 consensus_queue.cc:260] T e68916e2568f4527a181342cdc728001 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.354696 9688 tablet_service.cc:1511] Processing CreateTablet for tablet aa0f178c951848ff80a90e2944e19f51 (DEFAULT_TABLE table=default.Table_0d6d2481df1040f5b9cfc18cd9c7bfb2 [id=436203eac3364be2967d7af1f7908683]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.355268 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0f178c951848ff80a90e2944e19f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.356006 10375 ts_tablet_manager.cc:1929] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:10.356266 12716 raft_consensus.cc:493] T a78960e1f2164c848297411b9273ac64 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:10.356351 12705 raft_consensus.cc:493] T e68916e2568f4527a181342cdc728001 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:10.356482 12705 raft_consensus.cc:515] T e68916e2568f4527a181342cdc728001 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.356426 12716 raft_consensus.cc:515] T a78960e1f2164c848297411b9273ac64 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.357125 12705 leader_election.cc:290] T e68916e2568f4527a181342cdc728001 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:10.357401 12716 leader_election.cc:290] T a78960e1f2164c848297411b9273ac64 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:10.358275 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78960e1f2164c848297411b9273ac64" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:10.358860 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68916e2568f4527a181342cdc728001" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:10.358906 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68916e2568f4527a181342cdc728001" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:10.359035 10366 tablet_bootstrap.cc:492] T 4198f46be0194875aea6a7952321bc69 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:10.359189 10366 ts_tablet_manager.cc:1403] T 4198f46be0194875aea6a7952321bc69 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.002s
I20260810 19:48:10.359983 10366 raft_consensus.cc:359] T 4198f46be0194875aea6a7952321bc69 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.360157 10366 raft_consensus.cc:385] T 4198f46be0194875aea6a7952321bc69 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:10.360225 10366 raft_consensus.cc:740] T 4198f46be0194875aea6a7952321bc69 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:10.360469 10366 consensus_queue.cc:260] T 4198f46be0194875aea6a7952321bc69 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:10.360194 9830 leader_election.cc:343] T a78960e1f2164c848297411b9273ac64 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:10.360877 10068 leader_election.cc:304] T e68916e2568f4527a181342cdc728001 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:10.361158 12774 tablet.cc:1724] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:10.361392 12705 raft_consensus.cc:2749] T e68916e2568f4527a181342cdc728001 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:10.362020 10370 ts_tablet_manager.cc:1434] T e68916e2568f4527a181342cdc728001 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20260810 19:48:10.362996 10366 ts_tablet_manager.cc:1434] T 4198f46be0194875aea6a7952321bc69 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260810 19:48:10.363302 10366 tablet_bootstrap.cc:492] T 4f21e03993e841ba901f1e9c176309b9 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:10.364754 10366 tablet_bootstrap.cc:654] T 4f21e03993e841ba901f1e9c176309b9 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:10.372898 9831 leader_election.cc:343] T a78960e1f2164c848297411b9273ac64 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: a78960e1f2164c848297411b9273ac64
I20260810 19:48:10.373055 9831 leader_election.cc:304] T a78960e1f2164c848297411b9273ac64 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:10.373937 12597 raft_consensus.cc:2749] T a78960e1f2164c848297411b9273ac64 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:10.376734 10367 tablet_bootstrap.cc:492] T 56fa5de3bf7142b2b0978f9190091f33 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:10.377192 10370 tablet_bootstrap.cc:492] T 5ba42032e7344423a0e86c55d613f27d P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:10.380674 10377 ts_tablet_manager.cc:1929] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.4
I20260810 19:48:10.380815 10377 log.cc:1199] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/fb7b722c43ee4b8698b19b2b6c1b401d
I20260810 19:48:10.377372 10375 log.cc:1199] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/0d8e8e1b5f3f452f8fdfe5a42fd021a5
I20260810 19:48:10.381217 10377 ts_tablet_manager.cc:1950] T fb7b722c43ee4b8698b19b2b6c1b401d P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:10.376910 10367 ts_tablet_manager.cc:1403] T 56fa5de3bf7142b2b0978f9190091f33 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.084s user 0.003s sys 0.001s
I20260810 19:48:10.382560 10375 ts_tablet_manager.cc:1950] T 0d8e8e1b5f3f452f8fdfe5a42fd021a5 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:10.383855 10367 raft_consensus.cc:359] T 56fa5de3bf7142b2b0978f9190091f33 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.384050 10367 raft_consensus.cc:385] T 56fa5de3bf7142b2b0978f9190091f33 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:10.384109 10367 raft_consensus.cc:740] T 56fa5de3bf7142b2b0978f9190091f33 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:10.384321 10367 consensus_queue.cc:260] T 56fa5de3bf7142b2b0978f9190091f33 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.384887 10367 ts_tablet_manager.cc:1434] T 56fa5de3bf7142b2b0978f9190091f33 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260810 19:48:10.390432 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 224bce6be88842c0a26df57326f34442 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 224bce6be88842c0a26df57326f34442 already in progress: creating tablet
W20260810 19:48:10.390597 9395 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 45926.1us
W20260810 19:48:10.390669 9397 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 50265.9us
W20260810 19:48:10.393190 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 155b48f454e74ca9bb7007f584231a37 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 155b48f454e74ca9bb7007f584231a37 already in progress: creating tablet
W20260810 19:48:10.393500 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 9ae6d231840342fb8bb3493d0525c95b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ae6d231840342fb8bb3493d0525c95b already in progress: creating tablet
I20260810 19:48:10.398378 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet fb7b722c43ee4b8698b19b2b6c1b401d (table default.Table_bd99f8533af7419086a1ae12068ad426 [id=374cf9ed870c448fbbdad7050d0d11f9]) successfully deleted
W20260810 19:48:10.399128 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet b9b567b3338845e4a37cff2a955056ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9b567b3338845e4a37cff2a955056ae already in progress: creating tablet
W20260810 19:48:10.399391 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 23234c7580b64b55b4e62ded19d187d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23234c7580b64b55b4e62ded19d187d9 already in progress: creating tablet
I20260810 19:48:10.400245 9416 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_c5cc7d3e97ae4d02952905907354f9a3 [id=2d447d5da0e74e0885490174fc0f929d] alter complete (version 1)
I20260810 19:48:10.402547 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet dbef3b19330d42779bf0a62ec742bfcb
I20260810 19:48:10.402592 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 048a81d8dc7b42a39a9891d57fcd08b0
I20260810 19:48:10.403051 9410 catalog_manager.cc:6807] ReplaceTablet: tablet dbef3b19330d42779bf0a62ec742bfcb deleted and replaced by tablet 5f9535152e6d45fa8ade32631b749678
I20260810 19:48:10.403468 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9e9b6375d5a644c2b031f68e51f013df" } modify_external_catalogs: true
I20260810 19:48:10.403650 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9e9b6375d5a644c2b031f68e51f013df" } modify_external_catalogs: true
I20260810 19:48:10.404305 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 048a81d8dc7b42a39a9891d57fcd08b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:10.403440 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_fe3c84ad30eb4d57a6d20ec860c02286" } new_table_name: "default.Table_7ed4f01934094960b0695461a48273ae" modify_external_catalogs: true
W20260810 19:48:10.405097 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bef956a173084e7698a37dddc574ea65 consensus state has no leader
I20260810 19:48:10.405519 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1422ee4f50d147659ee2338071831d14" } new_table_name: "default.Table_8ac41ee7ac68449ab4ec0876ce229843" modify_external_catalogs: true
I20260810 19:48:10.406723 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 2e0ca51bb8664f53b1c8ec2ad324c0e4
I20260810 19:48:10.406701 9668 tablet_service.cc:1511] Processing CreateTablet for tablet 59ceeb12b3284160b5bbb2ab8cce683a (DEFAULT_TABLE table=default.Table_d7913fe68d904485a11092e9ad64f6b2 [id=9a6eb91108ab486cbde24cef283623dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.407189 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59ceeb12b3284160b5bbb2ab8cce683a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.407516 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f2eccfdc3ce64e779e3c043708d87427"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:10.407789 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e0ca51bb8664f53b1c8ec2ad324c0e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:10.408092 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f2eccfdc3ce64e779e3c043708d87427 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:10.409322 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet bb0bfaf245584de889a5ab0b5dedf534
I20260810 19:48:10.409993 9418 master_service.cc:960] ReplaceTablet: received request to replace tablet 983adb7af7954ac0a2807cb75d531a5a from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:10.411065 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 3acbb90135da41b2a09ed2c36af16f71 (DEFAULT_TABLE table=default.Table_6fee6c03a97344f2bca65780c5a8245a [id=4bb639eeb0b343a0a371ad87bb3ac5b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.411257 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 016b91706e1543c289d44fcf48caed9d
I20260810 19:48:10.411494 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3acbb90135da41b2a09ed2c36af16f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.412070 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_7f9cabc0ef0f47fab0af46c6d8de5526"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:10.412639 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f9cabc0ef0f47fab0af46c6d8de5526 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:10.415422 9890 tablet_service.cc:1511] Processing CreateTablet for tablet 3acbb90135da41b2a09ed2c36af16f71 (DEFAULT_TABLE table=default.Table_6fee6c03a97344f2bca65780c5a8245a [id=4bb639eeb0b343a0a371ad87bb3ac5b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.415881 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3acbb90135da41b2a09ed2c36af16f71. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:10.415910 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d857efeee4d3442ca065221e3095d421 consensus state has no leader
I20260810 19:48:10.416311 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c3a2e190a4654d4fbbdcfa31845001f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:10.416828 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3a2e190a4654d4fbbdcfa31845001f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:10.416846 9901 tablet_service.cc:1558] Processing DeleteTablet for tablet dbef3b19330d42779bf0a62ec742bfcb with delete_type TABLET_DATA_DELETED (replaced by tablet 5f9535152e6d45fa8ade32631b749678) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:10.416872 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 048a81d8dc7b42a39a9891d57fcd08b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:10.417171 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e0ca51bb8664f53b1c8ec2ad324c0e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:10.417385 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet bb0bfaf245584de889a5ab0b5dedf534 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:10.417632 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 016b91706e1543c289d44fcf48caed9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:10.418447 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1cf64a023a0740f393ef38a3295767ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:10.419034 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1cf64a023a0740f393ef38a3295767ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:10.425124 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_90f1232af7064dc2b768da280482a20b" } new_table_name: "default.Table_aa489bdcb733479bb531e701b5330991" modify_external_catalogs: true
I20260810 19:48:10.384006 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 843) took 2383 ms. Trace:
I20260810 19:48:10.426491 10375 rpcz_store.cc:276] 0810 19:48:08.000787 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:08.000845 (+ 58us) service_pool.cc:224] Handling call
0810 19:48:10.079772 (+2078927us) ts_tablet_manager.cc:1151] Deleting tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5
0810 19:48:10.079781 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:10.281728 (+201947us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:10.355940 (+ 74212us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:10.383982 (+ 28042us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2078738}
I20260810 19:48:10.427091 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 0d8e8e1b5f3f452f8fdfe5a42fd021a5 (table default.Table_e9c516dfdc1042a283064b3839f0d7ca [id=d6d2d95e5e9f4e10a7d5a8153e66e4b6]) successfully deleted
I20260810 19:48:10.427556 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 844) took 2401 ms. Trace:
I20260810 19:48:10.427644 10375 rpcz_store.cc:276] 0810 19:48:08.025786 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:08.025858 (+ 72us) service_pool.cc:224] Handling call
0810 19:48:10.427406 (+2401548us) ts_tablet_manager.cc:1151] Deleting tablet 67d02a8eea444f3383f14a1e1f0e236b
0810 19:48:10.427420 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:10.427535 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2401307}
I20260810 19:48:10.427896 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet dbef3b19330d42779bf0a62ec742bfcb with delete_type TABLET_DATA_DELETED (replaced by tablet 5f9535152e6d45fa8ade32631b749678) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:10.428123 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 67d02a8eea444f3383f14a1e1f0e236b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67d02a8eea444f3383f14a1e1f0e236b already in progress: creating tablet
I20260810 19:48:10.429239 10370 tablet_bootstrap.cc:654] T 5ba42032e7344423a0e86c55d613f27d P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:10.429215 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ff4cce4dbac7415ab706547dbfdd5af4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:10.429822 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ff4cce4dbac7415ab706547dbfdd5af4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:10.433354 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 016b91706e1543c289d44fcf48caed9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:10.434445 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet bb0bfaf245584de889a5ab0b5dedf534 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:10.435492 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 60798f21222443c69bacf4a799a33c8f (DEFAULT_TABLE table=default.Table_82e33c23f0d84cbc9203727b5216d5b9 [id=36e72d60ff074c289171c16d86625441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.435967 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60798f21222443c69bacf4a799a33c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.441428 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 59ceeb12b3284160b5bbb2ab8cce683a (DEFAULT_TABLE table=default.Table_d7913fe68d904485a11092e9ad64f6b2 [id=9a6eb91108ab486cbde24cef283623dd]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:10.446650 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 44e5c597335a4795b8dbb708af7726ee consensus state has no leader
I20260810 19:48:10.448561 9410 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet e68916e2568f4527a181342cdc728001 (table default.Table_3e7715bf0f8c41e3bd4964a0f918c9ea [id=3babf53bc29e4d4f9be8b2c19be6e2bd]). Expected version 2 got 0
I20260810 19:48:10.449710 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ed27127a3f5146ceb644818536073842"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:10.449849 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet 839dcdb448d14a8f8e452145ccf41263 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:10.450165 9142 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 64073.3us
W20260810 19:48:10.452260 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2186b5b292ef4a04b63c1d37f2afc078 consensus state has no leader
I20260810 19:48:10.452739 12407 raft_consensus.cc:493] T d7595dbb46b6441dbb811611da116791 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:10.452903 12407 raft_consensus.cc:515] T d7595dbb46b6441dbb811611da116791 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.453617 12407 leader_election.cc:290] T d7595dbb46b6441dbb811611da116791 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:10.455287 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 983adb7af7954ac0a2807cb75d531a5a
I20260810 19:48:10.456497 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f4212f91fcc34d53b982d7373f7704eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:10.459004 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet 983adb7af7954ac0a2807cb75d531a5a with delete_type TABLET_DATA_DELETED (replaced by tablet e341b104f53c4b6bb87ca3274845e58f) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:10.461931 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed27127a3f5146ceb644818536073842 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:10.464169 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_89a370539a6b4b6a816435afdb44361f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:10.464793 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89a370539a6b4b6a816435afdb44361f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:10.466614 12407 raft_consensus.cc:493] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:10.466785 12407 raft_consensus.cc:515] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.466941 9418 catalog_manager.cc:6807] ReplaceTablet: tablet 983adb7af7954ac0a2807cb75d531a5a deleted and replaced by tablet e341b104f53c4b6bb87ca3274845e58f
I20260810 19:48:10.467497 12407 leader_election.cc:290] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:10.468432 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4212f91fcc34d53b982d7373f7704eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:10.470017 10367 tablet_bootstrap.cc:492] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:10.471055 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet a07fca1f298e4473aca7e9813bdd11d6
I20260810 19:48:10.473903 10367 tablet_bootstrap.cc:654] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:10.474418 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 983adb7af7954ac0a2807cb75d531a5a with delete_type TABLET_DATA_DELETED (replaced by tablet e341b104f53c4b6bb87ca3274845e58f) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:10.474555 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet a07fca1f298e4473aca7e9813bdd11d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:10.475029 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet a07fca1f298e4473aca7e9813bdd11d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:10.459622 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 983adb7af7954ac0a2807cb75d531a5a with delete_type TABLET_DATA_DELETED (replaced by tablet e341b104f53c4b6bb87ca3274845e58f) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:10.475901 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59ceeb12b3284160b5bbb2ab8cce683a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.476373 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet a07fca1f298e4473aca7e9813bdd11d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:48:10.476579 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4579a71f8c8149798eb5f136135e5efe consensus state has no leader
W20260810 19:48:10.476827 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 73a2e6a512224caa892ac7541131349f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73a2e6a512224caa892ac7541131349f already in progress: creating tablet
W20260810 19:48:10.477137 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 60e99cd75ada470380ab69da60ddac77 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60e99cd75ada470380ab69da60ddac77 already in progress: creating tablet
I20260810 19:48:10.474923 10377 tablet_replica.cc:333] T 839dcdb448d14a8f8e452145ccf41263 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:10.406805 10116 tablet_service.cc:1558] Processing DeleteTablet for tablet 048a81d8dc7b42a39a9891d57fcd08b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:10.393095 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 60798f21222443c69bacf4a799a33c8f (DEFAULT_TABLE table=default.Table_82e33c23f0d84cbc9203727b5216d5b9 [id=36e72d60ff074c289171c16d86625441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.406859 10136 tablet_service.cc:1558] Processing DeleteTablet for tablet dbef3b19330d42779bf0a62ec742bfcb with delete_type TABLET_DATA_DELETED (replaced by tablet 5f9535152e6d45fa8ade32631b749678) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:10.411077 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet bb0bfaf245584de889a5ab0b5dedf534 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:10.411187 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e0ca51bb8664f53b1c8ec2ad324c0e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:10.414925 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet 016b91706e1543c289d44fcf48caed9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:10.408497 10120 tablet_service.cc:1511] Processing CreateTablet for tablet 59ceeb12b3284160b5bbb2ab8cce683a (DEFAULT_TABLE table=default.Table_d7913fe68d904485a11092e9ad64f6b2 [id=9a6eb91108ab486cbde24cef283623dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.401786 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 3acbb90135da41b2a09ed2c36af16f71 (DEFAULT_TABLE table=default.Table_6fee6c03a97344f2bca65780c5a8245a [id=4bb639eeb0b343a0a371ad87bb3ac5b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.483773 10377 raft_consensus.cc:2243] T 839dcdb448d14a8f8e452145ccf41263 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:10.484037 10377 raft_consensus.cc:2272] T 839dcdb448d14a8f8e452145ccf41263 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:10.484711 10377 ts_tablet_manager.cc:1916] T 839dcdb448d14a8f8e452145ccf41263 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:10.489835 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 845) took 2462 ms. Trace:
I20260810 19:48:10.489950 10375 rpcz_store.cc:276] 0810 19:48:08.027445 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:08.027504 (+ 59us) service_pool.cc:224] Handling call
0810 19:48:10.468705 (+2441201us) ts_tablet_manager.cc:1151] Deleting tablet 8a7212453dab49fa9372c628b80219c9
0810 19:48:10.489641 (+ 20936us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:10.489796 (+ 155us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2441002}
W20260810 19:48:10.490566 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 8a7212453dab49fa9372c628b80219c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a7212453dab49fa9372c628b80219c9 already in progress: creating tablet
I20260810 19:48:10.498822 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 846) took 2466 ms. Trace:
I20260810 19:48:10.498956 10375 rpcz_store.cc:276] 0810 19:48:08.032769 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:08.032822 (+ 53us) service_pool.cc:224] Handling call
0810 19:48:10.498656 (+2465834us) ts_tablet_manager.cc:1151] Deleting tablet 8713212c586a4143b65ff044a67b8b72
0810 19:48:10.498668 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:10.498781 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2465644}
W20260810 19:48:10.499459 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 8713212c586a4143b65ff044a67b8b72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8713212c586a4143b65ff044a67b8b72 already in progress: creating tablet
I20260810 19:48:10.499833 10375 tablet_replica.cc:333] T d77785d9bde843bc8366fe15d1b4fa18 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:10.500196 10375 raft_consensus.cc:2243] T d77785d9bde843bc8366fe15d1b4fa18 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:10.500430 10375 raft_consensus.cc:2272] T d77785d9bde843bc8366fe15d1b4fa18 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:10.501121 10375 ts_tablet_manager.cc:1916] T d77785d9bde843bc8366fe15d1b4fa18 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:10.502588 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60798f21222443c69bacf4a799a33c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.504146 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59ceeb12b3284160b5bbb2ab8cce683a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.507723 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3acbb90135da41b2a09ed2c36af16f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.509150 9420 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet e68916e2568f4527a181342cdc728001 (table default.Table_3e7715bf0f8c41e3bd4964a0f918c9ea [id=3babf53bc29e4d4f9be8b2c19be6e2bd]). Expected version 2 got 0
I20260810 19:48:10.515301 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet 444b49a69c8245b6944a76d53041154c from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:10.518522 9420 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_40317d27e3de4c7ebbe4a80239f78899 [id=4e38b3a52c3549889893d804ab0dfb89] alter complete (version 2)
I20260810 19:48:10.520148 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet a78960e1f2164c848297411b9273ac64 with delete_type TABLET_DATA_DELETED (replaced by tablet fdd82537177a4142bddd0544485b00c4) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:10.521407 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 4198f46be0194875aea6a7952321bc69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:10.493422 12266 ts_tablet_manager.cc:1929] T d6f410a1659c40f08ac274e63ad01b3d P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:10.526449 12266 log.cc:1199] T d6f410a1659c40f08ac274e63ad01b3d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/d6f410a1659c40f08ac274e63ad01b3d
I20260810 19:48:10.526964 12266 ts_tablet_manager.cc:1950] T d6f410a1659c40f08ac274e63ad01b3d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:10.527962 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 932) took 1089 ms. Trace:
I20260810 19:48:10.529994 10366 tablet_bootstrap.cc:492] T 4f21e03993e841ba901f1e9c176309b9 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:10.530144 10366 ts_tablet_manager.cc:1403] T 4f21e03993e841ba901f1e9c176309b9 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.167s user 0.004s sys 0.012s
I20260810 19:48:10.530915 10366 raft_consensus.cc:359] T 4f21e03993e841ba901f1e9c176309b9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.531100 10366 raft_consensus.cc:385] T 4f21e03993e841ba901f1e9c176309b9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:10.531155 10366 raft_consensus.cc:740] T 4f21e03993e841ba901f1e9c176309b9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:10.529580 9791 heartbeater.cc:344] Connected to a master server at 127.8.235.253:37397
I20260810 19:48:10.531277 12266 rpcz_store.cc:276] 0810 19:48:09.438667 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.438825 (+ 158us) service_pool.cc:224] Handling call
0810 19:48:10.339628 (+900803us) ts_tablet_manager.cc:1151] Deleting tablet d6f410a1659c40f08ac274e63ad01b3d
0810 19:48:10.339637 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:10.490000 (+150363us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:10.493351 (+ 3351us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:10.527938 (+ 34587us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":900481}
I20260810 19:48:10.531373 10366 consensus_queue.cc:260] T 4f21e03993e841ba901f1e9c176309b9 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.531680 12266 tablet_replica.cc:333] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:10.531889 12266 raft_consensus.cc:2243] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:10.532038 12266 raft_consensus.cc:2272] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:10.532583 12266 ts_tablet_manager.cc:1916] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:10.533679 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet d6f410a1659c40f08ac274e63ad01b3d (table default.Table_82e33c23f0d84cbc9203727b5216d5b9 [id=36e72d60ff074c289171c16d86625441]) successfully deleted
I20260810 19:48:10.536556 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f21e03993e841ba901f1e9c176309b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:10.543659 9420 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet e68916e2568f4527a181342cdc728001 (table default.Table_3e7715bf0f8c41e3bd4964a0f918c9ea [id=3babf53bc29e4d4f9be8b2c19be6e2bd]). Expected version 2 got 0
I20260810 19:48:10.545410 11937 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43944 (request call id 0) took 6395 ms. Trace:
I20260810 19:48:10.545629 12540 sys_catalog.cc:455] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c56283079e74549afd0096f7e72046a. Latest consensus state: current_term: 1 leader_uuid: "0c56283079e74549afd0096f7e72046a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } } }
I20260810 19:48:10.546558 12540 sys_catalog.cc:458] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [sys.catalog]: This master's current role is: FOLLOWER
I20260810 19:48:10.546559 12622 raft_consensus.cc:493] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c56283079e74549afd0096f7e72046a)
I20260810 19:48:10.546904 12622 raft_consensus.cc:515] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } }
I20260810 19:48:10.547684 10370 tablet_bootstrap.cc:492] T 5ba42032e7344423a0e86c55d613f27d P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:10.547837 10370 ts_tablet_manager.cc:1403] T 5ba42032e7344423a0e86c55d613f27d P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.171s user 0.002s sys 0.001s
I20260810 19:48:10.548623 10370 raft_consensus.cc:359] T 5ba42032e7344423a0e86c55d613f27d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.548816 10370 raft_consensus.cc:385] T 5ba42032e7344423a0e86c55d613f27d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:10.548874 10370 raft_consensus.cc:740] T 5ba42032e7344423a0e86c55d613f27d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:10.548902 10366 ts_tablet_manager.cc:1434] T 4f21e03993e841ba901f1e9c176309b9 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260810 19:48:10.549152 10370 consensus_queue.cc:260] T 5ba42032e7344423a0e86c55d613f27d P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.549815 10370 ts_tablet_manager.cc:1434] T 5ba42032e7344423a0e86c55d613f27d P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:10.550625 12622 leader_election.cc:290] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5268e710af3c43ddab70eb7dd1aaa575 (127.8.235.254:33891), 0c56283079e74549afd0096f7e72046a (127.8.235.252:43301)
I20260810 19:48:10.560498 10366 tablet_bootstrap.cc:492] T 82c3f619c76e40c583bfcdf2bb77fe42 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:10.562187 10366 tablet_bootstrap.cc:654] T 82c3f619c76e40c583bfcdf2bb77fe42 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:10.569021 10375 ts_tablet_manager.cc:1929] T d77785d9bde843bc8366fe15d1b4fa18 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:10.572275 10120 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ba42032e7344423a0e86c55d613f27d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:05 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:10.575711 12796 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 19:48:10.576241 12266 ts_tablet_manager.cc:1929] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:10.576498 12266 log.cc:1199] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/c285518ed49d4ed68a6039f98db3b700
I20260810 19:48:10.577724 12266 ts_tablet_manager.cc:1950] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:10.578430 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 933) took 1136 ms. Trace:
I20260810 19:48:10.578735 12266 rpcz_store.cc:276] 0810 19:48:09.441521 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.441580 (+ 59us) service_pool.cc:224] Handling call
0810 19:48:10.531622 (+1090042us) ts_tablet_manager.cc:1151] Deleting tablet c285518ed49d4ed68a6039f98db3b700
0810 19:48:10.531635 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:10.563937 (+ 32302us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:10.575048 (+ 11111us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:10.578402 (+ 3354us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1089760}
I20260810 19:48:10.579437 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet c285518ed49d4ed68a6039f98db3b700 (table default.Table_bb5a9a9ebfd340fba882f6db00cf2dac [id=4b0cbb23d570430bb2d95e9c1b27bb4d]) successfully deleted
I20260810 19:48:10.579489 11901 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" instance_seqno: 1786391264640285) as {username='slave'} at 127.8.235.193:41897; Asking this server to re-register.
I20260810 19:48:10.580017 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 934) took 1137 ms. Trace:
I20260810 19:48:10.580166 12266 rpcz_store.cc:276] 0810 19:48:09.442187 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.442237 (+ 50us) service_pool.cc:224] Handling call
0810 19:48:10.579873 (+1137636us) ts_tablet_manager.cc:1151] Deleting tablet fb7364664adb424384f6b646d9e423eb
0810 19:48:10.579886 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:10.579998 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1137387}
W20260810 19:48:10.580775 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet fb7364664adb424384f6b646d9e423eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb7364664adb424384f6b646d9e423eb already in progress: creating tablet
I20260810 19:48:10.581194 12266 tablet_replica.cc:333] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:10.581470 12266 raft_consensus.cc:2243] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:10.581732 12266 raft_consensus.cc:2272] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:10.582463 12266 ts_tablet_manager.cc:1916] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:10.587030 9791 heartbeater.cc:461] Registering TS with master...
I20260810 19:48:10.589766 12266 ts_tablet_manager.cc:1929] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.4
I20260810 19:48:10.589963 12266 log.cc:1199] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/fb7b722c43ee4b8698b19b2b6c1b401d
I20260810 19:48:10.590867 12266 ts_tablet_manager.cc:1950] T fb7b722c43ee4b8698b19b2b6c1b401d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:10.591966 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 935) took 1118 ms. Trace:
I20260810 19:48:10.592127 12266 rpcz_store.cc:276] 0810 19:48:09.473709 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.473777 (+ 68us) service_pool.cc:224] Handling call
0810 19:48:10.581124 (+1107347us) ts_tablet_manager.cc:1151] Deleting tablet fb7b722c43ee4b8698b19b2b6c1b401d
0810 19:48:10.581134 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:10.586507 (+ 5373us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:10.589704 (+ 3197us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:10.591943 (+ 2239us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1107032}
I20260810 19:48:10.592344 11901 ts_manager.cc:194] Registered new tserver with Master: fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413)
I20260810 19:48:10.592765 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet fb7b722c43ee4b8698b19b2b6c1b401d (table default.Table_bd99f8533af7419086a1ae12068ad426 [id=374cf9ed870c448fbbdad7050d0d11f9]) successfully deleted
I20260810 19:48:10.593216 12266 tablet_replica.cc:333] T 6ea318eddd8349a79d27ce5746f03798 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:10.593465 12266 raft_consensus.cc:2243] T 6ea318eddd8349a79d27ce5746f03798 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:10.593705 12266 raft_consensus.cc:2272] T 6ea318eddd8349a79d27ce5746f03798 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:10.594568 12266 ts_tablet_manager.cc:1916] T 6ea318eddd8349a79d27ce5746f03798 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:10.600103 10370 tablet_bootstrap.cc:492] T 15c070c23de34348ad3426c894e11022 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:10.602294 10370 tablet_bootstrap.cc:654] T 15c070c23de34348ad3426c894e11022 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:10.609279 12266 ts_tablet_manager.cc:1929] T 6ea318eddd8349a79d27ce5746f03798 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:10.609527 12266 log.cc:1199] T 6ea318eddd8349a79d27ce5746f03798 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/6ea318eddd8349a79d27ce5746f03798
I20260810 19:48:10.609928 12266 ts_tablet_manager.cc:1950] T 6ea318eddd8349a79d27ce5746f03798 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:10.610984 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 945) took 1075 ms. Trace:
I20260810 19:48:10.611146 12266 rpcz_store.cc:276] 0810 19:48:09.535963 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.536032 (+ 69us) service_pool.cc:224] Handling call
0810 19:48:10.593162 (+1057130us) ts_tablet_manager.cc:1151] Deleting tablet 6ea318eddd8349a79d27ce5746f03798
0810 19:48:10.593173 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:10.605899 (+ 12726us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:10.609207 (+ 3308us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:10.610958 (+ 1751us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1056904}
I20260810 19:48:10.611797 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 6ea318eddd8349a79d27ce5746f03798 (table default.Table_3d2a5a2863e24c4bb90af582b7f3a9bb [id=a8b0eeac86bf4ff5a8a71ca5432d07ec]) successfully deleted
I20260810 19:48:10.612360 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 946) took 1040 ms. Trace:
I20260810 19:48:10.612493 12266 rpcz_store.cc:276] 0810 19:48:09.571457 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.571536 (+ 79us) service_pool.cc:224] Handling call
0810 19:48:10.612203 (+1040667us) ts_tablet_manager.cc:1151] Deleting tablet b9b567b3338845e4a37cff2a955056ae
0810 19:48:10.612215 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:10.612339 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1040426}
W20260810 19:48:10.613087 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet b9b567b3338845e4a37cff2a955056ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9b567b3338845e4a37cff2a955056ae already in progress: creating tablet
I20260810 19:48:10.613544 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 947) took 1022 ms. Trace:
I20260810 19:48:10.613656 12266 rpcz_store.cc:276] 0810 19:48:09.591498 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.591701 (+ 203us) service_pool.cc:224] Handling call
0810 19:48:10.613415 (+1021714us) ts_tablet_manager.cc:1151] Deleting tablet 23234c7580b64b55b4e62ded19d187d9
0810 19:48:10.613426 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:10.613527 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1021301}
W20260810 19:48:10.614181 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 23234c7580b64b55b4e62ded19d187d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23234c7580b64b55b4e62ded19d187d9 already in progress: creating tablet
I20260810 19:48:10.614353 10375 log.cc:1199] T d77785d9bde843bc8366fe15d1b4fa18 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/d77785d9bde843bc8366fe15d1b4fa18
I20260810 19:48:10.614848 10375 ts_tablet_manager.cc:1950] T d77785d9bde843bc8366fe15d1b4fa18 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:10.615233 12266 tablet_replica.cc:333] T 64470598ccec45a7ae3e3c77fe4b9518 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:10.615617 12266 raft_consensus.cc:2243] T 64470598ccec45a7ae3e3c77fe4b9518 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:10.615911 12266 raft_consensus.cc:2272] T 64470598ccec45a7ae3e3c77fe4b9518 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:10.616868 12266 ts_tablet_manager.cc:1916] T 64470598ccec45a7ae3e3c77fe4b9518 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:10.618897 10366 tablet_bootstrap.cc:492] T 82c3f619c76e40c583bfcdf2bb77fe42 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:10.619058 10366 ts_tablet_manager.cc:1403] T 82c3f619c76e40c583bfcdf2bb77fe42 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.059s user 0.006s sys 0.000s
I20260810 19:48:10.619801 10366 raft_consensus.cc:359] T 82c3f619c76e40c583bfcdf2bb77fe42 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.619980 10366 raft_consensus.cc:385] T 82c3f619c76e40c583bfcdf2bb77fe42 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:10.620033 10366 raft_consensus.cc:740] T 82c3f619c76e40c583bfcdf2bb77fe42 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:10.620244 10366 consensus_queue.cc:260] T 82c3f619c76e40c583bfcdf2bb77fe42 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.620908 10366 ts_tablet_manager.cc:1434] T 82c3f619c76e40c583bfcdf2bb77fe42 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:10.624416 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d53c7e2836b143eab54246ed5e0de77e" } modify_external_catalogs: true
I20260810 19:48:10.624621 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d53c7e2836b143eab54246ed5e0de77e" } modify_external_catalogs: true
I20260810 19:48:10.624851 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3c331b2bd94d4303a3de78c1369771bc" } modify_external_catalogs: true
I20260810 19:48:10.625069 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3c331b2bd94d4303a3de78c1369771bc" } modify_external_catalogs: true
I20260810 19:48:10.625262 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b75eaa5b58264b5281c2d648b8917164" } modify_external_catalogs: true
I20260810 19:48:10.625427 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b75eaa5b58264b5281c2d648b8917164" } modify_external_catalogs: true
I20260810 19:48:10.625080 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4217f5ad81404f348810945248421770" } modify_external_catalogs: true
I20260810 19:48:10.625676 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4217f5ad81404f348810945248421770" } modify_external_catalogs: true
I20260810 19:48:10.625926 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d5ae3dacc4c64900b971f0b4f06554a8" } new_table_name: "default.Table_afcfb74254ec4c518d0b853f26945875" modify_external_catalogs: true
I20260810 19:48:10.626271 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8c96e0380fc64018ad77605ab117ca1b" } new_table_name: "default.Table_2c8d0fdfa727465cb881c0d8ceaf26e2" modify_external_catalogs: true
I20260810 19:48:10.627660 10366 tablet_bootstrap.cc:492] T f85f3fa629764c79921a710739eea7ae P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:10.628510 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2be04a7ccc8d4e65875d3e2e16f3d858"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:10.629724 10366 tablet_bootstrap.cc:654] T f85f3fa629764c79921a710739eea7ae P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:10.631150 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 82c3f619c76e40c583bfcdf2bb77fe42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:10.634223 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_44b7608bc31044139b543b16684f5fb9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:10.613781 10367 tablet_bootstrap.cc:492] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:10.641819 10367 ts_tablet_manager.cc:1403] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.172s user 0.004s sys 0.000s
I20260810 19:48:10.646582 10367 raft_consensus.cc:359] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.646795 10367 raft_consensus.cc:385] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:10.646869 10367 raft_consensus.cc:740] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:10.648658 10366 tablet_bootstrap.cc:492] T f85f3fa629764c79921a710739eea7ae P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:10.648964 10366 ts_tablet_manager.cc:1403] T f85f3fa629764c79921a710739eea7ae P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.021s user 0.009s sys 0.003s
I20260810 19:48:10.648993 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 847) took 2612 ms. Trace:
I20260810 19:48:10.649102 10375 rpcz_store.cc:276] 0810 19:48:08.036386 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:08.036438 (+ 52us) service_pool.cc:224] Handling call
0810 19:48:10.499766 (+2463328us) ts_tablet_manager.cc:1151] Deleting tablet d77785d9bde843bc8366fe15d1b4fa18
0810 19:48:10.499776 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:10.565710 (+ 65934us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:10.568943 (+ 3233us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:10.648966 (+ 80023us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2463130}
I20260810 19:48:10.649670 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet d77785d9bde843bc8366fe15d1b4fa18 (table default.Table_3e78e13c8ecc464eb6af12a2bc3f2eba [id=1af2d06c44b643e28d28bb080cd5eef8]) successfully deleted
I20260810 19:48:10.650118 10375 tablet_replica.cc:333] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:10.650352 10375 raft_consensus.cc:2243] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:10.650763 10375 pending_rounds.cc:70] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:10.650832 10375 pending_rounds.cc:77] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058715450724352 op_type: NO_OP noop_request { }
I20260810 19:48:10.650931 10375 raft_consensus.cc:2889] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:10.651024 10375 raft_consensus.cc:2272] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:10.651024 11903 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" instance_seqno: 1786391265204214) as {username='slave'} at 127.8.235.194:52449; Asking this server to re-register.
I20260810 19:48:10.650663 10366 raft_consensus.cc:359] T f85f3fa629764c79921a710739eea7ae P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.651234 10366 raft_consensus.cc:385] T f85f3fa629764c79921a710739eea7ae P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:10.651362 10366 raft_consensus.cc:740] T f85f3fa629764c79921a710739eea7ae P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:10.651590 10375 ts_tablet_manager.cc:1916] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:10.651779 10366 consensus_queue.cc:260] T f85f3fa629764c79921a710739eea7ae P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.652576 10029 heartbeater.cc:461] Registering TS with master...
I20260810 19:48:10.653034 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2ef5bea5eb994cf689de41a97d978b28" } new_table_name: "default.Table_1881cd552cf54157a0a41766d5b1b259" modify_external_catalogs: true
I20260810 19:48:10.655093 10370 tablet_bootstrap.cc:492] T 15c070c23de34348ad3426c894e11022 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:10.655223 10370 ts_tablet_manager.cc:1403] T 15c070c23de34348ad3426c894e11022 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.055s user 0.003s sys 0.000s
I20260810 19:48:10.656621 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet f85f3fa629764c79921a710739eea7ae with delete_type TABLET_DATA_DELETED (replaced by tablet 2892d9fcdda34167a532dde7ed398590) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:10.655927 10370 raft_consensus.cc:359] T 15c070c23de34348ad3426c894e11022 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.657095 10370 raft_consensus.cc:385] T 15c070c23de34348ad3426c894e11022 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:10.657078 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_05bfdf726be7422081506c051724ef2c" } new_table_name: "default.Table_4c63250a5e124a3aba1594cbdeec5941" modify_external_catalogs: true
I20260810 19:48:10.657198 10370 raft_consensus.cc:740] T 15c070c23de34348ad3426c894e11022 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:10.657239 11903 ts_manager.cc:194] Registered new tserver with Master: 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:10.659011 10370 consensus_queue.cc:260] T 15c070c23de34348ad3426c894e11022 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.659602 10370 ts_tablet_manager.cc:1434] T 15c070c23de34348ad3426c894e11022 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 19:48:10.659638 10366 ts_tablet_manager.cc:1434] T f85f3fa629764c79921a710739eea7ae P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260810 19:48:10.659976 10370 tablet_bootstrap.cc:492] T f3600d0528164850973cb296aaf6910f P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:10.660220 10366 tablet_bootstrap.cc:492] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:10.661691 10370 tablet_bootstrap.cc:654] T f3600d0528164850973cb296aaf6910f P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:10.671361 10366 tablet_bootstrap.cc:654] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:10.671408 11901 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" instance_seqno: 1786391265751320) as {username='slave'} at 127.8.235.195:41231; Asking this server to re-register.
I20260810 19:48:10.671586 12505 raft_consensus.cc:493] T 4198f46be0194875aea6a7952321bc69 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:10.671723 12505 raft_consensus.cc:515] T 4198f46be0194875aea6a7952321bc69 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.672397 12505 leader_election.cc:290] T 4198f46be0194875aea6a7952321bc69 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:10.672955 10247 heartbeater.cc:461] Registering TS with master...
W20260810 19:48:10.674417 9831 leader_election.cc:343] T 4198f46be0194875aea6a7952321bc69 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 4198f46be0194875aea6a7952321bc69
I20260810 19:48:10.674486 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198f46be0194875aea6a7952321bc69" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:10.675073 9830 leader_election.cc:343] T 4198f46be0194875aea6a7952321bc69 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:10.675187 9830 leader_election.cc:304] T 4198f46be0194875aea6a7952321bc69 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:48:10.614924 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 73a2e6a512224caa892ac7541131349f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73a2e6a512224caa892ac7541131349f already in progress: creating tablet
W20260810 19:48:10.675745 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2be04a7ccc8d4e65875d3e2e16f3d858 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:10.675947 9397 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 61006.5us
W20260810 19:48:10.675745 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_44b7608bc31044139b543b16684f5fb9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:10.676931 11901 ts_manager.cc:194] Registered new tserver with Master: eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:10.680248 12505 raft_consensus.cc:2749] T 4198f46be0194875aea6a7952321bc69 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:10.682742 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0a3f0e184b7a472bb7ae2bea8db000ad consensus state has no leader
W20260810 19:48:10.698669 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8988c60f2d8848d98d373813bdfc2228 consensus state has no leader
W20260810 19:48:10.698616 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 56fa5de3bf7142b2b0978f9190091f33 consensus state has no leader
I20260810 19:48:10.699236 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_08b067bad4ef46b8bea521aaee69f5cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:10.700192 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_08b067bad4ef46b8bea521aaee69f5cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:10.701038 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f0efe0b783444415bf0ef90618bf426f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:10.701225 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 15c070c23de34348ad3426c894e11022 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:52 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:10.701586 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0efe0b783444415bf0ef90618bf426f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:10.702877 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_8fc1feb94cbb484d9a075740f45d658e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:10.703411 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8fc1feb94cbb484d9a075740f45d658e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:10.704847 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b4656177d37d4cb59b3e500f12b7999e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:10.705385 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4656177d37d4cb59b3e500f12b7999e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:10.707589 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 320e42f6de6c4452adb7bbb379a156e6
I20260810 19:48:10.708446 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e50bfbd91b13440fa3c5d5891d940b14"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:10.708544 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet 320e42f6de6c4452adb7bbb379a156e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:10.708987 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e50bfbd91b13440fa3c5d5891d940b14 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:10.709326 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 320e42f6de6c4452adb7bbb379a156e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:48:10.711927 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 60165d5c1664471fb665d1ed8bdda26d consensus state has no leader
I20260810 19:48:10.712615 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e9c516dfdc1042a283064b3839f0d7ca" } modify_external_catalogs: true
I20260810 19:48:10.712899 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e9c516dfdc1042a283064b3839f0d7ca" } modify_external_catalogs: true
I20260810 19:48:10.717654 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0a1a76f241a1418ba5cb63ddec738374" } new_table_name: "default.Table_20e2fe27c4df47bebcc2d32dd2207662" modify_external_catalogs: true
I20260810 19:48:10.718479 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 320e42f6de6c4452adb7bbb379a156e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:10.729281 10367 consensus_queue.cc:260] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.730804 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_46194b48775d4bafac9cbce8b13a6b48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:10.734778 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46194b48775d4bafac9cbce8b13a6b48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:10.739125 10790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f52c40e347e24ab4b3129e7064f4a43e" candidate_term: 2 candidate_status { last_received { term: 1 index: 932 } } ignore_live_leader: false dest_uuid: "5268e710af3c43ddab70eb7dd1aaa575" is_pre_election: true
I20260810 19:48:10.745592 9435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f52c40e347e24ab4b3129e7064f4a43e" candidate_term: 2 candidate_status { last_received { term: 1 index: 932 } } ignore_live_leader: false dest_uuid: "0c56283079e74549afd0096f7e72046a" is_pre_election: true
I20260810 19:48:10.746750 11831 leader_election.cc:304] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f52c40e347e24ab4b3129e7064f4a43e; no voters: 0c56283079e74549afd0096f7e72046a, 5268e710af3c43ddab70eb7dd1aaa575
I20260810 19:48:10.747409 10377 ts_tablet_manager.cc:1929] T 839dcdb448d14a8f8e452145ccf41263 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:10.747546 10377 log.cc:1199] T 839dcdb448d14a8f8e452145ccf41263 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/839dcdb448d14a8f8e452145ccf41263
I20260810 19:48:10.747532 12622 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 19:48:10.747884 10377 ts_tablet_manager.cc:1950] T 839dcdb448d14a8f8e452145ccf41263 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:10.748646 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 839dcdb448d14a8f8e452145ccf41263 (table default.Table_745ec8d1fd994242990bec7acd5bd9cd [id=435f41d3a7ba4f03a738cdb2272f759e]) successfully deleted
W20260810 19:48:10.749511 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet dbef3b19330d42779bf0a62ec742bfcb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbef3b19330d42779bf0a62ec742bfcb already in progress: creating tablet
W20260810 19:48:10.749809 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 048a81d8dc7b42a39a9891d57fcd08b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 048a81d8dc7b42a39a9891d57fcd08b0 already in progress: creating tablet
W20260810 19:48:10.750025 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 2e0ca51bb8664f53b1c8ec2ad324c0e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e0ca51bb8664f53b1c8ec2ad324c0e4 already in progress: creating tablet
W20260810 19:48:10.750200 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet bb0bfaf245584de889a5ab0b5dedf534 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb0bfaf245584de889a5ab0b5dedf534 already in progress: creating tablet
I20260810 19:48:10.750432 10377 tablet_replica.cc:333] T a78960e1f2164c848297411b9273ac64 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
W20260810 19:48:10.750437 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 016b91706e1543c289d44fcf48caed9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 016b91706e1543c289d44fcf48caed9d already in progress: creating tablet
I20260810 19:48:10.750617 10377 raft_consensus.cc:2243] T a78960e1f2164c848297411b9273ac64 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260810 19:48:10.750644 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 983adb7af7954ac0a2807cb75d531a5a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 983adb7af7954ac0a2807cb75d531a5a already in progress: creating tablet
I20260810 19:48:10.750758 10377 raft_consensus.cc:2272] T a78960e1f2164c848297411b9273ac64 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:10.750881 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet a07fca1f298e4473aca7e9813bdd11d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a07fca1f298e4473aca7e9813bdd11d6 already in progress: creating tablet
I20260810 19:48:10.759663 12266 ts_tablet_manager.cc:1929] T 64470598ccec45a7ae3e3c77fe4b9518 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:10.759809 12266 log.cc:1199] T 64470598ccec45a7ae3e3c77fe4b9518 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/64470598ccec45a7ae3e3c77fe4b9518
I20260810 19:48:10.760123 12266 ts_tablet_manager.cc:1950] T 64470598ccec45a7ae3e3c77fe4b9518 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:10.760682 12407 raft_consensus.cc:2749] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:10.760963 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_4cc3eaea7ccf4c05b30978070f06afdf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:10.761154 9611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 535125us
I20260810 19:48:10.761433 9611 leader_election.cc:304] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
W20260810 19:48:10.761557 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4cc3eaea7ccf4c05b30978070f06afdf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:10.761694 12407 raft_consensus.cc:2804] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:10.761787 12407 raft_consensus.cc:697] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:48:10.762055 12407 consensus_queue.cc:237] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:10.770747 9611 leader_election.cc:343] T 3680db3f1a5945a89c1198eb4849e58c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:10.771023 9611 leader_election.cc:343] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:10.771111 9611 leader_election.cc:304] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:10.773020 12407 raft_consensus.cc:2749] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:10.773209 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_20c0928e4abc4405930a9632cfdc0e8f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:10.773808 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20c0928e4abc4405930a9632cfdc0e8f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:10.776892 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 64470598ccec45a7ae3e3c77fe4b9518 (table default.Table_20489495f6794646b9eda0458ee58d91 [id=16ed3d0d9475472283f6d95c69c60f8d]) successfully deleted
I20260810 19:48:10.779304 12266 tablet_replica.cc:333] T 444b49a69c8245b6944a76d53041154c P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:10.779567 12266 raft_consensus.cc:2243] T 444b49a69c8245b6944a76d53041154c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:10.779770 12266 raft_consensus.cc:2272] T 444b49a69c8245b6944a76d53041154c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:10.780408 12266 ts_tablet_manager.cc:1916] T 444b49a69c8245b6944a76d53041154c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:10.786137 10370 tablet_bootstrap.cc:492] T f3600d0528164850973cb296aaf6910f P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:10.787628 10370 ts_tablet_manager.cc:1403] T f3600d0528164850973cb296aaf6910f P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.128s user 0.000s sys 0.005s
I20260810 19:48:10.788902 9421 master_service.cc:960] ReplaceTablet: received request to replace tablet 6d9a7b19ea944e73b38e56a240650dbf from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:10.789453 10370 raft_consensus.cc:359] T f3600d0528164850973cb296aaf6910f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.793650 10120 tablet_service.cc:1511] Processing CreateTablet for tablet ed5ae28144b2488fb06e436920b3ca6a (DEFAULT_TABLE table=default.Table_0a8cc6e2f1d54fff9f1b64a59e7ee6d5 [id=41756f0879c54320a6ed106c715a9e0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.794152 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed5ae28144b2488fb06e436920b3ca6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.794376 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 35162ef445fe485c819183b5e97b1b99 (DEFAULT_TABLE table=default.Table_14f61231a449417485b40e77c36c2044 [id=8d2f806f83cc4a32b30dd215a77b6821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.794788 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35162ef445fe485c819183b5e97b1b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.795239 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 0c2c83c1f47c4aefaa9d54d43b058438 (DEFAULT_TABLE table=default.Table_a7e0ec86fb03487094c665f2cf62bb9e [id=e9a0bd1b56e74ffbac36100657932143]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.795549 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c2c83c1f47c4aefaa9d54d43b058438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.751287 10377 ts_tablet_manager.cc:1916] T a78960e1f2164c848297411b9273ac64 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:10.801082 10367 ts_tablet_manager.cc:1434] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.159s user 0.012s sys 0.000s
I20260810 19:48:10.801163 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 5dafda5a18bf4c44b8e75dcdee0e9506 (DEFAULT_TABLE table=default.Table_6e6e84d564374432900236d3124c5094 [id=99d7a97179c54f8e88327e14a993864b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.801587 10367 tablet_bootstrap.cc:492] T 823bcbb987374ab4b9b0fc3d9d79b571 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:10.801601 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dafda5a18bf4c44b8e75dcdee0e9506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.803421 10367 tablet_bootstrap.cc:654] T 823bcbb987374ab4b9b0fc3d9d79b571 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:10.793638 10370 raft_consensus.cc:385] T f3600d0528164850973cb296aaf6910f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:10.804513 10370 raft_consensus.cc:740] T f3600d0528164850973cb296aaf6910f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:10.804832 10370 consensus_queue.cc:260] T f3600d0528164850973cb296aaf6910f P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.792498 9890 tablet_service.cc:1511] Processing CreateTablet for tablet 0c2c83c1f47c4aefaa9d54d43b058438 (DEFAULT_TABLE table=default.Table_a7e0ec86fb03487094c665f2cf62bb9e [id=e9a0bd1b56e74ffbac36100657932143]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.807241 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c2c83c1f47c4aefaa9d54d43b058438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.794764 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 35162ef445fe485c819183b5e97b1b99 (DEFAULT_TABLE table=default.Table_14f61231a449417485b40e77c36c2044 [id=8d2f806f83cc4a32b30dd215a77b6821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.794958 9898 tablet_service.cc:1511] Processing CreateTablet for tablet ed5ae28144b2488fb06e436920b3ca6a (DEFAULT_TABLE table=default.Table_0a8cc6e2f1d54fff9f1b64a59e7ee6d5 [id=41756f0879c54320a6ed106c715a9e0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.753173 10366 tablet_bootstrap.cc:492] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:10.811591 10366 ts_tablet_manager.cc:1403] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.152s user 0.015s sys 0.043s
I20260810 19:48:10.812767 10370 ts_tablet_manager.cc:1434] T f3600d0528164850973cb296aaf6910f P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.024s user 0.001s sys 0.001s
I20260810 19:48:10.813156 10370 tablet_bootstrap.cc:492] T a78960e1f2164c848297411b9273ac64 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:10.814802 10366 raft_consensus.cc:359] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.814989 10366 raft_consensus.cc:385] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:10.815394 10366 raft_consensus.cc:740] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:10.815622 10366 consensus_queue.cc:260] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.816150 10366 ts_tablet_manager.cc:1434] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260810 19:48:10.816481 10366 tablet_bootstrap.cc:492] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:10.817682 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35162ef445fe485c819183b5e97b1b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.816159 10120 tablet_service.cc:1558] Processing DeleteTablet for tablet f3600d0528164850973cb296aaf6910f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:51 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:10.818356 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed5ae28144b2488fb06e436920b3ca6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.820987 10370 tablet_bootstrap.cc:654] T a78960e1f2164c848297411b9273ac64 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:10.821807 10366 tablet_bootstrap.cc:654] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:10.824741 10375 ts_tablet_manager.cc:1929] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:10.824879 10375 log.cc:1199] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/63486cc3f8774a11827b1cc5f1c16332
I20260810 19:48:10.825246 10375 ts_tablet_manager.cc:1950] T 63486cc3f8774a11827b1cc5f1c16332 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:10.826121 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 851) took 2520 ms. Trace:
I20260810 19:48:10.827147 9413 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 3840b035b88243ecad17865d4716fcfc (table default.Table_e1cc6dd116324bf385dbc82e56283cf7 [id=6bf4ac94189d476d9ab5778e69d0b14f]). Expected version 1 got 0
I20260810 19:48:10.835793 9413 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 3840b035b88243ecad17865d4716fcfc (table default.Table_e1cc6dd116324bf385dbc82e56283cf7 [id=6bf4ac94189d476d9ab5778e69d0b14f]). Expected version 1 got 0
I20260810 19:48:10.836511 12266 ts_tablet_manager.cc:1929] T 444b49a69c8245b6944a76d53041154c P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:10.836777 12266 log.cc:1199] T 444b49a69c8245b6944a76d53041154c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/444b49a69c8245b6944a76d53041154c
I20260810 19:48:10.837154 12266 ts_tablet_manager.cc:1950] T 444b49a69c8245b6944a76d53041154c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:10.841207 10370 tablet_bootstrap.cc:492] T a78960e1f2164c848297411b9273ac64 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:10.841548 10370 ts_tablet_manager.cc:1403] T a78960e1f2164c848297411b9273ac64 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.002s
I20260810 19:48:10.842509 10366 tablet_bootstrap.cc:492] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:10.842654 10366 ts_tablet_manager.cc:1403] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20260810 19:48:10.842492 10370 raft_consensus.cc:359] T a78960e1f2164c848297411b9273ac64 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.843240 10370 raft_consensus.cc:385] T a78960e1f2164c848297411b9273ac64 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:10.843384 10370 raft_consensus.cc:740] T a78960e1f2164c848297411b9273ac64 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:10.843422 10366 raft_consensus.cc:359] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.843593 10366 raft_consensus.cc:385] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:10.843648 10366 raft_consensus.cc:740] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:10.843825 10370 consensus_queue.cc:260] T a78960e1f2164c848297411b9273ac64 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.843871 10366 consensus_queue.cc:260] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.846261 10370 ts_tablet_manager.cc:1434] T a78960e1f2164c848297411b9273ac64 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260810 19:48:10.846630 10370 tablet_bootstrap.cc:492] T 39885c3e0adb4132945d507628f4f082 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:10.847828 9413 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet f3e3dde1c29e4275bafb27df63b117be (table default.Table_da45ba37a0804616b521723bc724e0f0 [id=d5afb5c8b2d042e5aec4a0721e2cae1d]). Expected version 1 got 0
I20260810 19:48:10.848248 12266 tablet_replica.cc:333] T 253f302c00cc42ff84076b0c17f7670a P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:10.848953 12266 raft_consensus.cc:2243] T 253f302c00cc42ff84076b0c17f7670a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:10.850766 10366 ts_tablet_manager.cc:1434] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260810 19:48:10.851114 10366 tablet_bootstrap.cc:492] T d6f410a1659c40f08ac274e63ad01b3d P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:10.851173 9668 tablet_service.cc:1511] Processing CreateTablet for tablet 0c2c83c1f47c4aefaa9d54d43b058438 (DEFAULT_TABLE table=default.Table_a7e0ec86fb03487094c665f2cf62bb9e [id=e9a0bd1b56e74ffbac36100657932143]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.852618 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 35162ef445fe485c819183b5e97b1b99 (DEFAULT_TABLE table=default.Table_14f61231a449417485b40e77c36c2044 [id=8d2f806f83cc4a32b30dd215a77b6821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.852857 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c2c83c1f47c4aefaa9d54d43b058438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.853063 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35162ef445fe485c819183b5e97b1b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.851986 9687 tablet_service.cc:1511] Processing CreateTablet for tablet ed5ae28144b2488fb06e436920b3ca6a (DEFAULT_TABLE table=default.Table_0a8cc6e2f1d54fff9f1b64a59e7ee6d5 [id=41756f0879c54320a6ed106c715a9e0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.855378 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed5ae28144b2488fb06e436920b3ca6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.856684 10366 tablet_bootstrap.cc:654] T d6f410a1659c40f08ac274e63ad01b3d P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:10.860704 10366 tablet_bootstrap.cc:492] T d6f410a1659c40f08ac274e63ad01b3d P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:10.860877 10366 ts_tablet_manager.cc:1403] T d6f410a1659c40f08ac274e63ad01b3d P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260810 19:48:10.861690 10366 raft_consensus.cc:359] T d6f410a1659c40f08ac274e63ad01b3d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.861883 10366 raft_consensus.cc:385] T d6f410a1659c40f08ac274e63ad01b3d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:10.861945 10366 raft_consensus.cc:740] T d6f410a1659c40f08ac274e63ad01b3d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:10.867949 10118 tablet_service.cc:1511] Processing CreateTablet for tablet e34a2947aad5407296472ac30ac587c7 (DEFAULT_TABLE table=default.Table_05f9785f4f5a4404a794f70ab8a399b4 [id=c1097452afaf49eeb67c11c9504fb2c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.868371 12266 raft_consensus.cc:2272] T 253f302c00cc42ff84076b0c17f7670a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:10.868466 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e34a2947aad5407296472ac30ac587c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.868862 10366 consensus_queue.cc:260] T d6f410a1659c40f08ac274e63ad01b3d P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.869771 12266 ts_tablet_manager.cc:1916] T 253f302c00cc42ff84076b0c17f7670a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:10.870038 10370 tablet_bootstrap.cc:654] T 39885c3e0adb4132945d507628f4f082 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:10.871532 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 78297ffad28145aebaa8fb551a321195 (DEFAULT_TABLE table=default.Table_13e20dfd1cf0474498db046286dfbb77 [id=01fbddac162145969132ee4b8de60af4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.871955 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78297ffad28145aebaa8fb551a321195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.872206 10120 tablet_service.cc:1511] Processing CreateTablet for tablet 5dafda5a18bf4c44b8e75dcdee0e9506 (DEFAULT_TABLE table=default.Table_6e6e84d564374432900236d3124c5094 [id=99d7a97179c54f8e88327e14a993864b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.872574 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dafda5a18bf4c44b8e75dcdee0e9506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.877935 10366 ts_tablet_manager.cc:1434] T d6f410a1659c40f08ac274e63ad01b3d P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260810 19:48:10.879230 12505 raft_consensus.cc:493] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:10.879377 12505 raft_consensus.cc:515] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.880017 12505 leader_election.cc:290] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:10.880640 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3840b035b88243ecad17865d4716fcfc" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:10.880910 9715 raft_consensus.cc:2468] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:10.881593 9831 leader_election.cc:304] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:10.882050 12716 raft_consensus.cc:2804] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:10.882138 12716 raft_consensus.cc:493] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:10.882189 12716 raft_consensus.cc:3060] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:10.882822 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3840b035b88243ecad17865d4716fcfc" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:10.883222 9898 tablet_service.cc:1511] Processing CreateTablet for tablet e34a2947aad5407296472ac30ac587c7 (DEFAULT_TABLE table=default.Table_05f9785f4f5a4404a794f70ab8a399b4 [id=c1097452afaf49eeb67c11c9504fb2c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.883628 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e34a2947aad5407296472ac30ac587c7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:10.883925 9830 leader_election.cc:343] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:10.884905 12716 raft_consensus.cc:515] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.885648 12716 leader_election.cc:290] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:10.886070 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3840b035b88243ecad17865d4716fcfc" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:10.886276 9715 raft_consensus.cc:3060] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:10.889183 9715 raft_consensus.cc:2468] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:10.889904 9831 leader_election.cc:304] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:10.890259 12505 raft_consensus.cc:493] T 82c3f619c76e40c583bfcdf2bb77fe42 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:10.890424 12505 raft_consensus.cc:515] T 82c3f619c76e40c583bfcdf2bb77fe42 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.891032 12505 leader_election.cc:290] T 82c3f619c76e40c583bfcdf2bb77fe42 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:10.891165 12505 raft_consensus.cc:2804] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:10.891260 12505 raft_consensus.cc:697] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:10.891486 12505 consensus_queue.cc:237] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.891882 10366 tablet_bootstrap.cc:492] T ca733de7babe4343ab26dbca2c9020b2 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
W20260810 19:48:10.893997 9831 leader_election.cc:343] T 82c3f619c76e40c583bfcdf2bb77fe42 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 82c3f619c76e40c583bfcdf2bb77fe42
I20260810 19:48:10.894345 10366 tablet_bootstrap.cc:654] T ca733de7babe4343ab26dbca2c9020b2 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:10.895781 12266 ts_tablet_manager.cc:1929] T 253f302c00cc42ff84076b0c17f7670a P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:10.896965 10370 tablet_bootstrap.cc:492] T 39885c3e0adb4132945d507628f4f082 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:10.897192 10370 ts_tablet_manager.cc:1403] T 39885c3e0adb4132945d507628f4f082 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.051s user 0.005s sys 0.000s
I20260810 19:48:10.898085 10370 raft_consensus.cc:359] T 39885c3e0adb4132945d507628f4f082 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.898363 10370 raft_consensus.cc:385] T 39885c3e0adb4132945d507628f4f082 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:10.898485 10370 raft_consensus.cc:740] T 39885c3e0adb4132945d507628f4f082 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:10.898798 10370 consensus_queue.cc:260] T 39885c3e0adb4132945d507628f4f082 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.898838 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3840b035b88243ecad17865d4716fcfc" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:10.826205 10375 rpcz_store.cc:276] 0810 19:48:08.306045 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:08.306658 (+ 613us) service_pool.cc:224] Handling call
0810 19:48:10.650067 (+2343409us) ts_tablet_manager.cc:1151] Deleting tablet 63486cc3f8774a11827b1cc5f1c16332
0810 19:48:10.650075 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:10.794737 (+144662us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:10.824676 (+ 29939us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:10.826095 (+ 1419us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2304553}
I20260810 19:48:10.899549 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c3f619c76e40c583bfcdf2bb77fe42" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:10.902179 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 63486cc3f8774a11827b1cc5f1c16332 (table default.Table_f1a090bd6e0042b58f8b6f478fc4fb11 [id=2e90b67006f344688d2b021965d8abdf]) successfully deleted
I20260810 19:48:10.902629 10375 tablet_replica.cc:333] T 72b39babf851404c89adb317033015ec P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:10.903745 10367 tablet_bootstrap.cc:492] T 823bcbb987374ab4b9b0fc3d9d79b571 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:10.903796 12266 log.cc:1199] T 253f302c00cc42ff84076b0c17f7670a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/253f302c00cc42ff84076b0c17f7670a
I20260810 19:48:10.903928 10367 ts_tablet_manager.cc:1403] T 823bcbb987374ab4b9b0fc3d9d79b571 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.102s user 0.005s sys 0.001s
I20260810 19:48:10.903578 10370 ts_tablet_manager.cc:1434] T 39885c3e0adb4132945d507628f4f082 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260810 19:48:10.904093 10375 raft_consensus.cc:2243] T 72b39babf851404c89adb317033015ec P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:10.904265 10375 raft_consensus.cc:2272] T 72b39babf851404c89adb317033015ec P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:10.904238 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_908340b735984b7db22ce5c7ce794987" } new_table_name: "default.Table_7608eb36c694476587c4fcd03b7d9162" modify_external_catalogs: true
I20260810 19:48:10.904493 10370 tablet_bootstrap.cc:492] T 4c75af1e592042f5a4d442b82a539c94 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:10.904834 10375 ts_tablet_manager.cc:1916] T 72b39babf851404c89adb317033015ec P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:10.904790 10367 raft_consensus.cc:359] T 823bcbb987374ab4b9b0fc3d9d79b571 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.904984 10367 raft_consensus.cc:385] T 823bcbb987374ab4b9b0fc3d9d79b571 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:10.905062 10367 raft_consensus.cc:740] T 823bcbb987374ab4b9b0fc3d9d79b571 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:10.905325 10367 consensus_queue.cc:260] T 823bcbb987374ab4b9b0fc3d9d79b571 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.905332 12266 ts_tablet_manager.cc:1950] T 253f302c00cc42ff84076b0c17f7670a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:10.905838 10367 ts_tablet_manager.cc:1434] T 823bcbb987374ab4b9b0fc3d9d79b571 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:10.906148 10367 tablet_bootstrap.cc:492] T 99aa001db52149dd90ce86e7261f7424 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:10.907101 12266 tablet_replica.cc:333] T f6f9eb86c6c84b4a84d109d4741238e1 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:10.907387 12266 raft_consensus.cc:2243] T f6f9eb86c6c84b4a84d109d4741238e1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260810 19:48:10.907806 9830 leader_election.cc:343] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:10.908267 9830 leader_election.cc:343] T 82c3f619c76e40c583bfcdf2bb77fe42 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:10.908522 9830 leader_election.cc:304] T 82c3f619c76e40c583bfcdf2bb77fe42 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:10.908957 12716 raft_consensus.cc:2749] T 82c3f619c76e40c583bfcdf2bb77fe42 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:10.909286 12266 raft_consensus.cc:2272] T f6f9eb86c6c84b4a84d109d4741238e1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:10.909933 12266 ts_tablet_manager.cc:1916] T f6f9eb86c6c84b4a84d109d4741238e1 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:10.910027 10367 tablet_bootstrap.cc:654] T 99aa001db52149dd90ce86e7261f7424 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:10.911423 10377 ts_tablet_manager.cc:1929] T a78960e1f2164c848297411b9273ac64 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:10.911549 10377 log.cc:1199] T a78960e1f2164c848297411b9273ac64 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/a78960e1f2164c848297411b9273ac64
I20260810 19:48:10.911931 10377 ts_tablet_manager.cc:1950] T a78960e1f2164c848297411b9273ac64 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:10.913072 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_14a3eacb9f0740e2bea3ccaf3ce9fc7f" } new_table_name: "default.Table_44e1a363b81646b9bf4cf6ca6cda52cf" modify_external_catalogs: true
I20260810 19:48:10.921597 12266 ts_tablet_manager.cc:1929] T f6f9eb86c6c84b4a84d109d4741238e1 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:10.923326 12266 log.cc:1199] T f6f9eb86c6c84b4a84d109d4741238e1 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/f6f9eb86c6c84b4a84d109d4741238e1
I20260810 19:48:10.923801 12266 ts_tablet_manager.cc:1950] T f6f9eb86c6c84b4a84d109d4741238e1 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:10.926054 10366 tablet_bootstrap.cc:492] T ca733de7babe4343ab26dbca2c9020b2 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:10.926221 10366 ts_tablet_manager.cc:1403] T ca733de7babe4343ab26dbca2c9020b2 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.005s
I20260810 19:48:10.927158 10366 raft_consensus.cc:359] T ca733de7babe4343ab26dbca2c9020b2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.927315 10377 tablet_replica.cc:333] T 4198f46be0194875aea6a7952321bc69 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:10.927342 10366 raft_consensus.cc:385] T ca733de7babe4343ab26dbca2c9020b2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:10.927393 10366 raft_consensus.cc:740] T ca733de7babe4343ab26dbca2c9020b2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:10.927506 10377 raft_consensus.cc:2243] T 4198f46be0194875aea6a7952321bc69 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:10.927649 10377 raft_consensus.cc:2272] T 4198f46be0194875aea6a7952321bc69 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:10.927899 10366 consensus_queue.cc:260] T ca733de7babe4343ab26dbca2c9020b2 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.928188 10377 ts_tablet_manager.cc:1916] T 4198f46be0194875aea6a7952321bc69 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:10.928543 10366 ts_tablet_manager.cc:1434] T ca733de7babe4343ab26dbca2c9020b2 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 19:48:10.928508 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 78297ffad28145aebaa8fb551a321195 (DEFAULT_TABLE table=default.Table_13e20dfd1cf0474498db046286dfbb77 [id=01fbddac162145969132ee4b8de60af4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.928808 10366 tablet_bootstrap.cc:492] T 60bd14fb8c2e40dc955352518d463ccb P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:10.932343 10367 tablet_bootstrap.cc:492] T 99aa001db52149dd90ce86e7261f7424 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:10.932530 10367 ts_tablet_manager.cc:1403] T 99aa001db52149dd90ce86e7261f7424 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.004s
I20260810 19:48:10.915074 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 444b49a69c8245b6944a76d53041154c (table default.Table_070cfe9bb949439ca652e166a5c0f63e [id=a16bb67de06846c38f490000206e507f]) successfully deleted
I20260810 19:48:10.932910 10370 tablet_bootstrap.cc:654] T 4c75af1e592042f5a4d442b82a539c94 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:10.933221 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 253f302c00cc42ff84076b0c17f7670a (table default.Table_ab79ddcb17e24ce7960c0c41dd451bc2 [id=9a73a382c71249058e61be3b0146826f]) successfully deleted
I20260810 19:48:10.933486 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet f6f9eb86c6c84b4a84d109d4741238e1 (table default.Table_3102211b2b544d6bae3547d4f9af2574 [id=c10c35b78ae24250a48631468376e8ea]) successfully deleted
I20260810 19:48:10.933506 10367 raft_consensus.cc:359] T 99aa001db52149dd90ce86e7261f7424 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.933708 10367 raft_consensus.cc:385] T 99aa001db52149dd90ce86e7261f7424 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:10.933801 10367 raft_consensus.cc:740] T 99aa001db52149dd90ce86e7261f7424 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:10.934128 10367 consensus_queue.cc:260] T 99aa001db52149dd90ce86e7261f7424 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.934736 10367 ts_tablet_manager.cc:1434] T 99aa001db52149dd90ce86e7261f7424 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:10.934710 9668 tablet_service.cc:1511] Processing CreateTablet for tablet 78297ffad28145aebaa8fb551a321195 (DEFAULT_TABLE table=default.Table_13e20dfd1cf0474498db046286dfbb77 [id=01fbddac162145969132ee4b8de60af4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.935146 10367 tablet_bootstrap.cc:492] T 3520274768ed41abb010bb109127affa P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:10.935220 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78297ffad28145aebaa8fb551a321195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.937047 10367 tablet_bootstrap.cc:654] T 3520274768ed41abb010bb109127affa P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:10.942296 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 5dafda5a18bf4c44b8e75dcdee0e9506 (DEFAULT_TABLE table=default.Table_6e6e84d564374432900236d3124c5094 [id=99d7a97179c54f8e88327e14a993864b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.942855 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dafda5a18bf4c44b8e75dcdee0e9506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.947191 12505 raft_consensus.cc:493] T 4f21e03993e841ba901f1e9c176309b9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:10.947363 12505 raft_consensus.cc:515] T 4f21e03993e841ba901f1e9c176309b9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.947422 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 651d224a2957465f889cce7408dffa45 (DEFAULT_TABLE table=default.Table_aeddf7c6df8a47eaaf1ff9da8fefc3d2 [id=99495eea31fc4581afa7ac7cdbc074ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.947551 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 88b92f1cd29b405a99693dc92210fd4d (DEFAULT_TABLE table=default.Table_01dc43c2a0894d7683e627655cd4c0b5 [id=9062fbc31f6e402d9be6b8f66ecea5d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.947836 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 651d224a2957465f889cce7408dffa45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.948050 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b92f1cd29b405a99693dc92210fd4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.948045 12505 leader_election.cc:290] T 4f21e03993e841ba901f1e9c176309b9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:10.950142 10366 tablet_bootstrap.cc:654] T 60bd14fb8c2e40dc955352518d463ccb P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:10.951624 12699 raft_consensus.cc:493] T 839dcdb448d14a8f8e452145ccf41263 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:10.951815 12699 raft_consensus.cc:515] T 839dcdb448d14a8f8e452145ccf41263 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.952562 12699 leader_election.cc:290] T 839dcdb448d14a8f8e452145ccf41263 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:10.953886 10067 leader_election.cc:343] T 839dcdb448d14a8f8e452145ccf41263 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 839dcdb448d14a8f8e452145ccf41263
W20260810 19:48:10.954892 10068 leader_election.cc:343] T 839dcdb448d14a8f8e452145ccf41263 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 839dcdb448d14a8f8e452145ccf41263
I20260810 19:48:10.955039 10068 leader_election.cc:304] T 839dcdb448d14a8f8e452145ccf41263 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:10.955538 12699 raft_consensus.cc:2749] T 839dcdb448d14a8f8e452145ccf41263 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:10.956254 9831 leader_election.cc:343] T 4f21e03993e841ba901f1e9c176309b9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 4f21e03993e841ba901f1e9c176309b9
I20260810 19:48:10.956794 9668 tablet_service.cc:1511] Processing CreateTablet for tablet e34a2947aad5407296472ac30ac587c7 (DEFAULT_TABLE table=default.Table_05f9785f4f5a4404a794f70ab8a399b4 [id=c1097452afaf49eeb67c11c9504fb2c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.957271 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e34a2947aad5407296472ac30ac587c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.958046 12266 tablet_replica.cc:333] T 3680db3f1a5945a89c1198eb4849e58c P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:10.958571 12266 raft_consensus.cc:2243] T 3680db3f1a5945a89c1198eb4849e58c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:10.958560 9407 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet f3e3dde1c29e4275bafb27df63b117be (table default.Table_da45ba37a0804616b521723bc724e0f0 [id=d5afb5c8b2d042e5aec4a0721e2cae1d]). Expected version 1 got 0
I20260810 19:48:10.959160 12266 raft_consensus.cc:2272] T 3680db3f1a5945a89c1198eb4849e58c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:10.959595 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4e1acd3ace89465287fb5819b364098e" } new_table_name: "default.Table_5430d2ba62784e2ab1c5b83502fa4be5" modify_external_catalogs: true
I20260810 19:48:10.960109 12266 ts_tablet_manager.cc:1916] T 3680db3f1a5945a89c1198eb4849e58c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:10.960518 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78297ffad28145aebaa8fb551a321195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.913744 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet a78960e1f2164c848297411b9273ac64 (table default.Table_21d8962dbe56454188c9a5b8729034c3 [id=d277a804313e4f35a31b58d4f682efe6]) successfully deleted
W20260810 19:48:10.961336 9395 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 47623.5us
I20260810 19:48:10.962261 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 651d224a2957465f889cce7408dffa45 (DEFAULT_TABLE table=default.Table_aeddf7c6df8a47eaaf1ff9da8fefc3d2 [id=99495eea31fc4581afa7ac7cdbc074ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.963570 9913 tablet_service.cc:1511] Processing CreateTablet for tablet ab5814fc52ab418e8e3701458210d4b6 (DEFAULT_TABLE table=default.Table_56ed643105684c67b9ee649bcbbb993c [id=7bdd0ebb0b5e4c418dd996ebd02b08a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.963881 10120 tablet_service.cc:1511] Processing CreateTablet for tablet ab5814fc52ab418e8e3701458210d4b6 (DEFAULT_TABLE table=default.Table_56ed643105684c67b9ee649bcbbb993c [id=7bdd0ebb0b5e4c418dd996ebd02b08a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.964891 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff798aa9ef5439bbfc2c1aa3b7eac6d (DEFAULT_TABLE table=default.Table_8f2b600b476e4a3ea8e7a450dad062a0 [id=4abe053396894a568779974165e1f34d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.965209 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff798aa9ef5439bbfc2c1aa3b7eac6d (DEFAULT_TABLE table=default.Table_8f2b600b476e4a3ea8e7a450dad062a0 [id=4abe053396894a568779974165e1f34d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.968053 10370 tablet_bootstrap.cc:492] T 4c75af1e592042f5a4d442b82a539c94 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:10.968283 10370 ts_tablet_manager.cc:1403] T 4c75af1e592042f5a4d442b82a539c94 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.064s user 0.007s sys 0.003s
I20260810 19:48:10.969204 10370 raft_consensus.cc:359] T 4c75af1e592042f5a4d442b82a539c94 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.969461 10370 raft_consensus.cc:385] T 4c75af1e592042f5a4d442b82a539c94 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:10.969563 10370 raft_consensus.cc:740] T 4c75af1e592042f5a4d442b82a539c94 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:10.969831 10370 consensus_queue.cc:260] T 4c75af1e592042f5a4d442b82a539c94 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.971140 10370 ts_tablet_manager.cc:1434] T 4c75af1e592042f5a4d442b82a539c94 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 19:48:10.974577 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 88b92f1cd29b405a99693dc92210fd4d (DEFAULT_TABLE table=default.Table_01dc43c2a0894d7683e627655cd4c0b5 [id=9062fbc31f6e402d9be6b8f66ecea5d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.982548 12266 ts_tablet_manager.cc:1929] T 3680db3f1a5945a89c1198eb4849e58c P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:10.982812 12266 log.cc:1199] T 3680db3f1a5945a89c1198eb4849e58c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/3680db3f1a5945a89c1198eb4849e58c
I20260810 19:48:10.970458 10118 tablet_service.cc:1511] Processing CreateTablet for tablet 88b92f1cd29b405a99693dc92210fd4d (DEFAULT_TABLE table=default.Table_01dc43c2a0894d7683e627655cd4c0b5 [id=9062fbc31f6e402d9be6b8f66ecea5d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.983389 12266 ts_tablet_manager.cc:1950] T 3680db3f1a5945a89c1198eb4849e58c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:10.986048 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet a78960e1f2164c848297411b9273ac64 with delete_type TABLET_DATA_DELETED (replaced by tablet fdd82537177a4142bddd0544485b00c4) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:10.991731 9664 tablet_service.cc:1511] Processing CreateTablet for tablet ab5814fc52ab418e8e3701458210d4b6 (DEFAULT_TABLE table=default.Table_56ed643105684c67b9ee649bcbbb993c [id=7bdd0ebb0b5e4c418dd996ebd02b08a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:10.992237 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab5814fc52ab418e8e3701458210d4b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.995000 10375 ts_tablet_manager.cc:1929] T 72b39babf851404c89adb317033015ec P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:10.995411 10366 tablet_bootstrap.cc:492] T 60bd14fb8c2e40dc955352518d463ccb P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:10.995630 10366 ts_tablet_manager.cc:1403] T 60bd14fb8c2e40dc955352518d463ccb P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.067s user 0.011s sys 0.003s
I20260810 19:48:10.996536 10366 raft_consensus.cc:359] T 60bd14fb8c2e40dc955352518d463ccb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.996809 10366 raft_consensus.cc:385] T 60bd14fb8c2e40dc955352518d463ccb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:10.996879 10366 raft_consensus.cc:740] T 60bd14fb8c2e40dc955352518d463ccb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:10.997134 10375 log.cc:1199] T 72b39babf851404c89adb317033015ec P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/72b39babf851404c89adb317033015ec
I20260810 19:48:10.997141 10366 consensus_queue.cc:260] T 60bd14fb8c2e40dc955352518d463ccb P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:10.998097 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 651d224a2957465f889cce7408dffa45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.998360 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab5814fc52ab418e8e3701458210d4b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:10.998685 10375 ts_tablet_manager.cc:1950] T 72b39babf851404c89adb317033015ec P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:10.998754 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff798aa9ef5439bbfc2c1aa3b7eac6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.001942 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b92f1cd29b405a99693dc92210fd4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.006963 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f21e03993e841ba901f1e9c176309b9" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:11.009635 9830 leader_election.cc:343] T 4f21e03993e841ba901f1e9c176309b9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.009799 9830 leader_election.cc:304] T 4f21e03993e841ba901f1e9c176309b9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:11.010430 12505 raft_consensus.cc:2749] T 4f21e03993e841ba901f1e9c176309b9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.013051 10366 ts_tablet_manager.cc:1434] T 60bd14fb8c2e40dc955352518d463ccb P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260810 19:48:11.014580 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff798aa9ef5439bbfc2c1aa3b7eac6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.022944 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab5814fc52ab418e8e3701458210d4b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.023001 10370 tablet_bootstrap.cc:492] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:11.025058 10370 tablet_bootstrap.cc:654] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.027031 10366 tablet_bootstrap.cc:492] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:11.029646 10377 ts_tablet_manager.cc:1929] T 4198f46be0194875aea6a7952321bc69 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:11.029824 10377 log.cc:1199] T 4198f46be0194875aea6a7952321bc69 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/4198f46be0194875aea6a7952321bc69
I20260810 19:48:11.030177 10377 ts_tablet_manager.cc:1950] T 4198f46be0194875aea6a7952321bc69 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:11.031831 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b92f1cd29b405a99693dc92210fd4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.035143 10370 tablet_bootstrap.cc:492] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:11.035378 10370 ts_tablet_manager.cc:1403] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.001s
I20260810 19:48:11.036202 10370 raft_consensus.cc:359] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.036460 10370 raft_consensus.cc:385] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.036554 10370 raft_consensus.cc:740] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.036963 10370 consensus_queue.cc:260] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.037464 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 4198f46be0194875aea6a7952321bc69 (table default.Table_066ecd6fc0e0441eb69e39d946ba0b9a [id=f5ad4bd8b30e44e9b14bd6dfcc2bbb28]) successfully deleted
I20260810 19:48:11.037665 10370 ts_tablet_manager.cc:1434] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 19:48:11.038195 10370 tablet_bootstrap.cc:492] T 0e967384768b4ec7956f1b508e8ab2af P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:11.040903 10377 tablet_replica.cc:333] T 4f21e03993e841ba901f1e9c176309b9 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:11.041124 10377 raft_consensus.cc:2243] T 4f21e03993e841ba901f1e9c176309b9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:11.041306 10377 raft_consensus.cc:2272] T 4f21e03993e841ba901f1e9c176309b9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:11.041923 10377 ts_tablet_manager.cc:1916] T 4f21e03993e841ba901f1e9c176309b9 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:11.042971 10370 tablet_bootstrap.cc:654] T 0e967384768b4ec7956f1b508e8ab2af P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.044442 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff798aa9ef5439bbfc2c1aa3b7eac6d (DEFAULT_TABLE table=default.Table_8f2b600b476e4a3ea8e7a450dad062a0 [id=4abe053396894a568779974165e1f34d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.044929 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff798aa9ef5439bbfc2c1aa3b7eac6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.023001 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 852) took 2716 ms. Trace:
I20260810 19:48:11.049527 10375 rpcz_store.cc:276] 0810 19:48:08.306161 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:08.306811 (+ 650us) service_pool.cc:224] Handling call
0810 19:48:10.902578 (+2595767us) ts_tablet_manager.cc:1151] Deleting tablet 72b39babf851404c89adb317033015ec
0810 19:48:10.902589 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:10.939347 (+ 36758us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:10.994924 (+ 55577us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:11.022973 (+ 28049us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2556991}
I20260810 19:48:11.050123 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 853) took 2743 ms. Trace:
I20260810 19:48:11.050298 10375 rpcz_store.cc:276] 0810 19:48:08.306271 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:08.306915 (+ 644us) service_pool.cc:224] Handling call
0810 19:48:11.050007 (+2743092us) ts_tablet_manager.cc:1151] Deleting tablet 9e8a23221e8447bd83592c05c9d1149c
0810 19:48:11.050018 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:11.050103 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2704371}
I20260810 19:48:11.050710 10375 tablet_replica.cc:333] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:11.051281 10375 raft_consensus.cc:2243] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:11.051322 10366 tablet_bootstrap.cc:654] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.051704 10375 pending_rounds.cc:70] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:11.051810 10375 pending_rounds.cc:77] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058715404472320 op_type: NO_OP noop_request { }
I20260810 19:48:11.053145 10367 tablet_bootstrap.cc:492] T 3520274768ed41abb010bb109127affa P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:11.053412 10367 ts_tablet_manager.cc:1403] T 3520274768ed41abb010bb109127affa P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.118s user 0.011s sys 0.006s
I20260810 19:48:11.054344 10367 raft_consensus.cc:359] T 3520274768ed41abb010bb109127affa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.054633 10367 raft_consensus.cc:385] T 3520274768ed41abb010bb109127affa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.054769 10367 raft_consensus.cc:740] T 3520274768ed41abb010bb109127affa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.055132 10367 consensus_queue.cc:260] T 3520274768ed41abb010bb109127affa P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.056567 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 72b39babf851404c89adb317033015ec (table default.Table_2d7f246476ac4544a3fa089ec3c52657 [id=c681008d2b5f43a9b7b6ed2d72653b1b]) successfully deleted
W20260810 19:48:11.056926 9395 catalog_manager.cc:5017] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 9e8a23221e8447bd83592c05c9d1149c because the tablet was not found. No further retry: Not found: Tablet not found: 9e8a23221e8447bd83592c05c9d1149c
I20260810 19:48:11.057493 10375 raft_consensus.cc:2889] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:11.057689 10375 raft_consensus.cc:2272] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:11.058444 10375 ts_tablet_manager.cc:1916] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:11.059554 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 60e99cd75ada470380ab69da60ddac77 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60e99cd75ada470380ab69da60ddac77 already in progress: creating tablet
I20260810 19:48:11.060730 10367 ts_tablet_manager.cc:1434] T 3520274768ed41abb010bb109127affa P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260810 19:48:11.061916 12699 raft_consensus.cc:493] T a78960e1f2164c848297411b9273ac64 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.062045 12699 raft_consensus.cc:515] T a78960e1f2164c848297411b9273ac64 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.062698 12699 leader_election.cc:290] T a78960e1f2164c848297411b9273ac64 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:11.063969 10067 leader_election.cc:343] T a78960e1f2164c848297411b9273ac64 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: a78960e1f2164c848297411b9273ac64
W20260810 19:48:11.065303 10068 leader_election.cc:343] T a78960e1f2164c848297411b9273ac64 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: a78960e1f2164c848297411b9273ac64
I20260810 19:48:11.065496 10068 leader_election.cc:304] T a78960e1f2164c848297411b9273ac64 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:11.065829 12699 raft_consensus.cc:2749] T a78960e1f2164c848297411b9273ac64 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.066762 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 651d224a2957465f889cce7408dffa45 (DEFAULT_TABLE table=default.Table_aeddf7c6df8a47eaaf1ff9da8fefc3d2 [id=99495eea31fc4581afa7ac7cdbc074ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.067260 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 651d224a2957465f889cce7408dffa45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.071470 10367 tablet_bootstrap.cc:492] T b4b6b17ce3354600b2f7450c6e483c69 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:11.073623 10367 tablet_bootstrap.cc:654] T b4b6b17ce3354600b2f7450c6e483c69 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.075451 10366 tablet_bootstrap.cc:492] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:11.075618 10366 ts_tablet_manager.cc:1403] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.001s
I20260810 19:48:11.076380 10366 raft_consensus.cc:359] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:11.076560 10366 raft_consensus.cc:385] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.076608 10366 raft_consensus.cc:740] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.076864 10366 consensus_queue.cc:260] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:11.077399 10366 ts_tablet_manager.cc:1434] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:11.077694 10366 tablet_bootstrap.cc:492] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:11.075768 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 962) took 1065 ms. Trace:
I20260810 19:48:11.078436 12266 rpcz_store.cc:276] 0810 19:48:10.009839 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:10.010038 (+ 199us) service_pool.cc:224] Handling call
0810 19:48:10.957948 (+947910us) ts_tablet_manager.cc:1151] Deleting tablet 3680db3f1a5945a89c1198eb4849e58c
0810 19:48:10.957958 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:10.975554 (+ 17596us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:10.982436 (+ 6882us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:11.075723 (+ 93287us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":857738}
W20260810 19:48:11.079418 9611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 308376us
I20260810 19:48:11.080363 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7595dbb46b6441dbb811611da116791" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:11.081346 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7595dbb46b6441dbb811611da116791" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:11.082350 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c285518ed49d4ed68a6039f98db3b700" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:11.082465 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c285518ed49d4ed68a6039f98db3b700" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:11.086408 12266 tablet_replica.cc:333] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
W20260810 19:48:11.086411 9611 leader_election.cc:343] T 3680db3f1a5945a89c1198eb4849e58c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.086617 9611 leader_election.cc:304] T 3680db3f1a5945a89c1198eb4849e58c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:11.086697 12266 raft_consensus.cc:2243] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 19:48:11.086825 9611 raft_consensus.cc:2686] T 3680db3f1a5945a89c1198eb4849e58c P fcd31b1bbb0340cbacfce652b4ad8da4: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 19:48:11.086928 12266 raft_consensus.cc:2272] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:11.087488 9611 leader_election.cc:343] T d7595dbb46b6441dbb811611da116791 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.087580 12266 ts_tablet_manager.cc:1916] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:11.087673 9611 leader_election.cc:343] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:11.088762 9611 leader_election.cc:343] T d7595dbb46b6441dbb811611da116791 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.088884 9611 leader_election.cc:304] T d7595dbb46b6441dbb811611da116791 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:11.089201 12819 raft_consensus.cc:2749] T d7595dbb46b6441dbb811611da116791 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:11.089591 9611 leader_election.cc:343] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.089704 9611 leader_election.cc:304] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
W20260810 19:48:11.089879 9611 raft_consensus.cc:2686] T c285518ed49d4ed68a6039f98db3b700 P fcd31b1bbb0340cbacfce652b4ad8da4: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 19:48:11.096024 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 3680db3f1a5945a89c1198eb4849e58c (table default.Table_68efca25ddd74752b30341b528693d1f [id=9601a761027047a2bbd739f0a1f86cd0]) successfully deleted
W20260810 19:48:11.096421 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 048a81d8dc7b42a39a9891d57fcd08b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 048a81d8dc7b42a39a9891d57fcd08b0 already in progress: creating tablet
W20260810 19:48:11.096797 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 2e0ca51bb8664f53b1c8ec2ad324c0e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e0ca51bb8664f53b1c8ec2ad324c0e4 already in progress: creating tablet
I20260810 19:48:11.096961 12266 ts_tablet_manager.cc:1929] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:11.097105 12266 log.cc:1199] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/320e42f6de6c4452adb7bbb379a156e6
I20260810 19:48:11.097273 10366 tablet_bootstrap.cc:654] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.097496 12266 ts_tablet_manager.cc:1950] T 320e42f6de6c4452adb7bbb379a156e6 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:11.102594 10367 tablet_bootstrap.cc:492] T b4b6b17ce3354600b2f7450c6e483c69 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:11.102779 10367 ts_tablet_manager.cc:1403] T b4b6b17ce3354600b2f7450c6e483c69 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.001s
I20260810 19:48:11.103611 10367 raft_consensus.cc:359] T b4b6b17ce3354600b2f7450c6e483c69 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.103818 10367 raft_consensus.cc:385] T b4b6b17ce3354600b2f7450c6e483c69 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.103904 10367 raft_consensus.cc:740] T b4b6b17ce3354600b2f7450c6e483c69 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.104147 10367 consensus_queue.cc:260] T b4b6b17ce3354600b2f7450c6e483c69 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:11.106290 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet dbef3b19330d42779bf0a62ec742bfcb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbef3b19330d42779bf0a62ec742bfcb already in progress: creating tablet
W20260810 19:48:11.106659 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 016b91706e1543c289d44fcf48caed9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 016b91706e1543c289d44fcf48caed9d already in progress: creating tablet
W20260810 19:48:11.106940 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet bb0bfaf245584de889a5ab0b5dedf534 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb0bfaf245584de889a5ab0b5dedf534 already in progress: creating tablet
W20260810 19:48:11.107231 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 983adb7af7954ac0a2807cb75d531a5a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 983adb7af7954ac0a2807cb75d531a5a already in progress: creating tablet
W20260810 19:48:11.107498 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet a07fca1f298e4473aca7e9813bdd11d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a07fca1f298e4473aca7e9813bdd11d6 already in progress: creating tablet
I20260810 19:48:11.107977 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 320e42f6de6c4452adb7bbb379a156e6 (table default.Table_d53c7e2836b143eab54246ed5e0de77e [id=5354f5d091794b14806dd9bc872da0ae]) successfully deleted
I20260810 19:48:11.108872 10375 ts_tablet_manager.cc:1929] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:11.108996 10375 log.cc:1199] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/ae3e151180ae4d258d18365770acaaad
I20260810 19:48:11.109421 10375 ts_tablet_manager.cc:1950] T ae3e151180ae4d258d18365770acaaad P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:11.109556 10377 ts_tablet_manager.cc:1929] T 4f21e03993e841ba901f1e9c176309b9 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:11.109683 10377 log.cc:1199] T 4f21e03993e841ba901f1e9c176309b9 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/4f21e03993e841ba901f1e9c176309b9
I20260810 19:48:11.110028 10377 ts_tablet_manager.cc:1950] T 4f21e03993e841ba901f1e9c176309b9 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:11.111208 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 4f21e03993e841ba901f1e9c176309b9 (table default.Table_a5aa062540ad4b02bf89b59e8ebc8cd7 [id=6c0a50477acc489cb3a3895e7cda4eca]) successfully deleted
I20260810 19:48:11.110028 10366 tablet_bootstrap.cc:492] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:11.113054 10366 ts_tablet_manager.cc:1403] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.035s user 0.000s sys 0.004s
I20260810 19:48:11.113870 10366 raft_consensus.cc:359] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.114044 10366 raft_consensus.cc:385] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.114091 10366 raft_consensus.cc:740] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.116695 10377 tablet_replica.cc:333] T 82c3f619c76e40c583bfcdf2bb77fe42 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:11.116910 10377 raft_consensus.cc:2243] T 82c3f619c76e40c583bfcdf2bb77fe42 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:11.117058 10377 raft_consensus.cc:2272] T 82c3f619c76e40c583bfcdf2bb77fe42 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:11.116124 10366 consensus_queue.cc:260] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.120061 10367 ts_tablet_manager.cc:1434] T b4b6b17ce3354600b2f7450c6e483c69 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260810 19:48:11.120430 10367 tablet_bootstrap.cc:492] T 1f895bcd21f647f2ab813903d600a31a P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:11.122206 10367 tablet_bootstrap.cc:654] T 1f895bcd21f647f2ab813903d600a31a P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.124816 10366 ts_tablet_manager.cc:1434] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260810 19:48:11.130722 10377 ts_tablet_manager.cc:1916] T 82c3f619c76e40c583bfcdf2bb77fe42 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:11.135856 10366 tablet_bootstrap.cc:492] T 31c2b9a4b8334e678b4632fc2f58dd0c P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:11.144593 10367 tablet_bootstrap.cc:492] T 1f895bcd21f647f2ab813903d600a31a P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:11.144783 10367 ts_tablet_manager.cc:1403] T 1f895bcd21f647f2ab813903d600a31a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.000s
I20260810 19:48:11.145661 10367 raft_consensus.cc:359] T 1f895bcd21f647f2ab813903d600a31a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.145890 10367 raft_consensus.cc:385] T 1f895bcd21f647f2ab813903d600a31a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.145967 10367 raft_consensus.cc:740] T 1f895bcd21f647f2ab813903d600a31a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.110283 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 850) took 2804 ms. Trace:
I20260810 19:48:11.132378 12699 raft_consensus.cc:493] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6986ed920dcb4af29a5eeeda6f671691)
I20260810 19:48:11.147147 12699 raft_consensus.cc:515] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.147090 10375 rpcz_store.cc:276] 0810 19:48:08.305892 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:08.307011 (+ 1119us) service_pool.cc:224] Handling call
0810 19:48:11.050661 (+2743650us) ts_tablet_manager.cc:1151] Deleting tablet ae3e151180ae4d258d18365770acaaad
0810 19:48:11.050672 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:11.105641 (+ 54969us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:11.108813 (+ 3172us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:11.110248 (+ 1435us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2704987}
I20260810 19:48:11.147704 10375 tablet_replica.cc:333] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:11.147863 12699 leader_election.cc:290] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:11.147910 10375 raft_consensus.cc:2243] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:11.148221 10375 pending_rounds.cc:70] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:11.148283 10375 pending_rounds.cc:77] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058715434729472 op_type: NO_OP noop_request { }
I20260810 19:48:11.148375 10375 raft_consensus.cc:2889] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:11.148451 10375 raft_consensus.cc:2272] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:11.149055 10375 ts_tablet_manager.cc:1916] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:11.149530 10067 leader_election.cc:343] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 7d93fd6556b146ca8933a6dc0a2357e8
W20260810 19:48:11.150784 10068 leader_election.cc:343] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 7d93fd6556b146ca8933a6dc0a2357e8
I20260810 19:48:11.150909 10068 leader_election.cc:304] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:11.151444 12699 raft_consensus.cc:2749] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 19:48:11.146235 10367 consensus_queue.cc:260] T 1f895bcd21f647f2ab813903d600a31a P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.151989 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet ae3e151180ae4d258d18365770acaaad (table default.Table_250f18957ff84ad58246dfec016f0abf [id=197d5993ea8643288fe8814a51e4bfd4]) successfully deleted
I20260810 19:48:11.152861 12699 raft_consensus.cc:493] T 5ba42032e7344423a0e86c55d613f27d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.152976 12699 raft_consensus.cc:515] T 5ba42032e7344423a0e86c55d613f27d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.153609 12699 leader_election.cc:290] T 5ba42032e7344423a0e86c55d613f27d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:11.155308 10067 leader_election.cc:343] T 5ba42032e7344423a0e86c55d613f27d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 5ba42032e7344423a0e86c55d613f27d
W20260810 19:48:11.157160 10068 leader_election.cc:343] T 5ba42032e7344423a0e86c55d613f27d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 5ba42032e7344423a0e86c55d613f27d
I20260810 19:48:11.157299 10068 leader_election.cc:304] T 5ba42032e7344423a0e86c55d613f27d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:11.156709 10367 ts_tablet_manager.cc:1434] T 1f895bcd21f647f2ab813903d600a31a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20260810 19:48:11.159945 10367 tablet_bootstrap.cc:492] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:11.160333 10366 tablet_bootstrap.cc:654] T 31c2b9a4b8334e678b4632fc2f58dd0c P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.161824 10367 tablet_bootstrap.cc:654] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.163367 12699 raft_consensus.cc:2749] T 5ba42032e7344423a0e86c55d613f27d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.164717 10366 tablet_bootstrap.cc:492] T 31c2b9a4b8334e678b4632fc2f58dd0c P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:11.164902 10366 ts_tablet_manager.cc:1403] T 31c2b9a4b8334e678b4632fc2f58dd0c P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.000s
I20260810 19:48:11.165769 10366 raft_consensus.cc:359] T 31c2b9a4b8334e678b4632fc2f58dd0c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.165958 10366 raft_consensus.cc:385] T 31c2b9a4b8334e678b4632fc2f58dd0c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.166006 10366 raft_consensus.cc:740] T 31c2b9a4b8334e678b4632fc2f58dd0c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.172888 12716 raft_consensus.cc:493] T 60bd14fb8c2e40dc955352518d463ccb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.173064 12716 raft_consensus.cc:515] T 60bd14fb8c2e40dc955352518d463ccb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.173712 12716 leader_election.cc:290] T 60bd14fb8c2e40dc955352518d463ccb P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:11.175228 9831 leader_election.cc:343] T 60bd14fb8c2e40dc955352518d463ccb P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 60bd14fb8c2e40dc955352518d463ccb
I20260810 19:48:11.175846 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60bd14fb8c2e40dc955352518d463ccb" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:11.176578 9830 leader_election.cc:343] T 60bd14fb8c2e40dc955352518d463ccb P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.176697 9830 leader_election.cc:304] T 60bd14fb8c2e40dc955352518d463ccb P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:11.177201 12716 raft_consensus.cc:2749] T 60bd14fb8c2e40dc955352518d463ccb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.182687 10375 ts_tablet_manager.cc:1929] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:11.182835 10375 log.cc:1199] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/8455cb11388340beb6daa13fee06177a
I20260810 19:48:11.183267 10375 ts_tablet_manager.cc:1950] T 8455cb11388340beb6daa13fee06177a P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:11.184175 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 849) took 2878 ms. Trace:
I20260810 19:48:11.184413 10370 tablet_bootstrap.cc:492] T 0e967384768b4ec7956f1b508e8ab2af P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:11.184619 10370 ts_tablet_manager.cc:1403] T 0e967384768b4ec7956f1b508e8ab2af P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.146s user 0.007s sys 0.010s
I20260810 19:48:11.185506 10370 raft_consensus.cc:359] T 0e967384768b4ec7956f1b508e8ab2af P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.185709 10370 raft_consensus.cc:385] T 0e967384768b4ec7956f1b508e8ab2af P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.185801 10370 raft_consensus.cc:740] T 0e967384768b4ec7956f1b508e8ab2af P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.186106 10370 consensus_queue.cc:260] T 0e967384768b4ec7956f1b508e8ab2af P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.186842 10370 ts_tablet_manager.cc:1434] T 0e967384768b4ec7956f1b508e8ab2af P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:11.186702 12861 tablet.cc:1724] T a45add97e0e54dce85225e175ecbb45a P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260810 19:48:11.188078 12716 raft_consensus.cc:493] T d6f410a1659c40f08ac274e63ad01b3d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.188372 12716 raft_consensus.cc:515] T d6f410a1659c40f08ac274e63ad01b3d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.189086 10370 tablet_bootstrap.cc:492] T 639c824ba4834734a4ebfd558181bebe P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:11.189961 12864 tablet.cc:1724] T a45add97e0e54dce85225e175ecbb45a P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260810 19:48:11.190132 12716 leader_election.cc:290] T d6f410a1659c40f08ac274e63ad01b3d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:11.192515 9831 leader_election.cc:343] T d6f410a1659c40f08ac274e63ad01b3d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: d6f410a1659c40f08ac274e63ad01b3d
I20260810 19:48:11.192543 10366 consensus_queue.cc:260] T 31c2b9a4b8334e678b4632fc2f58dd0c P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.191296 10370 tablet_bootstrap.cc:654] T 639c824ba4834734a4ebfd558181bebe P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.184293 10375 rpcz_store.cc:276] 0810 19:48:08.305748 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:08.306363 (+ 615us) service_pool.cc:224] Handling call
0810 19:48:11.147648 (+2841285us) ts_tablet_manager.cc:1151] Deleting tablet 8455cb11388340beb6daa13fee06177a
0810 19:48:11.147661 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:11.165292 (+ 17631us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:11.182605 (+ 17313us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:11.184149 (+ 1544us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2801926}
I20260810 19:48:11.197520 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 8455cb11388340beb6daa13fee06177a (table default.Table_9fc2f929c6aa4ff286e66b35f18da641 [id=2a56448ab2544b8ca7a6a49841520fc4]) successfully deleted
I20260810 19:48:11.204458 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f410a1659c40f08ac274e63ad01b3d" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:11.207489 9830 leader_election.cc:343] T d6f410a1659c40f08ac274e63ad01b3d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.207656 9830 leader_election.cc:304] T d6f410a1659c40f08ac274e63ad01b3d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:11.208449 12716 raft_consensus.cc:2749] T d6f410a1659c40f08ac274e63ad01b3d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.211419 12699 raft_consensus.cc:493] T 15c070c23de34348ad3426c894e11022 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.211587 12699 raft_consensus.cc:515] T 15c070c23de34348ad3426c894e11022 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.212415 12699 leader_election.cc:290] T 15c070c23de34348ad3426c894e11022 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:11.213666 10067 leader_election.cc:343] T 15c070c23de34348ad3426c894e11022 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 15c070c23de34348ad3426c894e11022
I20260810 19:48:11.214236 12716 raft_consensus.cc:493] T ca733de7babe4343ab26dbca2c9020b2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.214414 12716 raft_consensus.cc:515] T ca733de7babe4343ab26dbca2c9020b2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:11.214954 10068 leader_election.cc:343] T 15c070c23de34348ad3426c894e11022 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 15c070c23de34348ad3426c894e11022
I20260810 19:48:11.215049 12716 leader_election.cc:290] T ca733de7babe4343ab26dbca2c9020b2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:11.215060 10068 leader_election.cc:304] T 15c070c23de34348ad3426c894e11022 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:11.215451 12699 raft_consensus.cc:2749] T 15c070c23de34348ad3426c894e11022 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.219583 12823 raft_consensus.cc:493] T f2606854f9954f2ea10610aeb1e60368 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.219759 12823 raft_consensus.cc:515] T f2606854f9954f2ea10610aeb1e60368 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.220507 12823 leader_election.cc:290] T f2606854f9954f2ea10610aeb1e60368 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:11.220996 12861 tablet.cc:1724] T e68916e2568f4527a181342cdc728001 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:11.222452 10366 ts_tablet_manager.cc:1434] T 31c2b9a4b8334e678b4632fc2f58dd0c P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.057s user 0.001s sys 0.001s
I20260810 19:48:11.222822 10366 tablet_bootstrap.cc:492] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:11.224392 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca733de7babe4343ab26dbca2c9020b2" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:11.225306 10366 tablet_bootstrap.cc:654] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:11.226179 9830 leader_election.cc:343] T ca733de7babe4343ab26dbca2c9020b2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.226841 10377 ts_tablet_manager.cc:1929] T 82c3f619c76e40c583bfcdf2bb77fe42 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:11.226946 10377 log.cc:1199] T 82c3f619c76e40c583bfcdf2bb77fe42 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/82c3f619c76e40c583bfcdf2bb77fe42
I20260810 19:48:11.226892 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2606854f9954f2ea10610aeb1e60368" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:11.227299 10377 ts_tablet_manager.cc:1950] T 82c3f619c76e40c583bfcdf2bb77fe42 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:11.227964 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2606854f9954f2ea10610aeb1e60368" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:11.228228 10375 tablet_replica.cc:333] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:11.228332 10377 tablet_replica.cc:333] T f85f3fa629764c79921a710739eea7ae P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:11.228338 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet 39885c3e0adb4132945d507628f4f082 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:11.228437 10375 raft_consensus.cc:2243] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:11.228525 10377 raft_consensus.cc:2243] T f85f3fa629764c79921a710739eea7ae P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:11.228534 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 82c3f619c76e40c583bfcdf2bb77fe42 (table default.Table_267ef2e8b32c47328dd2094f69e0940d [id=0f7622612fec444b93d9454f31849cd7]) successfully deleted
I20260810 19:48:11.228677 10377 raft_consensus.cc:2272] T f85f3fa629764c79921a710739eea7ae P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:11.228756 10375 pending_rounds.cc:70] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:11.228811 10375 pending_rounds.cc:77] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058714287194112 op_type: NO_OP noop_request { }
I20260810 19:48:11.228892 10375 raft_consensus.cc:2889] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:11.228968 10375 raft_consensus.cc:2272] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:11.229364 9611 leader_election.cc:343] T f2606854f9954f2ea10610aeb1e60368 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:11.230527 9611 leader_election.cc:343] T f2606854f9954f2ea10610aeb1e60368 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.230677 9611 leader_election.cc:304] T f2606854f9954f2ea10610aeb1e60368 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:11.231266 12823 raft_consensus.cc:2749] T f2606854f9954f2ea10610aeb1e60368 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.231561 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c75af1e592042f5a4d442b82a539c94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:11.232997 10375 ts_tablet_manager.cc:1916] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:11.239215 10370 tablet_bootstrap.cc:492] T 639c824ba4834734a4ebfd558181bebe P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:11.239475 10370 ts_tablet_manager.cc:1403] T 639c824ba4834734a4ebfd558181bebe P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.050s user 0.004s sys 0.000s
W20260810 19:48:11.239462 9831 leader_election.cc:343] T ca733de7babe4343ab26dbca2c9020b2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: ca733de7babe4343ab26dbca2c9020b2
I20260810 19:48:11.239593 9831 leader_election.cc:304] T ca733de7babe4343ab26dbca2c9020b2 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:11.240247 12716 raft_consensus.cc:2749] T ca733de7babe4343ab26dbca2c9020b2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.240460 10370 raft_consensus.cc:359] T 639c824ba4834734a4ebfd558181bebe P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.240629 10370 raft_consensus.cc:385] T 639c824ba4834734a4ebfd558181bebe P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.240679 10370 raft_consensus.cc:740] T 639c824ba4834734a4ebfd558181bebe P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.240939 10370 consensus_queue.cc:260] T 639c824ba4834734a4ebfd558181bebe P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.241636 10370 ts_tablet_manager.cc:1434] T 639c824ba4834734a4ebfd558181bebe P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:11.242062 10370 tablet_bootstrap.cc:492] T b33aa8be266a434cba899da7514c47e9 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:11.243889 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 7459e64bd48449d2a8d4ff835b215d46
I20260810 19:48:11.245683 10370 tablet_bootstrap.cc:654] T b33aa8be266a434cba899da7514c47e9 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.246728 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 6d9a7b19ea944e73b38e56a240650dbf
I20260810 19:48:11.247824 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1908057f69774dad9aba1261a71de96c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:11.248690 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1908057f69774dad9aba1261a71de96c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:11.250983 12823 raft_consensus.cc:493] T b4b6b17ce3354600b2f7450c6e483c69 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.251178 12823 raft_consensus.cc:515] T b4b6b17ce3354600b2f7450c6e483c69 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.251649 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet bef956a173084e7698a37dddc574ea65
I20260810 19:48:11.251955 12823 leader_election.cc:290] T b4b6b17ce3354600b2f7450c6e483c69 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:11.252418 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e9beb6e0dbe741c4a2582c7024a00ac1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:11.252645 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d9a7b19ea944e73b38e56a240650dbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:11.253057 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9beb6e0dbe741c4a2582c7024a00ac1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:11.254446 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b6b17ce3354600b2f7450c6e483c69" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:11.254856 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 81aabb5656e7472f9223fd7acf10e43c
W20260810 19:48:11.255210 9611 leader_election.cc:343] T b4b6b17ce3354600b2f7450c6e483c69 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.255508 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_744b0ef1592749908ad53111cb98fa1c" } new_table_name: "default.Table_82e11ef45a7c49eda078cf80df544938" modify_external_catalogs: true
I20260810 19:48:11.255888 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 7459e64bd48449d2a8d4ff835b215d46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:10.546972 11937 rpcz_store.cc:276] 0810 19:48:04.150418 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:04.150495 (+ 77us) service_pool.cc:224] Handling call
0810 19:48:07.966147 (+3815652us) raft_consensus.cc:1471] Updating replica for 362 ops
0810 19:48:07.998350 (+ 32203us) raft_consensus.cc:1534] Early marking committed up to index 578
0810 19:48:08.072441 (+ 74091us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:08.072449 (+ 8us) write_op.cc:454] Released schema lock
0810 19:48:08.082940 (+ 10491us) write_op.cc:489] Releasing partition, row and schema locks
0810 19:48:08.082950 (+ 10us) write_op.cc:454] Released schema lock
0810 19:48:08.083179 (+ 229us) raft_consensus.cc:1539] Triggering prepare for 354 ops
0810 19:48:08.083610 (+ 431us) write_op.cc:270] Start()
0810 19:48:08.083669 (+ 59us) write_op.cc:276] Timestamp: P: 1786391275747775 usec, L: 0
0810 19:48:08.084017 (+ 348us) write_op.cc:270] Start()
0810 19:48:08.084041 (+ 24us) write_op.cc:276] Timestamp: P: 1786391275923931 usec, L: 0
0810 19:48:08.084217 (+ 176us) write_op.cc:270] Start()
0810 19:48:08.084237 (+ 20us) write_op.cc:276] Timestamp: P: 1786391275934683 usec, L: 0
0810 19:48:08.084374 (+ 137us) write_op.cc:270] Start()
0810 19:48:08.084396 (+ 22us) write_op.cc:276] Timestamp: P: 1786391275936367 usec, L: 0
0810 19:48:08.084581 (+ 185us) write_op.cc:270] Start()
0810 19:48:08.084599 (+ 18us) write_op.cc:276] Timestamp: P: 1786391275936930 usec, L: 0
0810 19:48:08.084744 (+ 145us) write_op.cc:270] Start()
0810 19:48:08.113826 (+ 29082us) write_op.cc:276] Timestamp: P: 1786391275937466 usec, L: 0
0810 19:48:08.114155 (+ 329us) write_op.cc:270] Start()
0810 19:48:08.114187 (+ 32us) write_op.cc:276] Timestamp: P: 1786391275938001 usec, L: 0
0810 19:48:08.122391 (+ 8204us) write_op.cc:270] Start()
0810 19:48:08.122442 (+ 51us) write_op.cc:276] Timestamp: P: 1786391275943708 usec, L: 0
0810 19:48:08.123729 (+ 1287us) write_op.cc:270] Start()
0810 19:48:08.123770 (+ 41us) write_op.cc:276] Timestamp: P: 1786391275948240 usec, L: 0
0810 19:48:08.129502 (+ 5732us) write_op.cc:270] Start()
0810 19:48:08.129537 (+ 35us) write_op.cc:276] Timestamp: P: 1786391275965245 usec, L: 0
0810 19:48:08.136453 (+ 6916us) write_op.cc:270] Start()
0810 19:48:08.136491 (+ 38us) write_op.cc:276] Timestamp: P: 1786391275998984 usec, L: 0
0810 19:48:08.150886 (+ 14395us) write_op.cc:270] Start()
0810 19:48:08.150924 (+ 38us) write_op.cc:276] Timestamp: P: 1786391276051294 usec, L: 0
0810 19:48:08.151557 (+ 633us) write_op.cc:270] Start()
0810 19:48:08.151586 (+ 29us) write_op.cc:276] Timestamp: P: 1786391276056653 usec, L: 0
0810 19:48:08.152226 (+ 640us) write_op.cc:270] Start()
0810 19:48:08.152251 (+ 25us) write_op.cc:276] Timestamp: P: 1786391276070763 usec, L: 0
0810 19:48:08.152758 (+ 507us) write_op.cc:270] Start()
0810 19:48:08.152793 (+ 35us) write_op.cc:276] Timestamp: P: 1786391276079531 usec, L: 0
0810 19:48:08.153283 (+ 490us) write_op.cc:270] Start()
0810 19:48:08.153304 (+ 21us) write_op.cc:276] Timestamp: P: 1786391276080885 usec, L: 0
0810 19:48:08.153803 (+ 499us) write_op.cc:270] Start()
0810 19:48:08.153836 (+ 33us) write_op.cc:276] Timestamp: P: 1786391276082001 usec, L: 0
0810 19:48:08.271399 (+117563us) write_op.cc:270] Start()
0810 19:48:08.271455 (+ 56us) write_op.cc:276] Timestamp: P: 1786391276083126 usec, L: 0
0810 19:48:08.272297 (+ 842us) write_op.cc:270] Start()
0810 19:48:08.272327 (+ 30us) write_op.cc:276] Timestamp: P: 1786391276085265 usec, L: 0
0810 19:48:08.274110 (+ 1783us) write_op.cc:270] Start()
0810 19:48:08.274239 (+ 129us) write_op.cc:276] Timestamp: P: 1786391276086484 usec, L: 0
0810 19:48:08.277554 (+ 3315us) write_op.cc:270] Start()
0810 19:48:08.277584 (+ 30us) write_op.cc:276] Timestamp: P: 1786391276092231 usec, L: 0
0810 19:48:08.279126 (+ 1542us) write_op.cc:270] Start()
0810 19:48:08.279189 (+ 63us) write_op.cc:276] Timestamp: P: 1786391276110671 usec, L: 0
0810 19:48:08.279738 (+ 549us) write_op.cc:270] Start()
0810 19:48:08.279774 (+ 36us) write_op.cc:276] Timestamp: P: 1786391276153167 usec, L: 0
0810 19:48:08.280292 (+ 518us) write_op.cc:270] Start()
0810 19:48:08.280313 (+ 21us) write_op.cc:276] Timestamp: P: 1786391276154970 usec, L: 0
0810 19:48:08.341258 (+ 60945us) write_op.cc:270] Start()
0810 19:48:08.341301 (+ 43us) write_op.cc:276] Timestamp: P: 1786391276159718 usec, L: 0
0810 19:48:08.342122 (+ 821us) write_op.cc:270] Start()
0810 19:48:08.342154 (+ 32us) write_op.cc:276] Timestamp: P: 1786391276160390 usec, L: 0
0810 19:48:08.350737 (+ 8583us) write_op.cc:270] Start()
0810 19:48:08.350790 (+ 53us) write_op.cc:276] Timestamp: P: 1786391276160947 usec, L: 0
0810 19:48:08.351895 (+ 1105us) write_op.cc:270] Start()
0810 19:48:08.351932 (+ 37us) write_op.cc:276] Timestamp: P: 1786391276161569 usec, L: 0
0810 19:48:08.356382 (+ 4450us) write_op.cc:270] Start()
0810 19:48:08.356415 (+ 33us) write_op.cc:276] Timestamp: P: 1786391276175993 usec, L: 0
0810 19:48:08.357245 (+ 830us) write_op.cc:270] Start()
0810 19:48:08.357274 (+ 29us) write_op.cc:276] Timestamp: P: 1786391276186423 usec, L: 0
0810 19:48:08.357959 (+ 685us) write_op.cc:270] Start()
0810 19:48:08.358009 (+ 50us) write_op.cc:276] Timestamp: P: 1786391276224899 usec, L: 0
0810 19:48:08.358588 (+ 579us) write_op.cc:270] Start()
0810 19:48:08.358612 (+ 24us) write_op.cc:276] Timestamp: P: 1786391276287593 usec, L: 0
0810 19:48:08.375531 (+ 16919us) write_op.cc:270] Start()
0810 19:48:08.375563 (+ 32us) write_op.cc:276] Timestamp: P: 1786391276289798 usec, L: 0
0810 19:48:08.377190 (+ 1627us) write_op.cc:270] Start()
0810 19:48:08.377219 (+ 29us) write_op.cc:276] Timestamp: P: 1786391276291079 usec, L: 0
0810 19:48:08.393908 (+ 16689us) write_op.cc:270] Start()
0810 19:48:08.393948 (+ 40us) write_op.cc:276] Timestamp: P: 1786391276298573 usec, L: 0
0810 19:48:08.431121 (+ 37173us) write_op.cc:270] Start()
0810 19:48:08.431163 (+ 42us) write_op.cc:276] Timestamp: P: 1786391276309576 usec, L: 0
0810 19:48:08.433227 (+ 2064us) write_op.cc:270] Start()
0810 19:48:08.433278 (+ 51us) write_op.cc:276] Timestamp: P: 1786391276496233 usec, L: 0
0810 19:48:08.439285 (+ 6007us) write_op.cc:270] Start()
0810 19:48:08.439326 (+ 41us) write_op.cc:276] Timestamp: P: 1786391276497340 usec, L: 0
0810 19:48:08.440528 (+ 1202us) write_op.cc:270] Start()
0810 19:48:08.440563 (+ 35us) write_op.cc:276] Timestamp: P: 1786391276497928 usec, L: 0
0810 19:48:08.544114 (+103551us) write_op.cc:270] Start()
0810 19:48:08.544161 (+ 47us) write_op.cc:276] Timestamp: P: 1786391276499302 usec, L: 0
0810 19:48:08.544879 (+ 718us) write_op.cc:270] Start()
0810 19:48:08.544910 (+ 31us) write_op.cc:276] Timestamp: P: 1786391276578376 usec, L: 0
0810 19:48:08.545631 (+ 721us) write_op.cc:270] Start()
0810 19:48:08.545658 (+ 27us) write_op.cc:276] Timestamp: P: 1786391276581939 usec, L: 0
0810 19:48:08.546206 (+ 548us) write_op.cc:270] Start()
0810 19:48:08.546232 (+ 26us) write_op.cc:276] Timestamp: P: 1786391276608709 usec, L: 0
0810 19:48:08.546914 (+ 682us) write_op.cc:270] Start()
0810 19:48:08.546946 (+ 32us) write_op.cc:276] Timestamp: P: 1786391276610258 usec, L: 0
0810 19:48:08.547572 (+ 626us) write_op.cc:270] Start()
0810 19:48:08.547605 (+ 33us) write_op.cc:276] Timestamp: P: 1786391276627659 usec, L: 0
0810 19:48:08.548146 (+ 541us) write_op.cc:270] Start()
0810 19:48:08.548168 (+ 22us) write_op.cc:276] Timestamp: P: 1786391276628913 usec, L: 0
0810 19:48:08.548656 (+ 488us) write_op.cc:270] Start()
0810 19:48:08.548678 (+ 22us) write_op.cc:276] Timestamp: P: 1786391276629886 usec, L: 0
0810 19:48:08.549167 (+ 489us) write_op.cc:270] Start()
0810 19:48:08.549190 (+ 23us) write_op.cc:276] Timestamp: P: 1786391276630731 usec, L: 0
0810 19:48:08.549639 (+ 449us) write_op.cc:270] Start()
0810 19:48:08.549660 (+ 21us) write_op.cc:276] Timestamp: P: 1786391276657185 usec, L: 0
0810 19:48:08.847847 (+298187us) write_op.cc:270] Start()
0810 19:48:08.847890 (+ 43us) write_op.cc:276] Timestamp: P: 1786391276660104 usec, L: 0
0810 19:48:08.848131 (+ 241us) write_op.cc:270] Start()
0810 19:48:08.848155 (+ 24us) write_op.cc:276] Timestamp: P: 1786391276665842 usec, L: 0
0810 19:48:08.848302 (+ 147us) write_op.cc:270] Start()
0810 19:48:08.848322 (+ 20us) write_op.cc:276] Timestamp: P: 1786391276671729 usec, L: 0
0810 19:48:08.848444 (+ 122us) write_op.cc:270] Start()
0810 19:48:08.848461 (+ 17us) write_op.cc:276] Timestamp: P: 1786391276704716 usec, L: 0
0810 19:48:08.848572 (+ 111us) write_op.cc:270] Start()
0810 19:48:08.848588 (+ 16us) write_op.cc:276] Timestamp: P: 1786391276713968 usec, L: 0
0810 19:48:08.848714 (+ 126us) write_op.cc:270] Start()
0810 19:48:08.848731 (+ 17us) write_op.cc:276] Timestamp: P: 1786391276714672 usec, L: 0
0810 19:48:08.848863 (+ 132us) write_op.cc:270] Start()
0810 19:48:08.848880 (+ 17us) write_op.cc:276] Timestamp: P: 1786391276747279 usec, L: 0
0810 19:48:08.848996 (+ 116us) write_op.cc:270] Start()
0810 19:48:08.849013 (+ 17us) write_op.cc:276] Timestamp: P: 1786391276748017 usec, L: 0
0810 19:48:08.849167 (+ 154us) write_op.cc:270] Start()
0810 19:48:08.849186 (+ 19us) write_op.cc:276] Timestamp: P: 1786391276748566 usec, L: 0
0810 19:48:08.849296 (+ 110us) write_op.cc:270] Start()
0810 19:48:08.849314 (+ 18us) write_op.cc:276] Timestamp: P: 1786391276760589 usec, L: 0
0810 19:48:08.849434 (+ 120us) write_op.cc:270] Start()
0810 19:48:08.849450 (+ 16us) write_op.cc:276] Timestamp: P: 1786391276785070 usec, L: 0
0810 19:48:08.849578 (+ 128us) write_op.cc:270] Start()
0810 19:48:08.849595 (+ 17us) write_op.cc:276] Timestamp: P: 1786391276785660 usec, L: 0
0810 19:48:08.924252 (+ 74657us) write_op.cc:270] Start()
0810 19:48:08.924295 (+ 43us) write_op.cc:276] Timestamp: P: 1786391276786186 usec, L: 0
0810 19:48:08.924481 (+ 186us) write_op.cc:270] Start()
0810 19:48:08.924504 (+ 23us) write_op.cc:276] Timestamp: P: 1786391276813416 usec, L: 0
0810 19:48:08.924641 (+ 137us) write_op.cc:270] Start()
0810 19:48:08.924658 (+ 17us) write_op.cc:276] Timestamp: P: 1786391276822091 usec, L: 0
0810 19:48:08.924836 (+ 178us) write_op.cc:270] Start()
0810 19:48:08.924955 (+ 119us) write_op.cc:276] Timestamp: P: 1786391276847678 usec, L: 0
0810 19:48:08.925141 (+ 186us) write_op.cc:270] Start()
0810 19:48:08.925162 (+ 21us) write_op.cc:276] Timestamp: P: 1786391276863577 usec, L: 0
0810 19:48:08.925292 (+ 130us) write_op.cc:270] Start()
0810 19:48:08.925310 (+ 18us) write_op.cc:276] Timestamp: P: 1786391276864337 usec, L: 0
0810 19:48:08.925438 (+ 128us) write_op.cc:270] Start()
0810 19:48:08.925456 (+ 18us) write_op.cc:276] Timestamp: P: 1786391276865844 usec, L: 0
0810 19:48:08.925609 (+ 153us) write_op.cc:270] Start()
0810 19:48:08.925629 (+ 20us) write_op.cc:276] Timestamp: P: 1786391276867148 usec, L: 0
0810 19:48:08.925746 (+ 117us) write_op.cc:270] Start()
0810 19:48:08.925762 (+ 16us) write_op.cc:276] Timestamp: P: 1786391276868380 usec, L: 0
0810 19:48:08.925899 (+ 137us) write_op.cc:270] Start()
0810 19:48:08.925919 (+ 20us) write_op.cc:276] Timestamp: P: 1786391276871082 usec, L: 0
0810 19:48:08.926040 (+ 121us) write_op.cc:270] Start()
0810 19:48:08.926056 (+ 16us) write_op.cc:276] Timestamp: P: 1786391276889370 usec, L: 0
0810 19:48:08.926158 (+ 102us) write_op.cc:270] Start()
0810 19:48:08.926174 (+ 16us) write_op.cc:276] Timestamp: P: 1786391276894101 usec, L: 0
0810 19:48:08.926285 (+ 111us) write_op.cc:270] Start()
0810 19:48:08.926301 (+ 16us) write_op.cc:276] Timestamp: P: 1786391276901075 usec, L: 0
0810 19:48:08.926440 (+ 139us) write_op.cc:270] Start()
0810 19:48:08.926457 (+ 17us) write_op.cc:276] Timestamp: P: 1786391276963771 usec, L: 0
0810 19:48:08.926590 (+ 133us) write_op.cc:270] Start()
0810 19:48:08.926616 (+ 26us) write_op.cc:276] Timestamp: P: 1786391276965371 usec, L: 0
0810 19:48:08.926758 (+ 142us) write_op.cc:270] Start()
0810 19:48:08.926789 (+ 31us) write_op.cc:276] Timestamp: P: 1786391276972593 usec, L: 0
0810 19:48:08.926921 (+ 132us) write_op.cc:270] Start()
0810 19:48:08.926939 (+ 18us) write_op.cc:276] Timestamp: P: 1786391277056269 usec, L: 0
0810 19:48:08.927056 (+ 117us) write_op.cc:270] Start()
0810 19:48:08.927102 (+ 46us) write_op.cc:276] Timestamp: P: 1786391277056901 usec, L: 0
0810 19:48:08.927238 (+ 136us) write_op.cc:270] Start()
0810 19:48:08.927263 (+ 25us) write_op.cc:276] Timestamp: P: 1786391277057526 usec, L: 0
0810 19:48:08.927371 (+ 108us) write_op.cc:270] Start()
0810 19:48:08.927388 (+ 17us) write_op.cc:276] Timestamp: P: 1786391277065810 usec, L: 0
0810 19:48:08.927516 (+ 128us) write_op.cc:270] Start()
0810 19:48:08.927537 (+ 21us) write_op.cc:276] Timestamp: P: 1786391277066440 usec, L: 0
0810 19:48:08.927641 (+ 104us) write_op.cc:270] Start()
0810 19:48:08.927656 (+ 15us) write_op.cc:276] Timestamp: P: 1786391277066988 usec, L: 0
0810 19:48:08.927755 (+ 99us) write_op.cc:270] Start()
0810 19:48:08.927782 (+ 27us) write_op.cc:276] Timestamp: P: 1786391277067555 usec, L: 0
0810 19:48:08.927904 (+ 122us) write_op.cc:270] Start()
0810 19:48:08.927921 (+ 17us) write_op.cc:276] Timestamp: P: 1786391277068160 usec, L: 0
0810 19:48:08.928029 (+ 108us) write_op.cc:270] Start()
0810 19:48:08.928046 (+ 17us) write_op.cc:276] Timestamp: P: 1786391277110750 usec, L: 0
0810 19:48:08.928173 (+ 127us) write_op.cc:270] Start()
0810 19:48:08.928190 (+ 17us) write_op.cc:276] Timestamp: P: 1786391277113203 usec, L: 0
0810 19:48:08.928301 (+ 111us) write_op.cc:270] Start()
0810 19:48:08.928316 (+ 15us) write_op.cc:276] Timestamp: P: 1786391277121142 usec, L: 0
0810 19:48:08.928420 (+ 104us) write_op.cc:270] Start()
0810 19:48:08.928434 (+ 14us) write_op.cc:276] Timestamp: P: 1786391277128758 usec, L: 0
0810 19:48:08.928534 (+ 100us) write_op.cc:270] Start()
0810 19:48:08.928549 (+ 15us) write_op.cc:276] Timestamp: P: 1786391277129870 usec, L: 0
0810 19:48:08.928662 (+ 113us) write_op.cc:270] Start()
0810 19:48:08.928679 (+ 17us) write_op.cc:276] Timestamp: P: 1786391277131809 usec, L: 0
0810 19:48:08.928850 (+ 171us) write_op.cc:270] Start()
0810 19:48:08.928871 (+ 21us) write_op.cc:276] Timestamp: P: 1786391277133224 usec, L: 0
0810 19:48:08.929016 (+ 145us) write_op.cc:270] Start()
0810 19:48:08.929059 (+ 43us) write_op.cc:276] Timestamp: P: 1786391277134705 usec, L: 0
0810 19:48:08.929180 (+ 121us) write_op.cc:270] Start()
0810 19:48:08.929196 (+ 16us) write_op.cc:276] Timestamp: P: 1786391277146711 usec, L: 0
0810 19:48:08.929339 (+ 143us) write_op.cc:270] Start()
0810 19:48:08.929358 (+ 19us) write_op.cc:276] Timestamp: P: 1786391277148784 usec, L: 0
0810 19:48:08.929475 (+ 117us) write_op.cc:270] Start()
0810 19:48:08.929492 (+ 17us) write_op.cc:276] Timestamp: P: 1786391277184335 usec, L: 0
0810 19:48:08.929620 (+ 128us) write_op.cc:270] Start()
0810 19:48:08.929636 (+ 16us) write_op.cc:276] Timestamp: P: 1786391277191486 usec, L: 0
0810 19:48:08.929787 (+ 151us) write_op.cc:270] Start()
0810 19:48:08.929807 (+ 20us) write_op.cc:276] Timestamp: P: 1786391277274401 usec, L: 0
0810 19:48:08.929938 (+ 131us) write_op.cc:270] Start()
0810 19:48:08.929955 (+ 17us) write_op.cc:276] Timestamp: P: 1786391277288505 usec, L: 0
0810 19:48:08.930080 (+ 125us) write_op.cc:270] Start()
0810 19:48:08.930097 (+ 17us) write_op.cc:276] Timestamp: P: 1786391277291905 usec, L: 0
0810 19:48:08.930267 (+ 170us) write_op.cc:270] Start()
0810 19:48:08.930289 (+ 22us) write_op.cc:276] Timestamp: P: 1786391277294156 usec, L: 0
0810 19:48:09.187308 (+257019us) write_op.cc:270] Start()
0810 19:48:09.187352 (+ 44us) write_op.cc:276] Timestamp: P: 1786391277295285 usec, L: 0
0810 19:48:09.187561 (+ 209us) write_op.cc:270] Start()
0810 19:48:09.187581 (+ 20us) write_op.cc:276] Timestamp: P: 1786391277299379 usec, L: 0
0810 19:48:09.187736 (+ 155us) write_op.cc:270] Start()
0810 19:48:09.187759 (+ 23us) write_op.cc:276] Timestamp: P: 1786391277310270 usec, L: 0
0810 19:48:09.187923 (+ 164us) write_op.cc:270] Start()
0810 19:48:09.187948 (+ 25us) write_op.cc:276] Timestamp: P: 1786391277605411 usec, L: 0
0810 19:48:09.188096 (+ 148us) write_op.cc:270] Start()
0810 19:48:09.188114 (+ 18us) write_op.cc:276] Timestamp: P: 1786391277616821 usec, L: 0
0810 19:48:09.188238 (+ 124us) write_op.cc:270] Start()
0810 19:48:09.188254 (+ 16us) write_op.cc:276] Timestamp: P: 1786391277617695 usec, L: 0
0810 19:48:09.188368 (+ 114us) write_op.cc:270] Start()
0810 19:48:09.188385 (+ 17us) write_op.cc:276] Timestamp: P: 1786391277717446 usec, L: 0
0810 19:48:09.188515 (+ 130us) write_op.cc:270] Start()
0810 19:48:09.188532 (+ 17us) write_op.cc:276] Timestamp: P: 1786391277718163 usec, L: 0
0810 19:48:09.188653 (+ 121us) write_op.cc:270] Start()
0810 19:48:09.188669 (+ 16us) write_op.cc:276] Timestamp: P: 1786391277803913 usec, L: 0
0810 19:48:09.188786 (+ 117us) write_op.cc:270] Start()
0810 19:48:09.188802 (+ 16us) write_op.cc:276] Timestamp: P: 1786391277852713 usec, L: 0
0810 19:48:09.188921 (+ 119us) write_op.cc:270] Start()
0810 19:48:09.188937 (+ 16us) write_op.cc:276] Timestamp: P: 1786391277853425 usec, L: 0
0810 19:48:09.189050 (+ 113us) write_op.cc:270] Start()
0810 19:48:09.189067 (+ 17us) write_op.cc:276] Timestamp: P: 1786391277854103 usec, L: 0
0810 19:48:09.189176 (+ 109us) write_op.cc:270] Start()
0810 19:48:09.189192 (+ 16us) write_op.cc:276] Timestamp: P: 1786391277856790 usec, L: 0
0810 19:48:09.189313 (+ 121us) write_op.cc:270] Start()
0810 19:48:09.189329 (+ 16us) write_op.cc:276] Timestamp: P: 1786391277857476 usec, L: 0
0810 19:48:09.412718 (+223389us) write_op.cc:270] Start()
0810 19:48:09.412774 (+ 56us) write_op.cc:276] Timestamp: P: 1786391277866142 usec, L: 0
0810 19:48:09.413249 (+ 475us) write_op.cc:270] Start()
0810 19:48:09.413280 (+ 31us) write_op.cc:276] Timestamp: P: 1786391277874014 usec, L: 0
0810 19:48:09.413626 (+ 346us) write_op.cc:270] Start()
0810 19:48:09.413665 (+ 39us) write_op.cc:276] Timestamp: P: 1786391277875849 usec, L: 0
0810 19:48:09.413825 (+ 160us) write_op.cc:270] Start()
0810 19:48:09.413846 (+ 21us) write_op.cc:276] Timestamp: P: 1786391277901420 usec, L: 0
0810 19:48:09.413975 (+ 129us) write_op.cc:270] Start()
0810 19:48:09.413991 (+ 16us) write_op.cc:276] Timestamp: P: 1786391277902561 usec, L: 0
0810 19:48:09.451691 (+ 37700us) write_op.cc:270] Start()
0810 19:48:09.451740 (+ 49us) write_op.cc:276] Timestamp: P: 1786391277903462 usec, L: 0
0810 19:48:09.452028 (+ 288us) write_op.cc:270] Start()
0810 19:48:09.452055 (+ 27us) write_op.cc:276] Timestamp: P: 1786391277910849 usec, L: 0
0810 19:48:09.452214 (+ 159us) write_op.cc:270] Start()
0810 19:48:09.452235 (+ 21us) write_op.cc:276] Timestamp: P: 1786391277912521 usec, L: 0
0810 19:48:09.452391 (+ 156us) write_op.cc:270] Start()
0810 19:48:09.452412 (+ 21us) write_op.cc:276] Timestamp: P: 1786391277915105 usec, L: 0
0810 19:48:09.452574 (+ 162us) write_op.cc:270] Start()
0810 19:48:09.452596 (+ 22us) write_op.cc:276] Timestamp: P: 1786391277915862 usec, L: 0
0810 19:48:09.452742 (+ 146us) write_op.cc:270] Start()
0810 19:48:09.452763 (+ 21us) write_op.cc:276] Timestamp: P: 1786391277967285 usec, L: 0
0810 19:48:09.452961 (+ 198us) write_op.cc:270] Start()
0810 19:48:09.452986 (+ 25us) write_op.cc:276] Timestamp: P: 1786391278024485 usec, L: 0
0810 19:48:09.453255 (+ 269us) write_op.cc:270] Start()
0810 19:48:09.453290 (+ 35us) write_op.cc:276] Timestamp: P: 1786391278027472 usec, L: 0
0810 19:48:09.453530 (+ 240us) write_op.cc:270] Start()
0810 19:48:09.453551 (+ 21us) write_op.cc:276] Timestamp: P: 1786391278066456 usec, L: 0
0810 19:48:09.453676 (+ 125us) write_op.cc:270] Start()
0810 19:48:09.453695 (+ 19us) write_op.cc:276] Timestamp: P: 1786391278070438 usec, L: 0
0810 19:48:09.453810 (+ 115us) write_op.cc:270] Start()
0810 19:48:09.453838 (+ 28us) write_op.cc:276] Timestamp: P: 1786391278071930 usec, L: 0
0810 19:48:09.453955 (+ 117us) write_op.cc:270] Start()
0810 19:48:09.453975 (+ 20us) write_op.cc:276] Timestamp: P: 1786391278216710 usec, L: 0
0810 19:48:09.454121 (+ 146us) write_op.cc:270] Start()
0810 19:48:09.454141 (+ 20us) write_op.cc:276] Timestamp: P: 1786391278479568 usec, L: 0
0810 19:48:09.507793 (+ 53652us) write_op.cc:270] Start()
0810 19:48:09.507869 (+ 76us) write_op.cc:276] Timestamp: P: 1786391278486585 usec, L: 0
0810 19:48:09.508173 (+ 304us) write_op.cc:270] Start()
0810 19:48:09.508205 (+ 32us) write_op.cc:276] Timestamp: P: 1786391278490819 usec, L: 0
0810 19:48:09.562764 (+ 54559us) write_op.cc:270] Start()
0810 19:48:09.562832 (+ 68us) write_op.cc:276] Timestamp: P: 1786391278531645 usec, L: 0
0810 19:48:09.563117 (+ 285us) write_op.cc:270] Start()
0810 19:48:09.563146 (+ 29us) write_op.cc:276] Timestamp: P: 1786391278535204 usec, L: 0
0810 19:48:09.563306 (+ 160us) write_op.cc:270] Start()
0810 19:48:09.563323 (+ 17us) write_op.cc:276] Timestamp: P: 1786391278540297 usec, L: 0
0810 19:48:09.563450 (+ 127us) write_op.cc:270] Start()
0810 19:48:09.563469 (+ 19us) write_op.cc:276] Timestamp: P: 1786391278546536 usec, L: 0
0810 19:48:09.563573 (+ 104us) write_op.cc:270] Start()
0810 19:48:09.563588 (+ 15us) write_op.cc:276] Timestamp: P: 1786391278549369 usec, L: 0
0810 19:48:09.563828 (+ 240us) write_op.cc:270] Start()
0810 19:48:09.563859 (+ 31us) write_op.cc:276] Timestamp: P: 1786391278561745 usec, L: 0
0810 19:48:09.564077 (+ 218us) write_op.cc:270] Start()
0810 19:48:09.564099 (+ 22us) write_op.cc:276] Timestamp: P: 1786391278572759 usec, L: 0
0810 19:48:09.564233 (+ 134us) write_op.cc:270] Start()
0810 19:48:09.564251 (+ 18us) write_op.cc:276] Timestamp: P: 1786391278585967 usec, L: 0
0810 19:48:09.564370 (+ 119us) write_op.cc:270] Start()
0810 19:48:09.564387 (+ 17us) write_op.cc:276] Timestamp: P: 1786391278622705 usec, L: 0
0810 19:48:09.564500 (+ 113us) write_op.cc:270] Start()
0810 19:48:09.564515 (+ 15us) write_op.cc:276] Timestamp: P: 1786391278764307 usec, L: 0
0810 19:48:09.564623 (+ 108us) write_op.cc:270] Start()
0810 19:48:09.564639 (+ 16us) write_op.cc:276] Timestamp: P: 1786391278765013 usec, L: 0
0810 19:48:09.564756 (+ 117us) write_op.cc:270] Start()
0810 19:48:09.564772 (+ 16us) write_op.cc:276] Timestamp: P: 1786391278839881 usec, L: 0
0810 19:48:09.564925 (+ 153us) write_op.cc:270] Start()
0810 19:48:09.564947 (+ 22us) write_op.cc:276] Timestamp: P: 1786391278842557 usec, L: 0
0810 19:48:09.565104 (+ 157us) write_op.cc:270] Start()
0810 19:48:09.565125 (+ 21us) write_op.cc:276] Timestamp: P: 1786391278854820 usec, L: 0
0810 19:48:09.607405 (+ 42280us) write_op.cc:270] Start()
0810 19:48:09.607445 (+ 40us) write_op.cc:276] Timestamp: P: 1786391278858706 usec, L: 0
0810 19:48:09.607717 (+ 272us) write_op.cc:270] Start()
0810 19:48:09.607744 (+ 27us) write_op.cc:276] Timestamp: P: 1786391278859846 usec, L: 0
0810 19:48:09.607962 (+ 218us) write_op.cc:270] Start()
0810 19:48:09.607986 (+ 24us) write_op.cc:276] Timestamp: P: 1786391278865814 usec, L: 0
0810 19:48:09.608130 (+ 144us) write_op.cc:270] Start()
0810 19:48:09.608149 (+ 19us) write_op.cc:276] Timestamp: P: 1786391278877541 usec, L: 0
0810 19:48:09.608291 (+ 142us) write_op.cc:270] Start()
0810 19:48:09.608310 (+ 19us) write_op.cc:276] Timestamp: P: 1786391278878219 usec, L: 0
0810 19:48:09.627953 (+ 19643us) write_op.cc:270] Start()
0810 19:48:09.628026 (+ 73us) write_op.cc:276] Timestamp: P: 1786391278916557 usec, L: 0
0810 19:48:09.628340 (+ 314us) write_op.cc:270] Start()
0810 19:48:09.628366 (+ 26us) write_op.cc:276] Timestamp: P: 1786391278917865 usec, L: 0
0810 19:48:09.628520 (+ 154us) write_op.cc:270] Start()
0810 19:48:09.628539 (+ 19us) write_op.cc:276] Timestamp: P: 1786391279086773 usec, L: 0
0810 19:48:09.628643 (+ 104us) write_op.cc:270] Start()
0810 19:48:09.628659 (+ 16us) write_op.cc:276] Timestamp: P: 1786391279088131 usec, L: 0
0810 19:48:09.628780 (+ 121us) write_op.cc:270] Start()
0810 19:48:09.628800 (+ 20us) write_op.cc:276] Timestamp: P: 1786391279160670 usec, L: 0
0810 19:48:09.628983 (+ 183us) write_op.cc:270] Start()
0810 19:48:09.629005 (+ 22us) write_op.cc:276] Timestamp: P: 1786391279161378 usec, L: 0
0810 19:48:09.629165 (+ 160us) write_op.cc:270] Start()
0810 19:48:09.629186 (+ 21us) write_op.cc:276] Timestamp: P: 1786391279162064 usec, L: 0
0810 19:48:09.629331 (+ 145us) write_op.cc:270] Start()
0810 19:48:09.629351 (+ 20us) write_op.cc:276] Timestamp: P: 1786391279162690 usec, L: 0
0810 19:48:09.629474 (+ 123us) write_op.cc:270] Start()
0810 19:48:09.629490 (+ 16us) write_op.cc:276] Timestamp: P: 1786391279163309 usec, L: 0
0810 19:48:09.629594 (+ 104us) write_op.cc:270] Start()
0810 19:48:09.629631 (+ 37us) write_op.cc:276] Timestamp: P: 1786391279461418 usec, L: 0
0810 19:48:09.629777 (+ 146us) write_op.cc:270] Start()
0810 19:48:09.629797 (+ 20us) write_op.cc:276] Timestamp: P: 1786391279487347 usec, L: 0
0810 19:48:09.629954 (+ 157us) write_op.cc:270] Start()
0810 19:48:09.629973 (+ 19us) write_op.cc:276] Timestamp: P: 1786391279518904 usec, L: 0
0810 19:48:09.630095 (+ 122us) write_op.cc:270] Start()
0810 19:48:09.630199 (+ 104us) write_op.cc:276] Timestamp: P: 1786391279529198 usec, L: 0
0810 19:48:09.653257 (+ 23058us) write_op.cc:270] Start()
0810 19:48:09.653303 (+ 46us) write_op.cc:276] Timestamp: P: 1786391279538098 usec, L: 0
0810 19:48:09.653543 (+ 240us) write_op.cc:270] Start()
0810 19:48:09.653571 (+ 28us) write_op.cc:276] Timestamp: P: 1786391279580760 usec, L: 0
0810 19:48:09.653746 (+ 175us) write_op.cc:270] Start()
0810 19:48:09.653770 (+ 24us) write_op.cc:276] Timestamp: P: 1786391279596669 usec, L: 0
0810 19:48:09.653940 (+ 170us) write_op.cc:270] Start()
0810 19:48:09.653964 (+ 24us) write_op.cc:276] Timestamp: P: 1786391279604891 usec, L: 0
0810 19:48:09.654121 (+ 157us) write_op.cc:270] Start()
0810 19:48:09.654142 (+ 21us) write_op.cc:276] Timestamp: P: 1786391279611654 usec, L: 0
0810 19:48:09.654354 (+ 212us) write_op.cc:270] Start()
0810 19:48:09.654378 (+ 24us) write_op.cc:276] Timestamp: P: 1786391279629904 usec, L: 0
0810 19:48:09.654523 (+ 145us) write_op.cc:270] Start()
0810 19:48:09.654540 (+ 17us) write_op.cc:276] Timestamp: P: 1786391279638820 usec, L: 0
0810 19:48:09.654656 (+ 116us) write_op.cc:270] Start()
0810 19:48:09.654671 (+ 15us) write_op.cc:276] Timestamp: P: 1786391279646551 usec, L: 0
0810 19:48:09.654810 (+ 139us) write_op.cc:270] Start()
0810 19:48:09.654838 (+ 28us) write_op.cc:276] Timestamp: P: 1786391279702529 usec, L: 0
0810 19:48:09.654983 (+ 145us) write_op.cc:270] Start()
0810 19:48:09.655005 (+ 22us) write_op.cc:276] Timestamp: P: 1786391279703793 usec, L: 0
0810 19:48:09.655158 (+ 153us) write_op.cc:270] Start()
0810 19:48:09.655177 (+ 19us) write_op.cc:276] Timestamp: P: 1786391279726639 usec, L: 0
0810 19:48:09.655304 (+ 127us) write_op.cc:270] Start()
0810 19:48:09.655320 (+ 16us) write_op.cc:276] Timestamp: P: 1786391279806301 usec, L: 0
0810 19:48:09.655425 (+ 105us) write_op.cc:270] Start()
0810 19:48:09.655441 (+ 16us) write_op.cc:276] Timestamp: P: 1786391279807388 usec, L: 0
0810 19:48:09.655547 (+ 106us) write_op.cc:270] Start()
0810 19:48:09.655562 (+ 15us) write_op.cc:276] Timestamp: P: 1786391279854714 usec, L: 0
0810 19:48:09.655660 (+ 98us) write_op.cc:270] Start()
0810 19:48:09.655674 (+ 14us) write_op.cc:276] Timestamp: P: 1786391279869060 usec, L: 0
0810 19:48:09.655776 (+ 102us) write_op.cc:270] Start()
0810 19:48:09.655793 (+ 17us) write_op.cc:276] Timestamp: P: 1786391279901660 usec, L: 0
0810 19:48:09.655962 (+ 169us) write_op.cc:270] Start()
0810 19:48:09.655984 (+ 22us) write_op.cc:276] Timestamp: P: 1786391279903824 usec, L: 0
0810 19:48:09.656119 (+ 135us) write_op.cc:270] Start()
0810 19:48:09.656136 (+ 17us) write_op.cc:276] Timestamp: P: 1786391279904631 usec, L: 0
0810 19:48:09.656270 (+ 134us) write_op.cc:270] Start()
0810 19:48:09.656287 (+ 17us) write_op.cc:276] Timestamp: P: 1786391279905283 usec, L: 0
0810 19:48:09.656407 (+ 120us) write_op.cc:270] Start()
0810 19:48:09.656424 (+ 17us) write_op.cc:276] Timestamp: P: 1786391279913143 usec, L: 0
0810 19:48:09.656550 (+ 126us) write_op.cc:270] Start()
0810 19:48:09.656567 (+ 17us) write_op.cc:276] Timestamp: P: 1786391279917417 usec, L: 0
0810 19:48:09.656694 (+ 127us) write_op.cc:270] Start()
0810 19:48:09.656716 (+ 22us) write_op.cc:276] Timestamp: P: 1786391279922145 usec, L: 0
0810 19:48:09.656852 (+ 136us) write_op.cc:270] Start()
0810 19:48:09.656874 (+ 22us) write_op.cc:276] Timestamp: P: 1786391279925700 usec, L: 0
0810 19:48:09.657057 (+ 183us) write_op.cc:270] Start()
0810 19:48:09.657079 (+ 22us) write_op.cc:276] Timestamp: P: 1786391280032405 usec, L: 0
0810 19:48:09.657251 (+ 172us) write_op.cc:270] Start()
0810 19:48:09.657272 (+ 21us) write_op.cc:276] Timestamp: P: 1786391280129287 usec, L: 0
0810 19:48:09.657407 (+ 135us) write_op.cc:270] Start()
0810 19:48:09.657427 (+ 20us) write_op.cc:276] Timestamp: P: 1786391280129979 usec, L: 0
0810 19:48:09.657573 (+ 146us) write_op.cc:270] Start()
0810 19:48:09.657593 (+ 20us) write_op.cc:276] Timestamp: P: 1786391280130783 usec, L: 0
0810 19:48:09.657728 (+ 135us) write_op.cc:270] Start()
0810 19:48:09.657747 (+ 19us) write_op.c
I20260810 19:48:11.256306 12823 raft_consensus.cc:493] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.256465 12823 raft_consensus.cc:515] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.257066 12823 leader_election.cc:290] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:11.258092 9901 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d9a7b19ea944e73b38e56a240650dbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:11.258479 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66acbafdcc8540368693c8f463b41752" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:11.259050 9611 leader_election.cc:343] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.259117 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66acbafdcc8540368693c8f463b41752" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:11.259755 9611 leader_election.cc:343] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.259882 9611 leader_election.cc:304] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:11.260321 12823 raft_consensus.cc:2749] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.263160 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet bef956a173084e7698a37dddc574ea65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:11.263278 10120 tablet_service.cc:1558] Processing DeleteTablet for tablet 81aabb5656e7472f9223fd7acf10e43c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:11.263695 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 81aabb5656e7472f9223fd7acf10e43c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:11.265326 10375 ts_tablet_manager.cc:1929] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:11.265456 10375 log.cc:1199] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/2b2b20dc77954af7a203f357c746be29
I20260810 19:48:11.265422 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b6b17ce3354600b2f7450c6e483c69" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:11.265897 10375 ts_tablet_manager.cc:1950] T 2b2b20dc77954af7a203f357c746be29 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:11.266044 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a22a70d0868e4274a3a9384539baf907" } modify_external_catalogs: true
I20260810 19:48:11.229223 10377 ts_tablet_manager.cc:1916] T f85f3fa629764c79921a710739eea7ae P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:11.266880 9611 leader_election.cc:343] T b4b6b17ce3354600b2f7450c6e483c69 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.267033 9611 leader_election.cc:304] T b4b6b17ce3354600b2f7450c6e483c69 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:11.267047 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a22a70d0868e4274a3a9384539baf907" } modify_external_catalogs: true
I20260810 19:48:11.267467 12823 raft_consensus.cc:2749] T b4b6b17ce3354600b2f7450c6e483c69 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.270035 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 854) took 2962 ms. Trace:
I20260810 19:48:11.270153 10375 rpcz_store.cc:276] 0810 19:48:08.307168 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:08.307222 (+ 54us) service_pool.cc:224] Handling call
0810 19:48:11.198043 (+2890821us) ts_tablet_manager.cc:1151] Deleting tablet 2b2b20dc77954af7a203f357c746be29
0810 19:48:11.228176 (+ 30133us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:11.247631 (+ 19455us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:11.265245 (+ 17614us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:11.270001 (+ 4756us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3070,"tablet-delete.queue_time_us":2852274}
I20260810 19:48:11.272886 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 2b2b20dc77954af7a203f357c746be29 (table default.Table_0de524b66ecf4dea8ab5e6b87c4f6261 [id=4de43e2ae0424104aa75c5d872b72d3a]) successfully deleted
I20260810 19:48:11.273587 10375 tablet_replica.cc:333] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:11.273805 10375 raft_consensus.cc:2243] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:11.274168 10375 pending_rounds.cc:70] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:11.274235 10375 pending_rounds.cc:77] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058715575947264 op_type: NO_OP noop_request { }
I20260810 19:48:11.274379 10375 raft_consensus.cc:2889] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:11.274477 10375 raft_consensus.cc:2272] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:11.275126 10375 ts_tablet_manager.cc:1916] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:11.281661 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet 7459e64bd48449d2a8d4ff835b215d46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:11.284058 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet 7459e64bd48449d2a8d4ff835b215d46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.284559 9901 tablet_service.cc:1558] Processing DeleteTablet for tablet bef956a173084e7698a37dddc574ea65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:48:11.286813 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 7459e64bd48449d2a8d4ff835b215d46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7459e64bd48449d2a8d4ff835b215d46 already in progress: creating tablet
I20260810 19:48:11.286979 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 81aabb5656e7472f9223fd7acf10e43c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.287081 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet bef956a173084e7698a37dddc574ea65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.287319 12266 tablet_replica.cc:333] T 81aabb5656e7472f9223fd7acf10e43c P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:11.287545 12266 raft_consensus.cc:2243] T 81aabb5656e7472f9223fd7acf10e43c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:11.287729 12266 raft_consensus.cc:2272] T 81aabb5656e7472f9223fd7acf10e43c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:11.288355 12266 ts_tablet_manager.cc:1916] T 81aabb5656e7472f9223fd7acf10e43c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:11.294366 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d9a7b19ea944e73b38e56a240650dbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.299182 12868 tablet.cc:1724] T e68916e2568f4527a181342cdc728001 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:11.309370 10375 ts_tablet_manager.cc:1929] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:11.309512 10375 log.cc:1199] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/0bddaf5b5fc1404e83b079ffa97e7321
I20260810 19:48:11.309872 10375 ts_tablet_manager.cc:1950] T 0bddaf5b5fc1404e83b079ffa97e7321 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:11.314805 12872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0c56283079e74549afd0096f7e72046a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } } }
I20260810 19:48:11.315076 12872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [sys.catalog]: This master's current role is: LEADER
I20260810 19:48:11.319037 12716 raft_consensus.cc:493] T 31c2b9a4b8334e678b4632fc2f58dd0c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.319227 12716 raft_consensus.cc:515] T 31c2b9a4b8334e678b4632fc2f58dd0c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.319891 12716 leader_election.cc:290] T 31c2b9a4b8334e678b4632fc2f58dd0c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:11.321231 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c2b9a4b8334e678b4632fc2f58dd0c" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:11.321938 9830 leader_election.cc:343] T 31c2b9a4b8334e678b4632fc2f58dd0c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.303968 10367 tablet_bootstrap.cc:492] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:11.326877 10367 ts_tablet_manager.cc:1403] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.167s user 0.016s sys 0.005s
I20260810 19:48:11.327641 10367 raft_consensus.cc:359] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.327849 10367 raft_consensus.cc:385] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.327911 10367 raft_consensus.cc:740] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.328100 10367 consensus_queue.cc:260] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.328229 10377 ts_tablet_manager.cc:1929] T f85f3fa629764c79921a710739eea7ae P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:11.328366 10377 log.cc:1199] T f85f3fa629764c79921a710739eea7ae P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/f85f3fa629764c79921a710739eea7ae
I20260810 19:48:11.328608 10367 ts_tablet_manager.cc:1434] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:11.328904 10367 tablet_bootstrap.cc:492] T bb1e4400ca684da7b3b5e6592e19b6e6 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:11.330545 10367 tablet_bootstrap.cc:654] T bb1e4400ca684da7b3b5e6592e19b6e6 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.322682 12876 tablet.cc:1724] T a45add97e0e54dce85225e175ecbb45a P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
W20260810 19:48:11.331512 9398 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 60165d5c1664471fb665d1ed8bdda26d (table default.Table_2c8d0fdfa727465cb881c0d8ceaf26e2 [id=001dab9496624153951d38cac8ade6d6], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 60165d5c1664471fb665d1ed8bdda26d consensus state has no leader
I20260810 19:48:11.332216 10377 ts_tablet_manager.cc:1950] T f85f3fa629764c79921a710739eea7ae P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:11.332736 10370 tablet_bootstrap.cc:492] T b33aa8be266a434cba899da7514c47e9 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:11.332980 10370 ts_tablet_manager.cc:1403] T b33aa8be266a434cba899da7514c47e9 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.091s user 0.004s sys 0.013s
W20260810 19:48:11.328392 9831 leader_election.cc:343] T 31c2b9a4b8334e678b4632fc2f58dd0c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 31c2b9a4b8334e678b4632fc2f58dd0c
I20260810 19:48:11.335484 9831 leader_election.cc:304] T 31c2b9a4b8334e678b4632fc2f58dd0c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:11.335824 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet f85f3fa629764c79921a710739eea7ae (table default.Table_aa5df7d93dfb4603b493ab5638468a59 [id=fadd6b8bf2244dfab48fdadb0d12b6fd]) successfully deleted
I20260810 19:48:11.334456 10366 tablet_bootstrap.cc:492] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:11.336210 12716 raft_consensus.cc:2749] T 31c2b9a4b8334e678b4632fc2f58dd0c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.336289 10366 ts_tablet_manager.cc:1403] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.114s user 0.005s sys 0.003s
I20260810 19:48:11.337059 10366 raft_consensus.cc:359] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.337234 10366 raft_consensus.cc:385] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.337298 10366 raft_consensus.cc:740] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.337559 10366 consensus_queue.cc:260] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.341732 10370 raft_consensus.cc:359] T b33aa8be266a434cba899da7514c47e9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.342108 10370 raft_consensus.cc:385] T b33aa8be266a434cba899da7514c47e9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.342238 10370 raft_consensus.cc:740] T b33aa8be266a434cba899da7514c47e9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.342679 10366 ts_tablet_manager.cc:1434] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260810 19:48:11.342659 10370 consensus_queue.cc:260] T b33aa8be266a434cba899da7514c47e9 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.343024 10366 tablet_bootstrap.cc:492] T 8fadd6f84c75466287b318ed7018b071 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:11.346763 10370 ts_tablet_manager.cc:1434] T b33aa8be266a434cba899da7514c47e9 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260810 19:48:11.347198 10370 tablet_bootstrap.cc:492] T 648ef608fa0c45cc8be4bad80c4200be P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:11.349154 10377 tablet_replica.cc:333] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:11.349186 10370 tablet_bootstrap.cc:654] T 648ef608fa0c45cc8be4bad80c4200be P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.349421 10377 raft_consensus.cc:2243] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:11.349831 10377 raft_consensus.cc:2272] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:11.350520 10377 ts_tablet_manager.cc:1916] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:11.350823 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 855) took 3043 ms. Trace:
I20260810 19:48:11.350975 10375 rpcz_store.cc:276] 0810 19:48:08.307303 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:08.307370 (+ 67us) service_pool.cc:224] Handling call
0810 19:48:11.273524 (+2966154us) ts_tablet_manager.cc:1151] Deleting tablet 0bddaf5b5fc1404e83b079ffa97e7321
0810 19:48:11.273538 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:11.304409 (+ 30871us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:11.309306 (+ 4897us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:11.350798 (+ 41492us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2927708}
I20260810 19:48:11.351877 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 0bddaf5b5fc1404e83b079ffa97e7321 (table default.Table_5bdde0f42da34c6f99e8462d17affb30 [id=7c6a3df13ef44571a127a5ef2e73683a]) successfully deleted
I20260810 19:48:11.352334 10367 tablet_bootstrap.cc:492] T bb1e4400ca684da7b3b5e6592e19b6e6 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:11.352495 10367 ts_tablet_manager.cc:1403] T bb1e4400ca684da7b3b5e6592e19b6e6 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.024s user 0.000s sys 0.004s
I20260810 19:48:11.352385 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 848) took 3046 ms. Trace:
I20260810 19:48:11.352818 10375 rpcz_store.cc:276] 0810 19:48:08.305588 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:08.305734 (+ 146us) service_pool.cc:224] Handling call
0810 19:48:11.352271 (+3046537us) ts_tablet_manager.cc:1151] Deleting tablet da3d8ade850c4d36bd2756c36706195d
0810 19:48:11.352283 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:11.352366 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":312,"tablet-delete.queue_time_us":3006739}
I20260810 19:48:11.353240 10367 raft_consensus.cc:359] T bb1e4400ca684da7b3b5e6592e19b6e6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.353413 10367 raft_consensus.cc:385] T bb1e4400ca684da7b3b5e6592e19b6e6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.353462 10367 raft_consensus.cc:740] T bb1e4400ca684da7b3b5e6592e19b6e6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.353683 10367 consensus_queue.cc:260] T bb1e4400ca684da7b3b5e6592e19b6e6 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:11.353916 9395 catalog_manager.cc:5017] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet da3d8ade850c4d36bd2756c36706195d because the tablet was not found. No further retry: Not found: Tablet not found: da3d8ade850c4d36bd2756c36706195d
I20260810 19:48:11.354250 10367 ts_tablet_manager.cc:1434] T bb1e4400ca684da7b3b5e6592e19b6e6 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:11.354583 10367 tablet_bootstrap.cc:492] T 48eee4ce10114021855075812e356652 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:11.354678 10375 tablet_replica.cc:333] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:11.354949 10375 raft_consensus.cc:2243] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:11.355715 12716 raft_consensus.cc:493] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.355854 12716 raft_consensus.cc:515] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.356004 10367 tablet_bootstrap.cc:654] T 48eee4ce10114021855075812e356652 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.356148 10366 tablet_bootstrap.cc:654] T 8fadd6f84c75466287b318ed7018b071 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.356552 12716 leader_election.cc:290] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:11.357709 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827dce05c192467589e2692fabd2a84e" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:11.358357 9831 leader_election.cc:343] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 827dce05c192467589e2692fabd2a84e
W20260810 19:48:11.358870 9830 leader_election.cc:343] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.358999 9830 leader_election.cc:304] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:11.359460 12716 raft_consensus.cc:2749] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.363436 12266 ts_tablet_manager.cc:1929] T 81aabb5656e7472f9223fd7acf10e43c P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:11.363574 12266 log.cc:1199] T 81aabb5656e7472f9223fd7acf10e43c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/81aabb5656e7472f9223fd7acf10e43c
I20260810 19:48:11.363919 12266 ts_tablet_manager.cc:1950] T 81aabb5656e7472f9223fd7acf10e43c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:11.365289 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 81aabb5656e7472f9223fd7acf10e43c (table default.Table_3c331b2bd94d4303a3de78c1369771bc [id=f9a169cfd328466b908bc057a70a9668]) successfully deleted
I20260810 19:48:11.366575 10370 tablet_bootstrap.cc:492] T 648ef608fa0c45cc8be4bad80c4200be P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:11.366909 10370 ts_tablet_manager.cc:1403] T 648ef608fa0c45cc8be4bad80c4200be P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.000s
I20260810 19:48:11.367797 10370 raft_consensus.cc:359] T 648ef608fa0c45cc8be4bad80c4200be P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.368010 10370 raft_consensus.cc:385] T 648ef608fa0c45cc8be4bad80c4200be P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.368100 10370 raft_consensus.cc:740] T 648ef608fa0c45cc8be4bad80c4200be P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.368409 10370 consensus_queue.cc:260] T 648ef608fa0c45cc8be4bad80c4200be P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.369097 10370 ts_tablet_manager.cc:1434] T 648ef608fa0c45cc8be4bad80c4200be P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:11.369424 10370 tablet_bootstrap.cc:492] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:11.369474 10159 raft_consensus.cc:3060] T b33aa8be266a434cba899da7514c47e9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:11.371395 10370 tablet_bootstrap.cc:654] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.372577 12677 raft_consensus.cc:493] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.372722 12677 raft_consensus.cc:515] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:11.373344 12677 leader_election.cc:290] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:11.374756 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet bef956a173084e7698a37dddc574ea65 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bef956a173084e7698a37dddc574ea65 already in progress: creating tablet
I20260810 19:48:11.374612 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18cd8adaa065425c846bc791c05fa67d" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:11.375178 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18cd8adaa065425c846bc791c05fa67d" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:11.375398 9715 raft_consensus.cc:2468] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
W20260810 19:48:11.376099 9830 leader_election.cc:343] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.376906 9831 leader_election.cc:304] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
W20260810 19:48:11.376966 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 6d9a7b19ea944e73b38e56a240650dbf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d9a7b19ea944e73b38e56a240650dbf already in progress: creating tablet
I20260810 19:48:11.377635 12505 raft_consensus.cc:2804] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:11.377720 12505 raft_consensus.cc:493] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:11.377784 12505 raft_consensus.cc:3060] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:11.377882 10367 tablet_bootstrap.cc:492] T 48eee4ce10114021855075812e356652 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:11.378041 10367 ts_tablet_manager.cc:1403] T 48eee4ce10114021855075812e356652 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.001s
I20260810 19:48:11.378964 10366 tablet_bootstrap.cc:492] T 8fadd6f84c75466287b318ed7018b071 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:11.379082 10366 ts_tablet_manager.cc:1403] T 8fadd6f84c75466287b318ed7018b071 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.000s
I20260810 19:48:11.379052 10367 raft_consensus.cc:359] T 48eee4ce10114021855075812e356652 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.379220 10367 raft_consensus.cc:385] T 48eee4ce10114021855075812e356652 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.379271 10367 raft_consensus.cc:740] T 48eee4ce10114021855075812e356652 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.379654 10367 consensus_queue.cc:260] T 48eee4ce10114021855075812e356652 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.379782 10366 raft_consensus.cc:359] T 8fadd6f84c75466287b318ed7018b071 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.379946 10366 raft_consensus.cc:385] T 8fadd6f84c75466287b318ed7018b071 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.379988 10366 raft_consensus.cc:740] T 8fadd6f84c75466287b318ed7018b071 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.380208 10366 consensus_queue.cc:260] T 8fadd6f84c75466287b318ed7018b071 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.380666 10366 ts_tablet_manager.cc:1434] T 8fadd6f84c75466287b318ed7018b071 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:11.380663 10367 ts_tablet_manager.cc:1434] T 48eee4ce10114021855075812e356652 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:48:11.380551 12505 raft_consensus.cc:515] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:11.380963 10367 tablet_bootstrap.cc:492] T 263a5695e7754b44a64edbda27b42135 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:11.381381 12505 leader_election.cc:290] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:11.381727 12505 raft_consensus.cc:493] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.381889 12505 raft_consensus.cc:515] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.382494 12505 leader_election.cc:290] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:11.384214 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18cd8adaa065425c846bc791c05fa67d" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:11.385068 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab27734e3d974260a77f1d94e5f534fe" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:11.385653 9830 leader_election.cc:343] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:11.385929 9830 leader_election.cc:343] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.382931 10366 tablet_bootstrap.cc:492] T 19e2bf7b7d254894a07c5a75bf24e742 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:11.387737 12864 tablet.cc:1724] T b33aa8be266a434cba899da7514c47e9 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:11.387856 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18cd8adaa065425c846bc791c05fa67d" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:11.388046 9717 raft_consensus.cc:3060] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:11.392277 10367 tablet_bootstrap.cc:654] T 263a5695e7754b44a64edbda27b42135 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.392635 10370 tablet_bootstrap.cc:492] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:11.392781 10370 ts_tablet_manager.cc:1403] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.000s
I20260810 19:48:11.393467 10366 tablet_bootstrap.cc:654] T 19e2bf7b7d254894a07c5a75bf24e742 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.393565 10370 raft_consensus.cc:359] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.393748 10370 raft_consensus.cc:385] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.393810 10370 raft_consensus.cc:740] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.394023 10370 consensus_queue.cc:260] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.392478 9717 raft_consensus.cc:2468] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:11.394567 10370 ts_tablet_manager.cc:1434] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:11.394874 10370 tablet_bootstrap.cc:492] T f85f3fa629764c79921a710739eea7ae P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:11.396376 10370 tablet_bootstrap.cc:654] T f85f3fa629764c79921a710739eea7ae P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:11.397629 9831 leader_election.cc:343] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: ab27734e3d974260a77f1d94e5f534fe
I20260810 19:48:11.397790 9831 leader_election.cc:304] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:11.398449 9831 leader_election.cc:304] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:11.398950 12677 raft_consensus.cc:2749] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.399401 12677 raft_consensus.cc:2804] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:11.399497 12677 raft_consensus.cc:697] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:11.399737 12677 consensus_queue.cc:237] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:11.403076 10377 ts_tablet_manager.cc:1929] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:11.403224 10377 log.cc:1199] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/320e42f6de6c4452adb7bbb379a156e6
I20260810 19:48:11.403638 10377 ts_tablet_manager.cc:1950] T 320e42f6de6c4452adb7bbb379a156e6 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:11.404934 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 320e42f6de6c4452adb7bbb379a156e6 (table default.Table_d53c7e2836b143eab54246ed5e0de77e [id=5354f5d091794b14806dd9bc872da0ae]) successfully deleted
I20260810 19:48:11.405627 10159 raft_consensus.cc:3060] T e68916e2568f4527a181342cdc728001 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:11.408414 10375 pending_rounds.cc:70] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:11.408917 10375 pending_rounds.cc:77] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058716488286208 op_type: NO_OP noop_request { }
I20260810 19:48:11.409068 10375 raft_consensus.cc:2889] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:11.409175 10375 raft_consensus.cc:2272] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:11.409802 10375 ts_tablet_manager.cc:1916] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:11.411249 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 7459e64bd48449d2a8d4ff835b215d46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7459e64bd48449d2a8d4ff835b215d46 already in progress: creating tablet
I20260810 19:48:11.412645 10370 tablet_bootstrap.cc:492] T f85f3fa629764c79921a710739eea7ae P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:11.412796 10370 ts_tablet_manager.cc:1403] T f85f3fa629764c79921a710739eea7ae P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
W20260810 19:48:11.412783 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 6d9a7b19ea944e73b38e56a240650dbf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d9a7b19ea944e73b38e56a240650dbf already in progress: creating tablet
I20260810 19:48:11.413617 10370 raft_consensus.cc:359] T f85f3fa629764c79921a710739eea7ae P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:11.413707 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 81aabb5656e7472f9223fd7acf10e43c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81aabb5656e7472f9223fd7acf10e43c already in progress: creating tablet
I20260810 19:48:11.413794 10370 raft_consensus.cc:385] T f85f3fa629764c79921a710739eea7ae P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.413853 10370 raft_consensus.cc:740] T f85f3fa629764c79921a710739eea7ae P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.414119 10370 consensus_queue.cc:260] T f85f3fa629764c79921a710739eea7ae P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:11.414587 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet bef956a173084e7698a37dddc574ea65 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bef956a173084e7698a37dddc574ea65 already in progress: creating tablet
I20260810 19:48:11.414664 10367 tablet_bootstrap.cc:492] T 263a5695e7754b44a64edbda27b42135 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:11.414829 10367 ts_tablet_manager.cc:1403] T 263a5695e7754b44a64edbda27b42135 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.034s user 0.005s sys 0.000s
I20260810 19:48:11.415501 10367 raft_consensus.cc:359] T 263a5695e7754b44a64edbda27b42135 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.415680 10367 raft_consensus.cc:385] T 263a5695e7754b44a64edbda27b42135 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.415740 10367 raft_consensus.cc:740] T 263a5695e7754b44a64edbda27b42135 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.415994 10367 consensus_queue.cc:260] T 263a5695e7754b44a64edbda27b42135 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.416644 10367 ts_tablet_manager.cc:1434] T 263a5695e7754b44a64edbda27b42135 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:11.416843 10370 ts_tablet_manager.cc:1434] T f85f3fa629764c79921a710739eea7ae P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 19:48:11.416962 10367 tablet_bootstrap.cc:492] T 7459e64bd48449d2a8d4ff835b215d46 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:11.417121 10370 tablet_bootstrap.cc:492] T 3840b035b88243ecad17865d4716fcfc P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:11.418592 10367 tablet_bootstrap.cc:654] T 7459e64bd48449d2a8d4ff835b215d46 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.418663 10370 tablet_bootstrap.cc:654] T 3840b035b88243ecad17865d4716fcfc P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.435391 10367 tablet_bootstrap.cc:492] T 7459e64bd48449d2a8d4ff835b215d46 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:11.435564 10367 ts_tablet_manager.cc:1403] T 7459e64bd48449d2a8d4ff835b215d46 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.002s
I20260810 19:48:11.436283 10367 raft_consensus.cc:359] T 7459e64bd48449d2a8d4ff835b215d46 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.436460 10367 raft_consensus.cc:385] T 7459e64bd48449d2a8d4ff835b215d46 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.436506 10367 raft_consensus.cc:740] T 7459e64bd48449d2a8d4ff835b215d46 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.436830 10367 consensus_queue.cc:260] T 7459e64bd48449d2a8d4ff835b215d46 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.437469 10367 ts_tablet_manager.cc:1434] T 7459e64bd48449d2a8d4ff835b215d46 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:11.437788 10367 tablet_bootstrap.cc:492] T 59a767c91abf45e79cebab582525ad2e P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:11.439349 10367 tablet_bootstrap.cc:654] T 59a767c91abf45e79cebab582525ad2e P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:11.444940 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 89486e79019a4ea49066231ee761089f consensus state has no leader
I20260810 19:48:11.445573 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1aa7012040f54866836d16c7d236a8a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:11.446254 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1aa7012040f54866836d16c7d236a8a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:11.447875 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 07856671e97e4f0089cd67f6b8b2ac42 consensus state has no leader
I20260810 19:48:11.448283 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_5cf984e484f0410a830b95cecdb057d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:11.448855 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5cf984e484f0410a830b95cecdb057d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:11.450162 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a8963894d23348d3844ab5377762d249 consensus state has no leader
I20260810 19:48:11.450670 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_26690c8afd2343e6abeaf8a6a026c2e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:11.451258 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_26690c8afd2343e6abeaf8a6a026c2e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:11.452684 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_5910df4a049c4ae7a3f91a2b44614751"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:11.453230 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5910df4a049c4ae7a3f91a2b44614751 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:11.454401 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fd92028cb8c849d4b121cec3775cbe62 consensus state has no leader
I20260810 19:48:11.454770 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_4e5a130c086049a886c3cbaeeafc5458"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:11.455265 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e5a130c086049a886c3cbaeeafc5458 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:11.456627 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_925abe17cfd440bf9b41ed6f51b5e788"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:11.457085 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_925abe17cfd440bf9b41ed6f51b5e788 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:11.461253 12823 raft_consensus.cc:493] T 99aa001db52149dd90ce86e7261f7424 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.461406 12823 raft_consensus.cc:515] T 99aa001db52149dd90ce86e7261f7424 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.462047 12823 leader_election.cc:290] T 99aa001db52149dd90ce86e7261f7424 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:11.467239 10375 ts_tablet_manager.cc:1929] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:11.467391 10375 log.cc:1199] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/dcb3660108094399b36d19ea8e6b8308
I20260810 19:48:11.467762 10375 ts_tablet_manager.cc:1950] T dcb3660108094399b36d19ea8e6b8308 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:11.473644 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 877) took 2743 ms. Trace:
I20260810 19:48:11.473769 10375 rpcz_store.cc:276] 0810 19:48:08.730046 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:08.730465 (+ 419us) service_pool.cc:224] Handling call
0810 19:48:11.354247 (+2623782us) ts_tablet_manager.cc:1151] Deleting tablet dcb3660108094399b36d19ea8e6b8308
0810 19:48:11.354270 (+ 23us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:11.449221 (+ 94951us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:11.467156 (+ 17935us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:11.473615 (+ 6459us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4934,"tablet-delete.queue_time_us":2623537}
I20260810 19:48:11.474488 10375 tablet_replica.cc:333] T 4dba7046bdfd41f1a2ad6f299a723776 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:11.474442 9413 catalog_manager.cc:5719] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:11.474819 10375 raft_consensus.cc:2243] T 4dba7046bdfd41f1a2ad6f299a723776 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:11.474874 9413 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 3840b035b88243ecad17865d4716fcfc (table default.Table_e1cc6dd116324bf385dbc82e56283cf7 [id=6bf4ac94189d476d9ab5778e69d0b14f]). Expected version 1 got 0
I20260810 19:48:11.474977 10375 raft_consensus.cc:2272] T 4dba7046bdfd41f1a2ad6f299a723776 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:11.475533 10375 ts_tablet_manager.cc:1916] T 4dba7046bdfd41f1a2ad6f299a723776 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:11.477280 9415 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 5e47086440ef4a249f1eed23db655879 (table default.Table_b38998c1916842f1aa85263f019bde23 [id=a2b6e3d955f3426781465b670f4fa727]). Expected version 1 got 0
I20260810 19:48:11.477458 9415 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet a45add97e0e54dce85225e175ecbb45a (table default.Table_20e2fe27c4df47bebcc2d32dd2207662 [id=c580a677dcab41d9892011258d5993d7]). Expected version 4 got 3
I20260810 19:48:11.477633 9415 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet b33aa8be266a434cba899da7514c47e9 (table default.Table_40317d27e3de4c7ebbe4a80239f78899 [id=4e38b3a52c3549889893d804ab0dfb89]). Expected version 2 got 0
I20260810 19:48:11.478554 12864 tablet.cc:1724] T e68916e2568f4527a181342cdc728001 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:11.479660 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet dcb3660108094399b36d19ea8e6b8308 (table default.Table_9d569d756be84460b1b78812a13b95ad [id=14e993ddf3b646098d6d3a3e24d01b07]) successfully deleted
I20260810 19:48:11.480068 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 84b7657b60d34da2b136d36c3abbb786 (DEFAULT_TABLE table=default.Table_46194b48775d4bafac9cbce8b13a6b48 [id=03740351152f40ddae00c3fc2adbf9fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.480103 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 84b7657b60d34da2b136d36c3abbb786 (DEFAULT_TABLE table=default.Table_46194b48775d4bafac9cbce8b13a6b48 [id=03740351152f40ddae00c3fc2adbf9fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.480509 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84b7657b60d34da2b136d36c3abbb786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.480513 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84b7657b60d34da2b136d36c3abbb786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.480443 10118 tablet_service.cc:1511] Processing CreateTablet for tablet dc613dbf00d64d0c83762a10f4b16832 (DEFAULT_TABLE table=default.Table_08b067bad4ef46b8bea521aaee69f5cc [id=b04254bc91da48838d0dd35bb882d438]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.480772 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc613dbf00d64d0c83762a10f4b16832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.481004 10120 tablet_service.cc:1511] Processing CreateTablet for tablet cf7e0d5029b54b2896391bba39827031 (DEFAULT_TABLE table=default.Table_2be04a7ccc8d4e65875d3e2e16f3d858 [id=0a44c02659394b76967c10457ce64d43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.481308 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7e0d5029b54b2896391bba39827031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.482596 9896 tablet_service.cc:1511] Processing CreateTablet for tablet dc613dbf00d64d0c83762a10f4b16832 (DEFAULT_TABLE table=default.Table_08b067bad4ef46b8bea521aaee69f5cc [id=b04254bc91da48838d0dd35bb882d438]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.482956 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc613dbf00d64d0c83762a10f4b16832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.486470 9408 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_20e2fe27c4df47bebcc2d32dd2207662 [id=c580a677dcab41d9892011258d5993d7] alter complete (version 4)
I20260810 19:48:11.486603 9890 tablet_service.cc:1511] Processing CreateTablet for tablet cf7e0d5029b54b2896391bba39827031 (DEFAULT_TABLE table=default.Table_2be04a7ccc8d4e65875d3e2e16f3d858 [id=0a44c02659394b76967c10457ce64d43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.486984 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7e0d5029b54b2896391bba39827031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.488018 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ce3200001a3c49ddbf1783a9db0805f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:11.488611 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce3200001a3c49ddbf1783a9db0805f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:11.494174 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bddaf5b5fc1404e83b079ffa97e7321 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:11.494454 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b2b20dc77954af7a203f357c746be29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:11.494638 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet dcb3660108094399b36d19ea8e6b8308 with delete_type TABLET_DATA_DELETED (replaced by tablet f5fa6060b9ef48cea6830cd9d19424ea) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:11.495074 9668 tablet_service.cc:1511] Processing CreateTablet for tablet 84b7657b60d34da2b136d36c3abbb786 (DEFAULT_TABLE table=default.Table_46194b48775d4bafac9cbce8b13a6b48 [id=03740351152f40ddae00c3fc2adbf9fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.495546 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84b7657b60d34da2b136d36c3abbb786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.496563 12823 raft_consensus.cc:493] T 3520274768ed41abb010bb109127affa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.496709 12823 raft_consensus.cc:515] T 3520274768ed41abb010bb109127affa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.497350 12823 leader_election.cc:290] T 3520274768ed41abb010bb109127affa P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:11.498742 9684 tablet_service.cc:1511] Processing CreateTablet for tablet cf7e0d5029b54b2896391bba39827031 (DEFAULT_TABLE table=default.Table_2be04a7ccc8d4e65875d3e2e16f3d858 [id=0a44c02659394b76967c10457ce64d43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.499181 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7e0d5029b54b2896391bba39827031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.499713 9415 master_service.cc:960] ReplaceTablet: received request to replace tablet f2606854f9954f2ea10610aeb1e60368 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:11.503034 9892 tablet_service.cc:1511] Processing CreateTablet for tablet bcedece14bba4f69bac23e22fd327c82 (DEFAULT_TABLE table=default.Table_ed27127a3f5146ceb644818536073842 [id=5f1b5510934743a69234b3aae0ff5ddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.503454 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcedece14bba4f69bac23e22fd327c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.506467 12699 raft_consensus.cc:493] T 39885c3e0adb4132945d507628f4f082 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.506630 12699 raft_consensus.cc:515] T 39885c3e0adb4132945d507628f4f082 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.507316 12699 leader_election.cc:290] T 39885c3e0adb4132945d507628f4f082 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:11.507869 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 721b84fab1b44b88aee5ac397c2d6891 (DEFAULT_TABLE table=default.Table_f4212f91fcc34d53b982d7373f7704eb [id=61a1c746dec74317bc2a4207a2bddb89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.507839 9664 tablet_service.cc:1511] Processing CreateTablet for tablet bcedece14bba4f69bac23e22fd327c82 (DEFAULT_TABLE table=default.Table_ed27127a3f5146ceb644818536073842 [id=5f1b5510934743a69234b3aae0ff5ddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.508277 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 721b84fab1b44b88aee5ac397c2d6891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.508286 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcedece14bba4f69bac23e22fd327c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.495100 9666 tablet_service.cc:1511] Processing CreateTablet for tablet dc613dbf00d64d0c83762a10f4b16832 (DEFAULT_TABLE table=default.Table_08b067bad4ef46b8bea521aaee69f5cc [id=b04254bc91da48838d0dd35bb882d438]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.510881 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc613dbf00d64d0c83762a10f4b16832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.512560 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet 749cea5cd8f842b891f4e2cab07c054e from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:11.513255 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b5a8a6be570046fc83326c8efb7b8f10" } new_table_name: "default.Table_35eb86435a614980b851a37a6fdb216f" modify_external_catalogs: true
I20260810 19:48:11.514997 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99aa001db52149dd90ce86e7261f7424" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:11.515125 9416 master_service.cc:960] ReplaceTablet: received request to replace tablet 17a0745b87a24e3ca0e3e32c2059f422 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:11.515503 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3520274768ed41abb010bb109127affa" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:11.516075 9611 leader_election.cc:343] T 99aa001db52149dd90ce86e7261f7424 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:11.516525 9611 leader_election.cc:343] T 3520274768ed41abb010bb109127affa P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.517493 9418 master_service.cc:960] ReplaceTablet: received request to replace tablet 2daf9e86dff44999ae8975529cd6014f from {username='slave'} at 127.0.0.1:56048
W20260810 19:48:11.518546 10067 leader_election.cc:343] T 39885c3e0adb4132945d507628f4f082 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 39885c3e0adb4132945d507628f4f082
I20260810 19:48:11.518781 12699 raft_consensus.cc:493] T 639c824ba4834734a4ebfd558181bebe P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.518918 12699 raft_consensus.cc:515] T 639c824ba4834734a4ebfd558181bebe P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.519140 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ad8ef827a5d043a098c5fb5101be8ecf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:11.519608 12699 leader_election.cc:290] T 639c824ba4834734a4ebfd558181bebe P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:11.519727 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad8ef827a5d043a098c5fb5101be8ecf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:11.520290 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639c824ba4834734a4ebfd558181bebe" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:11.520527 9931 raft_consensus.cc:2393] T 639c824ba4834734a4ebfd558181bebe P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eadde59fd6504d679e47f03a60c64bb0 in current term 1: Already voted for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in this term.
I20260810 19:48:11.521384 10137 tablet_service.cc:1511] Processing CreateTablet for tablet bcedece14bba4f69bac23e22fd327c82 (DEFAULT_TABLE table=default.Table_ed27127a3f5146ceb644818536073842 [id=5f1b5510934743a69234b3aae0ff5ddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.521811 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcedece14bba4f69bac23e22fd327c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.522250 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639c824ba4834734a4ebfd558181bebe" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:11.522377 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99aa001db52149dd90ce86e7261f7424" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:11.522894 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3520274768ed41abb010bb109127affa" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:11.523312 9611 leader_election.cc:343] T 99aa001db52149dd90ce86e7261f7424 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.523432 9611 leader_election.cc:304] T 99aa001db52149dd90ce86e7261f7424 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:11.523847 12823 raft_consensus.cc:2749] T 99aa001db52149dd90ce86e7261f7424 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:11.524231 9611 leader_election.cc:343] T 3520274768ed41abb010bb109127affa P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.524330 9611 leader_election.cc:304] T 3520274768ed41abb010bb109127affa P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:11.524667 12823 raft_consensus.cc:2749] T 3520274768ed41abb010bb109127affa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:11.525068 10068 leader_election.cc:343] T 39885c3e0adb4132945d507628f4f082 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 39885c3e0adb4132945d507628f4f082
I20260810 19:48:11.525162 10068 leader_election.cc:304] T 39885c3e0adb4132945d507628f4f082 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:11.525378 12699 raft_consensus.cc:2749] T 39885c3e0adb4132945d507628f4f082 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.526366 10067 leader_election.cc:304] T 639c824ba4834734a4ebfd558181bebe P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:11.527076 12705 raft_consensus.cc:3060] T 639c824ba4834734a4ebfd558181bebe P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:11.529649 12705 raft_consensus.cc:2749] T 639c824ba4834734a4ebfd558181bebe P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.530468 9890 tablet_service.cc:1511] Processing CreateTablet for tablet 6d815026a3d548449ba663e03f369905 (DEFAULT_TABLE table=default.Table_89a370539a6b4b6a816435afdb44361f [id=2aea1bc8d59343a580202f509d9119f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.530951 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d815026a3d548449ba663e03f369905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.534868 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 721b84fab1b44b88aee5ac397c2d6891 (DEFAULT_TABLE table=default.Table_f4212f91fcc34d53b982d7373f7704eb [id=61a1c746dec74317bc2a4207a2bddb89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.535290 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 721b84fab1b44b88aee5ac397c2d6891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.541674 10366 tablet_bootstrap.cc:492] T 19e2bf7b7d254894a07c5a75bf24e742 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:11.541862 10366 ts_tablet_manager.cc:1403] T 19e2bf7b7d254894a07c5a75bf24e742 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.159s user 0.005s sys 0.005s
I20260810 19:48:11.542699 10366 raft_consensus.cc:359] T 19e2bf7b7d254894a07c5a75bf24e742 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.542894 10366 raft_consensus.cc:385] T 19e2bf7b7d254894a07c5a75bf24e742 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.542948 10366 raft_consensus.cc:740] T 19e2bf7b7d254894a07c5a75bf24e742 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.543165 10366 consensus_queue.cc:260] T 19e2bf7b7d254894a07c5a75bf24e742 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.543679 10366 ts_tablet_manager.cc:1434] T 19e2bf7b7d254894a07c5a75bf24e742 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:11.543990 10366 tablet_bootstrap.cc:492] T c285518ed49d4ed68a6039f98db3b700 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:11.545544 10366 tablet_bootstrap.cc:654] T c285518ed49d4ed68a6039f98db3b700 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.546749 10118 tablet_service.cc:1511] Processing CreateTablet for tablet 721b84fab1b44b88aee5ac397c2d6891 (DEFAULT_TABLE table=default.Table_f4212f91fcc34d53b982d7373f7704eb [id=61a1c746dec74317bc2a4207a2bddb89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.551014 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 51d6334e2b174319a809fc9421bb8a77
I20260810 19:48:11.551914 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_85e674f117d5404eb01680b66429bc7b" } modify_external_catalogs: true
I20260810 19:48:11.552121 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_85e674f117d5404eb01680b66429bc7b" } modify_external_catalogs: true
I20260810 19:48:11.554559 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_eedceb8b47b24ffdada374252ad7e3b3" } modify_external_catalogs: true
I20260810 19:48:11.554764 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c537ac5c113143f0b5d0d8ca769417af" } modify_external_catalogs: true
I20260810 19:48:11.554955 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c537ac5c113143f0b5d0d8ca769417af" } modify_external_catalogs: true
I20260810 19:48:11.555109 10366 tablet_bootstrap.cc:492] T c285518ed49d4ed68a6039f98db3b700 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:11.555266 10366 ts_tablet_manager.cc:1403] T c285518ed49d4ed68a6039f98db3b700 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.002s
I20260810 19:48:11.555259 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 17a0745b87a24e3ca0e3e32c2059f422
I20260810 19:48:11.555725 9416 catalog_manager.cc:6807] ReplaceTablet: tablet 17a0745b87a24e3ca0e3e32c2059f422 deleted and replaced by tablet bfc3ac0bec4243bc91e2b6a847405d1d
I20260810 19:48:11.556046 10366 raft_consensus.cc:359] T c285518ed49d4ed68a6039f98db3b700 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.556155 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_41357f4dd0244d5f9850412683272914" } modify_external_catalogs: true
I20260810 19:48:11.556224 10366 raft_consensus.cc:385] T c285518ed49d4ed68a6039f98db3b700 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.556327 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_41357f4dd0244d5f9850412683272914" } modify_external_catalogs: true
I20260810 19:48:11.556277 10366 raft_consensus.cc:740] T c285518ed49d4ed68a6039f98db3b700 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.556634 10366 consensus_queue.cc:260] T c285518ed49d4ed68a6039f98db3b700 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.554780 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_eedceb8b47b24ffdada374252ad7e3b3" } modify_external_catalogs: true
I20260810 19:48:11.558171 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 2daf9e86dff44999ae8975529cd6014f
I20260810 19:48:11.558241 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet f2606854f9954f2ea10610aeb1e60368
I20260810 19:48:11.558732 9415 catalog_manager.cc:6807] ReplaceTablet: tablet f2606854f9954f2ea10610aeb1e60368 deleted and replaced by tablet 898b70d09c1d410fb75cd4dd32d844c8
I20260810 19:48:11.559345 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 721b84fab1b44b88aee5ac397c2d6891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.559345 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 17a0745b87a24e3ca0e3e32c2059f422 with delete_type TABLET_DATA_DELETED (replaced by tablet bfc3ac0bec4243bc91e2b6a847405d1d) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:11.559998 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 51d6334e2b174319a809fc9421bb8a77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:11.560213 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet 17a0745b87a24e3ca0e3e32c2059f422 with delete_type TABLET_DATA_DELETED (replaced by tablet bfc3ac0bec4243bc91e2b6a847405d1d) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:11.561167 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 2daf9e86dff44999ae8975529cd6014f with delete_type TABLET_DATA_DELETED (replaced by tablet 0a44b20cd972465290c49536b475510c) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:11.561393 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet f2606854f9954f2ea10610aeb1e60368 with delete_type TABLET_DATA_DELETED (replaced by tablet 898b70d09c1d410fb75cd4dd32d844c8) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:11.561499 12823 raft_consensus.cc:493] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.561574 9901 tablet_service.cc:1558] Processing DeleteTablet for tablet ca733de7babe4343ab26dbca2c9020b2 with delete_type TABLET_DATA_DELETED (replaced by tablet 264a65bd642648e59998fb55fb3c8de1) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:11.561656 12823 raft_consensus.cc:515] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.561991 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet f2606854f9954f2ea10610aeb1e60368 with delete_type TABLET_DATA_DELETED (replaced by tablet 898b70d09c1d410fb75cd4dd32d844c8) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:11.562062 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet f2606854f9954f2ea10610aeb1e60368 with delete_type TABLET_DATA_DELETED (replaced by tablet 898b70d09c1d410fb75cd4dd32d844c8) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.562189 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet 2daf9e86dff44999ae8975529cd6014f with delete_type TABLET_DATA_DELETED (replaced by tablet 0a44b20cd972465290c49536b475510c) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:11.562418 10377 tablet_replica.cc:333] T ca733de7babe4343ab26dbca2c9020b2 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:11.562413 12823 leader_election.cc:290] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:11.562493 12266 tablet_replica.cc:333] T f2606854f9954f2ea10610aeb1e60368 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:11.562614 10377 raft_consensus.cc:2243] T ca733de7babe4343ab26dbca2c9020b2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:11.562681 12266 raft_consensus.cc:2243] T f2606854f9954f2ea10610aeb1e60368 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:11.562803 10377 raft_consensus.cc:2272] T ca733de7babe4343ab26dbca2c9020b2 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:11.562845 12266 raft_consensus.cc:2272] T f2606854f9954f2ea10610aeb1e60368 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:11.558706 9418 catalog_manager.cc:6807] ReplaceTablet: tablet 2daf9e86dff44999ae8975529cd6014f deleted and replaced by tablet 0a44b20cd972465290c49536b475510c
I20260810 19:48:11.563412 10377 ts_tablet_manager.cc:1916] T ca733de7babe4343ab26dbca2c9020b2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:11.563452 12266 ts_tablet_manager.cc:1916] T f2606854f9954f2ea10610aeb1e60368 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:11.564014 9412 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 8b24b75629ec423b90e4bf287e7cfd38 (table default.Table_ce3ea915b9dd44b3943c4de2b462d48c [id=9f58b113854b4d139e789332dfe00c8c]). Expected version 3 got 0
I20260810 19:48:11.564505 9412 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 56fa5de3bf7142b2b0978f9190091f33 (table default.Table_1881cd552cf54157a0a41766d5b1b259 [id=87220e53176e4254a5238c988b6a7311]). Expected version 2 got 0
I20260810 19:48:11.564865 9412 catalog_manager.cc:5719] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193). New cstate: current_term: 1 leader_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:11.565353 9412 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 639c824ba4834734a4ebfd558181bebe (table default.Table_35ada13f5f5a41b0a93a57276b7756d9 [id=fa3844f34a5b4d55b6e87ec2164eb8fb]). Expected version 2 got 0
I20260810 19:48:11.566753 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet 2daf9e86dff44999ae8975529cd6014f with delete_type TABLET_DATA_DELETED (replaced by tablet 0a44b20cd972465290c49536b475510c) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.566804 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24b75629ec423b90e4bf287e7cfd38" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:11.568856 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24b75629ec423b90e4bf287e7cfd38" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:11.569703 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 0608e8013b704c38adc733327fe9bb02 (DEFAULT_TABLE table=default.Table_f2eccfdc3ce64e779e3c043708d87427 [id=e81f2428ecc741eaafe7e8e0daa2a845]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.570178 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0608e8013b704c38adc733327fe9bb02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.571180 12705 raft_consensus.cc:493] T f85f3fa629764c79921a710739eea7ae P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.571343 12705 raft_consensus.cc:515] T f85f3fa629764c79921a710739eea7ae P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.571812 12677 raft_consensus.cc:493] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.571985 12677 raft_consensus.cc:515] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.572090 12705 leader_election.cc:290] T f85f3fa629764c79921a710739eea7ae P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:11.572664 12677 leader_election.cc:290] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:11.573101 10067 leader_election.cc:343] T f85f3fa629764c79921a710739eea7ae P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: f85f3fa629764c79921a710739eea7ae
I20260810 19:48:11.573280 9709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e3dde1c29e4275bafb27df63b117be" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:11.573516 9709 raft_consensus.cc:2468] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
W20260810 19:48:11.574141 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 17a0745b87a24e3ca0e3e32c2059f422 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17a0745b87a24e3ca0e3e32c2059f422 already in progress: creating tablet
W20260810 19:48:11.574507 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 2daf9e86dff44999ae8975529cd6014f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2daf9e86dff44999ae8975529cd6014f already in progress: creating tablet
I20260810 19:48:11.574651 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 0608e8013b704c38adc733327fe9bb02 (DEFAULT_TABLE table=default.Table_f2eccfdc3ce64e779e3c043708d87427 [id=e81f2428ecc741eaafe7e8e0daa2a845]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:11.574739 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet f2606854f9954f2ea10610aeb1e60368 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2606854f9954f2ea10610aeb1e60368 already in progress: creating tablet
I20260810 19:48:11.575131 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0608e8013b704c38adc733327fe9bb02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.575235 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e3dde1c29e4275bafb27df63b117be" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:11.575634 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 6d815026a3d548449ba663e03f369905 (DEFAULT_TABLE table=default.Table_89a370539a6b4b6a816435afdb44361f [id=2aea1bc8d59343a580202f509d9119f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.576025 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d815026a3d548449ba663e03f369905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.578547 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 6d815026a3d548449ba663e03f369905 (DEFAULT_TABLE table=default.Table_89a370539a6b4b6a816435afdb44361f [id=2aea1bc8d59343a580202f509d9119f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.578601 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 0608e8013b704c38adc733327fe9bb02 (DEFAULT_TABLE table=default.Table_f2eccfdc3ce64e779e3c043708d87427 [id=e81f2428ecc741eaafe7e8e0daa2a845]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.578966 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d815026a3d548449ba663e03f369905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.578965 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0608e8013b704c38adc733327fe9bb02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.579269 9831 leader_election.cc:304] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:11.579569 12677 raft_consensus.cc:2804] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:11.579629 12677 raft_consensus.cc:493] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:11.579681 12677 raft_consensus.cc:3060] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:11.569777 9611 leader_election.cc:343] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:11.582643 9611 leader_election.cc:343] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:11.582681 10068 leader_election.cc:343] T f85f3fa629764c79921a710739eea7ae P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: f85f3fa629764c79921a710739eea7ae
I20260810 19:48:11.582754 9611 leader_election.cc:304] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:11.582803 10068 leader_election.cc:304] T f85f3fa629764c79921a710739eea7ae P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:48:11.583417 9830 leader_election.cc:343] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.583937 12823 raft_consensus.cc:2749] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.584391 12677 raft_consensus.cc:515] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.584681 10370 tablet_bootstrap.cc:492] T 3840b035b88243ecad17865d4716fcfc P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:11.584821 10370 ts_tablet_manager.cc:1403] T 3840b035b88243ecad17865d4716fcfc P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.168s user 0.003s sys 0.000s
I20260810 19:48:11.585162 12677 leader_election.cc:290] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:11.585638 10370 raft_consensus.cc:359] T 3840b035b88243ecad17865d4716fcfc P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.585819 10370 raft_consensus.cc:385] T 3840b035b88243ecad17865d4716fcfc P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.585878 10370 raft_consensus.cc:740] T 3840b035b88243ecad17865d4716fcfc P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.585932 9709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e3dde1c29e4275bafb27df63b117be" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:11.586110 9709 raft_consensus.cc:3060] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:11.586114 10370 consensus_queue.cc:260] T 3840b035b88243ecad17865d4716fcfc P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.586875 10370 ts_tablet_manager.cc:1434] T 3840b035b88243ecad17865d4716fcfc P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:11.587200 10370 tablet_bootstrap.cc:492] T 4f21e03993e841ba901f1e9c176309b9 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:11.589035 10370 tablet_bootstrap.cc:654] T 4f21e03993e841ba901f1e9c176309b9 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.592726 12699 raft_consensus.cc:2749] T f85f3fa629764c79921a710739eea7ae P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.592751 9709 raft_consensus.cc:2468] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:11.593353 9831 leader_election.cc:304] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:11.593639 12899 raft_consensus.cc:2804] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:11.593763 12899 raft_consensus.cc:697] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:11.594059 12899 consensus_queue.cc:237] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.595948 12823 raft_consensus.cc:493] T 48eee4ce10114021855075812e356652 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.596109 12823 raft_consensus.cc:515] T 48eee4ce10114021855075812e356652 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.596575 10120 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b40fd0d57ea4b71aeef2d66f4958ac8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:11.596786 12823 leader_election.cc:290] T 48eee4ce10114021855075812e356652 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:11.599134 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eee4ce10114021855075812e356652" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:11.599656 12705 raft_consensus.cc:493] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.600173 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 8569d63bbd8e4753b376ee6a5127fd3d (DEFAULT_TABLE table=default.Table_c3a2e190a4654d4fbbdcfa31845001f0 [id=0607b06dd44a4804a84538c61db98c34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.600651 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8569d63bbd8e4753b376ee6a5127fd3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.601436 9657 tablet_service.cc:1511] Processing CreateTablet for tablet b9794231f0f24139b2433abc3b7a560d (DEFAULT_TABLE table=default.Table_1cf64a023a0740f393ef38a3295767ab [id=aec2c931ee1c43879811d9719759b8b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.601816 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9794231f0f24139b2433abc3b7a560d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.599808 12705 raft_consensus.cc:515] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:11.602644 9611 leader_election.cc:343] T 48eee4ce10114021855075812e356652 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.603006 12705 leader_election.cc:290] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:11.607369 10067 leader_election.cc:343] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 9b40fd0d57ea4b71aeef2d66f4958ac8
I20260810 19:48:11.609372 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e967384768b4ec7956f1b508e8ab2af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:11.612908 9913 tablet_service.cc:1511] Processing CreateTablet for tablet b9794231f0f24139b2433abc3b7a560d (DEFAULT_TABLE table=default.Table_1cf64a023a0740f393ef38a3295767ab [id=aec2c931ee1c43879811d9719759b8b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.612908 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 8569d63bbd8e4753b376ee6a5127fd3d (DEFAULT_TABLE table=default.Table_c3a2e190a4654d4fbbdcfa31845001f0 [id=0607b06dd44a4804a84538c61db98c34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.613430 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8569d63bbd8e4753b376ee6a5127fd3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.613637 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9794231f0f24139b2433abc3b7a560d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.614549 10120 tablet_service.cc:1511] Processing CreateTablet for tablet b9794231f0f24139b2433abc3b7a560d (DEFAULT_TABLE table=default.Table_1cf64a023a0740f393ef38a3295767ab [id=aec2c931ee1c43879811d9719759b8b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.614845 10377 ts_tablet_manager.cc:1929] T ca733de7babe4343ab26dbca2c9020b2 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:11.614955 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9794231f0f24139b2433abc3b7a560d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.614972 10377 log.cc:1199] T ca733de7babe4343ab26dbca2c9020b2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/ca733de7babe4343ab26dbca2c9020b2
W20260810 19:48:11.616993 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3b2f576afb084987be171167a62883bb consensus state has no leader
I20260810 19:48:11.618108 10366 ts_tablet_manager.cc:1434] T c285518ed49d4ed68a6039f98db3b700 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.063s user 0.001s sys 0.001s
I20260810 19:48:11.618511 10366 tablet_bootstrap.cc:492] T ee5f38d91bb349a9ae1da8ba69d2ddbc P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:11.618621 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 8569d63bbd8e4753b376ee6a5127fd3d (DEFAULT_TABLE table=default.Table_c3a2e190a4654d4fbbdcfa31845001f0 [id=0607b06dd44a4804a84538c61db98c34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.619019 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8569d63bbd8e4753b376ee6a5127fd3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.621079 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet 51d6334e2b174319a809fc9421bb8a77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:11.621426 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 17a0745b87a24e3ca0e3e32c2059f422 with delete_type TABLET_DATA_DELETED (replaced by tablet bfc3ac0bec4243bc91e2b6a847405d1d) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.621687 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 51d6334e2b174319a809fc9421bb8a77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.621990 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet d6f410a1659c40f08ac274e63ad01b3d with delete_type TABLET_DATA_DELETED (replaced by tablet 60798f21222443c69bacf4a799a33c8f) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:11.622252 12266 ts_tablet_manager.cc:1929] T f2606854f9954f2ea10610aeb1e60368 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:11.622426 12266 log.cc:1199] T f2606854f9954f2ea10610aeb1e60368 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/f2606854f9954f2ea10610aeb1e60368
I20260810 19:48:11.622779 12266 ts_tablet_manager.cc:1950] T f2606854f9954f2ea10610aeb1e60368 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:11.623626 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet aa5702d7b3bd421eb7b8a4e0f181d2d4
I20260810 19:48:11.624554 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 48fa5f075d2749dc80ad5594746d7564
I20260810 19:48:11.624990 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 49fa134c630d4df4af2d92b0e3f1f498
I20260810 19:48:11.625397 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet aa5702d7b3bd421eb7b8a4e0f181d2d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:11.625293 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 578dda3cfd5a4cfeab830195bcb3b6bb (DEFAULT_TABLE table=default.Table_44b7608bc31044139b543b16684f5fb9 [id=75affd542589424a8c169bccb5cc3b37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.625806 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 7dcf7d5fe650439bbbc744b3155a31e1 (DEFAULT_TABLE table=default.Table_1abca061cc224f4b966955e5b949b622 [id=abf463816e5a4d7d8e64f58fbd9da4ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.626113 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 578dda3cfd5a4cfeab830195bcb3b6bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.626698 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet aa5702d7b3bd421eb7b8a4e0f181d2d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.626713 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 49fa134c630d4df4af2d92b0e3f1f498 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.627334 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dcf7d5fe650439bbbc744b3155a31e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.628649 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet 48fa5f075d2749dc80ad5594746d7564 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.629142 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 51d6334e2b174319a809fc9421bb8a77 (DEFAULT_TABLE table=default.Table_a22a70d0868e4274a3a9384539baf907 [id=d885f373c84943e88ed6332fdd7308a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.629698 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 51d6334e2b174319a809fc9421bb8a77 (DEFAULT_TABLE table=default.Table_a22a70d0868e4274a3a9384539baf907 [id=d885f373c84943e88ed6332fdd7308a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.630120 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d6334e2b174319a809fc9421bb8a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.630537 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d6334e2b174319a809fc9421bb8a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.632732 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 028fd8427d824ae89ff035d32548710b
I20260810 19:48:11.633108 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 7dcf7d5fe650439bbbc744b3155a31e1 (DEFAULT_TABLE table=default.Table_1abca061cc224f4b966955e5b949b622 [id=abf463816e5a4d7d8e64f58fbd9da4ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.633538 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dcf7d5fe650439bbbc744b3155a31e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.636144 9418 catalog_manager.cc:5719] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } }
I20260810 19:48:11.636804 9418 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 18cd8adaa065425c846bc791c05fa67d (table default.Table_a1645668cf79415ca029a01169fbf874 [id=aec405416e584af6bfb8194b357d6dbc]). Expected version 3 got 0
I20260810 19:48:11.638484 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet 028fd8427d824ae89ff035d32548710b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.638592 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eee4ce10114021855075812e356652" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:11.638701 10377 ts_tablet_manager.cc:1950] T ca733de7babe4343ab26dbca2c9020b2 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:11.639143 9890 tablet_service.cc:1511] Processing CreateTablet for tablet 51d6334e2b174319a809fc9421bb8a77 (DEFAULT_TABLE table=default.Table_a22a70d0868e4274a3a9384539baf907 [id=d885f373c84943e88ed6332fdd7308a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.639920 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 7dcf7d5fe650439bbbc744b3155a31e1 (DEFAULT_TABLE table=default.Table_1abca061cc224f4b966955e5b949b622 [id=abf463816e5a4d7d8e64f58fbd9da4ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.640347 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dcf7d5fe650439bbbc744b3155a31e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.640547 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e3dde1c29e4275bafb27df63b117be" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
W20260810 19:48:11.641872 9830 leader_election.cc:343] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:11.641908 10068 leader_election.cc:343] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 9b40fd0d57ea4b71aeef2d66f4958ac8
I20260810 19:48:11.642016 10068 leader_election.cc:304] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:48:11.642004 9611 leader_election.cc:343] T 48eee4ce10114021855075812e356652 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.642112 9611 leader_election.cc:304] T 48eee4ce10114021855075812e356652 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:11.642549 12823 raft_consensus.cc:2749] T 48eee4ce10114021855075812e356652 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.642793 12705 raft_consensus.cc:2749] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.643263 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d6334e2b174319a809fc9421bb8a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.644687 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet aa5702d7b3bd421eb7b8a4e0f181d2d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:11.646072 12266 tablet_replica.cc:333] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:11.646082 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet f2606854f9954f2ea10610aeb1e60368 (table default.Table_33ab9a72c1d543beb6a25830c7f1aa23 [id=4fe62c29683b4e5ca802b5cf74ae195e]) successfully deleted
W20260810 19:48:11.646471 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 2daf9e86dff44999ae8975529cd6014f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2daf9e86dff44999ae8975529cd6014f already in progress: creating tablet
W20260810 19:48:11.646709 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 17a0745b87a24e3ca0e3e32c2059f422 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17a0745b87a24e3ca0e3e32c2059f422 already in progress: creating tablet
W20260810 19:48:11.646947 9397 catalog_manager.cc:5017] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 51d6334e2b174319a809fc9421bb8a77 because the tablet was not found. No further retry: Not found: Tablet not found: 51d6334e2b174319a809fc9421bb8a77
I20260810 19:48:11.651413 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 48fa5f075d2749dc80ad5594746d7564 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:11.651793 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet 48fa5f075d2749dc80ad5594746d7564 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:11.652681 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet 49fa134c630d4df4af2d92b0e3f1f498 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:11.660272 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 49fa134c630d4df4af2d92b0e3f1f498 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:11.660604 10377 tablet_replica.cc:333] T d6f410a1659c40f08ac274e63ad01b3d P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:11.660808 10377 raft_consensus.cc:2243] T d6f410a1659c40f08ac274e63ad01b3d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:11.660980 10377 raft_consensus.cc:2272] T d6f410a1659c40f08ac274e63ad01b3d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:11.661322 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8376743094a548beba588e486d56d283" } new_table_name: "default.Table_31f5fbb1fbfc4d92a4e4ca2f2614be0b" modify_external_catalogs: true
I20260810 19:48:11.661538 10377 ts_tablet_manager.cc:1916] T d6f410a1659c40f08ac274e63ad01b3d P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:11.662789 12705 raft_consensus.cc:493] T 3840b035b88243ecad17865d4716fcfc P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.662928 12705 raft_consensus.cc:515] T 3840b035b88243ecad17865d4716fcfc P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.663560 12705 leader_election.cc:290] T 3840b035b88243ecad17865d4716fcfc P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:11.664347 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a58aa5218e0f45bda94dcc2410503f08"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:11.664539 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_d1ef74ea96924073acb57beb996e40fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:11.664806 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 028fd8427d824ae89ff035d32548710b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:48:11.664968 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a58aa5218e0f45bda94dcc2410503f08 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:11.665174 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_aa489bdcb733479bb531e701b5330991" } new_table_name: "default.Table_cec9f2727c1943e2a6e9be05722f268c" modify_external_catalogs: true
I20260810 19:48:11.665241 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 578dda3cfd5a4cfeab830195bcb3b6bb (DEFAULT_TABLE table=default.Table_44b7608bc31044139b543b16684f5fb9 [id=75affd542589424a8c169bccb5cc3b37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.665680 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 578dda3cfd5a4cfeab830195bcb3b6bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.664347 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_475e897fdcd7418bbe190ef1ab210c2a" } new_table_name: "default.Table_fc1cb7f5578e44d6b246830ac5cf0ed1" modify_external_catalogs: true
I20260810 19:48:11.666781 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3fa3d0ea397e42ee85937bb679ac16e0" } new_table_name: "default.Table_00f3c6cfc4b644a58cd1b5e9daee8d15" modify_external_catalogs: true
W20260810 19:48:11.664968 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d1ef74ea96924073acb57beb996e40fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:11.670526 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet 028fd8427d824ae89ff035d32548710b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:11.670888 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet ca733de7babe4343ab26dbca2c9020b2 (table default.Table_99d4dfcac15d4d91b42b2a250bd58fc8 [id=5aaa48a6a5d94fef89881115cdd023ac]) successfully deleted
W20260810 19:48:11.672377 9395 catalog_manager.cc:5017] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 51d6334e2b174319a809fc9421bb8a77 because the tablet was not found. No further retry: Not found: Tablet not found: 51d6334e2b174319a809fc9421bb8a77
I20260810 19:48:11.657449 12823 raft_consensus.cc:493] T 1f895bcd21f647f2ab813903d600a31a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.673157 12823 raft_consensus.cc:515] T 1f895bcd21f647f2ab813903d600a31a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.673231 12266 raft_consensus.cc:2243] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:11.673448 12266 raft_consensus.cc:2272] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:11.673893 12823 leader_election.cc:290] T 1f895bcd21f647f2ab813903d600a31a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:11.664640 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 578dda3cfd5a4cfeab830195bcb3b6bb (DEFAULT_TABLE table=default.Table_44b7608bc31044139b543b16684f5fb9 [id=75affd542589424a8c169bccb5cc3b37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.671763 9709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3840b035b88243ecad17865d4716fcfc" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:11.675580 9709 raft_consensus.cc:2393] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eadde59fd6504d679e47f03a60c64bb0 in current term 1: Already voted for candidate 6986ed920dcb4af29a5eeeda6f671691 in this term.
I20260810 19:48:11.676270 12823 raft_consensus.cc:493] T 7459e64bd48449d2a8d4ff835b215d46 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.676312 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895bcd21f647f2ab813903d600a31a" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:11.676396 12823 raft_consensus.cc:515] T 7459e64bd48449d2a8d4ff835b215d46 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.677037 12823 leader_election.cc:290] T 7459e64bd48449d2a8d4ff835b215d46 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:11.678576 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7459e64bd48449d2a8d4ff835b215d46" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:11.680676 9611 leader_election.cc:343] T 7459e64bd48449d2a8d4ff835b215d46 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.681102 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 578dda3cfd5a4cfeab830195bcb3b6bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.683199 12266 ts_tablet_manager.cc:1916] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:11.683420 10367 tablet_bootstrap.cc:492] T 59a767c91abf45e79cebab582525ad2e P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:11.683540 10367 ts_tablet_manager.cc:1403] T 59a767c91abf45e79cebab582525ad2e P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.246s user 0.003s sys 0.000s
I20260810 19:48:11.684003 9415 master_service.cc:960] ReplaceTablet: received request to replace tablet d857efeee4d3442ca065221e3095d421 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:11.684209 10367 raft_consensus.cc:359] T 59a767c91abf45e79cebab582525ad2e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.684370 10367 raft_consensus.cc:385] T 59a767c91abf45e79cebab582525ad2e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.684423 10367 raft_consensus.cc:740] T 59a767c91abf45e79cebab582525ad2e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
W20260810 19:48:11.684445 9611 leader_election.cc:343] T 1f895bcd21f647f2ab813903d600a31a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.684607 10367 consensus_queue.cc:260] T 59a767c91abf45e79cebab582525ad2e P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.685041 12705 raft_consensus.cc:493] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.685180 12705 raft_consensus.cc:515] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.685274 10367 ts_tablet_manager.cc:1434] T 59a767c91abf45e79cebab582525ad2e P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:11.685993 12705 leader_election.cc:290] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:11.686787 10377 ts_tablet_manager.cc:1929] T d6f410a1659c40f08ac274e63ad01b3d P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:11.686905 10377 log.cc:1199] T d6f410a1659c40f08ac274e63ad01b3d P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/d6f410a1659c40f08ac274e63ad01b3d
I20260810 19:48:11.687186 10377 ts_tablet_manager.cc:1950] T d6f410a1659c40f08ac274e63ad01b3d P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:11.692188 10367 tablet_bootstrap.cc:492] T 38b0c6a017dc4afc849090cca7ee8b26 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:11.692157 9687 tablet_service.cc:1511] Processing CreateTablet for tablet b5ec15d8a0d241e3b6238c408d2fb436 (DEFAULT_TABLE table=default.Table_e50bfbd91b13440fa3c5d5891d940b14 [id=38362ecfc665477a96e61d6e6fb4c90c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.692727 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ec15d8a0d241e3b6238c408d2fb436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.693591 10367 tablet_bootstrap.cc:654] T 38b0c6a017dc4afc849090cca7ee8b26 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.696429 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3840b035b88243ecad17865d4716fcfc" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:11.674968 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895bcd21f647f2ab813903d600a31a" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:11.697582 10067 leader_election.cc:304] T 3840b035b88243ecad17865d4716fcfc P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:11.697932 9688 tablet_service.cc:1511] Processing CreateTablet for tablet a8263a2e8c8b435d85c04f3282b2db4f (DEFAULT_TABLE table=default.Table_f0efe0b783444415bf0ef90618bf426f [id=71b4b5b9ef354523b0742e93a94273c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.698127 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827dce05c192467589e2692fabd2a84e" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:11.698329 9935 raft_consensus.cc:2468] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:11.698395 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8263a2e8c8b435d85c04f3282b2db4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.698918 10067 leader_election.cc:304] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
W20260810 19:48:11.699234 9611 leader_election.cc:343] T 1f895bcd21f647f2ab813903d600a31a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.699265 12699 raft_consensus.cc:3060] T 3840b035b88243ecad17865d4716fcfc P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:11.699368 9611 leader_election.cc:304] T 1f895bcd21f647f2ab813903d600a31a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:11.699613 12705 raft_consensus.cc:2804] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:11.699790 12705 raft_consensus.cc:493] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:11.699859 12823 raft_consensus.cc:2749] T 1f895bcd21f647f2ab813903d600a31a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.699903 12705 raft_consensus.cc:3060] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:11.701318 10136 tablet_service.cc:1511] Processing CreateTablet for tablet a8263a2e8c8b435d85c04f3282b2db4f (DEFAULT_TABLE table=default.Table_f0efe0b783444415bf0ef90618bf426f [id=71b4b5b9ef354523b0742e93a94273c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.701701 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8263a2e8c8b435d85c04f3282b2db4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.704746 10377 tablet_replica.cc:333] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:11.704954 10377 raft_consensus.cc:2243] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:11.705272 10377 raft_consensus.cc:2272] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:11.705875 10377 ts_tablet_manager.cc:1916] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:11.705998 10375 ts_tablet_manager.cc:1929] T 4dba7046bdfd41f1a2ad6f299a723776 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:11.706096 10375 log.cc:1199] T 4dba7046bdfd41f1a2ad6f299a723776 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/4dba7046bdfd41f1a2ad6f299a723776
I20260810 19:48:11.706451 10375 ts_tablet_manager.cc:1950] T 4dba7046bdfd41f1a2ad6f299a723776 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:11.706516 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 5f9535152e6d45fa8ade32631b749678 (DEFAULT_TABLE table=default.Table_f458a2f7a78d4870b5f489afdcd4eef6 [id=815aba326e24410cadef0e060b427979]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.705977 9898 tablet_service.cc:1511] Processing CreateTablet for tablet a8263a2e8c8b435d85c04f3282b2db4f (DEFAULT_TABLE table=default.Table_f0efe0b783444415bf0ef90618bf426f [id=71b4b5b9ef354523b0742e93a94273c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.706569 10118 tablet_service.cc:1511] Processing CreateTablet for tablet b5ec15d8a0d241e3b6238c408d2fb436 (DEFAULT_TABLE table=default.Table_e50bfbd91b13440fa3c5d5891d940b14 [id=38362ecfc665477a96e61d6e6fb4c90c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.706941 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f9535152e6d45fa8ade32631b749678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.707290 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ec15d8a0d241e3b6238c408d2fb436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.708714 12505 consensus_queue.cc:1048] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:11.710150 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8263a2e8c8b435d85c04f3282b2db4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.714046 10366 tablet_bootstrap.cc:654] T ee5f38d91bb349a9ae1da8ba69d2ddbc P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.715193 10116 tablet_service.cc:1511] Processing CreateTablet for tablet 5f9535152e6d45fa8ade32631b749678 (DEFAULT_TABLE table=default.Table_f458a2f7a78d4870b5f489afdcd4eef6 [id=815aba326e24410cadef0e060b427979]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.715653 10116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f9535152e6d45fa8ade32631b749678. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:11.718101 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4579a71f8c8149798eb5f136135e5efe consensus state has no leader
W20260810 19:48:11.718938 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fafad8559b074dab958f03061e65b8c3 consensus state has no leader
I20260810 19:48:11.719055 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_47b60293596b47298fd66de06fff3f84"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:11.719662 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47b60293596b47298fd66de06fff3f84 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:11.720957 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f7037b58854c488bac1be56bf21092a7 consensus state has no leader
I20260810 19:48:11.721793 9420 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 639c824ba4834734a4ebfd558181bebe (table default.Table_35ada13f5f5a41b0a93a57276b7756d9 [id=fa3844f34a5b4d55b6e87ec2164eb8fb]). Expected version 2 got 0
I20260810 19:48:11.722692 9412 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_3e7715bf0f8c41e3bd4964a0f918c9ea [id=3babf53bc29e4d4f9be8b2c19be6e2bd] alter complete (version 2)
I20260810 19:48:11.723914 12699 raft_consensus.cc:2749] T 3840b035b88243ecad17865d4716fcfc P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.724150 12699 raft_consensus.cc:493] T f3600d0528164850973cb296aaf6910f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.724304 12699 raft_consensus.cc:515] T f3600d0528164850973cb296aaf6910f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.724982 12699 leader_election.cc:290] T f3600d0528164850973cb296aaf6910f P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:11.725737 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet 99aa001db52149dd90ce86e7261f7424 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:05 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.726305 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet 3520274768ed41abb010bb109127affa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.726836 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet b4b6b17ce3354600b2f7450c6e483c69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:11.726936 10067 leader_election.cc:343] T f3600d0528164850973cb296aaf6910f P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: f3600d0528164850973cb296aaf6910f
I20260810 19:48:11.727720 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f895bcd21f647f2ab813903d600a31a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.728547 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet 263a5695e7754b44a64edbda27b42135 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:04 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.729118 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet f2606854f9954f2ea10610aeb1e60368 with delete_type TABLET_DATA_DELETED (replaced by tablet 898b70d09c1d410fb75cd4dd32d844c8) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.729163 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 5f9535152e6d45fa8ade32631b749678 (DEFAULT_TABLE table=default.Table_f458a2f7a78d4870b5f489afdcd4eef6 [id=815aba326e24410cadef0e060b427979]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.729652 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f9535152e6d45fa8ade32631b749678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.729683 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet 48eee4ce10114021855075812e356652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.730134 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet 823bcbb987374ab4b9b0fc3d9d79b571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.730623 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet 7459e64bd48449d2a8d4ff835b215d46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.730790 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet bb1e4400ca684da7b3b5e6592e19b6e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.732494 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_4f5dcaf24d054f4a9d0ccca5ae5bb787"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:11.732692 9896 tablet_service.cc:1511] Processing CreateTablet for tablet b5ec15d8a0d241e3b6238c408d2fb436 (DEFAULT_TABLE table=default.Table_e50bfbd91b13440fa3c5d5891d940b14 [id=38362ecfc665477a96e61d6e6fb4c90c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.733126 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ec15d8a0d241e3b6238c408d2fb436. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:11.733116 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f5dcaf24d054f4a9d0ccca5ae5bb787 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:11.735036 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet d6f410a1659c40f08ac274e63ad01b3d (table default.Table_82e33c23f0d84cbc9203727b5216d5b9 [id=36e72d60ff074c289171c16d86625441]) successfully deleted
I20260810 19:48:11.735740 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7459e64bd48449d2a8d4ff835b215d46" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:11.740280 12699 raft_consensus.cc:493] T 4c75af1e592042f5a4d442b82a539c94 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.740460 12699 raft_consensus.cc:515] T 4c75af1e592042f5a4d442b82a539c94 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.741343 12699 leader_election.cc:290] T 4c75af1e592042f5a4d442b82a539c94 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:11.741415 10370 tablet_bootstrap.cc:492] T 4f21e03993e841ba901f1e9c176309b9 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:11.741680 10370 ts_tablet_manager.cc:1403] T 4f21e03993e841ba901f1e9c176309b9 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.155s user 0.006s sys 0.000s
I20260810 19:48:11.742633 10370 raft_consensus.cc:359] T 4f21e03993e841ba901f1e9c176309b9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.742885 10370 raft_consensus.cc:385] T 4f21e03993e841ba901f1e9c176309b9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.742995 10370 raft_consensus.cc:740] T 4f21e03993e841ba901f1e9c176309b9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.743260 10370 consensus_queue.cc:260] T 4f21e03993e841ba901f1e9c176309b9 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.743906 10370 ts_tablet_manager.cc:1434] T 4f21e03993e841ba901f1e9c176309b9 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 19:48:11.736517 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f04ffd21d3474bf5b3635136aacb1c0b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:11.738551 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d41e89d919f34588a03c8bf831fbc123 consensus state has no leader
I20260810 19:48:11.743328 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b3daf051b3a147c09c80e0524fb5faf5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:11.745139 9413 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 3840b035b88243ecad17865d4716fcfc (table default.Table_e1cc6dd116324bf385dbc82e56283cf7 [id=6bf4ac94189d476d9ab5778e69d0b14f]). Expected version 1 got 0
W20260810 19:48:11.745253 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3daf051b3a147c09c80e0524fb5faf5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:11.746721 10370 tablet_bootstrap.cc:492] T ca733de7babe4343ab26dbca2c9020b2 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:48:11.746873 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f04ffd21d3474bf5b3635136aacb1c0b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:11.743600 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_327c404433c9482fa11e3d685ddfb285"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:11.748384 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_327c404433c9482fa11e3d685ddfb285 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:11.748335 9664 tablet_service.cc:1511] Processing CreateTablet for tablet f572f72e488a49b6b9ef5b742500abfc (DEFAULT_TABLE table=default.Table_7f9cabc0ef0f47fab0af46c6d8de5526 [id=e0de5d57db28431dacd8b4495fc4e3da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.748518 10370 tablet_bootstrap.cc:654] T ca733de7babe4343ab26dbca2c9020b2 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.748776 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f572f72e488a49b6b9ef5b742500abfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.750562 10120 tablet_service.cc:1558] Processing DeleteTablet for tablet 648ef608fa0c45cc8be4bad80c4200be with delete_type TABLET_DATA_DELETED (replaced by tablet 67d02a8eea444f3383f14a1e1f0e236b) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:11.751724 10120 tablet_service.cc:1558] Processing DeleteTablet for tablet 827dce05c192467589e2692fabd2a84e with delete_type TABLET_DATA_DELETED (replaced by tablet 5a35be79a8924213ab860a9da04a598c) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:11.752522 10120 tablet_service.cc:1558] Processing DeleteTablet for tablet f85f3fa629764c79921a710739eea7ae with delete_type TABLET_DATA_DELETED (replaced by tablet 2892d9fcdda34167a532dde7ed398590) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:11.755169 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7050c55c82f44e458fec37fef674afea" } modify_external_catalogs: true
I20260810 19:48:11.755412 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7050c55c82f44e458fec37fef674afea" } modify_external_catalogs: true
I20260810 19:48:11.755734 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 60bd14fb8c2e40dc955352518d463ccb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:53 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:11.752324 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ad46f1256ca54dfca9927ca88a9829f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:11.756143 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 31c2b9a4b8334e678b4632fc2f58dd0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:11.756275 12823 raft_consensus.cc:493] T 823bcbb987374ab4b9b0fc3d9d79b571 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.756484 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 19e2bf7b7d254894a07c5a75bf24e742 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:11.756424 12823 raft_consensus.cc:515] T 823bcbb987374ab4b9b0fc3d9d79b571 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:11.756570 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad46f1256ca54dfca9927ca88a9829f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:11.756783 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 827dce05c192467589e2692fabd2a84e with delete_type TABLET_DATA_DELETED (replaced by tablet 5a35be79a8924213ab860a9da04a598c) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:11.757077 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet c285518ed49d4ed68a6039f98db3b700 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:11.757110 12823 leader_election.cc:290] T 823bcbb987374ab4b9b0fc3d9d79b571 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:11.757354 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fadd6f84c75466287b318ed7018b071 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:53 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:11.757603 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet ab27734e3d974260a77f1d94e5f534fe with delete_type TABLET_DATA_DELETED (replaced by tablet f1c74666c3694ab881ba8ed452a73714) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:11.758076 9895 tablet_service.cc:1511] Processing CreateTablet for tablet f572f72e488a49b6b9ef5b742500abfc (DEFAULT_TABLE table=default.Table_7f9cabc0ef0f47fab0af46c6d8de5526 [id=e0de5d57db28431dacd8b4495fc4e3da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.755378 10137 tablet_service.cc:1511] Processing CreateTablet for tablet f572f72e488a49b6b9ef5b742500abfc (DEFAULT_TABLE table=default.Table_7f9cabc0ef0f47fab0af46c6d8de5526 [id=e0de5d57db28431dacd8b4495fc4e3da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.759172 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f572f72e488a49b6b9ef5b742500abfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.761126 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f572f72e488a49b6b9ef5b742500abfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.762662 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_db9ba9fcc2774506a2c86fe376f8314e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:11.763453 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db9ba9fcc2774506a2c86fe376f8314e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:11.765224 10068 leader_election.cc:343] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 827dce05c192467589e2692fabd2a84e
W20260810 19:48:11.765619 10068 leader_election.cc:343] T f3600d0528164850973cb296aaf6910f P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: f3600d0528164850973cb296aaf6910f
I20260810 19:48:11.765720 10068 leader_election.cc:304] T f3600d0528164850973cb296aaf6910f P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:11.765983 12699 raft_consensus.cc:2749] T f3600d0528164850973cb296aaf6910f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:11.766117 10068 leader_election.cc:343] T 4c75af1e592042f5a4d442b82a539c94 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 4c75af1e592042f5a4d442b82a539c94
I20260810 19:48:11.771709 9657 tablet_service.cc:1511] Processing CreateTablet for tablet e341b104f53c4b6bb87ca3274845e58f (DEFAULT_TABLE table=default.Table_9747046448e44dc4ab648e6759baad73 [id=e460539cc73c4fa59757b6b683e59530]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.772292 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e341b104f53c4b6bb87ca3274845e58f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.774128 10120 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f21e03993e841ba901f1e9c176309b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:11.785549 12699 raft_consensus.cc:493] T 648ef608fa0c45cc8be4bad80c4200be P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.785727 12699 raft_consensus.cc:515] T 648ef608fa0c45cc8be4bad80c4200be P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.786437 12699 leader_election.cc:290] T 648ef608fa0c45cc8be4bad80c4200be P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:11.787976 10068 leader_election.cc:343] T 648ef608fa0c45cc8be4bad80c4200be P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 648ef608fa0c45cc8be4bad80c4200be
W20260810 19:48:11.788854 10067 leader_election.cc:343] T 4c75af1e592042f5a4d442b82a539c94 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 4c75af1e592042f5a4d442b82a539c94
I20260810 19:48:11.789032 10067 leader_election.cc:304] T 4c75af1e592042f5a4d442b82a539c94 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:11.791162 10367 tablet_bootstrap.cc:492] T 38b0c6a017dc4afc849090cca7ee8b26 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:11.791314 10367 ts_tablet_manager.cc:1403] T 38b0c6a017dc4afc849090cca7ee8b26 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.099s user 0.002s sys 0.002s
I20260810 19:48:11.791290 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 878) took 3061 ms. Trace:
I20260810 19:48:11.791376 10375 rpcz_store.cc:276] 0810 19:48:08.730153 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:08.730754 (+ 601us) service_pool.cc:224] Handling call
0810 19:48:11.474432 (+2743678us) ts_tablet_manager.cc:1151] Deleting tablet 4dba7046bdfd41f1a2ad6f299a723776
0810 19:48:11.474444 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:11.702911 (+228467us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:11.705945 (+ 3034us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:11.791266 (+ 85321us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2743489}
I20260810 19:48:11.791801 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 880) took 3061 ms. Trace:
I20260810 19:48:11.791885 10375 rpcz_store.cc:276] 0810 19:48:08.730410 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:08.730977 (+ 567us) service_pool.cc:224] Handling call
0810 19:48:11.791665 (+3060688us) ts_tablet_manager.cc:1151] Deleting tablet 988d87b2b00a459d9afc44ba0ae1961e
0810 19:48:11.791674 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:11.791771 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3060530}
I20260810 19:48:11.792004 10367 raft_consensus.cc:359] T 38b0c6a017dc4afc849090cca7ee8b26 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.792182 10367 raft_consensus.cc:385] T 38b0c6a017dc4afc849090cca7ee8b26 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.792212 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 876) took 3062 ms. Trace:
I20260810 19:48:11.792235 10367 raft_consensus.cc:740] T 38b0c6a017dc4afc849090cca7ee8b26 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.792285 10375 rpcz_store.cc:276] 0810 19:48:08.729888 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:08.731168 (+ 1280us) service_pool.cc:224] Handling call
0810 19:48:11.792110 (+3060942us) ts_tablet_manager.cc:1151] Deleting tablet 53bfac43413347cc8d596169e6daa274
0810 19:48:11.792120 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:11.792196 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3060784}
I20260810 19:48:11.792435 10367 consensus_queue.cc:260] T 38b0c6a017dc4afc849090cca7ee8b26 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.792580 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 879) took 3062 ms. Trace:
I20260810 19:48:11.792655 10375 rpcz_store.cc:276] 0810 19:48:08.730244 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:08.731360 (+ 1116us) service_pool.cc:224] Handling call
0810 19:48:11.792488 (+3061128us) ts_tablet_manager.cc:1151] Deleting tablet b8a7c2857add422281542e7f187979ab
0810 19:48:11.792497 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:11.792566 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3060970}
I20260810 19:48:11.792992 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 881) took 3048 ms. Trace:
I20260810 19:48:11.793074 10367 ts_tablet_manager.cc:1434] T 38b0c6a017dc4afc849090cca7ee8b26 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:11.793062 10375 rpcz_store.cc:276] 0810 19:48:08.744699 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:08.744762 (+ 63us) service_pool.cc:224] Handling call
0810 19:48:11.792897 (+3048135us) ts_tablet_manager.cc:1151] Deleting tablet 33f2ea0d46f44fca88e16ea83ad67bc2
0810 19:48:11.792906 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:11.792977 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3047792}
I20260810 19:48:11.793306 10375 tablet_replica.cc:333] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:11.793365 10367 tablet_bootstrap.cc:492] T 87bbcc651d034e2a826478b805792e48 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:11.793483 10375 raft_consensus.cc:2243] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:11.793653 10375 raft_consensus.cc:2272] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:11.794425 12699 raft_consensus.cc:2749] T 4c75af1e592042f5a4d442b82a539c94 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.795156 10367 tablet_bootstrap.cc:654] T 87bbcc651d034e2a826478b805792e48 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.796957 12705 raft_consensus.cc:515] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.797632 12705 leader_election.cc:290] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:11.797696 12716 consensus_queue.cc:1048] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:11.798061 12266 ts_tablet_manager.cc:1929] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260810 19:48:11.798167 12266 log.cc:1199] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/aa5702d7b3bd421eb7b8a4e0f181d2d4
I20260810 19:48:11.798569 12266 ts_tablet_manager.cc:1950] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
W20260810 19:48:11.799265 9611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 100032us
I20260810 19:48:11.800019 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823bcbb987374ab4b9b0fc3d9d79b571" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:11.800467 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet aa5702d7b3bd421eb7b8a4e0f181d2d4 (table default.Table_85e674f117d5404eb01680b66429bc7b [id=a837d5f74eac4f74b2029f46d73acc93]) successfully deleted
W20260810 19:48:11.800856 9611 leader_election.cc:343] T 7459e64bd48449d2a8d4ff835b215d46 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.806552 10375 ts_tablet_manager.cc:1916] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:11.801038 9611 leader_election.cc:304] T 7459e64bd48449d2a8d4ff835b215d46 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:11.809952 12823 raft_consensus.cc:493] T 59a767c91abf45e79cebab582525ad2e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.810098 12823 raft_consensus.cc:515] T 59a767c91abf45e79cebab582525ad2e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.810149 9684 tablet_service.cc:1511] Processing CreateTablet for tablet dc4f30406e8f45caac7031def784e16c (DEFAULT_TABLE table=default.Table_4cc3eaea7ccf4c05b30978070f06afdf [id=8246b836ba7245a5bfe2527d74619945]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.810580 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4f30406e8f45caac7031def784e16c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.810768 12823 leader_election.cc:290] T 59a767c91abf45e79cebab582525ad2e P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:11.810900 12823 raft_consensus.cc:2749] T 7459e64bd48449d2a8d4ff835b215d46 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.812343 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a767c91abf45e79cebab582525ad2e" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:11.812682 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 5598878488864bfba663b2edd999e224 (DEFAULT_TABLE table=default.Table_8fc1feb94cbb484d9a075740f45d658e [id=728de56c2aed4ecdbb7f1b6da2c27efa]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:11.813323 9611 leader_election.cc:343] T 823bcbb987374ab4b9b0fc3d9d79b571 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:11.813542 9611 leader_election.cc:343] T 59a767c91abf45e79cebab582525ad2e P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.813751 9666 tablet_service.cc:1511] Processing CreateTablet for tablet e56d9c164d2b47abb004d13b7f2488d9 (DEFAULT_TABLE table=default.Table_b4656177d37d4cb59b3e500f12b7999e [id=a1b8d2e7a88a423296bc7337fa9392d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.814179 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5598878488864bfba663b2edd999e224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.815925 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet d857efeee4d3442ca065221e3095d421
I20260810 19:48:11.816373 9415 catalog_manager.cc:6807] ReplaceTablet: tablet d857efeee4d3442ca065221e3095d421 deleted and replaced by tablet 6704a570c156403fbf8cc3f87df9bd6e
I20260810 19:48:11.816429 12677 raft_consensus.cc:493] T c285518ed49d4ed68a6039f98db3b700 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.816579 12677 raft_consensus.cc:515] T c285518ed49d4ed68a6039f98db3b700 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.816668 12823 raft_consensus.cc:493] T 38b0c6a017dc4afc849090cca7ee8b26 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 19:48:11.816730 10067 leader_election.cc:343] T 648ef608fa0c45cc8be4bad80c4200be P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 648ef608fa0c45cc8be4bad80c4200be
I20260810 19:48:11.816802 12823 raft_consensus.cc:515] T 38b0c6a017dc4afc849090cca7ee8b26 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.816949 10067 leader_election.cc:304] T 648ef608fa0c45cc8be4bad80c4200be P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:11.817368 12823 leader_election.cc:290] T 38b0c6a017dc4afc849090cca7ee8b26 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:11.818850 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e56d9c164d2b47abb004d13b7f2488d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.820168 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a70b9fa6ee4b4696b9f30fcfd17a3505" } new_table_name: "default.Table_b6ff709815a5403ebebf4652a5b58f6e" modify_external_catalogs: true
I20260810 19:48:11.821906 10124 tablet_service.cc:1511] Processing CreateTablet for tablet dc4f30406e8f45caac7031def784e16c (DEFAULT_TABLE table=default.Table_4cc3eaea7ccf4c05b30978070f06afdf [id=8246b836ba7245a5bfe2527d74619945]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.821971 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_97d2fd6539194595b1a536e612315869"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:11.822415 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4f30406e8f45caac7031def784e16c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:11.822558 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97d2fd6539194595b1a536e612315869 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:11.824543 9892 tablet_service.cc:1511] Processing CreateTablet for tablet dc4f30406e8f45caac7031def784e16c (DEFAULT_TABLE table=default.Table_4cc3eaea7ccf4c05b30978070f06afdf [id=8246b836ba7245a5bfe2527d74619945]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.824543 9913 tablet_service.cc:1511] Processing CreateTablet for tablet e341b104f53c4b6bb87ca3274845e58f (DEFAULT_TABLE table=default.Table_9747046448e44dc4ab648e6759baad73 [id=e460539cc73c4fa59757b6b683e59530]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.825019 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e341b104f53c4b6bb87ca3274845e58f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.825066 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet d857efeee4d3442ca065221e3095d421 with delete_type TABLET_DATA_DELETED (replaced by tablet 6704a570c156403fbf8cc3f87df9bd6e) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.825201 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4f30406e8f45caac7031def784e16c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.832779 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5282e99c68244e1fa33fbe374acd2ea4" } modify_external_catalogs: true
I20260810 19:48:11.833034 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5282e99c68244e1fa33fbe374acd2ea4" } modify_external_catalogs: true
I20260810 19:48:11.834811 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e50bfbd91b13440fa3c5d5891d940b14" } modify_external_catalogs: true
I20260810 19:48:11.835093 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e50bfbd91b13440fa3c5d5891d940b14" } modify_external_catalogs: true
I20260810 19:48:11.837990 12705 raft_consensus.cc:2749] T 648ef608fa0c45cc8be4bad80c4200be P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.840886 12266 tablet_replica.cc:333] T 99aa001db52149dd90ce86e7261f7424 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:11.841133 12266 raft_consensus.cc:2243] T 99aa001db52149dd90ce86e7261f7424 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:11.841764 12677 leader_election.cc:290] T c285518ed49d4ed68a6039f98db3b700 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:11.844457 9831 leader_election.cc:343] T c285518ed49d4ed68a6039f98db3b700 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: c285518ed49d4ed68a6039f98db3b700
I20260810 19:48:11.844517 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0bbfea1f106c4df1921c642928671792" } modify_external_catalogs: true
I20260810 19:48:11.844748 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0bbfea1f106c4df1921c642928671792" } modify_external_catalogs: true
I20260810 19:48:11.845533 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b0c6a017dc4afc849090cca7ee8b26" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:11.846601 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ce92099864b748aaa3d27ac772ec799d" } modify_external_catalogs: true
I20260810 19:48:11.846771 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ce92099864b748aaa3d27ac772ec799d" } modify_external_catalogs: true
I20260810 19:48:11.849817 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827dce05c192467589e2692fabd2a84e" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
W20260810 19:48:11.849934 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 49fa134c630d4df4af2d92b0e3f1f498 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49fa134c630d4df4af2d92b0e3f1f498 already in progress: creating tablet
I20260810 19:48:11.850013 9935 raft_consensus.cc:3060] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:11.850217 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 48fa5f075d2749dc80ad5594746d7564 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 48fa5f075d2749dc80ad5594746d7564 already in progress: creating tablet
W20260810 19:48:11.851038 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 028fd8427d824ae89ff035d32548710b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 028fd8427d824ae89ff035d32548710b already in progress: creating tablet
I20260810 19:48:11.854096 10367 tablet_bootstrap.cc:492] T 87bbcc651d034e2a826478b805792e48 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:11.854254 10367 ts_tablet_manager.cc:1403] T 87bbcc651d034e2a826478b805792e48 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.061s user 0.003s sys 0.000s
I20260810 19:48:11.857396 12823 consensus_queue.cc:1048] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 19:48:11.860406 9611 leader_election.cc:343] T 38b0c6a017dc4afc849090cca7ee8b26 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.861886 12266 raft_consensus.cc:2272] T 99aa001db52149dd90ce86e7261f7424 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:11.864081 10367 raft_consensus.cc:359] T 87bbcc651d034e2a826478b805792e48 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.864264 10367 raft_consensus.cc:385] T 87bbcc651d034e2a826478b805792e48 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.864322 10367 raft_consensus.cc:740] T 87bbcc651d034e2a826478b805792e48 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.864509 10367 consensus_queue.cc:260] T 87bbcc651d034e2a826478b805792e48 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.865020 10367 ts_tablet_manager.cc:1434] T 87bbcc651d034e2a826478b805792e48 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260810 19:48:11.865144 12266 ts_tablet_manager.cc:1916] T 99aa001db52149dd90ce86e7261f7424 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:11.869499 9684 tablet_service.cc:1511] Processing CreateTablet for tablet ae368e32900e428196d8a7d0098ca7f7 (DEFAULT_TABLE table=default.Table_ff4cce4dbac7415ab706547dbfdd5af4 [id=e9980afd94f6468a8066ce7fa0d8ca9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.880044 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae368e32900e428196d8a7d0098ca7f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.884274 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 065536e52b4a477a824ab0261168cbd3
I20260810 19:48:11.865327 10367 tablet_bootstrap.cc:492] T 73abedd88ba548bdb5a23f508b77403d P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:11.885737 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 5598878488864bfba663b2edd999e224 (DEFAULT_TABLE table=default.Table_8fc1feb94cbb484d9a075740f45d658e [id=728de56c2aed4ecdbb7f1b6da2c27efa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.886235 9935 raft_consensus.cc:2468] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:11.886937 10130 tablet_service.cc:1511] Processing CreateTablet for tablet e56d9c164d2b47abb004d13b7f2488d9 (DEFAULT_TABLE table=default.Table_b4656177d37d4cb59b3e500f12b7999e [id=a1b8d2e7a88a423296bc7337fa9392d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.887398 10367 tablet_bootstrap.cc:654] T 73abedd88ba548bdb5a23f508b77403d P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.887789 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet d857efeee4d3442ca065221e3095d421 with delete_type TABLET_DATA_DELETED (replaced by tablet 6704a570c156403fbf8cc3f87df9bd6e) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:11.888206 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 4dba7046bdfd41f1a2ad6f299a723776 (table default.Table_074b525586d74c169b286124d5849cd2 [id=4dd4fbd829aa40048810c5a338d1b741]) successfully deleted
I20260810 19:48:11.888506 10067 leader_election.cc:304] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:11.889267 12705 raft_consensus.cc:2804] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:11.889402 12705 raft_consensus.cc:697] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:11.889678 12705 consensus_queue.cc:237] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.892894 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 065536e52b4a477a824ab0261168cbd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.894860 12699 raft_consensus.cc:493] T 0e967384768b4ec7956f1b508e8ab2af P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.895047 12699 raft_consensus.cc:515] T 0e967384768b4ec7956f1b508e8ab2af P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.895664 12699 leader_election.cc:290] T 0e967384768b4ec7956f1b508e8ab2af P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:11.896950 10067 leader_election.cc:343] T 0e967384768b4ec7956f1b508e8ab2af P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 0e967384768b4ec7956f1b508e8ab2af
I20260810 19:48:11.897392 9907 tablet_service.cc:1511] Processing CreateTablet for tablet e56d9c164d2b47abb004d13b7f2488d9 (DEFAULT_TABLE table=default.Table_b4656177d37d4cb59b3e500f12b7999e [id=a1b8d2e7a88a423296bc7337fa9392d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.897887 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e56d9c164d2b47abb004d13b7f2488d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.904560 12266 ts_tablet_manager.cc:1929] T 99aa001db52149dd90ce86e7261f7424 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:11.907410 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5598878488864bfba663b2edd999e224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.907616 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 5598878488864bfba663b2edd999e224 (DEFAULT_TABLE table=default.Table_8fc1feb94cbb484d9a075740f45d658e [id=728de56c2aed4ecdbb7f1b6da2c27efa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.907831 12266 log.cc:1199] T 99aa001db52149dd90ce86e7261f7424 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/99aa001db52149dd90ce86e7261f7424
I20260810 19:48:11.908018 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5598878488864bfba663b2edd999e224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.908069 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet d857efeee4d3442ca065221e3095d421 with delete_type TABLET_DATA_DELETED (replaced by tablet 6704a570c156403fbf8cc3f87df9bd6e) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:11.908246 12266 ts_tablet_manager.cc:1950] T 99aa001db52149dd90ce86e7261f7424 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:11.909845 12266 tablet_replica.cc:333] T 3520274768ed41abb010bb109127affa P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:11.910050 12266 raft_consensus.cc:2243] T 3520274768ed41abb010bb109127affa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:11.910184 12266 raft_consensus.cc:2272] T 3520274768ed41abb010bb109127affa P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:11.910753 12266 ts_tablet_manager.cc:1916] T 3520274768ed41abb010bb109127affa P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:11.910780 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e56d9c164d2b47abb004d13b7f2488d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.917394 12266 ts_tablet_manager.cc:1929] T 3520274768ed41abb010bb109127affa P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:11.917634 12266 log.cc:1199] T 3520274768ed41abb010bb109127affa P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/3520274768ed41abb010bb109127affa
I20260810 19:48:11.918043 12266 ts_tablet_manager.cc:1950] T 3520274768ed41abb010bb109127affa P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:11.918161 10137 tablet_service.cc:1511] Processing CreateTablet for tablet e341b104f53c4b6bb87ca3274845e58f (DEFAULT_TABLE table=default.Table_9747046448e44dc4ab648e6759baad73 [id=e460539cc73c4fa59757b6b683e59530]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.918715 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e341b104f53c4b6bb87ca3274845e58f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.919303 12266 tablet_replica.cc:333] T b4b6b17ce3354600b2f7450c6e483c69 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:11.919565 12266 raft_consensus.cc:2243] T b4b6b17ce3354600b2f7450c6e483c69 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:11.919780 12266 raft_consensus.cc:2272] T b4b6b17ce3354600b2f7450c6e483c69 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:11.920388 12266 ts_tablet_manager.cc:1916] T b4b6b17ce3354600b2f7450c6e483c69 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:11.921726 10377 ts_tablet_manager.cc:1929] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260810 19:48:11.921921 10377 log.cc:1199] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/aa5702d7b3bd421eb7b8a4e0f181d2d4
I20260810 19:48:11.923851 10159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823bcbb987374ab4b9b0fc3d9d79b571" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:11.924670 10366 tablet_bootstrap.cc:492] T ee5f38d91bb349a9ae1da8ba69d2ddbc P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:11.924873 10366 ts_tablet_manager.cc:1403] T ee5f38d91bb349a9ae1da8ba69d2ddbc P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.306s user 0.005s sys 0.006s
I20260810 19:48:11.925719 10366 raft_consensus.cc:359] T ee5f38d91bb349a9ae1da8ba69d2ddbc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.925979 10366 raft_consensus.cc:385] T ee5f38d91bb349a9ae1da8ba69d2ddbc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.926092 10366 raft_consensus.cc:740] T ee5f38d91bb349a9ae1da8ba69d2ddbc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.926535 10366 consensus_queue.cc:260] T ee5f38d91bb349a9ae1da8ba69d2ddbc P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:11.926981 9611 leader_election.cc:343] T 823bcbb987374ab4b9b0fc3d9d79b571 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.927095 9611 leader_election.cc:304] T 823bcbb987374ab4b9b0fc3d9d79b571 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:11.927292 10366 ts_tablet_manager.cc:1434] T ee5f38d91bb349a9ae1da8ba69d2ddbc P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:11.927515 12912 raft_consensus.cc:2749] T 823bcbb987374ab4b9b0fc3d9d79b571 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.927597 10366 tablet_bootstrap.cc:492] T bafc42f0cdf94ebd823dfb678df8a83b P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
W20260810 19:48:11.927687 10068 leader_election.cc:343] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 827dce05c192467589e2692fabd2a84e
I20260810 19:48:11.926800 12266 ts_tablet_manager.cc:1929] T b4b6b17ce3354600b2f7450c6e483c69 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:11.927946 12266 log.cc:1199] T b4b6b17ce3354600b2f7450c6e483c69 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/b4b6b17ce3354600b2f7450c6e483c69
W20260810 19:48:11.928131 10068 leader_election.cc:343] T 0e967384768b4ec7956f1b508e8ab2af P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 0e967384768b4ec7956f1b508e8ab2af
I20260810 19:48:11.928236 10068 leader_election.cc:304] T 0e967384768b4ec7956f1b508e8ab2af P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:11.928467 12266 ts_tablet_manager.cc:1950] T b4b6b17ce3354600b2f7450c6e483c69 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:11.928661 12699 raft_consensus.cc:2749] T 0e967384768b4ec7956f1b508e8ab2af P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.929526 10377 ts_tablet_manager.cc:1950] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:11.929656 12266 tablet_replica.cc:333] T 1f895bcd21f647f2ab813903d600a31a P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:11.929915 12266 raft_consensus.cc:2243] T 1f895bcd21f647f2ab813903d600a31a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:11.930142 12266 raft_consensus.cc:2272] T 1f895bcd21f647f2ab813903d600a31a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:11.930804 12266 ts_tablet_manager.cc:1916] T 1f895bcd21f647f2ab813903d600a31a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:11.931180 10370 tablet_bootstrap.cc:492] T ca733de7babe4343ab26dbca2c9020b2 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:11.931386 10370 ts_tablet_manager.cc:1403] T ca733de7babe4343ab26dbca2c9020b2 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.185s user 0.007s sys 0.003s
I20260810 19:48:11.932011 10366 tablet_bootstrap.cc:654] T bafc42f0cdf94ebd823dfb678df8a83b P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:11.932444 10370 raft_consensus.cc:359] T ca733de7babe4343ab26dbca2c9020b2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.932696 10370 raft_consensus.cc:385] T ca733de7babe4343ab26dbca2c9020b2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.932792 10370 raft_consensus.cc:740] T ca733de7babe4343ab26dbca2c9020b2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.933065 10370 consensus_queue.cc:260] T ca733de7babe4343ab26dbca2c9020b2 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.933616 10370 ts_tablet_manager.cc:1434] T ca733de7babe4343ab26dbca2c9020b2 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:11.909392 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 99aa001db52149dd90ce86e7261f7424 (table default.Table_35de6164baf24ff79163d6b665fc6b8c [id=17f46f6e25bd4c3084a0fcb333694b71]) successfully deleted
W20260810 19:48:11.935339 9395 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.235.195:43797, user_credentials={real_user=slave}} blocked reactor thread for 47113.2us
W20260810 19:48:11.935649 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 988d87b2b00a459d9afc44ba0ae1961e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 988d87b2b00a459d9afc44ba0ae1961e already in progress: creating tablet
I20260810 19:48:11.935853 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 3520274768ed41abb010bb109127affa (table default.Table_f9e687e842744de19940ff3ddb74dfa1 [id=541cc0f8fabe41b4a2114eb70c9d5ba4]) successfully deleted
W20260810 19:48:11.935941 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 53bfac43413347cc8d596169e6daa274 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53bfac43413347cc8d596169e6daa274 already in progress: creating tablet
I20260810 19:48:11.936110 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet b4b6b17ce3354600b2f7450c6e483c69 (table default.Table_b94c792bfc8b4c16b86e7127f8082af5 [id=270934e8d981479d9f4b49bc54916f77]) successfully deleted
W20260810 19:48:11.936146 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet b8a7c2857add422281542e7f187979ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8a7c2857add422281542e7f187979ab already in progress: creating tablet
W20260810 19:48:11.936453 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 33f2ea0d46f44fca88e16ea83ad67bc2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33f2ea0d46f44fca88e16ea83ad67bc2 already in progress: creating tablet
I20260810 19:48:11.930747 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_35eb86435a614980b851a37a6fdb216f" } new_table_name: "default.Table_9f15ead49f2144078612a81d1f03b63a" modify_external_catalogs: true
I20260810 19:48:11.938483 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 065536e52b4a477a824ab0261168cbd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:11.939275 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ad8ef827a5d043a098c5fb5101be8ecf" } new_table_name: "default.Table_78b342a2c7134ba3a33ee9b59859ccb7" modify_external_catalogs: true
I20260810 19:48:11.940191 12266 ts_tablet_manager.cc:1929] T 1f895bcd21f647f2ab813903d600a31a P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:11.940327 12266 log.cc:1199] T 1f895bcd21f647f2ab813903d600a31a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/1f895bcd21f647f2ab813903d600a31a
I20260810 19:48:11.940510 10377 tablet_replica.cc:333] T 60bd14fb8c2e40dc955352518d463ccb P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:11.940642 12266 ts_tablet_manager.cc:1950] T 1f895bcd21f647f2ab813903d600a31a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:11.940724 10377 raft_consensus.cc:2243] T 60bd14fb8c2e40dc955352518d463ccb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260810 19:48:11.940804 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f9bcb6c71d384f758e1e44137612fe21 consensus state has no leader
I20260810 19:48:11.940877 10377 raft_consensus.cc:2272] T 60bd14fb8c2e40dc955352518d463ccb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:11.941437 10377 ts_tablet_manager.cc:1916] T 60bd14fb8c2e40dc955352518d463ccb P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:11.931123 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_515f62a16a5945a7bced9e1a802a0a49" } new_table_name: "default.Table_67e55147983548869ce84ab222a3de3d" modify_external_catalogs: true
I20260810 19:48:11.941870 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 1f895bcd21f647f2ab813903d600a31a (table default.Table_c4fa695c16634a2382811d87f8b8224b [id=69aa2ddd2b2d4733a1b0e29676c59330]) successfully deleted
I20260810 19:48:11.942267 12266 tablet_replica.cc:333] T 263a5695e7754b44a64edbda27b42135 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:11.942539 12266 raft_consensus.cc:2243] T 263a5695e7754b44a64edbda27b42135 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:11.942751 12266 raft_consensus.cc:2272] T 263a5695e7754b44a64edbda27b42135 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:11.943408 12266 ts_tablet_manager.cc:1916] T 263a5695e7754b44a64edbda27b42135 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:11.943555 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 065536e52b4a477a824ab0261168cbd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:11.931437 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ddc094375fad454aabc00b0a86132f9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:11.944392 9710 raft_consensus.cc:1275] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Refusing update from remote peer 6986ed920dcb4af29a5eeeda6f671691: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260810 19:48:11.945359 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ddc094375fad454aabc00b0a86132f9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:11.948606 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 625b0e4eedb946908bd00c6af5f06c08
I20260810 19:48:11.945214 12899 consensus_queue.cc:1048] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:11.949606 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 3bf9486839474b2a8ddff3a49b4fda2a
I20260810 19:48:11.949656 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 625b0e4eedb946908bd00c6af5f06c08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.950142 12505 raft_consensus.cc:493] T 8fadd6f84c75466287b318ed7018b071 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:11.950307 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bf9486839474b2a8ddff3a49b4fda2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.950275 12505 raft_consensus.cc:515] T 8fadd6f84c75466287b318ed7018b071 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.950552 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet b5ec15d8a0d241e3b6238c408d2fb436
I20260810 19:48:11.951197 12505 leader_election.cc:290] T 8fadd6f84c75466287b318ed7018b071 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:11.951260 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 4abd3c95aa394e1cad066d49d22b5764
I20260810 19:48:11.951378 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet b5ec15d8a0d241e3b6238c408d2fb436 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.951894 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 4abd3c95aa394e1cad066d49d22b5764 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:11.952087 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_dd3680521a084b7e9b0d94c1e8b1e7b6" } new_table_name: "default.Table_b37d211df8744854a90b5ac6475ef6dd" modify_external_catalogs: true
I20260810 19:48:11.952646 12266 ts_tablet_manager.cc:1929] T 263a5695e7754b44a64edbda27b42135 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:11.952821 12266 log.cc:1199] T 263a5695e7754b44a64edbda27b42135 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/263a5695e7754b44a64edbda27b42135
I20260810 19:48:11.953203 12266 ts_tablet_manager.cc:1950] T 263a5695e7754b44a64edbda27b42135 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
W20260810 19:48:11.954074 9831 leader_election.cc:343] T 8fadd6f84c75466287b318ed7018b071 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 8fadd6f84c75466287b318ed7018b071
I20260810 19:48:11.955336 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 263a5695e7754b44a64edbda27b42135 (table default.Table_3b5fc2bb35a448e8bbe8bef5a535e9c2 [id=ef9ce56a9b874bfc92f88cae54ca0891]) successfully deleted
I20260810 19:48:11.946950 10130 tablet_service.cc:1511] Processing CreateTablet for tablet ae368e32900e428196d8a7d0098ca7f7 (DEFAULT_TABLE table=default.Table_ff4cce4dbac7415ab706547dbfdd5af4 [id=e9980afd94f6468a8066ce7fa0d8ca9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.949620 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a767c91abf45e79cebab582525ad2e" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:11.949946 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c285518ed49d4ed68a6039f98db3b700" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:11.956166 9397 catalog_manager.cc:5017] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet f2606854f9954f2ea10610aeb1e60368 because the tablet was not found. No further retry: Not found: Tablet not found: f2606854f9954f2ea10610aeb1e60368
I20260810 19:48:11.949469 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b0c6a017dc4afc849090cca7ee8b26" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:11.956480 12266 tablet_replica.cc:333] T 48eee4ce10114021855075812e356652 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:11.956679 12266 raft_consensus.cc:2243] T 48eee4ce10114021855075812e356652 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:11.956916 12266 raft_consensus.cc:2272] T 48eee4ce10114021855075812e356652 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:11.957556 12266 ts_tablet_manager.cc:1916] T 48eee4ce10114021855075812e356652 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:11.966087 10367 tablet_bootstrap.cc:492] T 73abedd88ba548bdb5a23f508b77403d P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:11.966389 10367 ts_tablet_manager.cc:1403] T 73abedd88ba548bdb5a23f508b77403d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.101s user 0.004s sys 0.000s
I20260810 19:48:11.967473 10367 raft_consensus.cc:359] T 73abedd88ba548bdb5a23f508b77403d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:11.967837 10367 raft_consensus.cc:385] T 73abedd88ba548bdb5a23f508b77403d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:11.967968 10367 raft_consensus.cc:740] T 73abedd88ba548bdb5a23f508b77403d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:11.968252 10367 consensus_queue.cc:260] T 73abedd88ba548bdb5a23f508b77403d P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:11.971243 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3b2f576afb084987be171167a62883bb consensus state has no leader
W20260810 19:48:11.971764 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a761dc4c01d34b6db2d33655ec6f7dd3 has no consensus state
I20260810 19:48:11.971935 9410 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 3840b035b88243ecad17865d4716fcfc (table default.Table_e1cc6dd116324bf385dbc82e56283cf7 [id=6bf4ac94189d476d9ab5778e69d0b14f]). Expected version 1 got 0
W20260810 19:48:11.973521 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 76cd3adb759342c0b2d34f956a81c9e0 consensus state has no leader
I20260810 19:48:11.975800 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2ca134cde4db4944a8ec84eacc06d5eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:11.976660 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ca134cde4db4944a8ec84eacc06d5eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:11.982856 9907 tablet_service.cc:1511] Processing CreateTablet for tablet ae368e32900e428196d8a7d0098ca7f7 (DEFAULT_TABLE table=default.Table_ff4cce4dbac7415ab706547dbfdd5af4 [id=e9980afd94f6468a8066ce7fa0d8ca9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:11.983459 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae368e32900e428196d8a7d0098ca7f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:11.987787 12266 ts_tablet_manager.cc:1929] T 48eee4ce10114021855075812e356652 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:11.988857 10375 ts_tablet_manager.cc:1929] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260810 19:48:11.989027 10375 log.cc:1199] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/7d93fd6556b146ca8933a6dc0a2357e8
I20260810 19:48:11.989450 10375 ts_tablet_manager.cc:1950] T 7d93fd6556b146ca8933a6dc0a2357e8 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:11.990581 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 882) took 3200 ms. Trace:
I20260810 19:48:11.991680 12266 log.cc:1199] T 48eee4ce10114021855075812e356652 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/48eee4ce10114021855075812e356652
I20260810 19:48:11.992308 12266 ts_tablet_manager.cc:1950] T 48eee4ce10114021855075812e356652 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
W20260810 19:48:11.997138 9611 leader_election.cc:343] T 59a767c91abf45e79cebab582525ad2e P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.997462 9611 leader_election.cc:304] T 59a767c91abf45e79cebab582525ad2e P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
W20260810 19:48:11.997890 9611 leader_election.cc:343] T 38b0c6a017dc4afc849090cca7ee8b26 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:11.998015 9611 leader_election.cc:304] T 38b0c6a017dc4afc849090cca7ee8b26 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:11.998459 12823 raft_consensus.cc:2749] T 59a767c91abf45e79cebab582525ad2e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.998648 12823 raft_consensus.cc:2749] T 38b0c6a017dc4afc849090cca7ee8b26 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:11.998286 9410 catalog_manager.cc:5719] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:11.999194 9410 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet f3e3dde1c29e4275bafb27df63b117be (table default.Table_da45ba37a0804616b521723bc724e0f0 [id=d5afb5c8b2d042e5aec4a0721e2cae1d]). Expected version 1 got 0
I20260810 19:48:11.996938 12912 consensus_queue.cc:1048] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260810 19:48:12.002537 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 48eee4ce10114021855075812e356652 (table default.Table_11f7a8e6101542a5935af66211bd2469 [id=a8bcb3d29fb749c5ab9fa745718d0fac]) successfully deleted
I20260810 19:48:12.003008 12266 tablet_replica.cc:333] T 823bcbb987374ab4b9b0fc3d9d79b571 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:12.003378 12266 raft_consensus.cc:2243] T 823bcbb987374ab4b9b0fc3d9d79b571 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.003639 12266 raft_consensus.cc:2272] T 823bcbb987374ab4b9b0fc3d9d79b571 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:12.003971 9830 leader_election.cc:343] T c285518ed49d4ed68a6039f98db3b700 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:12.004186 9830 leader_election.cc:304] T c285518ed49d4ed68a6039f98db3b700 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:12.004293 12266 ts_tablet_manager.cc:1916] T 823bcbb987374ab4b9b0fc3d9d79b571 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.004530 12899 raft_consensus.cc:2749] T c285518ed49d4ed68a6039f98db3b700 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:12.005658 9830 consensus_peers.cc:597] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:12.006894 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet aa5702d7b3bd421eb7b8a4e0f181d2d4 (table default.Table_85e674f117d5404eb01680b66429bc7b [id=a837d5f74eac4f74b2029f46d73acc93]) successfully deleted
W20260810 19:48:12.007313 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 48fa5f075d2749dc80ad5594746d7564 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 48fa5f075d2749dc80ad5594746d7564 already in progress: creating tablet
W20260810 19:48:12.007616 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 49fa134c630d4df4af2d92b0e3f1f498 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49fa134c630d4df4af2d92b0e3f1f498 already in progress: creating tablet
W20260810 19:48:12.007934 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 028fd8427d824ae89ff035d32548710b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 028fd8427d824ae89ff035d32548710b already in progress: creating tablet
I20260810 19:48:12.010993 10367 ts_tablet_manager.cc:1434] T 73abedd88ba548bdb5a23f508b77403d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.044s user 0.002s sys 0.000s
I20260810 19:48:12.011409 10367 tablet_bootstrap.cc:492] T 5f4e2adee0264e418ff8c54912973e60 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:12.011698 10375 rpcz_store.cc:276] 0810 19:48:08.790564 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:08.790640 (+ 76us) service_pool.cc:224] Handling call
0810 19:48:11.793263 (+3002623us) ts_tablet_manager.cc:1151] Deleting tablet 7d93fd6556b146ca8933a6dc0a2357e8
0810 19:48:11.793272 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:11.809965 (+ 16693us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:11.988770 (+178805us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:11.990553 (+ 1783us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3002377}
I20260810 19:48:11.991637 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae368e32900e428196d8a7d0098ca7f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.012704 12266 ts_tablet_manager.cc:1929] T 823bcbb987374ab4b9b0fc3d9d79b571 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.012908 12266 log.cc:1199] T 823bcbb987374ab4b9b0fc3d9d79b571 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/823bcbb987374ab4b9b0fc3d9d79b571
I20260810 19:48:12.013223 10367 tablet_bootstrap.cc:654] T 5f4e2adee0264e418ff8c54912973e60 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:12.013243 12912 raft_consensus.cc:493] T 56fa5de3bf7142b2b0978f9190091f33 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:12.013381 12912 raft_consensus.cc:515] T 56fa5de3bf7142b2b0978f9190091f33 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.014029 12912 leader_election.cc:290] T 56fa5de3bf7142b2b0978f9190091f33 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:12.015184 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fa5de3bf7142b2b0978f9190091f33" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:12.015836 9611 leader_election.cc:343] T 56fa5de3bf7142b2b0978f9190091f33 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:12.016433 12266 ts_tablet_manager.cc:1950] T 823bcbb987374ab4b9b0fc3d9d79b571 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:12.016566 9412 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 3840b035b88243ecad17865d4716fcfc (table default.Table_e1cc6dd116324bf385dbc82e56283cf7 [id=6bf4ac94189d476d9ab5778e69d0b14f]). Expected version 1 got 0
I20260810 19:48:12.016909 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fa5de3bf7142b2b0978f9190091f33" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:11.993153 10370 tablet_bootstrap.cc:492] T 82c3f619c76e40c583bfcdf2bb77fe42 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:11.996047 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fadd6f84c75466287b318ed7018b071" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:12.017642 9611 leader_election.cc:343] T 56fa5de3bf7142b2b0978f9190091f33 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:12.017743 9611 leader_election.cc:304] T 56fa5de3bf7142b2b0978f9190091f33 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:12.018174 12912 raft_consensus.cc:2749] T 56fa5de3bf7142b2b0978f9190091f33 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:12.018491 12266 tablet_replica.cc:333] T 7459e64bd48449d2a8d4ff835b215d46 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
W20260810 19:48:12.018582 9830 leader_election.cc:343] T 8fadd6f84c75466287b318ed7018b071 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:12.018764 9830 leader_election.cc:304] T 8fadd6f84c75466287b318ed7018b071 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:12.018816 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 59a767c91abf45e79cebab582525ad2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:12.019032 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 823bcbb987374ab4b9b0fc3d9d79b571 (table default.Table_c53d9c7f87054a568e99b3f08135ff87 [id=55a3c423691d48feb82508b11c04ca4e]) successfully deleted
I20260810 19:48:12.019064 12899 raft_consensus.cc:2749] T 8fadd6f84c75466287b318ed7018b071 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:12.018954 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 38b0c6a017dc4afc849090cca7ee8b26 with delete_type TABLET_DATA_DELETED (replaced by tablet 47c54793369048fc874522388d08d3da) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:12.019618 12266 raft_consensus.cc:2243] T 7459e64bd48449d2a8d4ff835b215d46 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.019852 12266 raft_consensus.cc:2272] T 7459e64bd48449d2a8d4ff835b215d46 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.020514 12266 ts_tablet_manager.cc:1916] T 7459e64bd48449d2a8d4ff835b215d46 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.020833 10370 tablet_bootstrap.cc:654] T 82c3f619c76e40c583bfcdf2bb77fe42 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:12.023370 9412 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 3840b035b88243ecad17865d4716fcfc (table default.Table_e1cc6dd116324bf385dbc82e56283cf7 [id=6bf4ac94189d476d9ab5778e69d0b14f]). Expected version 1 got 0
I20260810 19:48:12.024385 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 883) took 3232 ms. Trace:
I20260810 19:48:12.024530 10375 rpcz_store.cc:276] 0810 19:48:08.791744 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:08.791808 (+ 64us) service_pool.cc:224] Handling call
0810 19:48:12.012387 (+3220579us) ts_tablet_manager.cc:1151] Deleting tablet f42e9b00e3da4d73b4beb1b325f09f4a
0810 19:48:12.024217 (+ 11830us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.024357 (+ 140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3220367}
I20260810 19:48:12.025156 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 885) took 3138 ms. Trace:
I20260810 19:48:12.025336 10375 rpcz_store.cc:276] 0810 19:48:08.886764 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:08.903537 (+ 16773us) service_pool.cc:224] Handling call
0810 19:48:12.025042 (+3121505us) ts_tablet_manager.cc:1151] Deleting tablet 1a615a32f94949179de8e8ee8a444576
0810 19:48:12.025053 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.025138 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3120216}
I20260810 19:48:12.026419 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_bf518ebf11a34609befb3cef7a20e7ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.027196 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf518ebf11a34609befb3cef7a20e7ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.028396 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 889) took 3058 ms. Trace:
I20260810 19:48:12.028538 10375 rpcz_store.cc:276] 0810 19:48:08.970420 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:08.970484 (+ 64us) service_pool.cc:224] Handling call
0810 19:48:12.025746 (+3055262us) ts_tablet_manager.cc:1151] Deleting tablet da807b279a8e47f3a7bb7b773c04b558
0810 19:48:12.025757 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.025838 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3055029}
I20260810 19:48:12.034168 12266 ts_tablet_manager.cc:1929] T 7459e64bd48449d2a8d4ff835b215d46 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.034662 12266 log.cc:1199] T 7459e64bd48449d2a8d4ff835b215d46 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/7459e64bd48449d2a8d4ff835b215d46
I20260810 19:48:12.035113 12266 ts_tablet_manager.cc:1950] T 7459e64bd48449d2a8d4ff835b215d46 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:12.036360 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 7459e64bd48449d2a8d4ff835b215d46 (table default.Table_4217f5ad81404f348810945248421770 [id=60c86daf4a0f4442ab6754a4e3dc2106]) successfully deleted
I20260810 19:48:12.036774 12266 tablet_replica.cc:333] T bb1e4400ca684da7b3b5e6592e19b6e6 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:12.037025 12266 raft_consensus.cc:2243] T bb1e4400ca684da7b3b5e6592e19b6e6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.037923 12266 raft_consensus.cc:2272] T bb1e4400ca684da7b3b5e6592e19b6e6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.038645 12266 ts_tablet_manager.cc:1916] T bb1e4400ca684da7b3b5e6592e19b6e6 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.045156 12266 ts_tablet_manager.cc:1929] T bb1e4400ca684da7b3b5e6592e19b6e6 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.045152 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 4abd3c95aa394e1cad066d49d22b5764 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:12.046164 12266 log.cc:1199] T bb1e4400ca684da7b3b5e6592e19b6e6 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/bb1e4400ca684da7b3b5e6592e19b6e6
I20260810 19:48:12.046617 12266 ts_tablet_manager.cc:1950] T bb1e4400ca684da7b3b5e6592e19b6e6 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:12.047518 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bf9486839474b2a8ddff3a49b4fda2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:12.048717 12266 tablet_replica.cc:333] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:12.048671 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet bb1e4400ca684da7b3b5e6592e19b6e6 (table default.Table_a1fa6532e8104ca59b2dca19999e2e61 [id=857eb3f1b89c41a6b2e3b30b375a585c]) successfully deleted
W20260810 19:48:12.048972 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet d857efeee4d3442ca065221e3095d421 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d857efeee4d3442ca065221e3095d421 already in progress: creating tablet
I20260810 19:48:12.049226 12266 raft_consensus.cc:2243] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 19:48:12.049230 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 065536e52b4a477a824ab0261168cbd3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 065536e52b4a477a824ab0261168cbd3 already in progress: creating tablet
W20260810 19:48:12.049480 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 625b0e4eedb946908bd00c6af5f06c08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 625b0e4eedb946908bd00c6af5f06c08 already in progress: creating tablet
I20260810 19:48:12.049533 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet b5ec15d8a0d241e3b6238c408d2fb436 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:12.038046 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet 625b0e4eedb946908bd00c6af5f06c08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.050284 12266 raft_consensus.cc:2272] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.039265 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bf9486839474b2a8ddff3a49b4fda2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.044623 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet b5ec15d8a0d241e3b6238c408d2fb436 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.046046 10370 tablet_bootstrap.cc:492] T 82c3f619c76e40c583bfcdf2bb77fe42 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:12.050770 10370 ts_tablet_manager.cc:1403] T 82c3f619c76e40c583bfcdf2bb77fe42 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.058s user 0.002s sys 0.002s
I20260810 19:48:12.051214 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 890) took 3049 ms. Trace:
I20260810 19:48:12.051142 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_fa2d4835f00b4e80955453185ee56272"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:12.051446 10375 rpcz_store.cc:276] 0810 19:48:09.001566 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.001634 (+ 68us) service_pool.cc:224] Handling call
0810 19:48:12.051064 (+3049430us) ts_tablet_manager.cc:1151] Deleting tablet 1cb0193bab3543d38ec5f6dc6a947b6e
0810 19:48:12.051076 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.051194 (+ 118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3049213}
W20260810 19:48:12.051777 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa2d4835f00b4e80955453185ee56272 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.052064 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 891) took 3039 ms. Trace:
I20260810 19:48:12.052135 10370 raft_consensus.cc:359] T 82c3f619c76e40c583bfcdf2bb77fe42 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.052343 10370 raft_consensus.cc:385] T 82c3f619c76e40c583bfcdf2bb77fe42 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:12.052202 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_8ce93209c7104f5cb5d786470e0fbf94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:12.052394 10370 raft_consensus.cc:740] T 82c3f619c76e40c583bfcdf2bb77fe42 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:12.052597 10370 consensus_queue.cc:260] T 82c3f619c76e40c583bfcdf2bb77fe42 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:12.052772 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ce93209c7104f5cb5d786470e0fbf94 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.053130 10370 ts_tablet_manager.cc:1434] T 82c3f619c76e40c583bfcdf2bb77fe42 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:12.053193 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a388312470544fb89f54d782ffd6f7c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:12.053443 10370 tablet_bootstrap.cc:492] T 4198f46be0194875aea6a7952321bc69 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:48:12.053678 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a388312470544fb89f54d782ffd6f7c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.054062 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 7d93fd6556b146ca8933a6dc0a2357e8 (table default.Table_92979ca12b07474b8e621122d23568a7 [id=de4d62ebb8c440a1a71ed57ac4f3c530]) successfully deleted
W20260810 19:48:12.054370 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet f42e9b00e3da4d73b4beb1b325f09f4a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f42e9b00e3da4d73b4beb1b325f09f4a already in progress: creating tablet
W20260810 19:48:12.054638 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 1a615a32f94949179de8e8ee8a444576 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a615a32f94949179de8e8ee8a444576 already in progress: creating tablet
W20260810 19:48:12.054987 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet da807b279a8e47f3a7bb7b773c04b558 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da807b279a8e47f3a7bb7b773c04b558 already in progress: creating tablet
I20260810 19:48:12.055212 10370 tablet_bootstrap.cc:654] T 4198f46be0194875aea6a7952321bc69 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:12.056835 12266 ts_tablet_manager.cc:1916] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.052136 10375 rpcz_store.cc:276] 0810 19:48:09.012520 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.012586 (+ 66us) service_pool.cc:224] Handling call
0810 19:48:12.051951 (+3039365us) ts_tablet_manager.cc:1151] Deleting tablet 2d72c72f90964f34bbc2232118dc5172
0810 19:48:12.051961 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.052050 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3039129}
I20260810 19:48:12.063019 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 892) took 3040 ms. Trace:
I20260810 19:48:12.063215 10375 rpcz_store.cc:276] 0810 19:48:09.022212 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.022274 (+ 62us) service_pool.cc:224] Handling call
0810 19:48:12.062874 (+3040600us) ts_tablet_manager.cc:1151] Deleting tablet 9e37ab519ffe4791ab276a9fc0d96ead
0810 19:48:12.062887 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.062999 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3040348}
I20260810 19:48:12.063910 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 897) took 2914 ms. Trace:
I20260810 19:48:12.064450 10375 rpcz_store.cc:276] 0810 19:48:09.149869 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.161749 (+ 11880us) service_pool.cc:224] Handling call
0810 19:48:12.063743 (+2901994us) ts_tablet_manager.cc:1151] Deleting tablet 3b9f29803809462a9b8b64b03eed040b
0810 19:48:12.063754 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.063890 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2901595}
I20260810 19:48:12.064950 10367 tablet_bootstrap.cc:492] T 5f4e2adee0264e418ff8c54912973e60 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:12.065167 10367 ts_tablet_manager.cc:1403] T 5f4e2adee0264e418ff8c54912973e60 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.054s user 0.004s sys 0.000s
I20260810 19:48:12.065243 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 902) took 2774 ms. Trace:
I20260810 19:48:12.065626 10375 rpcz_store.cc:276] 0810 19:48:09.291279 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.291346 (+ 67us) service_pool.cc:224] Handling call
0810 19:48:12.065128 (+2773782us) ts_tablet_manager.cc:1151] Deleting tablet 155b48f454e74ca9bb7007f584231a37
0810 19:48:12.065138 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.065226 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2666645}
I20260810 19:48:12.066517 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 903) took 2774 ms. Trace:
I20260810 19:48:12.066990 10367 raft_consensus.cc:359] T 5f4e2adee0264e418ff8c54912973e60 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.067251 10367 raft_consensus.cc:385] T 5f4e2adee0264e418ff8c54912973e60 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:12.066902 10375 rpcz_store.cc:276] 0810 19:48:09.291849 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.291902 (+ 53us) service_pool.cc:224] Handling call
0810 19:48:12.066404 (+2774502us) ts_tablet_manager.cc:1151] Deleting tablet 224bce6be88842c0a26df57326f34442
0810 19:48:12.066414 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.066500 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2667843}
I20260810 19:48:12.067358 10367 raft_consensus.cc:740] T 5f4e2adee0264e418ff8c54912973e60 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:12.067653 10367 consensus_queue.cc:260] T 5f4e2adee0264e418ff8c54912973e60 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.067911 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 904) took 2775 ms. Trace:
I20260810 19:48:12.068326 10367 ts_tablet_manager.cc:1434] T 5f4e2adee0264e418ff8c54912973e60 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:48:12.068282 10375 rpcz_store.cc:276] 0810 19:48:09.292296 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.292359 (+ 63us) service_pool.cc:224] Handling call
0810 19:48:12.067795 (+2775436us) ts_tablet_manager.cc:1151] Deleting tablet 9ae6d231840342fb8bb3493d0525c95b
0810 19:48:12.067805 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.067893 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2669185}
I20260810 19:48:12.068688 10367 tablet_bootstrap.cc:492] T 2d72c72f90964f34bbc2232118dc5172 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:12.068459 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 4abd3c95aa394e1cad066d49d22b5764 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.069068 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 905) took 2654 ms. Trace:
I20260810 19:48:12.069469 10375 rpcz_store.cc:276] 0810 19:48:09.414729 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.414883 (+ 154us) service_pool.cc:224] Handling call
0810 19:48:12.068933 (+2654050us) ts_tablet_manager.cc:1151] Deleting tablet d6f410a1659c40f08ac274e63ad01b3d
0810 19:48:12.068942 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.069051 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2653823}
I20260810 19:48:12.070217 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 906) took 2646 ms. Trace:
W20260810 19:48:12.070444 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 1cb0193bab3543d38ec5f6dc6a947b6e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1cb0193bab3543d38ec5f6dc6a947b6e already in progress: creating tablet
I20260810 19:48:12.070748 10375 rpcz_store.cc:276] 0810 19:48:09.424157 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.424219 (+ 62us) service_pool.cc:224] Handling call
0810 19:48:12.070096 (+2645877us) ts_tablet_manager.cc:1151] Deleting tablet c285518ed49d4ed68a6039f98db3b700
0810 19:48:12.070105 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.070202 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2645672}
W20260810 19:48:12.073378 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 2d72c72f90964f34bbc2232118dc5172 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d72c72f90964f34bbc2232118dc5172 already in progress: creating tablet
W20260810 19:48:12.074944 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 9e37ab519ffe4791ab276a9fc0d96ead because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e37ab519ffe4791ab276a9fc0d96ead already in progress: creating tablet
W20260810 19:48:12.076740 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 3b9f29803809462a9b8b64b03eed040b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b9f29803809462a9b8b64b03eed040b already in progress: creating tablet
I20260810 19:48:12.080606 10375 tablet_replica.cc:333] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:12.081148 10375 raft_consensus.cc:2243] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.081650 10375 raft_consensus.cc:2272] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.082578 10375 ts_tablet_manager.cc:1916] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:12.084760 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 155b48f454e74ca9bb7007f584231a37 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 155b48f454e74ca9bb7007f584231a37 already in progress: creating tablet
I20260810 19:48:12.072645 12266 ts_tablet_manager.cc:1929] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:12.086799 12266 log.cc:1199] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/3bf9486839474b2a8ddff3a49b4fda2a
I20260810 19:48:12.086709 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d2b8c5a92e3d43b89de4938297a90542" } modify_external_catalogs: true
I20260810 19:48:12.087387 12266 ts_tablet_manager.cc:1950] T 3bf9486839474b2a8ddff3a49b4fda2a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:12.087059 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d2b8c5a92e3d43b89de4938297a90542" } modify_external_catalogs: true
I20260810 19:48:12.088739 12266 tablet_replica.cc:333] T 59a767c91abf45e79cebab582525ad2e P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:12.088747 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 3bf9486839474b2a8ddff3a49b4fda2a (table default.Table_0bbfea1f106c4df1921c642928671792 [id=d628448cf7b94ebab79194e81fcaf040]) successfully deleted
I20260810 19:48:12.088946 12266 raft_consensus.cc:2243] T 59a767c91abf45e79cebab582525ad2e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.088994 10366 tablet_bootstrap.cc:492] T bafc42f0cdf94ebd823dfb678df8a83b P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:12.089119 12266 raft_consensus.cc:2272] T 59a767c91abf45e79cebab582525ad2e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.089143 10366 ts_tablet_manager.cc:1403] T bafc42f0cdf94ebd823dfb678df8a83b P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.162s user 0.003s sys 0.001s
W20260810 19:48:12.089784 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet b5ec15d8a0d241e3b6238c408d2fb436 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5ec15d8a0d241e3b6238c408d2fb436 already in progress: creating tablet
W20260810 19:48:12.090046 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 4abd3c95aa394e1cad066d49d22b5764 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4abd3c95aa394e1cad066d49d22b5764 already in progress: creating tablet
I20260810 19:48:12.090014 10366 raft_consensus.cc:359] T bafc42f0cdf94ebd823dfb678df8a83b P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.090179 10366 raft_consensus.cc:385] T bafc42f0cdf94ebd823dfb678df8a83b P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:12.090256 10366 raft_consensus.cc:740] T bafc42f0cdf94ebd823dfb678df8a83b P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:12.090623 10366 consensus_queue.cc:260] T bafc42f0cdf94ebd823dfb678df8a83b P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.095381 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_585a8a9b06434703beb484747743577d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:12.095510 10375 ts_tablet_manager.cc:1929] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.4
I20260810 19:48:12.095610 10375 log.cc:1199] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/fb7b722c43ee4b8698b19b2b6c1b401d
I20260810 19:48:12.095949 10375 ts_tablet_manager.cc:1950] T fb7b722c43ee4b8698b19b2b6c1b401d P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
W20260810 19:48:12.095947 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_585a8a9b06434703beb484747743577d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.096796 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 908) took 2629 ms. Trace:
I20260810 19:48:12.096890 10375 rpcz_store.cc:276] 0810 19:48:09.467327 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.508257 (+ 40930us) service_pool.cc:224] Handling call
0810 19:48:12.080542 (+2572285us) ts_tablet_manager.cc:1151] Deleting tablet fb7b722c43ee4b8698b19b2b6c1b401d
0810 19:48:12.080554 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.092364 (+ 11810us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.095449 (+ 3085us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.096768 (+ 1319us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2572023}
I20260810 19:48:12.101637 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a96082c210af46e4acbf221a98d946eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.102281 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a96082c210af46e4acbf221a98d946eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.103283 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 907) took 2674 ms. Trace:
I20260810 19:48:12.103381 10375 rpcz_store.cc:276] 0810 19:48:09.429192 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.514832 (+ 85640us) service_pool.cc:224] Handling call
0810 19:48:12.103092 (+2588260us) ts_tablet_manager.cc:1151] Deleting tablet fb7364664adb424384f6b646d9e423eb
0810 19:48:12.103106 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.103241 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2588042}
I20260810 19:48:12.104512 10375 tablet_replica.cc:333] T 3582ed23ffdf4ff089952e29083e5425 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:12.104720 10375 raft_consensus.cc:2243] T 3582ed23ffdf4ff089952e29083e5425 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.104882 10375 raft_consensus.cc:2272] T 3582ed23ffdf4ff089952e29083e5425 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.105468 10375 ts_tablet_manager.cc:1916] T 3582ed23ffdf4ff089952e29083e5425 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.105698 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet d7595dbb46b6441dbb811611da116791
I20260810 19:48:12.106895 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet 625b0e4eedb946908bd00c6af5f06c08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:11 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:12.107159 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet d7595dbb46b6441dbb811611da116791 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:12.117604 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 224bce6be88842c0a26df57326f34442 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 224bce6be88842c0a26df57326f34442 already in progress: creating tablet
W20260810 19:48:12.117873 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 9ae6d231840342fb8bb3493d0525c95b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ae6d231840342fb8bb3493d0525c95b already in progress: creating tablet
W20260810 19:48:12.118076 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet d6f410a1659c40f08ac274e63ad01b3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6f410a1659c40f08ac274e63ad01b3d already in progress: creating tablet
I20260810 19:48:12.118635 10367 tablet_bootstrap.cc:654] T 2d72c72f90964f34bbc2232118dc5172 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:12.120985 12954 tablet.cc:1724] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260810 19:48:12.121743 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet c285518ed49d4ed68a6039f98db3b700 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c285518ed49d4ed68a6039f98db3b700 already in progress: creating tablet
I20260810 19:48:12.121968 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet fb7b722c43ee4b8698b19b2b6c1b401d (table default.Table_bd99f8533af7419086a1ae12068ad426 [id=374cf9ed870c448fbbdad7050d0d11f9]) successfully deleted
W20260810 19:48:12.122174 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet fb7364664adb424384f6b646d9e423eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb7364664adb424384f6b646d9e423eb already in progress: creating tablet
I20260810 19:48:12.123124 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet ca733de7babe4343ab26dbca2c9020b2 with delete_type TABLET_DATA_DELETED (replaced by tablet 264a65bd642648e59998fb55fb3c8de1) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.125584 10375 ts_tablet_manager.cc:1929] T 3582ed23ffdf4ff089952e29083e5425 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.125712 10375 log.cc:1199] T 3582ed23ffdf4ff089952e29083e5425 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/3582ed23ffdf4ff089952e29083e5425
I20260810 19:48:12.126053 10375 ts_tablet_manager.cc:1950] T 3582ed23ffdf4ff089952e29083e5425 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:12.129079 12941 raft_consensus.cc:493] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:12.129268 12941 raft_consensus.cc:515] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.130007 12941 leader_election.cc:290] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:12.130618 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4571e0c723f74c828220b33116fed9e9" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:12.130688 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4571e0c723f74c828220b33116fed9e9" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:12.131346 9611 leader_election.cc:343] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:12.131562 9611 leader_election.cc:343] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:12.131633 9611 leader_election.cc:304] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:12.132072 12941 raft_consensus.cc:2749] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:12.132107 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 909) took 2628 ms. Trace:
I20260810 19:48:12.132863 12266 ts_tablet_manager.cc:1916] T 59a767c91abf45e79cebab582525ad2e P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.133131 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet d7595dbb46b6441dbb811611da116791 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:12.132182 10375 rpcz_store.cc:276] 0810 19:48:09.503533 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.608433 (+104900us) service_pool.cc:224] Handling call
0810 19:48:12.104454 (+2496021us) ts_tablet_manager.cc:1151] Deleting tablet 3582ed23ffdf4ff089952e29083e5425
0810 19:48:12.104465 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.116749 (+ 12284us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.125503 (+ 8754us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.132085 (+ 6582us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2485183}
I20260810 19:48:12.133669 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 919) took 2441 ms. Trace:
I20260810 19:48:12.133744 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet d7595dbb46b6441dbb811611da116791 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.133169 10367 tablet_bootstrap.cc:492] T 2d72c72f90964f34bbc2232118dc5172 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:12.134558 10367 ts_tablet_manager.cc:1403] T 2d72c72f90964f34bbc2232118dc5172 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.066s user 0.003s sys 0.001s
I20260810 19:48:12.134603 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 3582ed23ffdf4ff089952e29083e5425 (table default.Table_4fb96dbc73be4091855b1cbbed3b9ce6 [id=c72c64a09f73486abc4b2c6a72271d57]) successfully deleted
I20260810 19:48:12.135455 10367 raft_consensus.cc:359] T 2d72c72f90964f34bbc2232118dc5172 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.135685 10367 raft_consensus.cc:385] T 2d72c72f90964f34bbc2232118dc5172 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:12.135780 10367 raft_consensus.cc:740] T 2d72c72f90964f34bbc2232118dc5172 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:12.136034 10367 consensus_queue.cc:260] T 2d72c72f90964f34bbc2232118dc5172 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.136723 10367 ts_tablet_manager.cc:1434] T 2d72c72f90964f34bbc2232118dc5172 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:12.133765 10375 rpcz_store.cc:276] 0810 19:48:09.692108 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.692153 (+ 45us) service_pool.cc:224] Handling call
0810 19:48:12.133533 (+2441380us) ts_tablet_manager.cc:1151] Deleting tablet b9b567b3338845e4a37cff2a955056ae
0810 19:48:12.133544 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.133649 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2416631}
I20260810 19:48:12.139971 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 920) took 2447 ms. Trace:
I20260810 19:48:12.141080 12266 ts_tablet_manager.cc:1929] T 59a767c91abf45e79cebab582525ad2e P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.141189 12266 log.cc:1199] T 59a767c91abf45e79cebab582525ad2e P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/59a767c91abf45e79cebab582525ad2e
I20260810 19:48:12.140444 10375 rpcz_store.cc:276] 0810 19:48:09.692447 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.696292 (+ 3845us) service_pool.cc:224] Handling call
0810 19:48:12.139129 (+2442837us) ts_tablet_manager.cc:1151] Deleting tablet 23234c7580b64b55b4e62ded19d187d9
0810 19:48:12.139194 (+ 65us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.139845 (+ 651us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2421418}
I20260810 19:48:12.141515 12266 ts_tablet_manager.cc:1950] T 59a767c91abf45e79cebab582525ad2e P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
W20260810 19:48:12.138484 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet b9b567b3338845e4a37cff2a955056ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9b567b3338845e4a37cff2a955056ae already in progress: creating tablet
I20260810 19:48:12.144243 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ea8b681a37ff4a1596ff78f93ef12192" } new_table_name: "default.Table_886708c0fc644bb29d6dbd06061dac2a" modify_external_catalogs: true
I20260810 19:48:12.145565 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 930) took 2445 ms. Trace:
W20260810 19:48:12.142201 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 23234c7580b64b55b4e62ded19d187d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23234c7580b64b55b4e62ded19d187d9 already in progress: creating tablet
I20260810 19:48:12.146329 10375 rpcz_store.cc:276] 0810 19:48:09.699701 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.699750 (+ 49us) service_pool.cc:224] Handling call
0810 19:48:12.143621 (+2443871us) ts_tablet_manager.cc:1151] Deleting tablet 73a2e6a512224caa892ac7541131349f
0810 19:48:12.143634 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.145156 (+ 1522us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2425470}
I20260810 19:48:12.146502 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ad71d1a139444738b47b2cbbf23e10e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.146799 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 73a2e6a512224caa892ac7541131349f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73a2e6a512224caa892ac7541131349f already in progress: creating tablet
W20260810 19:48:12.147047 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad71d1a139444738b47b2cbbf23e10e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.147517 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 931) took 2215 ms. Trace:
I20260810 19:48:12.147598 10375 rpcz_store.cc:276] 0810 19:48:09.931878 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:09.931950 (+ 72us) service_pool.cc:224] Handling call
0810 19:48:12.147342 (+2215392us) ts_tablet_manager.cc:1151] Deleting tablet 60e99cd75ada470380ab69da60ddac77
0810 19:48:12.147353 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.147496 (+ 143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2215163}
W20260810 19:48:12.148041 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 60e99cd75ada470380ab69da60ddac77 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60e99cd75ada470380ab69da60ddac77 already in progress: creating tablet
I20260810 19:48:12.151438 10375 tablet_replica.cc:333] T 896b7cfdb0ca4904aaeafa13ff19365e P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:12.152038 10375 raft_consensus.cc:2243] T 896b7cfdb0ca4904aaeafa13ff19365e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.152211 12677 raft_consensus.cc:493] T bafc42f0cdf94ebd823dfb678df8a83b P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:12.152442 10375 raft_consensus.cc:2272] T 896b7cfdb0ca4904aaeafa13ff19365e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.153192 10375 ts_tablet_manager.cc:1916] T 896b7cfdb0ca4904aaeafa13ff19365e P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.157270 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_44e1a363b81646b9bf4cf6ca6cda52cf" } modify_external_catalogs: true
I20260810 19:48:12.157341 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ddc094375fad454aabc00b0a86132f9d" } modify_external_catalogs: true
I20260810 19:48:12.157483 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_44e1a363b81646b9bf4cf6ca6cda52cf" } modify_external_catalogs: true
I20260810 19:48:12.157505 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ddc094375fad454aabc00b0a86132f9d" } modify_external_catalogs: true
I20260810 19:48:12.158034 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c41427d1476b48f7acf16d9656f70cd4" } modify_external_catalogs: true
I20260810 19:48:12.158167 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c41427d1476b48f7acf16d9656f70cd4" } modify_external_catalogs: true
I20260810 19:48:12.158556 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7ed4f01934094960b0695461a48273ae" } modify_external_catalogs: true
I20260810 19:48:12.158682 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7ed4f01934094960b0695461a48273ae" } modify_external_catalogs: true
W20260810 19:48:12.159595 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3194d795b1ee4b17bd91c27bb6a86fb8 consensus state has no leader
I20260810 19:48:12.171970 10375 ts_tablet_manager.cc:1929] T 896b7cfdb0ca4904aaeafa13ff19365e P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.172116 10375 log.cc:1199] T 896b7cfdb0ca4904aaeafa13ff19365e P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/896b7cfdb0ca4904aaeafa13ff19365e
I20260810 19:48:12.172428 10375 ts_tablet_manager.cc:1950] T 896b7cfdb0ca4904aaeafa13ff19365e P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:12.173281 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 932) took 2088 ms. Trace:
I20260810 19:48:12.173381 10375 rpcz_store.cc:276] 0810 19:48:10.085037 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:10.085099 (+ 62us) service_pool.cc:224] Handling call
0810 19:48:12.151377 (+2066278us) ts_tablet_manager.cc:1151] Deleting tablet 896b7cfdb0ca4904aaeafa13ff19365e
0810 19:48:12.151389 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.168375 (+ 16986us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.171888 (+ 3513us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.173241 (+ 1353us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2065951}
I20260810 19:48:12.176246 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 896b7cfdb0ca4904aaeafa13ff19365e (table default.Table_9ae3537027a04f86aa62a86f5668fe12 [id=376702dd80dd4e91b7e35a056f4ec452]) successfully deleted
I20260810 19:48:12.176816 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_92ef15e1c6b640b6916580ccb7f93497" } new_table_name: "default.Table_c3b6fdaa9f2442f59e4dddf40bc53733" modify_external_catalogs: true
I20260810 19:48:12.178656 9408 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 20bcaea08c7a41609d571fb32f105883
I20260810 19:48:12.179000 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_491e9a2223e9472a842709f9e9250766" } new_table_name: "default.Table_350e803d66de4035a7263606a811cb39" modify_external_catalogs: true
I20260810 19:48:12.179404 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_85870c032faa47d5946b1523ec0ce3d8" } new_table_name: "default.Table_2e7ef72559904ca0b29fbb9f42f8059d" modify_external_catalogs: true
I20260810 19:48:12.180269 10375 tablet_replica.cc:333] T 839dcdb448d14a8f8e452145ccf41263 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:12.180492 10375 raft_consensus.cc:2243] T 839dcdb448d14a8f8e452145ccf41263 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.180670 10375 raft_consensus.cc:2272] T 839dcdb448d14a8f8e452145ccf41263 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.180684 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_aeddf7c6df8a47eaaf1ff9da8fefc3d2" } new_table_name: "default.Table_6a546246efe3460f99c4f33556ba10a6" modify_external_catalogs: true
I20260810 19:48:12.181289 10375 ts_tablet_manager.cc:1916] T 839dcdb448d14a8f8e452145ccf41263 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.191529 10375 ts_tablet_manager.cc:1929] T 839dcdb448d14a8f8e452145ccf41263 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.191679 10375 log.cc:1199] T 839dcdb448d14a8f8e452145ccf41263 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/839dcdb448d14a8f8e452145ccf41263
I20260810 19:48:12.192018 10375 ts_tablet_manager.cc:1950] T 839dcdb448d14a8f8e452145ccf41263 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:12.192907 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 955) took 1743 ms. Trace:
I20260810 19:48:12.192992 10375 rpcz_store.cc:276] 0810 19:48:10.449692 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:10.449762 (+ 70us) service_pool.cc:224] Handling call
0810 19:48:12.180191 (+1730429us) ts_tablet_manager.cc:1151] Deleting tablet 839dcdb448d14a8f8e452145ccf41263
0810 19:48:12.180205 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.188273 (+ 8068us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.191453 (+ 3180us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.192881 (+ 1428us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1730176}
I20260810 19:48:12.194161 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 839dcdb448d14a8f8e452145ccf41263 (table default.Table_745ec8d1fd994242990bec7acd5bd9cd [id=435f41d3a7ba4f03a738cdb2272f759e]) successfully deleted
I20260810 19:48:12.201190 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 956) took 1742 ms. Trace:
I20260810 19:48:12.201323 10375 rpcz_store.cc:276] 0810 19:48:10.458847 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:10.458916 (+ 69us) service_pool.cc:224] Handling call
0810 19:48:12.201007 (+1742091us) ts_tablet_manager.cc:1151] Deleting tablet 983adb7af7954ac0a2807cb75d531a5a
0810 19:48:12.201022 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.201161 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1741825}
W20260810 19:48:12.201854 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 983adb7af7954ac0a2807cb75d531a5a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 983adb7af7954ac0a2807cb75d531a5a already in progress: creating tablet
W20260810 19:48:12.202092 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f4a7579cf1af43159bba3686228b5983 consensus state has no leader
I20260810 19:48:12.202980 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b29c1da447c64a1e84fe8717e23c4c60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.203619 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b29c1da447c64a1e84fe8717e23c4c60 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.204025 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 957) took 1729 ms. Trace:
I20260810 19:48:12.204104 10375 rpcz_store.cc:276] 0810 19:48:10.474893 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:10.474958 (+ 65us) service_pool.cc:224] Handling call
0810 19:48:12.203852 (+1728894us) ts_tablet_manager.cc:1151] Deleting tablet a07fca1f298e4473aca7e9813bdd11d6
0810 19:48:12.203866 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.204000 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1728684}
W20260810 19:48:12.204589 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet a07fca1f298e4473aca7e9813bdd11d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a07fca1f298e4473aca7e9813bdd11d6 already in progress: creating tablet
I20260810 19:48:12.205600 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 951) took 1798 ms. Trace:
I20260810 19:48:12.205690 10375 rpcz_store.cc:276] 0810 19:48:10.406671 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:10.406733 (+ 62us) service_pool.cc:224] Handling call
0810 19:48:12.205458 (+1798725us) ts_tablet_manager.cc:1151] Deleting tablet 048a81d8dc7b42a39a9891d57fcd08b0
0810 19:48:12.205471 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.205578 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1722879}
W20260810 19:48:12.206141 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 048a81d8dc7b42a39a9891d57fcd08b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 048a81d8dc7b42a39a9891d57fcd08b0 already in progress: creating tablet
I20260810 19:48:12.207283 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 950) took 1800 ms. Trace:
I20260810 19:48:12.207903 12957 tablet.cc:1724] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 19:48:12.207376 10375 rpcz_store.cc:276] 0810 19:48:10.406536 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:10.406834 (+ 298us) service_pool.cc:224] Handling call
0810 19:48:12.207118 (+1800284us) ts_tablet_manager.cc:1151] Deleting tablet dbef3b19330d42779bf0a62ec742bfcb
0810 19:48:12.207141 (+ 23us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.207262 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1724403}
I20260810 19:48:12.208835 10367 tablet_bootstrap.cc:492] T b9b567b3338845e4a37cff2a955056ae P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
W20260810 19:48:12.208876 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet dbef3b19330d42779bf0a62ec742bfcb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbef3b19330d42779bf0a62ec742bfcb already in progress: creating tablet
I20260810 19:48:12.209923 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 953) took 1798 ms. Trace:
I20260810 19:48:12.210234 10375 rpcz_store.cc:276] 0810 19:48:10.410972 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:10.411024 (+ 52us) service_pool.cc:224] Handling call
0810 19:48:12.209437 (+1798413us) ts_tablet_manager.cc:1151] Deleting tablet bb0bfaf245584de889a5ab0b5dedf534
0810 19:48:12.209564 (+ 127us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.209899 (+ 335us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1726608}
W20260810 19:48:12.212132 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet bb0bfaf245584de889a5ab0b5dedf534 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb0bfaf245584de889a5ab0b5dedf534 already in progress: creating tablet
I20260810 19:48:12.212657 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 952) took 1801 ms. Trace:
I20260810 19:48:12.212738 10375 rpcz_store.cc:276] 0810 19:48:10.410787 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:10.411155 (+ 368us) service_pool.cc:224] Handling call
0810 19:48:12.212512 (+1801357us) ts_tablet_manager.cc:1151] Deleting tablet 2e0ca51bb8664f53b1c8ec2ad324c0e4
0810 19:48:12.212525 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.212637 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1729588}
W20260810 19:48:12.213220 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 2e0ca51bb8664f53b1c8ec2ad324c0e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e0ca51bb8664f53b1c8ec2ad324c0e4 already in progress: creating tablet
W20260810 19:48:12.214113 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 53bb7e081b8747308d85ca933bb3528c consensus state has no leader
I20260810 19:48:12.214116 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 954) took 1799 ms. Trace:
I20260810 19:48:12.214193 10375 rpcz_store.cc:276] 0810 19:48:10.414813 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:10.414869 (+ 56us) service_pool.cc:224] Handling call
0810 19:48:12.213984 (+1799115us) ts_tablet_manager.cc:1151] Deleting tablet 016b91706e1543c289d44fcf48caed9d
0810 19:48:12.213996 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.214097 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1730969}
I20260810 19:48:12.214579 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_465ab367cd274ae493b639b9811d5a03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.214701 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 016b91706e1543c289d44fcf48caed9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 016b91706e1543c289d44fcf48caed9d already in progress: creating tablet
W20260810 19:48:12.215205 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_465ab367cd274ae493b639b9811d5a03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.215541 10375 tablet_replica.cc:333] T 5ba42032e7344423a0e86c55d613f27d P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:12.215728 10375 raft_consensus.cc:2243] T 5ba42032e7344423a0e86c55d613f27d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.215881 10375 raft_consensus.cc:2272] T 5ba42032e7344423a0e86c55d613f27d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.217803 10375 ts_tablet_manager.cc:1916] T 5ba42032e7344423a0e86c55d613f27d P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:12.217869 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d1f88b5c7685407590a1677dfa0ea697 consensus state has no leader
I20260810 19:48:12.220553 10367 tablet_bootstrap.cc:654] T b9b567b3338845e4a37cff2a955056ae P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:12.222477 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 651d224a2957465f889cce7408dffa45 consensus state has no leader
I20260810 19:48:12.223419 10370 tablet_bootstrap.cc:492] T 4198f46be0194875aea6a7952321bc69 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:12.223666 10370 ts_tablet_manager.cc:1403] T 4198f46be0194875aea6a7952321bc69 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.170s user 0.020s sys 0.035s
I20260810 19:48:12.225072 10370 raft_consensus.cc:359] T 4198f46be0194875aea6a7952321bc69 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.225365 10370 raft_consensus.cc:385] T 4198f46be0194875aea6a7952321bc69 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:12.225479 10370 raft_consensus.cc:740] T 4198f46be0194875aea6a7952321bc69 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:12.225831 10370 consensus_queue.cc:260] T 4198f46be0194875aea6a7952321bc69 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.227017 12941 raft_consensus.cc:493] T 73abedd88ba548bdb5a23f508b77403d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:12.227200 12941 raft_consensus.cc:515] T 73abedd88ba548bdb5a23f508b77403d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.227815 10367 tablet_bootstrap.cc:492] T b9b567b3338845e4a37cff2a955056ae P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:12.227939 12941 leader_election.cc:290] T 73abedd88ba548bdb5a23f508b77403d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:12.228036 10367 ts_tablet_manager.cc:1403] T b9b567b3338845e4a37cff2a955056ae P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260810 19:48:12.228890 10367 raft_consensus.cc:359] T b9b567b3338845e4a37cff2a955056ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.229071 10367 raft_consensus.cc:385] T b9b567b3338845e4a37cff2a955056ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:12.229156 10367 raft_consensus.cc:740] T b9b567b3338845e4a37cff2a955056ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:12.229527 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_de018de17ae54300873a272247929e46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:12.229586 10367 consensus_queue.cc:260] T b9b567b3338845e4a37cff2a955056ae P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.230145 10367 ts_tablet_manager.cc:1434] T b9b567b3338845e4a37cff2a955056ae P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260810 19:48:12.230275 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de018de17ae54300873a272247929e46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.230561 10367 tablet_bootstrap.cc:492] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:12.232499 10367 tablet_bootstrap.cc:654] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:12.233516 10370 ts_tablet_manager.cc:1434] T 4198f46be0194875aea6a7952321bc69 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 19:48:12.233992 10370 tablet_bootstrap.cc:492] T 18cd8adaa065425c846bc791c05fa67d P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:12.236008 10370 tablet_bootstrap.cc:654] T 18cd8adaa065425c846bc791c05fa67d P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:12.239450 12941 raft_consensus.cc:493] T 87bbcc651d034e2a826478b805792e48 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:12.239645 12941 raft_consensus.cc:515] T 87bbcc651d034e2a826478b805792e48 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.240386 12941 leader_election.cc:290] T 87bbcc651d034e2a826478b805792e48 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:12.241365 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87bbcc651d034e2a826478b805792e48" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:12.242086 9611 leader_election.cc:343] T 87bbcc651d034e2a826478b805792e48 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:12.245317 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73abedd88ba548bdb5a23f508b77403d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:12.246192 9611 leader_election.cc:343] T 73abedd88ba548bdb5a23f508b77403d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:12.245504 10370 tablet_bootstrap.cc:492] T 18cd8adaa065425c846bc791c05fa67d P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:12.246487 10370 ts_tablet_manager.cc:1403] T 18cd8adaa065425c846bc791c05fa67d P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.000s
I20260810 19:48:12.246778 10375 ts_tablet_manager.cc:1929] T 5ba42032e7344423a0e86c55d613f27d P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.247666 10375 log.cc:1199] T 5ba42032e7344423a0e86c55d613f27d P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/5ba42032e7344423a0e86c55d613f27d
I20260810 19:48:12.248216 10375 ts_tablet_manager.cc:1950] T 5ba42032e7344423a0e86c55d613f27d P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:12.248485 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 07856671e97e4f0089cd67f6b8b2ac42
I20260810 19:48:12.250054 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 07856671e97e4f0089cd67f6b8b2ac42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.250447 9407 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 639c824ba4834734a4ebfd558181bebe (table default.Table_35ada13f5f5a41b0a93a57276b7756d9 [id=fa3844f34a5b4d55b6e87ec2164eb8fb]). Expected version 2 got 0
I20260810 19:48:12.250667 9407 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 3840b035b88243ecad17865d4716fcfc (table default.Table_e1cc6dd116324bf385dbc82e56283cf7 [id=6bf4ac94189d476d9ab5778e69d0b14f]). Expected version 1 got 0
I20260810 19:48:12.250852 9407 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 73abedd88ba548bdb5a23f508b77403d (table default.Table_2c70d731dd51405188ec44cbbcffaf57 [id=85908f0b736c4bf9bdbcd67352e2d491]). Expected version 1 got 0
I20260810 19:48:12.250982 9407 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 18cd8adaa065425c846bc791c05fa67d (table default.Table_a1645668cf79415ca029a01169fbf874 [id=aec405416e584af6bfb8194b357d6dbc]). Expected version 3 got 0
I20260810 19:48:12.251194 10370 raft_consensus.cc:359] T 18cd8adaa065425c846bc791c05fa67d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:12.251384 10370 raft_consensus.cc:385] T 18cd8adaa065425c846bc791c05fa67d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:12.251579 9418 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 639c824ba4834734a4ebfd558181bebe (table default.Table_35ada13f5f5a41b0a93a57276b7756d9 [id=fa3844f34a5b4d55b6e87ec2164eb8fb]). Expected version 2 got 0
I20260810 19:48:12.252496 9413 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 639c824ba4834734a4ebfd558181bebe (table default.Table_35ada13f5f5a41b0a93a57276b7756d9 [id=fa3844f34a5b4d55b6e87ec2164eb8fb]). Expected version 2 got 0
I20260810 19:48:12.252700 9413 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 3840b035b88243ecad17865d4716fcfc (table default.Table_e1cc6dd116324bf385dbc82e56283cf7 [id=6bf4ac94189d476d9ab5778e69d0b14f]). Expected version 1 got 0
I20260810 19:48:12.253309 10370 raft_consensus.cc:740] T 18cd8adaa065425c846bc791c05fa67d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:12.255640 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 9e7cda16630143b1966e1b66fa970346 (DEFAULT_TABLE table=default.Table_f04ffd21d3474bf5b3635136aacb1c0b [id=83f5da680ba4444da3eece58ff5cd766]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.255766 9413 master_service.cc:960] ReplaceTablet: received request to replace tablet 59a767c91abf45e79cebab582525ad2e from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:12.256053 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e7cda16630143b1966e1b66fa970346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.257125 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 07856671e97e4f0089cd67f6b8b2ac42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:12.257678 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 87bbcc651d034e2a826478b805792e48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:12.258641 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 9e7cda16630143b1966e1b66fa970346 (DEFAULT_TABLE table=default.Table_f04ffd21d3474bf5b3635136aacb1c0b [id=83f5da680ba4444da3eece58ff5cd766]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.259205 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e7cda16630143b1966e1b66fa970346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.183754 12716 raft_consensus.cc:493] T 19e2bf7b7d254894a07c5a75bf24e742 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:12.262450 12716 raft_consensus.cc:515] T 19e2bf7b7d254894a07c5a75bf24e742 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.263134 12716 leader_election.cc:290] T 19e2bf7b7d254894a07c5a75bf24e742 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:12.264398 9831 leader_election.cc:343] T 19e2bf7b7d254894a07c5a75bf24e742 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 19e2bf7b7d254894a07c5a75bf24e742
I20260810 19:48:12.265023 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 958) took 1693 ms. Trace:
I20260810 19:48:12.264974 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e2bf7b7d254894a07c5a75bf24e742" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:12.265106 10375 rpcz_store.cc:276] 0810 19:48:10.572064 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:10.572190 (+ 126us) service_pool.cc:224] Handling call
0810 19:48:12.215490 (+1643300us) ts_tablet_manager.cc:1151] Deleting tablet 5ba42032e7344423a0e86c55d613f27d
0810 19:48:12.215501 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.236451 (+ 20950us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.246260 (+ 9809us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.265004 (+ 18744us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1372,"tablet-delete.queue_time_us":1642950}
I20260810 19:48:12.265552 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 5ba42032e7344423a0e86c55d613f27d (table default.Table_c6af56cc89144541a50f07ce309f7aaf [id=0bbc6397fe1b49cb894bb0e50af006fc]) successfully deleted
W20260810 19:48:12.265676 9830 leader_election.cc:343] T 19e2bf7b7d254894a07c5a75bf24e742 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:12.265795 9830 leader_election.cc:304] T 19e2bf7b7d254894a07c5a75bf24e742 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:12.265929 10370 consensus_queue.cc:260] T 18cd8adaa065425c846bc791c05fa67d P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:12.266228 12716 raft_consensus.cc:2749] T 19e2bf7b7d254894a07c5a75bf24e742 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:12.266678 12677 raft_consensus.cc:515] T bafc42f0cdf94ebd823dfb678df8a83b P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.267125 10370 ts_tablet_manager.cc:1434] T 18cd8adaa065425c846bc791c05fa67d P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.020s user 0.001s sys 0.000s
I20260810 19:48:12.268093 10370 tablet_bootstrap.cc:492] T f3e3dde1c29e4275bafb27df63b117be P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:48:12.268172 9831 leader_election.cc:343] T bafc42f0cdf94ebd823dfb678df8a83b P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: bafc42f0cdf94ebd823dfb678df8a83b
I20260810 19:48:12.269042 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bafc42f0cdf94ebd823dfb678df8a83b" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:12.269662 9830 leader_election.cc:343] T bafc42f0cdf94ebd823dfb678df8a83b P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:12.269783 9830 leader_election.cc:304] T bafc42f0cdf94ebd823dfb678df8a83b P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:12.270069 12716 raft_consensus.cc:2749] T bafc42f0cdf94ebd823dfb678df8a83b P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:12.270267 10370 tablet_bootstrap.cc:654] T f3e3dde1c29e4275bafb27df63b117be P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:12.267612 10375 tablet_replica.cc:333] T 15c070c23de34348ad3426c894e11022 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:12.273355 10375 raft_consensus.cc:2243] T 15c070c23de34348ad3426c894e11022 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.273515 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 0f2a1ce4229340318460b50be053be39
I20260810 19:48:12.273591 10375 raft_consensus.cc:2272] T 15c070c23de34348ad3426c894e11022 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.274160 10375 ts_tablet_manager.cc:1916] T 15c070c23de34348ad3426c894e11022 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.275203 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f2a1ce4229340318460b50be053be39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.275935 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f2a1ce4229340318460b50be053be39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:12.278566 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_7a0fc5c4560f422c80521b1c04c6f9e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:12.206156 10366 ts_tablet_manager.cc:1434] T bafc42f0cdf94ebd823dfb678df8a83b P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.117s user 0.001s sys 0.001s
I20260810 19:48:12.229439 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73abedd88ba548bdb5a23f508b77403d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:12.241114 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87bbcc651d034e2a826478b805792e48" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:12.279177 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a0fc5c4560f422c80521b1c04c6f9e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.249855 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet 07856671e97e4f0089cd67f6b8b2ac42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:12.254602 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet bafc42f0cdf94ebd823dfb678df8a83b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:48:12.279814 9611 leader_election.cc:343] T 73abedd88ba548bdb5a23f508b77403d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:12.279963 9611 leader_election.cc:304] T 73abedd88ba548bdb5a23f508b77403d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
W20260810 19:48:12.280462 9611 leader_election.cc:343] T 87bbcc651d034e2a826478b805792e48 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:12.280489 10375 ts_tablet_manager.cc:1929] T 15c070c23de34348ad3426c894e11022 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.280601 10375 log.cc:1199] T 15c070c23de34348ad3426c894e11022 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/15c070c23de34348ad3426c894e11022
I20260810 19:48:12.280927 10375 ts_tablet_manager.cc:1950] T 15c070c23de34348ad3426c894e11022 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:12.280877 9611 leader_election.cc:304] T 87bbcc651d034e2a826478b805792e48 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:12.281243 12912 raft_consensus.cc:2749] T 73abedd88ba548bdb5a23f508b77403d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:12.281390 12941 raft_consensus.cc:2749] T 87bbcc651d034e2a826478b805792e48 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:12.258473 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet ee5f38d91bb349a9ae1da8ba69d2ddbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:12.261760 9890 tablet_service.cc:1511] Processing CreateTablet for tablet 9e7cda16630143b1966e1b66fa970346 (DEFAULT_TABLE table=default.Table_f04ffd21d3474bf5b3635136aacb1c0b [id=83f5da680ba4444da3eece58ff5cd766]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.275244 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f2a1ce4229340318460b50be053be39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:12.270303 12677 leader_election.cc:290] T bafc42f0cdf94ebd823dfb678df8a83b P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:12.283099 9407 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 639c824ba4834734a4ebfd558181bebe (table default.Table_35ada13f5f5a41b0a93a57276b7756d9 [id=fa3844f34a5b4d55b6e87ec2164eb8fb]). Expected version 2 got 0
I20260810 19:48:12.285944 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 82c3f619c76e40c583bfcdf2bb77fe42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.286558 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 4198f46be0194875aea6a7952321bc69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.288802 12954 tablet.cc:1724] T 5576e9087855441498904bc59685a442 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:12.291841 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 44e5c597335a4795b8dbb708af7726ee
I20260810 19:48:12.293016 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 44e5c597335a4795b8dbb708af7726ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:12.294198 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 44e5c597335a4795b8dbb708af7726ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.294796 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 44e5c597335a4795b8dbb708af7726ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:12.297150 9413 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_a1645668cf79415ca029a01169fbf874 [id=aec405416e584af6bfb8194b357d6dbc] alter complete (version 3)
I20260810 19:48:12.299391 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_5fd2a309ec6f484f8b2c2dc66fb79a3f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.300267 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5fd2a309ec6f484f8b2c2dc66fb79a3f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.300376 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f4e2adee0264e418ff8c54912973e60 with delete_type TABLET_DATA_DELETED (replaced by tablet 883bf419763f4dcfab870fea49137eff) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:12.301301 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d72c72f90964f34bbc2232118dc5172 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:12.302104 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet b9b567b3338845e4a37cff2a955056ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:12.305478 12705 raft_consensus.cc:493] T 18cd8adaa065425c846bc791c05fa67d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:12.305665 12705 raft_consensus.cc:515] T 18cd8adaa065425c846bc791c05fa67d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } }
I20260810 19:48:12.306402 12705 leader_election.cc:290] T 18cd8adaa065425c846bc791c05fa67d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:12.307464 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18cd8adaa065425c846bc791c05fa67d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:12.308207 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18cd8adaa065425c846bc791c05fa67d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:12.308688 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_925abe17cfd440bf9b41ed6f51b5e788" } modify_external_catalogs: true
I20260810 19:48:12.308887 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_925abe17cfd440bf9b41ed6f51b5e788" } modify_external_catalogs: true
I20260810 19:48:12.309841 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ad4c8111945d44589f5608226af55c5b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.310843 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad4c8111945d44589f5608226af55c5b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.312750 10067 leader_election.cc:304] T 18cd8adaa065425c846bc791c05fa67d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:12.313158 12705 raft_consensus.cc:2749] T 18cd8adaa065425c846bc791c05fa67d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:12.313905 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_43d705e812c24da3876d013deb20ac5d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.314626 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43d705e812c24da3876d013deb20ac5d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.282053 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e7cda16630143b1966e1b66fa970346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.315140 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_28f6d1fdbe464aeca07552d5916714f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:12.315689 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 959) took 1614 ms. Trace:
I20260810 19:48:12.315778 10375 rpcz_store.cc:276] 0810 19:48:10.701086 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:10.701152 (+ 66us) service_pool.cc:224] Handling call
0810 19:48:12.267557 (+1566405us) ts_tablet_manager.cc:1151] Deleting tablet 15c070c23de34348ad3426c894e11022
0810 19:48:12.267568 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.277370 (+ 9802us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.280422 (+ 3052us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.315662 (+ 35240us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1566160}
W20260810 19:48:12.315976 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28f6d1fdbe464aeca07552d5916714f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.316141 10375 tablet_replica.cc:333] T 320e42f6de6c4452adb7bbb379a156e6 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:12.316342 10375 raft_consensus.cc:2243] T 320e42f6de6c4452adb7bbb379a156e6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.316385 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 5775e6715f5644239239b6c143f806cb (DEFAULT_TABLE table=default.Table_4f5dcaf24d054f4a9d0ccca5ae5bb787 [id=3064ae1d0b5b413d8eaa60322e709817]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.316551 10375 raft_consensus.cc:2272] T 320e42f6de6c4452adb7bbb379a156e6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.316875 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 15c070c23de34348ad3426c894e11022 (table default.Table_511b7773a9034830ad84841ad4c71063 [id=b69a88eb84db49daa3c6a51ca2c6e4d7]) successfully deleted
I20260810 19:48:12.317165 10375 ts_tablet_manager.cc:1916] T 320e42f6de6c4452adb7bbb379a156e6 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.322115 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 5775e6715f5644239239b6c143f806cb (DEFAULT_TABLE table=default.Table_4f5dcaf24d054f4a9d0ccca5ae5bb787 [id=3064ae1d0b5b413d8eaa60322e709817]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.323030 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5775e6715f5644239239b6c143f806cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.323979 10375 ts_tablet_manager.cc:1929] T 320e42f6de6c4452adb7bbb379a156e6 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:12.324095 10375 log.cc:1199] T 320e42f6de6c4452adb7bbb379a156e6 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/320e42f6de6c4452adb7bbb379a156e6
I20260810 19:48:12.324514 10375 ts_tablet_manager.cc:1950] T 320e42f6de6c4452adb7bbb379a156e6 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:12.325361 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 960) took 1616 ms. Trace:
I20260810 19:48:12.325464 10375 rpcz_store.cc:276] 0810 19:48:10.708996 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:10.718392 (+ 9396us) service_pool.cc:224] Handling call
0810 19:48:12.316086 (+1597694us) ts_tablet_manager.cc:1151] Deleting tablet 320e42f6de6c4452adb7bbb379a156e6
0810 19:48:12.316097 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.320779 (+ 4682us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.323916 (+ 3137us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.325332 (+ 1416us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1593499}
I20260810 19:48:12.325817 10375 tablet_replica.cc:333] T f3600d0528164850973cb296aaf6910f P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:12.326005 10375 raft_consensus.cc:2243] T f3600d0528164850973cb296aaf6910f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.326041 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 320e42f6de6c4452adb7bbb379a156e6 (table default.Table_d53c7e2836b143eab54246ed5e0de77e [id=5354f5d091794b14806dd9bc872da0ae]) successfully deleted
I20260810 19:48:12.326160 10375 raft_consensus.cc:2272] T f3600d0528164850973cb296aaf6910f P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.326717 10375 ts_tablet_manager.cc:1916] T f3600d0528164850973cb296aaf6910f P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.328204 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 5775e6715f5644239239b6c143f806cb (DEFAULT_TABLE table=default.Table_4f5dcaf24d054f4a9d0ccca5ae5bb787 [id=3064ae1d0b5b413d8eaa60322e709817]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.321550 12975 tablet.cc:1724] T 5576e9087855441498904bc59685a442 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:12.328608 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5775e6715f5644239239b6c143f806cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.334875 10370 tablet_bootstrap.cc:492] T f3e3dde1c29e4275bafb27df63b117be P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:12.336369 10370 ts_tablet_manager.cc:1403] T f3e3dde1c29e4275bafb27df63b117be P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.068s user 0.010s sys 0.011s
I20260810 19:48:12.282446 10366 tablet_bootstrap.cc:492] T 5aa0f24443a34714a44137a77c12bbc3 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:12.340451 10370 raft_consensus.cc:359] T f3e3dde1c29e4275bafb27df63b117be P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.340826 10366 tablet_bootstrap.cc:654] T 5aa0f24443a34714a44137a77c12bbc3 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:12.341781 10370 raft_consensus.cc:385] T f3e3dde1c29e4275bafb27df63b117be P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:12.342033 10370 raft_consensus.cc:740] T f3e3dde1c29e4275bafb27df63b117be P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:12.342607 10370 consensus_queue.cc:260] T f3e3dde1c29e4275bafb27df63b117be P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.343724 10370 ts_tablet_manager.cc:1434] T f3e3dde1c29e4275bafb27df63b117be P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260810 19:48:12.344496 10370 tablet_bootstrap.cc:492] T d6f410a1659c40f08ac274e63ad01b3d P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:12.350559 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 27c75f3340e24fe1a10de5bd6bcdfb2f (DEFAULT_TABLE table=default.Table_47b60293596b47298fd66de06fff3f84 [id=6f28f38ede6e4e61b2df497c676858f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.350610 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 27c75f3340e24fe1a10de5bd6bcdfb2f (DEFAULT_TABLE table=default.Table_47b60293596b47298fd66de06fff3f84 [id=6f28f38ede6e4e61b2df497c676858f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.351518 10366 tablet_bootstrap.cc:492] T 5aa0f24443a34714a44137a77c12bbc3 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:12.351671 10366 ts_tablet_manager.cc:1403] T 5aa0f24443a34714a44137a77c12bbc3 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.069s user 0.003s sys 0.000s
I20260810 19:48:12.352533 10366 raft_consensus.cc:359] T 5aa0f24443a34714a44137a77c12bbc3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.352730 10366 raft_consensus.cc:385] T 5aa0f24443a34714a44137a77c12bbc3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:12.352790 10366 raft_consensus.cc:740] T 5aa0f24443a34714a44137a77c12bbc3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:12.352842 11937 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43944 (request call id 1) took 1047 ms. Trace:
I20260810 19:48:12.282047 10377 ts_tablet_manager.cc:1929] T 60bd14fb8c2e40dc955352518d463ccb P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.353073 10377 log.cc:1199] T 60bd14fb8c2e40dc955352518d463ccb P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/60bd14fb8c2e40dc955352518d463ccb
I20260810 19:48:12.353404 10377 ts_tablet_manager.cc:1950] T 60bd14fb8c2e40dc955352518d463ccb P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
W20260810 19:48:12.354126 11900 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.8.235.193:41897 (request call id 122) took 1023 ms (client timeout 1000 ms). Trace:
W20260810 19:48:12.354259 11900 rpcz_store.cc:269] 0810 19:48:11.331047 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:11.331326 (+ 279us) service_pool.cc:224] Handling call
0810 19:48:12.352986 (+1021660us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x616000060a54. stack: 00007f041f6e7326 00007f041f6e70e0 00007f041e71134d 00000000009a5774 00000000009a573d 00007f042ec6665d 00007f042ec66753 00007f042b7ebac1 00007f04335c540d 00007f043374e358 00007f042a1391f6 00007f042a138f25 00007f042682a61e 00007f04268294fe 00007f042682f738 00007f042683009f
0810 19:48:12.354062 (+ 1076us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2347707648}
W20260810 19:48:12.355700 11901 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.8.235.194:52449 (request call id 97) took 1013 ms (client timeout 1000 ms). Trace:
I20260810 19:48:12.355715 9412 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 18cd8adaa065425c846bc791c05fa67d (table default.Table_a1645668cf79415ca029a01169fbf874 [id=aec405416e584af6bfb8194b357d6dbc]). Expected version 3 got 0
W20260810 19:48:12.355796 11901 rpcz_store.cc:269] 0810 19:48:11.341738 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:11.341817 (+ 79us) service_pool.cc:224] Handling call
0810 19:48:12.354880 (+1013063us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x616000060a54. stack: 00007f041f6e7326 00007f041f6e70e0 00007f041e71134d 00000000009a5774 00000000009a573d 00007f042ec6665d 00007f042ec66753 00007f042b7ebac1 00007f04335c540d 00007f043374e358 00007f042a1391f6 00007f042a138f25 00007f042682a61e 00007f04268294fe 00007f042682f738 00007f042683009f
0810 19:48:12.355637 (+ 757us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2328458496}
W20260810 19:48:12.357728 11903 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.8.235.195:41231 (request call id 91) took 1011 ms (client timeout 1000 ms). Trace:
W20260810 19:48:12.357848 11903 rpcz_store.cc:269] 0810 19:48:11.345750 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:11.345808 (+ 58us) service_pool.cc:224] Handling call
0810 19:48:12.356698 (+1010890us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x616000060a54. stack: 00007f041f6e7326 00007f041f6e70e0 00007f041e71134d 00000000009a5774 00000000009a573d 00007f042ec6665d 00007f042ec66753 00007f042b7ebac1 00007f04335c540d 00007f043374e358 00007f042a1391f6 00007f042a138f25 00007f042682a61e 00007f04268294fe 00007f042682f738 00007f042683009f
0810 19:48:12.357661 (+ 963us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2323478272}
W20260810 19:48:12.358292 9398 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 651d224a2957465f889cce7408dffa45 (table default.Table_6a546246efe3460f99c4f33556ba10a6 [id=99495eea31fc4581afa7ac7cdbc074ed], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 651d224a2957465f889cce7408dffa45 consensus state has no leader
I20260810 19:48:12.359437 10367 tablet_bootstrap.cc:492] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:12.359601 10367 ts_tablet_manager.cc:1403] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.129s user 0.018s sys 0.015s
I20260810 19:48:12.359768 12928 raft_consensus.cc:493] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c56283079e74549afd0096f7e72046a)
I20260810 19:48:12.359949 12928 raft_consensus.cc:515] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } }
I20260810 19:48:12.360451 10367 raft_consensus.cc:359] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.360651 10367 raft_consensus.cc:385] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:12.360728 10367 raft_consensus.cc:740] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:12.360989 12928 leader_election.cc:290] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5268e710af3c43ddab70eb7dd1aaa575 (127.8.235.254:33891), 0c56283079e74549afd0096f7e72046a (127.8.235.252:43301)
I20260810 19:48:12.361011 10367 consensus_queue.cc:260] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.362210 10367 ts_tablet_manager.cc:1434] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 19:48:12.363102 10370 tablet_bootstrap.cc:654] T d6f410a1659c40f08ac274e63ad01b3d P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:12.363276 10375 ts_tablet_manager.cc:1929] T f3600d0528164850973cb296aaf6910f P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.364434 10375 log.cc:1199] T f3600d0528164850973cb296aaf6910f P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/f3600d0528164850973cb296aaf6910f
I20260810 19:48:12.364850 10375 ts_tablet_manager.cc:1950] T f3600d0528164850973cb296aaf6910f P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:12.364960 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_02612994a1ec4e07ab667d3b965e6fe8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.365657 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02612994a1ec4e07ab667d3b965e6fe8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.365995 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 964) took 1550 ms. Trace:
I20260810 19:48:12.366155 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5cf984e484f0410a830b95cecdb057d3" } new_table_name: "default.Table_7ee95575c8bd4022bd40fe7d6071950d" modify_external_catalogs: true
I20260810 19:48:12.366137 10375 rpcz_store.cc:276] 0810 19:48:10.815426 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:10.815975 (+ 549us) service_pool.cc:224] Handling call
0810 19:48:12.325763 (+1509788us) ts_tablet_manager.cc:1151] Deleting tablet f3600d0528164850973cb296aaf6910f
0810 19:48:12.325776 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.337098 (+ 11322us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.358626 (+ 21528us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.365968 (+ 7342us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1507595}
I20260810 19:48:12.366541 10375 tablet_replica.cc:333] T a78960e1f2164c848297411b9273ac64 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:12.366700 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet e1993fe2402f485481c36a5b41ba2571
I20260810 19:48:12.366726 10375 raft_consensus.cc:2243] T a78960e1f2164c848297411b9273ac64 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.367470 9435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f52c40e347e24ab4b3129e7064f4a43e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1238 } } ignore_live_leader: false dest_uuid: "0c56283079e74549afd0096f7e72046a" is_pre_election: true
I20260810 19:48:12.367739 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet f3600d0528164850973cb296aaf6910f (table default.Table_a02900865d894a1dbfdb42b50ca8ebbf [id=d772b7f40fc3470ebbfe9442d8c44185]) successfully deleted
I20260810 19:48:12.367810 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet e1993fe2402f485481c36a5b41ba2571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:12.368556 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet e1993fe2402f485481c36a5b41ba2571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:12.369071 10375 raft_consensus.cc:2272] T a78960e1f2164c848297411b9273ac64 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.369578 10788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f52c40e347e24ab4b3129e7064f4a43e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1238 } } ignore_live_leader: false dest_uuid: "5268e710af3c43ddab70eb7dd1aaa575" is_pre_election: true
I20260810 19:48:12.369724 10375 ts_tablet_manager.cc:1916] T a78960e1f2164c848297411b9273ac64 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.371408 11833 leader_election.cc:304] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f52c40e347e24ab4b3129e7064f4a43e; no voters: 0c56283079e74549afd0096f7e72046a, 5268e710af3c43ddab70eb7dd1aaa575
I20260810 19:48:12.372015 12928 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 19:48:12.373646 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet e1993fe2402f485481c36a5b41ba2571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.373903 9415 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet f3e3dde1c29e4275bafb27df63b117be (table default.Table_da45ba37a0804616b521723bc724e0f0 [id=d5afb5c8b2d042e5aec4a0721e2cae1d]). Expected version 1 got 0
I20260810 19:48:12.376691 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5775e6715f5644239239b6c143f806cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.377496 10370 tablet_bootstrap.cc:492] T d6f410a1659c40f08ac274e63ad01b3d P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:12.377732 10370 ts_tablet_manager.cc:1403] T d6f410a1659c40f08ac274e63ad01b3d P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.003s
I20260810 19:48:12.377899 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_4d5e244280274336986ed743fd862073"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.378542 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d5e244280274336986ed743fd862073 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.378693 10370 raft_consensus.cc:359] T d6f410a1659c40f08ac274e63ad01b3d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.378865 10370 raft_consensus.cc:385] T d6f410a1659c40f08ac274e63ad01b3d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:12.378918 10370 raft_consensus.cc:740] T d6f410a1659c40f08ac274e63ad01b3d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:12.379181 10370 consensus_queue.cc:260] T d6f410a1659c40f08ac274e63ad01b3d P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.381983 10370 ts_tablet_manager.cc:1434] T d6f410a1659c40f08ac274e63ad01b3d P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20260810 19:48:12.383507 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 04efdb236d4647098c89c90a593a0269 consensus state has no leader
I20260810 19:48:12.384337 10375 ts_tablet_manager.cc:1929] T a78960e1f2164c848297411b9273ac64 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.384472 10375 log.cc:1199] T a78960e1f2164c848297411b9273ac64 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/a78960e1f2164c848297411b9273ac64
I20260810 19:48:12.384469 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27c75f3340e24fe1a10de5bd6bcdfb2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.384806 10375 ts_tablet_manager.cc:1950] T a78960e1f2164c848297411b9273ac64 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:12.387089 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3fd0fd1fa532480fb2a10e99a8835b4c" } modify_external_catalogs: true
I20260810 19:48:12.387274 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3fd0fd1fa532480fb2a10e99a8835b4c" } modify_external_catalogs: true
I20260810 19:48:12.392026 10370 tablet_bootstrap.cc:492] T 60bd14fb8c2e40dc955352518d463ccb P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:12.393016 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 27c75f3340e24fe1a10de5bd6bcdfb2f (DEFAULT_TABLE table=default.Table_47b60293596b47298fd66de06fff3f84 [id=6f28f38ede6e4e61b2df497c676858f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.393504 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet d6f410a1659c40f08ac274e63ad01b3d with delete_type TABLET_DATA_DELETED (replaced by tablet 60798f21222443c69bacf4a799a33c8f) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.393860 10370 tablet_bootstrap.cc:654] T 60bd14fb8c2e40dc955352518d463ccb P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:12.394136 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 60bd14fb8c2e40dc955352518d463ccb (table default.Table_e9290dde7b6e467584d7cdf7b0ceae58 [id=72ed9704a69b4a26a1edd95ad525650a]) successfully deleted
I20260810 19:48:12.394490 10377 tablet_replica.cc:333] T 31c2b9a4b8334e678b4632fc2f58dd0c P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:12.394711 10377 raft_consensus.cc:2243] T 31c2b9a4b8334e678b4632fc2f58dd0c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.394876 10377 raft_consensus.cc:2272] T 31c2b9a4b8334e678b4632fc2f58dd0c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.395426 10377 ts_tablet_manager.cc:1916] T 31c2b9a4b8334e678b4632fc2f58dd0c P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.398115 10165 raft_consensus.cc:3060] T 18cd8adaa065425c846bc791c05fa67d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:12.393518 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27c75f3340e24fe1a10de5bd6bcdfb2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.400208 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 65605d404d42467ab6d7eabc8b685c3e
I20260810 19:48:12.401976 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 65605d404d42467ab6d7eabc8b685c3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.403820 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_11b9e297e91844cebe879c69f2b920b9" } new_table_name: "default.Table_115f2de9cd804bc3b8545a019c488f92" modify_external_catalogs: true
I20260810 19:48:12.404044 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 65605d404d42467ab6d7eabc8b685c3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:12.404263 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet 65605d404d42467ab6d7eabc8b685c3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:12.405110 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27c75f3340e24fe1a10de5bd6bcdfb2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.407485 10366 consensus_queue.cc:260] T 5aa0f24443a34714a44137a77c12bbc3 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.408151 10366 ts_tablet_manager.cc:1434] T 5aa0f24443a34714a44137a77c12bbc3 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.056s user 0.001s sys 0.000s
I20260810 19:48:12.408504 10366 tablet_bootstrap.cc:492] T 988d87b2b00a459d9afc44ba0ae1961e P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
W20260810 19:48:12.409480 9831 consensus_peers.cc:597] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3bf9486839474b2a8ddff3a49b4fda2a. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:12.410215 10366 tablet_bootstrap.cc:654] T 988d87b2b00a459d9afc44ba0ae1961e P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:12.412463 12941 raft_consensus.cc:493] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:12.412649 12941 raft_consensus.cc:515] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.413427 12941 leader_election.cc:290] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:12.414908 12982 tablet.cc:1724] T 18cd8adaa065425c846bc791c05fa67d P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 19:48:12.419072 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ff4cce4dbac7415ab706547dbfdd5af4" } new_table_name: "default.Table_fd734e953f924647a5c7420cb79e08d7" modify_external_catalogs: true
I20260810 19:48:12.421036 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c99b8dcecc604805abab5632c6a9a490" } new_table_name: "default.Table_ee877dee1af74132be28860b7695ff9d" modify_external_catalogs: true
I20260810 19:48:12.417392 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f1c7a75aac4d6a9462af4def91eaa4" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:12.423229 12266 tablet_replica.cc:333] T 38b0c6a017dc4afc849090cca7ee8b26 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:12.423504 12266 raft_consensus.cc:2243] T 38b0c6a017dc4afc849090cca7ee8b26 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.418955 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 972) took 1433 ms. Trace:
I20260810 19:48:12.423705 12266 raft_consensus.cc:2272] T 38b0c6a017dc4afc849090cca7ee8b26 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.423630 10375 rpcz_store.cc:276] 0810 19:48:10.985929 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:10.985989 (+ 60us) service_pool.cc:224] Handling call
0810 19:48:12.366491 (+1380502us) ts_tablet_manager.cc:1151] Deleting tablet a78960e1f2164c848297411b9273ac64
0810 19:48:12.366503 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.373199 (+ 6696us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.384272 (+ 11073us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.418926 (+ 34654us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1380280}
W20260810 19:48:12.424075 9611 leader_election.cc:343] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:12.424151 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet a78960e1f2164c848297411b9273ac64 (table default.Table_21d8962dbe56454188c9a5b8729034c3 [id=d277a804313e4f35a31b58d4f682efe6]) successfully deleted
I20260810 19:48:12.424329 12266 ts_tablet_manager.cc:1916] T 38b0c6a017dc4afc849090cca7ee8b26 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.424491 10375 tablet_replica.cc:333] T 39885c3e0adb4132945d507628f4f082 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:12.424685 10375 raft_consensus.cc:2243] T 39885c3e0adb4132945d507628f4f082 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.424814 10375 raft_consensus.cc:2272] T 39885c3e0adb4132945d507628f4f082 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.425348 10375 ts_tablet_manager.cc:1916] T 39885c3e0adb4132945d507628f4f082 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.426680 10367 tablet_bootstrap.cc:492] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:12.426890 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 59a767c91abf45e79cebab582525ad2e (table default.Table_32e6a45ca640436c8efef8fa31883db9 [id=d7ca25dd070e4a8ab702a123925bc985]) successfully deleted
I20260810 19:48:12.428476 10367 tablet_bootstrap.cc:654] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:12.430774 10153 raft_consensus.cc:3060] T f3e3dde1c29e4275bafb27df63b117be P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:12.432994 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6e6e84d564374432900236d3124c5094" } new_table_name: "default.Table_fd1701e5b67e4e7886261e68ecf09221" modify_external_catalogs: true
I20260810 19:48:12.438899 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_db92859a63cc4b6290e90e5b7d4ef344"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.439536 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db92859a63cc4b6290e90e5b7d4ef344 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.441165 12984 tablet.cc:1724] T 5576e9087855441498904bc59685a442 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:12.443089 12266 ts_tablet_manager.cc:1929] T 38b0c6a017dc4afc849090cca7ee8b26 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.443903 10370 tablet_bootstrap.cc:492] T 60bd14fb8c2e40dc955352518d463ccb P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:12.444083 10370 ts_tablet_manager.cc:1403] T 60bd14fb8c2e40dc955352518d463ccb P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.052s user 0.004s sys 0.000s
I20260810 19:48:12.445134 10370 raft_consensus.cc:359] T 60bd14fb8c2e40dc955352518d463ccb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.445245 12266 log.cc:1199] T 38b0c6a017dc4afc849090cca7ee8b26 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/38b0c6a017dc4afc849090cca7ee8b26
I20260810 19:48:12.445325 10370 raft_consensus.cc:385] T 60bd14fb8c2e40dc955352518d463ccb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:12.445377 10370 raft_consensus.cc:740] T 60bd14fb8c2e40dc955352518d463ccb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:12.445931 12266 ts_tablet_manager.cc:1950] T 38b0c6a017dc4afc849090cca7ee8b26 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:12.448585 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 38b0c6a017dc4afc849090cca7ee8b26 (table default.Table_9c7e78bf368c4d99bca05e9fc4dfcbda [id=df9ef32c15fd46caab42b0a0214afd64]) successfully deleted
I20260810 19:48:12.449841 10375 ts_tablet_manager.cc:1929] T 39885c3e0adb4132945d507628f4f082 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.449975 10375 log.cc:1199] T 39885c3e0adb4132945d507628f4f082 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/39885c3e0adb4132945d507628f4f082
I20260810 19:48:12.449890 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_305d8142bffd45bdb498f6fb78548315"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:12.450300 10375 ts_tablet_manager.cc:1950] T 39885c3e0adb4132945d507628f4f082 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:12.450301 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_897f0a603fed42b6b45f1b9d730491d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.450524 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_305d8142bffd45bdb498f6fb78548315 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.450845 12266 tablet_replica.cc:333] T d7595dbb46b6441dbb811611da116791 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
W20260810 19:48:12.450861 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_897f0a603fed42b6b45f1b9d730491d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.451299 12266 raft_consensus.cc:2243] T d7595dbb46b6441dbb811611da116791 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.451810 12266 raft_consensus.cc:2272] T d7595dbb46b6441dbb811611da116791 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.452445 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 974) took 1227 ms. Trace:
I20260810 19:48:12.452535 10375 rpcz_store.cc:276] 0810 19:48:11.224910 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:11.228285 (+ 3375us) service_pool.cc:224] Handling call
0810 19:48:12.424432 (+1196147us) ts_tablet_manager.cc:1151] Deleting tablet 39885c3e0adb4132945d507628f4f082
0810 19:48:12.424445 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.436873 (+ 12428us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.449767 (+ 12894us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.452422 (+ 2655us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1195975}
I20260810 19:48:12.452893 10375 tablet_replica.cc:333] T 4c75af1e592042f5a4d442b82a539c94 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:12.453096 10375 raft_consensus.cc:2243] T 4c75af1e592042f5a4d442b82a539c94 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.453258 10375 raft_consensus.cc:2272] T 4c75af1e592042f5a4d442b82a539c94 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.453243 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 9e967dc514614a59bf123098a9255e94 (DEFAULT_TABLE table=default.Table_a58aa5218e0f45bda94dcc2410503f08 [id=26d06b8d64d94b50863cf42ac5f12617]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.453634 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e967dc514614a59bf123098a9255e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.453886 10375 ts_tablet_manager.cc:1916] T 4c75af1e592042f5a4d442b82a539c94 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.454445 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 39885c3e0adb4132945d507628f4f082 (table default.Table_2502bd78450e4b1b940e7f64a514dc85 [id=76cdf98e49ae4acb8b64ca07d0e28e8c]) successfully deleted
I20260810 19:48:12.454453 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e2cacf22254c483cb65f6d2b79a4f541" } modify_external_catalogs: true
I20260810 19:48:12.454779 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e2cacf22254c483cb65f6d2b79a4f541" } modify_external_catalogs: true
I20260810 19:48:12.457278 12266 ts_tablet_manager.cc:1916] T d7595dbb46b6441dbb811611da116791 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.456313 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 9e967dc514614a59bf123098a9255e94 (DEFAULT_TABLE table=default.Table_a58aa5218e0f45bda94dcc2410503f08 [id=26d06b8d64d94b50863cf42ac5f12617]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.459713 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e967dc514614a59bf123098a9255e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.460355 10375 ts_tablet_manager.cc:1929] T 4c75af1e592042f5a4d442b82a539c94 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.460482 10375 log.cc:1199] T 4c75af1e592042f5a4d442b82a539c94 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/4c75af1e592042f5a4d442b82a539c94
I20260810 19:48:12.460825 10375 ts_tablet_manager.cc:1950] T 4c75af1e592042f5a4d442b82a539c94 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:12.461664 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 973) took 1236 ms. Trace:
I20260810 19:48:12.461766 10375 rpcz_store.cc:276] 0810 19:48:11.224801 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:11.231499 (+ 6698us) service_pool.cc:224] Handling call
0810 19:48:12.452843 (+1221344us) ts_tablet_manager.cc:1151] Deleting tablet 4c75af1e592042f5a4d442b82a539c94
0810 19:48:12.452854 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.457129 (+ 4275us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.460296 (+ 3167us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.461639 (+ 1343us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1221070}
I20260810 19:48:12.462242 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 4c75af1e592042f5a4d442b82a539c94 (table default.Table_b15ce9ec2404408f8f8e74743a8cce0d [id=d26dfd722c9448a0a299198ccf217edc]) successfully deleted
I20260810 19:48:12.462756 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 976) took 1212 ms. Trace:
I20260810 19:48:12.462855 10375 rpcz_store.cc:276] 0810 19:48:11.250615 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:11.252582 (+ 1967us) service_pool.cc:224] Handling call
0810 19:48:12.462574 (+1209992us) ts_tablet_manager.cc:1151] Deleting tablet 6d9a7b19ea944e73b38e56a240650dbf
0810 19:48:12.462584 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.462736 (+ 152us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1209797}
W20260810 19:48:12.463322 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 6d9a7b19ea944e73b38e56a240650dbf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d9a7b19ea944e73b38e56a240650dbf already in progress: creating tablet
I20260810 19:48:12.464413 9684 tablet_service.cc:1511] Processing CreateTablet for tablet bd26a2dabb664299aa0738a48dca5b9a (DEFAULT_TABLE table=default.Table_ce3200001a3c49ddbf1783a9db0805f0 [id=9baa95c4d23946c1908d0181dcd6468f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.464635 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 977) took 1201 ms. Trace:
I20260810 19:48:12.464726 10375 rpcz_store.cc:276] 0810 19:48:11.263019 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:11.263097 (+ 78us) service_pool.cc:224] Handling call
0810 19:48:12.464482 (+1201385us) ts_tablet_manager.cc:1151] Deleting tablet bef956a173084e7698a37dddc574ea65
0810 19:48:12.464493 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.464615 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1201177}
I20260810 19:48:12.465114 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd26a2dabb664299aa0738a48dca5b9a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:12.465164 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet bef956a173084e7698a37dddc574ea65 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bef956a173084e7698a37dddc574ea65 already in progress: creating tablet
I20260810 19:48:12.465559 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 978) took 1202 ms. Trace:
I20260810 19:48:12.465637 10375 rpcz_store.cc:276] 0810 19:48:11.263173 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:11.263226 (+ 53us) service_pool.cc:224] Handling call
0810 19:48:12.465438 (+1202212us) ts_tablet_manager.cc:1151] Deleting tablet 81aabb5656e7472f9223fd7acf10e43c
0810 19:48:12.465447 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.465539 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1202028}
W20260810 19:48:12.466058 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 81aabb5656e7472f9223fd7acf10e43c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81aabb5656e7472f9223fd7acf10e43c already in progress: creating tablet
I20260810 19:48:12.466449 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 975) took 1221 ms. Trace:
I20260810 19:48:12.466516 10375 rpcz_store.cc:276] 0810 19:48:11.244808 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:11.281543 (+ 36735us) service_pool.cc:224] Handling call
0810 19:48:12.466304 (+1184761us) ts_tablet_manager.cc:1151] Deleting tablet 7459e64bd48449d2a8d4ff835b215d46
0810 19:48:12.466344 (+ 40us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.466432 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1183546}
W20260810 19:48:12.466890 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 7459e64bd48449d2a8d4ff835b215d46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7459e64bd48449d2a8d4ff835b215d46 already in progress: creating tablet
W20260810 19:48:12.467459 9395 catalog_manager.cc:5017] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 0bddaf5b5fc1404e83b079ffa97e7321 because the tablet was not found. No further retry: Not found: Tablet not found: 0bddaf5b5fc1404e83b079ffa97e7321
W20260810 19:48:12.468017 9395 catalog_manager.cc:5017] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 2b2b20dc77954af7a203f357c746be29 because the tablet was not found. No further retry: Not found: Tablet not found: 2b2b20dc77954af7a203f357c746be29
W20260810 19:48:12.468518 9395 catalog_manager.cc:5017] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet dcb3660108094399b36d19ea8e6b8308 because the tablet was not found. No further retry: Not found: Tablet not found: dcb3660108094399b36d19ea8e6b8308
W20260810 19:48:12.469130 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 51d6334e2b174319a809fc9421bb8a77 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51d6334e2b174319a809fc9421bb8a77 already in progress: creating tablet
I20260810 19:48:12.469904 9412 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_b37d211df8744854a90b5ac6475ef6dd [id=51d5f38a702e4bbd932ae4a181eb367d] alter complete (version 1)
W20260810 19:48:12.474668 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 17a0745b87a24e3ca0e3e32c2059f422 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17a0745b87a24e3ca0e3e32c2059f422 already in progress: creating tablet
W20260810 19:48:12.475396 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet f2606854f9954f2ea10610aeb1e60368 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2606854f9954f2ea10610aeb1e60368 already in progress: creating tablet
W20260810 19:48:12.476008 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 2daf9e86dff44999ae8975529cd6014f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2daf9e86dff44999ae8975529cd6014f already in progress: creating tablet
I20260810 19:48:12.476265 10375 tablet_replica.cc:333] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:12.476457 10375 raft_consensus.cc:2243] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.476624 10375 raft_consensus.cc:2272] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.477205 10375 ts_tablet_manager.cc:1916] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.482142 10137 tablet_service.cc:1511] Processing CreateTablet for tablet bd26a2dabb664299aa0738a48dca5b9a (DEFAULT_TABLE table=default.Table_ce3200001a3c49ddbf1783a9db0805f0 [id=9baa95c4d23946c1908d0181dcd6468f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.485818 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd26a2dabb664299aa0738a48dca5b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.488193 10370 consensus_queue.cc:260] T 60bd14fb8c2e40dc955352518d463ccb P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.488897 10370 ts_tablet_manager.cc:1434] T 60bd14fb8c2e40dc955352518d463ccb P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.045s user 0.002s sys 0.000s
I20260810 19:48:12.489300 10370 tablet_bootstrap.cc:492] T 31c2b9a4b8334e678b4632fc2f58dd0c P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:12.491273 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b60a7be0965645f8be9d8b1e3ea458d2" } modify_external_catalogs: true
I20260810 19:48:12.492280 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 25da36714b1d4e89a2c4af713331f4ec (DEFAULT_TABLE table=default.Table_5910df4a049c4ae7a3f91a2b44614751 [id=9d12c7caf8e74671aa5455920f77bda6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.492762 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25da36714b1d4e89a2c4af713331f4ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.493059 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 25da36714b1d4e89a2c4af713331f4ec (DEFAULT_TABLE table=default.Table_5910df4a049c4ae7a3f91a2b44614751 [id=9d12c7caf8e74671aa5455920f77bda6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.493436 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25da36714b1d4e89a2c4af713331f4ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.493793 9664 tablet_service.cc:1511] Processing CreateTablet for tablet e1993fe2402f485481c36a5b41ba2571 (DEFAULT_TABLE table=default.Table_925abe17cfd440bf9b41ed6f51b5e788 [id=fab36ddccafd4a0a8aae5d554df62856]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.494168 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1993fe2402f485481c36a5b41ba2571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.500591 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f1b9a2a5ef6a45d9b4bad8e0c6b1cecb" } modify_external_catalogs: true
I20260810 19:48:12.500895 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f1b9a2a5ef6a45d9b4bad8e0c6b1cecb" } modify_external_catalogs: true
I20260810 19:48:12.503137 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b60a7be0965645f8be9d8b1e3ea458d2" } modify_external_catalogs: true
W20260810 19:48:12.515116 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c6142276b28447b5854a27cd007edb04 consensus state has no leader
W20260810 19:48:12.515549 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ae368e32900e428196d8a7d0098ca7f7 consensus state has no leader
I20260810 19:48:12.515676 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2056fc593131401e9f2f70d9afd76ace"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.515964 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 978695f755c9493db750d81a0c4680f5 consensus state has no leader
W20260810 19:48:12.516270 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2056fc593131401e9f2f70d9afd76ace in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:12.516309 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5dafda5a18bf4c44b8e75dcdee0e9506 consensus state has no leader
I20260810 19:48:12.518812 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet a7d3a90046d74f4087fd5b283581970d
I20260810 19:48:12.520247 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet a7d3a90046d74f4087fd5b283581970d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.521672 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet a7d3a90046d74f4087fd5b283581970d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:12.416751 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f1c7a75aac4d6a9462af4def91eaa4" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:12.434419 12899 consensus_queue.cc:1048] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 19:48:12.522985 9611 leader_election.cc:343] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:12.449467 9890 tablet_service.cc:1511] Processing CreateTablet for tablet 9e967dc514614a59bf123098a9255e94 (DEFAULT_TABLE table=default.Table_a58aa5218e0f45bda94dcc2410503f08 [id=26d06b8d64d94b50863cf42ac5f12617]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.523113 9611 leader_election.cc:304] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:12.523419 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e967dc514614a59bf123098a9255e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.523569 12941 raft_consensus.cc:2749] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:12.464238 9913 tablet_service.cc:1511] Processing CreateTablet for tablet bd26a2dabb664299aa0738a48dca5b9a (DEFAULT_TABLE table=default.Table_ce3200001a3c49ddbf1783a9db0805f0 [id=9baa95c4d23946c1908d0181dcd6468f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.526253 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 3218fa847637435895267dd0980f1e38 (DEFAULT_TABLE table=default.Table_26690c8afd2343e6abeaf8a6a026c2e4 [id=e46e8db6d99649e29862369015bd5bc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.526711 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd26a2dabb664299aa0738a48dca5b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.526741 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3218fa847637435895267dd0980f1e38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.528086 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 81de4b3e05604a34b305ca0ad744d769
I20260810 19:48:12.528944 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 81de4b3e05604a34b305ca0ad744d769 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.529196 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet c01bde86f6d14c4db35f7211b84b7cb9
I20260810 19:48:12.529846 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet c01bde86f6d14c4db35f7211b84b7cb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.530107 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet c01bde86f6d14c4db35f7211b84b7cb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:12.530181 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet 81de4b3e05604a34b305ca0ad744d769 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:12.530364 10118 tablet_service.cc:1511] Processing CreateTablet for tablet e1993fe2402f485481c36a5b41ba2571 (DEFAULT_TABLE table=default.Table_925abe17cfd440bf9b41ed6f51b5e788 [id=fab36ddccafd4a0a8aae5d554df62856]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.481381 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aa0f24443a34714a44137a77c12bbc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:12.530812 10375 ts_tablet_manager.cc:1929] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.530944 10375 log.cc:1199] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/9b40fd0d57ea4b71aeef2d66f4958ac8
I20260810 19:48:12.531270 10375 ts_tablet_manager.cc:1950] T 9b40fd0d57ea4b71aeef2d66f4958ac8 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:12.532114 12705 raft_consensus.cc:493] T 4198f46be0194875aea6a7952321bc69 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:12.532261 12705 raft_consensus.cc:515] T 4198f46be0194875aea6a7952321bc69 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.532899 12705 leader_election.cc:290] T 4198f46be0194875aea6a7952321bc69 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:12.533984 10068 leader_election.cc:343] T 4198f46be0194875aea6a7952321bc69 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 4198f46be0194875aea6a7952321bc69
I20260810 19:48:12.491222 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 25da36714b1d4e89a2c4af713331f4ec (DEFAULT_TABLE table=default.Table_5910df4a049c4ae7a3f91a2b44614751 [id=9d12c7caf8e74671aa5455920f77bda6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.492766 9892 tablet_service.cc:1511] Processing CreateTablet for tablet e1993fe2402f485481c36a5b41ba2571 (DEFAULT_TABLE table=default.Table_925abe17cfd440bf9b41ed6f51b5e788 [id=fab36ddccafd4a0a8aae5d554df62856]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.534812 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25da36714b1d4e89a2c4af713331f4ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.519928 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet a7d3a90046d74f4087fd5b283581970d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:12.535213 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1993fe2402f485481c36a5b41ba2571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.536662 9901 tablet_service.cc:1558] Processing DeleteTablet for tablet c01bde86f6d14c4db35f7211b84b7cb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:12.536662 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 81de4b3e05604a34b305ca0ad744d769 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:12.538662 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 3218fa847637435895267dd0980f1e38 (DEFAULT_TABLE table=default.Table_26690c8afd2343e6abeaf8a6a026c2e4 [id=e46e8db6d99649e29862369015bd5bc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.539108 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3218fa847637435895267dd0980f1e38. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:12.542541 10067 leader_election.cc:343] T 4198f46be0194875aea6a7952321bc69 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 4198f46be0194875aea6a7952321bc69
I20260810 19:48:12.542693 10067 leader_election.cc:304] T 4198f46be0194875aea6a7952321bc69 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:12.543201 12705 raft_consensus.cc:2749] T 4198f46be0194875aea6a7952321bc69 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:12.549911 12899 consensus_queue.cc:1048] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:12.558696 9420 master_service.cc:960] ReplaceTablet: received request to replace tablet b8ad239a5d4a410581d93b66d3982120 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:12.559370 10367 tablet_bootstrap.cc:492] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:12.559535 10367 ts_tablet_manager.cc:1403] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.133s user 0.002s sys 0.010s
I20260810 19:48:12.567539 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet b8ad239a5d4a410581d93b66d3982120
I20260810 19:48:12.568106 9420 catalog_manager.cc:6807] ReplaceTablet: tablet b8ad239a5d4a410581d93b66d3982120 deleted and replaced by tablet 4e5022d4d6524352be3e461cfa170ccc
I20260810 19:48:12.568861 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet b8ad239a5d4a410581d93b66d3982120 with delete_type TABLET_DATA_DELETED (replaced by tablet 4e5022d4d6524352be3e461cfa170ccc) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:12.569005 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet b8ad239a5d4a410581d93b66d3982120 with delete_type TABLET_DATA_DELETED (replaced by tablet 4e5022d4d6524352be3e461cfa170ccc) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.570799 10370 tablet_bootstrap.cc:654] T 31c2b9a4b8334e678b4632fc2f58dd0c P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:12.572796 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6bacbec2a69f41549e72fa5a46246b11" } modify_external_catalogs: true
I20260810 19:48:12.573043 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6bacbec2a69f41549e72fa5a46246b11" } modify_external_catalogs: true
I20260810 19:48:12.575516 10367 raft_consensus.cc:359] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.576215 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet b8ad239a5d4a410581d93b66d3982120 with delete_type TABLET_DATA_DELETED (replaced by tablet 4e5022d4d6524352be3e461cfa170ccc) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:12.581620 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_8e32d50c139a4e4f96de1c5580964bf9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.582270 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e32d50c139a4e4f96de1c5580964bf9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.582286 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 60c45125545340059d49b5faa8025c73
I20260810 19:48:12.585284 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet 60c45125545340059d49b5faa8025c73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:12.585647 10367 raft_consensus.cc:385] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:12.585774 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet 60c45125545340059d49b5faa8025c73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:12.585965 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0d164894b2e9487bb8bfbd80407e3ec5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:12.586342 10367 raft_consensus.cc:740] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
W20260810 19:48:12.586715 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d164894b2e9487bb8bfbd80407e3ec5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.587265 10367 consensus_queue.cc:260] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.589977 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_115f2de9cd804bc3b8545a019c488f92" } new_table_name: "default.Table_33004c19de4046e492e156e63819d5ec" modify_external_catalogs: true
I20260810 19:48:12.591010 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a91426db4fba4e90a7fba3cf473ed1e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.591534 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a91426db4fba4e90a7fba3cf473ed1e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.595165 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_4458e0094c7a4f2fbe18a9101886249d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.595858 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4458e0094c7a4f2fbe18a9101886249d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.598778 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_10672eb0663b47feafccbbfe7d561940"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.599298 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10672eb0663b47feafccbbfe7d561940 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.600816 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_410ce6c736c14fa39121fc3c487ee2ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.601285 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_410ce6c736c14fa39121fc3c487ee2ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.602732 9418 master_service.cc:960] ReplaceTablet: received request to replace tablet c9e2dbef6e7a48caa2964ab90fbf9b73 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:12.605809 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4dd3d4c4497546b28df06251099213a0" } modify_external_catalogs: true
I20260810 19:48:12.606073 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4dd3d4c4497546b28df06251099213a0" } modify_external_catalogs: true
W20260810 19:48:12.609992 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c6142276b28447b5854a27cd007edb04 consensus state has no leader
I20260810 19:48:12.577646 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1993fe2402f485481c36a5b41ba2571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.579429 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 983) took 1085 ms. Trace:
I20260810 19:48:12.612514 10375 rpcz_store.cc:276] 0810 19:48:11.493736 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:11.596501 (+102765us) service_pool.cc:224] Handling call
0810 19:48:12.476218 (+879717us) ts_tablet_manager.cc:1151] Deleting tablet 9b40fd0d57ea4b71aeef2d66f4958ac8
0810 19:48:12.476227 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.481917 (+ 5690us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.529259 (+ 47342us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.579402 (+ 50143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":879502}
I20260810 19:48:12.612834 10377 ts_tablet_manager.cc:1929] T 31c2b9a4b8334e678b4632fc2f58dd0c P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.612946 10375 tablet_replica.cc:333] T 0e967384768b4ec7956f1b508e8ab2af P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:12.612978 10377 log.cc:1199] T 31c2b9a4b8334e678b4632fc2f58dd0c P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/31c2b9a4b8334e678b4632fc2f58dd0c
I20260810 19:48:12.613147 10375 raft_consensus.cc:2243] T 0e967384768b4ec7956f1b508e8ab2af P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.613319 10377 ts_tablet_manager.cc:1950] T 31c2b9a4b8334e678b4632fc2f58dd0c P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:12.613337 10375 raft_consensus.cc:2272] T 0e967384768b4ec7956f1b508e8ab2af P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.613921 10375 ts_tablet_manager.cc:1916] T 0e967384768b4ec7956f1b508e8ab2af P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.614500 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 31c2b9a4b8334e678b4632fc2f58dd0c (table default.Table_05b1dcc5bf9f412c87505d19c57d7025 [id=a6004b573d3e47feb446328fa64530f4]) successfully deleted
W20260810 19:48:12.616328 10067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 73807.3us
I20260810 19:48:12.617718 12989 raft_consensus.cc:493] T 60bd14fb8c2e40dc955352518d463ccb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:12.617944 12989 raft_consensus.cc:515] T 60bd14fb8c2e40dc955352518d463ccb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.585587 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 60c45125545340059d49b5faa8025c73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.618475 9898 tablet_service.cc:1511] Processing CreateTablet for tablet a761dc4c01d34b6db2d33655ec6f7dd3 (DEFAULT_TABLE table=default.Table_78b342a2c7134ba3a33ee9b59859ccb7 [id=86dadda4fd564248af8699824fd1a701]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.618893 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a761dc4c01d34b6db2d33655ec6f7dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.619243 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 3218fa847637435895267dd0980f1e38 (DEFAULT_TABLE table=default.Table_26690c8afd2343e6abeaf8a6a026c2e4 [id=e46e8db6d99649e29862369015bd5bc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.612272 12705 raft_consensus.cc:493] T 4f21e03993e841ba901f1e9c176309b9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:12.619517 12705 raft_consensus.cc:515] T 4f21e03993e841ba901f1e9c176309b9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:12.619689 10068 leader_election.cc:343] T 60bd14fb8c2e40dc955352518d463ccb P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 60bd14fb8c2e40dc955352518d463ccb
I20260810 19:48:12.620090 12705 leader_election.cc:290] T 4f21e03993e841ba901f1e9c176309b9 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:12.620379 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 9b40fd0d57ea4b71aeef2d66f4958ac8 (table default.Table_b1aaf42f1f01402f9f92aabf33808cd4 [id=27df62a1199844dd88c52fdd4757529c]) successfully deleted
W20260810 19:48:12.620898 10068 leader_election.cc:343] T 4f21e03993e841ba901f1e9c176309b9 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 4f21e03993e841ba901f1e9c176309b9
I20260810 19:48:12.621009 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet 60bd14fb8c2e40dc955352518d463ccb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:53 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.619966 12989 leader_election.cc:290] T 60bd14fb8c2e40dc955352518d463ccb P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:12.622102 9687 tablet_service.cc:1511] Processing CreateTablet for tablet a761dc4c01d34b6db2d33655ec6f7dd3 (DEFAULT_TABLE table=default.Table_78b342a2c7134ba3a33ee9b59859ccb7 [id=86dadda4fd564248af8699824fd1a701]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.622604 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a761dc4c01d34b6db2d33655ec6f7dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.623387 10375 ts_tablet_manager.cc:1929] T 0e967384768b4ec7956f1b508e8ab2af P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.623493 10375 log.cc:1199] T 0e967384768b4ec7956f1b508e8ab2af P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/0e967384768b4ec7956f1b508e8ab2af
I20260810 19:48:12.623783 10375 ts_tablet_manager.cc:1950] T 0e967384768b4ec7956f1b508e8ab2af P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:12.624286 10137 tablet_service.cc:1511] Processing CreateTablet for tablet a761dc4c01d34b6db2d33655ec6f7dd3 (DEFAULT_TABLE table=default.Table_78b342a2c7134ba3a33ee9b59859ccb7 [id=86dadda4fd564248af8699824fd1a701]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.626422 10366 tablet_bootstrap.cc:492] T 988d87b2b00a459d9afc44ba0ae1961e P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:12.626644 10366 ts_tablet_manager.cc:1403] T 988d87b2b00a459d9afc44ba0ae1961e P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.218s user 0.012s sys 0.008s
I20260810 19:48:12.627496 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3218fa847637435895267dd0980f1e38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.627650 10366 raft_consensus.cc:359] T 988d87b2b00a459d9afc44ba0ae1961e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.627825 10366 raft_consensus.cc:385] T 988d87b2b00a459d9afc44ba0ae1961e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:12.627877 10366 raft_consensus.cc:740] T 988d87b2b00a459d9afc44ba0ae1961e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
W20260810 19:48:12.630301 10067 leader_election.cc:343] T 60bd14fb8c2e40dc955352518d463ccb P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 60bd14fb8c2e40dc955352518d463ccb
I20260810 19:48:12.630468 10067 leader_election.cc:304] T 60bd14fb8c2e40dc955352518d463ccb P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:12.628171 10366 consensus_queue.cc:260] T 988d87b2b00a459d9afc44ba0ae1961e P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.631517 10367 ts_tablet_manager.cc:1434] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.072s user 0.003s sys 0.000s
I20260810 19:48:12.631875 10367 tablet_bootstrap.cc:492] T 8d93821ff46a4096a8ebbac83faabed7 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:12.632694 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a761dc4c01d34b6db2d33655ec6f7dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.637027 10366 ts_tablet_manager.cc:1434] T 988d87b2b00a459d9afc44ba0ae1961e P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
I20260810 19:48:12.637363 10366 tablet_bootstrap.cc:492] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:12.640515 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet 988d87b2b00a459d9afc44ba0ae1961e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:12.642868 9410 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet f3e3dde1c29e4275bafb27df63b117be (table default.Table_da45ba37a0804616b521723bc724e0f0 [id=d5afb5c8b2d042e5aec4a0721e2cae1d]). Expected version 1 got 0
I20260810 19:48:12.644392 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 982) took 1150 ms. Trace:
I20260810 19:48:12.644590 10375 rpcz_store.cc:276] 0810 19:48:11.493607 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:11.609292 (+115685us) service_pool.cc:224] Handling call
0810 19:48:12.612886 (+1003594us) ts_tablet_manager.cc:1151] Deleting tablet 0e967384768b4ec7956f1b508e8ab2af
0810 19:48:12.612899 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.617027 (+ 4128us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.623331 (+ 6304us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.644363 (+ 21032us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10162,"tablet-delete.queue_time_us":1003313}
I20260810 19:48:12.645227 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 0e967384768b4ec7956f1b508e8ab2af (table default.Table_5043edeafbb047c6a7619f91323879c2 [id=6287581e5dad45b4b7fd481e9ae5eae3]) successfully deleted
I20260810 19:48:12.645643 10375 tablet_replica.cc:333] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:12.645828 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 5c637a1138ef43f9ac67bb7e72a0ab1b
I20260810 19:48:12.645924 10375 raft_consensus.cc:2243] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.646149 10375 raft_consensus.cc:2272] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.646729 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c637a1138ef43f9ac67bb7e72a0ab1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.647033 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c637a1138ef43f9ac67bb7e72a0ab1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:12.647112 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c637a1138ef43f9ac67bb7e72a0ab1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:12.647550 10375 ts_tablet_manager.cc:1916] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.649917 10367 tablet_bootstrap.cc:654] T 8d93821ff46a4096a8ebbac83faabed7 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:12.644434 10067 leader_election.cc:343] T 4f21e03993e841ba901f1e9c176309b9 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 4f21e03993e841ba901f1e9c176309b9
I20260810 19:48:12.650825 10067 leader_election.cc:304] T 4f21e03993e841ba901f1e9c176309b9 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:12.653658 12705 raft_consensus.cc:2749] T 60bd14fb8c2e40dc955352518d463ccb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:12.653885 12705 raft_consensus.cc:2749] T 4f21e03993e841ba901f1e9c176309b9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:12.654848 12266 ts_tablet_manager.cc:1929] T d7595dbb46b6441dbb811611da116791 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.655539 12266 log.cc:1199] T d7595dbb46b6441dbb811611da116791 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/d7595dbb46b6441dbb811611da116791
I20260810 19:48:12.655980 12266 ts_tablet_manager.cc:1950] T d7595dbb46b6441dbb811611da116791 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:12.656561 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 6704a570c156403fbf8cc3f87df9bd6e (DEFAULT_TABLE table=default.Table_e916b40c39f5472392d206dfce08a8dc [id=7aa1da4aa51f412f97bf04e4be70279a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.657002 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6704a570c156403fbf8cc3f87df9bd6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.657286 10367 tablet_bootstrap.cc:492] T 8d93821ff46a4096a8ebbac83faabed7 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:12.657488 10367 ts_tablet_manager.cc:1403] T 8d93821ff46a4096a8ebbac83faabed7 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.001s
I20260810 19:48:12.658250 10367 raft_consensus.cc:359] T 8d93821ff46a4096a8ebbac83faabed7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.668069 9413 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet f3e3dde1c29e4275bafb27df63b117be (table default.Table_da45ba37a0804616b521723bc724e0f0 [id=d5afb5c8b2d042e5aec4a0721e2cae1d]). Expected version 1 got 0
I20260810 19:48:12.669061 10367 raft_consensus.cc:385] T 8d93821ff46a4096a8ebbac83faabed7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:12.671411 10366 tablet_bootstrap.cc:654] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:12.671000 10367 raft_consensus.cc:740] T 8d93821ff46a4096a8ebbac83faabed7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:12.678874 10367 consensus_queue.cc:260] T 8d93821ff46a4096a8ebbac83faabed7 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.679776 10367 ts_tablet_manager.cc:1434] T 8d93821ff46a4096a8ebbac83faabed7 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260810 19:48:12.680049 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 6704a570c156403fbf8cc3f87df9bd6e (DEFAULT_TABLE table=default.Table_e916b40c39f5472392d206dfce08a8dc [id=7aa1da4aa51f412f97bf04e4be70279a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.680606 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6704a570c156403fbf8cc3f87df9bd6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.680689 10377 tablet_replica.cc:333] T 19e2bf7b7d254894a07c5a75bf24e742 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:12.680914 10377 raft_consensus.cc:2243] T 19e2bf7b7d254894a07c5a75bf24e742 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.681092 10377 raft_consensus.cc:2272] T 19e2bf7b7d254894a07c5a75bf24e742 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.681214 10375 ts_tablet_manager.cc:1929] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260810 19:48:12.681326 10375 log.cc:1199] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/aa5702d7b3bd421eb7b8a4e0f181d2d4
I20260810 19:48:12.681691 10375 ts_tablet_manager.cc:1950] T aa5702d7b3bd421eb7b8a4e0f181d2d4 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:12.681778 10377 ts_tablet_manager.cc:1916] T 19e2bf7b7d254894a07c5a75bf24e742 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.682596 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 999) took 1038 ms. Trace:
I20260810 19:48:12.682693 10375 rpcz_store.cc:276] 0810 19:48:11.644581 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:11.644634 (+ 53us) service_pool.cc:224] Handling call
0810 19:48:12.645583 (+1000949us) ts_tablet_manager.cc:1151] Deleting tablet aa5702d7b3bd421eb7b8a4e0f181d2d4
0810 19:48:12.645595 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.664912 (+ 19317us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.681143 (+ 16231us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.682569 (+ 1426us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1000724}
I20260810 19:48:12.683204 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet aa5702d7b3bd421eb7b8a4e0f181d2d4 (table default.Table_85e674f117d5404eb01680b66429bc7b [id=a837d5f74eac4f74b2029f46d73acc93]) successfully deleted
I20260810 19:48:12.683682 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 1000) took 1032 ms. Trace:
I20260810 19:48:12.683766 10375 rpcz_store.cc:276] 0810 19:48:11.651032 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:11.651728 (+ 696us) service_pool.cc:224] Handling call
0810 19:48:12.683533 (+1031805us) ts_tablet_manager.cc:1151] Deleting tablet 48fa5f075d2749dc80ad5594746d7564
0810 19:48:12.683544 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.683662 (+ 118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1031575}
W20260810 19:48:12.684211 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 48fa5f075d2749dc80ad5594746d7564 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 48fa5f075d2749dc80ad5594746d7564 already in progress: creating tablet
I20260810 19:48:12.684595 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 1001) took 1032 ms. Trace:
I20260810 19:48:12.684660 10375 rpcz_store.cc:276] 0810 19:48:11.652571 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:11.652625 (+ 54us) service_pool.cc:224] Handling call
0810 19:48:12.684470 (+1031845us) ts_tablet_manager.cc:1151] Deleting tablet 49fa134c630d4df4af2d92b0e3f1f498
0810 19:48:12.684480 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.684579 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1031633}
W20260810 19:48:12.685041 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 49fa134c630d4df4af2d92b0e3f1f498 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49fa134c630d4df4af2d92b0e3f1f498 already in progress: creating tablet
I20260810 19:48:12.685381 10375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41610 (request call id 1002) took 1025 ms. Trace:
I20260810 19:48:12.685447 10375 rpcz_store.cc:276] 0810 19:48:11.659832 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:11.670441 (+ 10609us) service_pool.cc:224] Handling call
0810 19:48:12.685268 (+1014827us) ts_tablet_manager.cc:1151] Deleting tablet 028fd8427d824ae89ff035d32548710b
0810 19:48:12.685278 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.685364 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1013242}
W20260810 19:48:12.685809 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 028fd8427d824ae89ff035d32548710b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 028fd8427d824ae89ff035d32548710b already in progress: creating tablet
I20260810 19:48:12.686108 10375 tablet_replica.cc:333] T 648ef608fa0c45cc8be4bad80c4200be P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:12.686299 10375 raft_consensus.cc:2243] T 648ef608fa0c45cc8be4bad80c4200be P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.686462 12993 raft_consensus.cc:493] T 82c3f619c76e40c583bfcdf2bb77fe42 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:12.686503 10375 raft_consensus.cc:2272] T 648ef608fa0c45cc8be4bad80c4200be P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.686580 12993 raft_consensus.cc:515] T 82c3f619c76e40c583bfcdf2bb77fe42 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.687086 10375 ts_tablet_manager.cc:1916] T 648ef608fa0c45cc8be4bad80c4200be P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.690733 10367 tablet_bootstrap.cc:492] T 9ed73161398f4f54a20a9173c18b4d3c P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:12.691083 12993 leader_election.cc:290] T 82c3f619c76e40c583bfcdf2bb77fe42 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:12.691776 10068 leader_election.cc:343] T 82c3f619c76e40c583bfcdf2bb77fe42 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 82c3f619c76e40c583bfcdf2bb77fe42
W20260810 19:48:12.692332 10067 leader_election.cc:343] T 82c3f619c76e40c583bfcdf2bb77fe42 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 82c3f619c76e40c583bfcdf2bb77fe42
I20260810 19:48:12.692399 10367 tablet_bootstrap.cc:654] T 9ed73161398f4f54a20a9173c18b4d3c P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:12.692541 10067 leader_election.cc:304] T 82c3f619c76e40c583bfcdf2bb77fe42 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:12.697947 12677 raft_consensus.cc:493] T ee5f38d91bb349a9ae1da8ba69d2ddbc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:12.698165 12677 raft_consensus.cc:515] T ee5f38d91bb349a9ae1da8ba69d2ddbc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.698426 10375 ts_tablet_manager.cc:1929] T 648ef608fa0c45cc8be4bad80c4200be P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.698559 10375 log.cc:1199] T 648ef608fa0c45cc8be4bad80c4200be P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/648ef608fa0c45cc8be4bad80c4200be
I20260810 19:48:12.698617 12993 raft_consensus.cc:2749] T 82c3f619c76e40c583bfcdf2bb77fe42 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:12.700536 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 6704a570c156403fbf8cc3f87df9bd6e (DEFAULT_TABLE table=default.Table_e916b40c39f5472392d206dfce08a8dc [id=7aa1da4aa51f412f97bf04e4be70279a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.700990 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6704a570c156403fbf8cc3f87df9bd6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.701067 10375 ts_tablet_manager.cc:1950] T 648ef608fa0c45cc8be4bad80c4200be P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:12.702208 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 648ef608fa0c45cc8be4bad80c4200be (table default.Table_63c36107140a41da9c5d337a853cb5d3 [id=d921f4a824ae4dd6b0b9dbb8310ff00a]) successfully deleted
I20260810 19:48:12.702711 10375 tablet_replica.cc:333] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:12.702913 10375 raft_consensus.cc:2243] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:12.703166 10375 pending_rounds.cc:70] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:12.703215 10375 pending_rounds.cc:77] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058731582484480 op_type: NO_OP noop_request { }
I20260810 19:48:12.703326 10375 raft_consensus.cc:2889] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:12.703406 10375 raft_consensus.cc:2272] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.704282 10375 ts_tablet_manager.cc:1916] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.706776 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet d7595dbb46b6441dbb811611da116791 (table default.Table_d2b8c5a92e3d43b89de4938297a90542 [id=43f4ba98204449f6a0902c584b3e7eb2]) successfully deleted
W20260810 19:48:12.707506 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 07856671e97e4f0089cd67f6b8b2ac42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 07856671e97e4f0089cd67f6b8b2ac42 already in progress: creating tablet
I20260810 19:48:12.707813 12266 tablet_replica.cc:333] T 87bbcc651d034e2a826478b805792e48 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:12.708015 12266 raft_consensus.cc:2243] T 87bbcc651d034e2a826478b805792e48 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.708160 12266 raft_consensus.cc:2272] T 87bbcc651d034e2a826478b805792e48 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.708720 12266 ts_tablet_manager.cc:1916] T 87bbcc651d034e2a826478b805792e48 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.710718 10375 ts_tablet_manager.cc:1929] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:12.710850 10375 log.cc:1199] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/827dce05c192467589e2692fabd2a84e
I20260810 19:48:12.711222 10375 ts_tablet_manager.cc:1950] T 827dce05c192467589e2692fabd2a84e P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:12.712426 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 827dce05c192467589e2692fabd2a84e (table default.Table_dca6b457fbf744e089c4a583fca06cbb [id=4bce0610a04641ff86ab3af94e12e31d]) successfully deleted
I20260810 19:48:12.713642 10375 tablet_replica.cc:333] T f85f3fa629764c79921a710739eea7ae P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:12.713838 10375 raft_consensus.cc:2243] T f85f3fa629764c79921a710739eea7ae P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.713973 10375 raft_consensus.cc:2272] T f85f3fa629764c79921a710739eea7ae P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.714505 10375 ts_tablet_manager.cc:1916] T f85f3fa629764c79921a710739eea7ae P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.719300 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c3a2e190a4654d4fbbdcfa31845001f0" } new_table_name: "default.Table_16ef5360f2e14f14854335370de7da9d" modify_external_catalogs: true
I20260810 19:48:12.721515 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4cc3eaea7ccf4c05b30978070f06afdf" } new_table_name: "default.Table_02fdca1f6c7c47eb88164b67837e30ce" modify_external_catalogs: true
I20260810 19:48:12.722525 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_fd734e953f924647a5c7420cb79e08d7" } new_table_name: "default.Table_272c5bdbf1f34804af6051ffc4f2ec5f" modify_external_catalogs: true
I20260810 19:48:12.725452 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_39afeeb5729c4dc8827566b36b0dbc1f" } new_table_name: "default.Table_079c56f5b23049f0bfd2ec3217105ab9" modify_external_catalogs: true
I20260810 19:48:12.725535 10375 ts_tablet_manager.cc:1929] T f85f3fa629764c79921a710739eea7ae P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.725482 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_fa7206e2e20a419cb082d3e4ea0eeeb5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:12.725646 10375 log.cc:1199] T f85f3fa629764c79921a710739eea7ae P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/f85f3fa629764c79921a710739eea7ae
I20260810 19:48:12.725919 10375 ts_tablet_manager.cc:1950] T f85f3fa629764c79921a710739eea7ae P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
W20260810 19:48:12.725979 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa7206e2e20a419cb082d3e4ea0eeeb5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.726089 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b9afcbc98870448c9acc76cbe6c2d12e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.726555 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9afcbc98870448c9acc76cbe6c2d12e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.727008 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet f85f3fa629764c79921a710739eea7ae (table default.Table_aa5df7d93dfb4603b493ab5638468a59 [id=fadd6b8bf2244dfab48fdadb0d12b6fd]) successfully deleted
I20260810 19:48:12.727213 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_6f90d8ae9e154aa5ad31454eabb04b3e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:12.727356 10375 tablet_replica.cc:333] T 4f21e03993e841ba901f1e9c176309b9 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:12.727547 10375 raft_consensus.cc:2243] T 4f21e03993e841ba901f1e9c176309b9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.727679 10375 raft_consensus.cc:2272] T 4f21e03993e841ba901f1e9c176309b9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:12.727716 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f90d8ae9e154aa5ad31454eabb04b3e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.728263 10375 ts_tablet_manager.cc:1916] T 4f21e03993e841ba901f1e9c176309b9 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.734935 10375 ts_tablet_manager.cc:1929] T 4f21e03993e841ba901f1e9c176309b9 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.735085 10375 log.cc:1199] T 4f21e03993e841ba901f1e9c176309b9 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/4f21e03993e841ba901f1e9c176309b9
I20260810 19:48:12.735440 10375 ts_tablet_manager.cc:1950] T 4f21e03993e841ba901f1e9c176309b9 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:12.735896 10370 tablet_bootstrap.cc:492] T 31c2b9a4b8334e678b4632fc2f58dd0c P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:12.736119 10370 ts_tablet_manager.cc:1403] T 31c2b9a4b8334e678b4632fc2f58dd0c P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.247s user 0.003s sys 0.001s
I20260810 19:48:12.736563 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 4f21e03993e841ba901f1e9c176309b9 (table default.Table_a5aa062540ad4b02bf89b59e8ebc8cd7 [id=6c0a50477acc489cb3a3895e7cda4eca]) successfully deleted
I20260810 19:48:12.737174 10370 raft_consensus.cc:359] T 31c2b9a4b8334e678b4632fc2f58dd0c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.737458 10370 raft_consensus.cc:385] T 31c2b9a4b8334e678b4632fc2f58dd0c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:12.737519 10367 tablet_bootstrap.cc:492] T 9ed73161398f4f54a20a9173c18b4d3c P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:12.737649 10370 raft_consensus.cc:740] T 31c2b9a4b8334e678b4632fc2f58dd0c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:12.737731 10367 ts_tablet_manager.cc:1403] T 9ed73161398f4f54a20a9173c18b4d3c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.001s
I20260810 19:48:12.738018 10370 consensus_queue.cc:260] T 31c2b9a4b8334e678b4632fc2f58dd0c P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.738894 10367 raft_consensus.cc:359] T 9ed73161398f4f54a20a9173c18b4d3c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.739130 10367 raft_consensus.cc:385] T 9ed73161398f4f54a20a9173c18b4d3c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:12.739202 10367 raft_consensus.cc:740] T 9ed73161398f4f54a20a9173c18b4d3c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:12.739614 10367 consensus_queue.cc:260] T 9ed73161398f4f54a20a9173c18b4d3c P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:12.740459 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet d857efeee4d3442ca065221e3095d421 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d857efeee4d3442ca065221e3095d421 already in progress: creating tablet
I20260810 19:48:12.741544 10367 ts_tablet_manager.cc:1434] T 9ed73161398f4f54a20a9173c18b4d3c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260810 19:48:12.742105 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e337292d09af43c7877689c7d13490de" } modify_external_catalogs: true
W20260810 19:48:12.742175 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 065536e52b4a477a824ab0261168cbd3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 065536e52b4a477a824ab0261168cbd3 already in progress: creating tablet
I20260810 19:48:12.742285 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e337292d09af43c7877689c7d13490de" } modify_external_catalogs: true
W20260810 19:48:12.742383 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8569d63bbd8e4753b376ee6a5127fd3d consensus state has no leader
I20260810 19:48:12.742584 10375 tablet_replica.cc:333] T 3bf9486839474b2a8ddff3a49b4fda2a P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:12.742739 9416 master_service.cc:960] ReplaceTablet: received request to replace tablet ab5814fc52ab418e8e3701458210d4b6 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:12.742801 10375 raft_consensus.cc:2243] T 3bf9486839474b2a8ddff3a49b4fda2a P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.742995 10375 raft_consensus.cc:2272] T 3bf9486839474b2a8ddff3a49b4fda2a P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.743467 10367 tablet_bootstrap.cc:492] T 985440898cc04a98877c15a5122a7dd3 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
W20260810 19:48:12.743891 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ae368e32900e428196d8a7d0098ca7f7 consensus state has no leader
I20260810 19:48:12.744259 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4d4cbd339a304b6684323ba9e3a91e07" } modify_external_catalogs: true
I20260810 19:48:12.744434 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4d4cbd339a304b6684323ba9e3a91e07" } modify_external_catalogs: true
W20260810 19:48:12.745841 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dc4f30406e8f45caac7031def784e16c consensus state has no leader
I20260810 19:48:12.745936 10375 ts_tablet_manager.cc:1916] T 3bf9486839474b2a8ddff3a49b4fda2a P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.746191 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_305d8142bffd45bdb498f6fb78548315" } modify_external_catalogs: true
I20260810 19:48:12.746385 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_305d8142bffd45bdb498f6fb78548315" } modify_external_catalogs: true
I20260810 19:48:12.747697 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2594ece5242247b5a59bd25aec31ad82"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.748345 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2594ece5242247b5a59bd25aec31ad82 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.749683 10367 tablet_bootstrap.cc:654] T 985440898cc04a98877c15a5122a7dd3 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:12.753634 9412 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet f3e3dde1c29e4275bafb27df63b117be (table default.Table_da45ba37a0804616b521723bc724e0f0 [id=d5afb5c8b2d042e5aec4a0721e2cae1d]). Expected version 1 got 0
I20260810 19:48:12.753996 10375 ts_tablet_manager.cc:1929] T 3bf9486839474b2a8ddff3a49b4fda2a P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:12.754125 10375 log.cc:1199] T 3bf9486839474b2a8ddff3a49b4fda2a P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/3bf9486839474b2a8ddff3a49b4fda2a
I20260810 19:48:12.754630 10375 ts_tablet_manager.cc:1950] T 3bf9486839474b2a8ddff3a49b4fda2a P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:12.754645 9410 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 0292c3214aa84c40ace16760f414d912 (table default.Table_3ca7c069a1d34227aca0af884fac1b5b [id=b3ab2ecf4f4247369ce62adeb445c834]). Expected version 1 got 0
I20260810 19:48:12.755105 9410 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet f3e3dde1c29e4275bafb27df63b117be (table default.Table_da45ba37a0804616b521723bc724e0f0 [id=d5afb5c8b2d042e5aec4a0721e2cae1d]). Expected version 1 got 0
I20260810 19:48:12.757336 10370 ts_tablet_manager.cc:1434] T 31c2b9a4b8334e678b4632fc2f58dd0c P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.021s user 0.001s sys 0.000s
I20260810 19:48:12.759858 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 3bf9486839474b2a8ddff3a49b4fda2a (table default.Table_0bbfea1f106c4df1921c642928671792 [id=d628448cf7b94ebab79194e81fcaf040]) successfully deleted
W20260810 19:48:12.761200 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet b5ec15d8a0d241e3b6238c408d2fb436 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5ec15d8a0d241e3b6238c408d2fb436 already in progress: creating tablet
W20260810 19:48:12.762279 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 625b0e4eedb946908bd00c6af5f06c08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 625b0e4eedb946908bd00c6af5f06c08 already in progress: creating tablet
W20260810 19:48:12.763230 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 4abd3c95aa394e1cad066d49d22b5764 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4abd3c95aa394e1cad066d49d22b5764 already in progress: creating tablet
I20260810 19:48:12.763820 10375 tablet_replica.cc:333] T ca733de7babe4343ab26dbca2c9020b2 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:12.764312 10375 raft_consensus.cc:2243] T ca733de7babe4343ab26dbca2c9020b2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.764833 10375 raft_consensus.cc:2272] T ca733de7babe4343ab26dbca2c9020b2 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.765269 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 0a44b20cd972465290c49536b475510c (DEFAULT_TABLE table=default.Table_6cf0e640c54b4c6aa2a0d1c2f9b7debb [id=67344545cc21406a9c64399e008af284]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.765690 10375 ts_tablet_manager.cc:1916] T ca733de7babe4343ab26dbca2c9020b2 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.765892 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a44b20cd972465290c49536b475510c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.766359 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 0a44b20cd972465290c49536b475510c (DEFAULT_TABLE table=default.Table_6cf0e640c54b4c6aa2a0d1c2f9b7debb [id=67344545cc21406a9c64399e008af284]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.766736 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a44b20cd972465290c49536b475510c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.771603 9687 tablet_service.cc:1511] Processing CreateTablet for tablet bfc3ac0bec4243bc91e2b6a847405d1d (DEFAULT_TABLE table=default.Table_51ca1bcf8aa844e8a0e7d1647c932d94 [id=063e64ec4fde41f8803eec6ee0de7991]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.773783 9890 tablet_service.cc:1511] Processing CreateTablet for tablet 0a44b20cd972465290c49536b475510c (DEFAULT_TABLE table=default.Table_6cf0e640c54b4c6aa2a0d1c2f9b7debb [id=67344545cc21406a9c64399e008af284]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.777316 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet 6ea318eddd8349a79d27ce5746f03798 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:12.778151 10370 tablet_bootstrap.cc:492] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:12.779816 12677 leader_election.cc:290] T ee5f38d91bb349a9ae1da8ba69d2ddbc P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:12.780580 9892 tablet_service.cc:1511] Processing CreateTablet for tablet bfc3ac0bec4243bc91e2b6a847405d1d (DEFAULT_TABLE table=default.Table_51ca1bcf8aa844e8a0e7d1647c932d94 [id=063e64ec4fde41f8803eec6ee0de7991]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.780690 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5f38d91bb349a9ae1da8ba69d2ddbc" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:12.781989 10137 tablet_service.cc:1511] Processing CreateTablet for tablet bfc3ac0bec4243bc91e2b6a847405d1d (DEFAULT_TABLE table=default.Table_51ca1bcf8aa844e8a0e7d1647c932d94 [id=063e64ec4fde41f8803eec6ee0de7991]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.782490 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfc3ac0bec4243bc91e2b6a847405d1d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:12.782712 9830 leader_election.cc:343] T ee5f38d91bb349a9ae1da8ba69d2ddbc P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:12.784559 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 89793065d3eb48ecab1340e7621a40c6 (DEFAULT_TABLE table=default.Table_d1ef74ea96924073acb57beb996e40fd [id=3c9c061c47584e99970c2291e1aaf5a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.791514 10370 tablet_bootstrap.cc:654] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:12.791572 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 89793065d3eb48ecab1340e7621a40c6 (DEFAULT_TABLE table=default.Table_d1ef74ea96924073acb57beb996e40fd [id=3c9c061c47584e99970c2291e1aaf5a4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:12.793473 9831 leader_election.cc:343] T ee5f38d91bb349a9ae1da8ba69d2ddbc P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: ee5f38d91bb349a9ae1da8ba69d2ddbc
I20260810 19:48:12.793537 9412 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet f3e3dde1c29e4275bafb27df63b117be (table default.Table_da45ba37a0804616b521723bc724e0f0 [id=d5afb5c8b2d042e5aec4a0721e2cae1d]). Expected version 1 got 0
I20260810 19:48:12.793623 9831 leader_election.cc:304] T ee5f38d91bb349a9ae1da8ba69d2ddbc P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:12.794829 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfc3ac0bec4243bc91e2b6a847405d1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.794793 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8721298cbe674d2abc25a201da5c09b0" } modify_external_catalogs: true
I20260810 19:48:12.794973 12899 raft_consensus.cc:2749] T ee5f38d91bb349a9ae1da8ba69d2ddbc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:12.795029 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8721298cbe674d2abc25a201da5c09b0" } modify_external_catalogs: true
I20260810 19:48:12.795487 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89793065d3eb48ecab1340e7621a40c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.797746 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a44b20cd972465290c49536b475510c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:12.800710 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 01f778560eb9475da082dec2e2892e9c consensus state has no leader
I20260810 19:48:12.801038 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet d59e5607e4184683bc3924266ed6ca20
I20260810 19:48:12.801205 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet ab5814fc52ab418e8e3701458210d4b6
I20260810 19:48:12.801678 9416 catalog_manager.cc:6807] ReplaceTablet: tablet ab5814fc52ab418e8e3701458210d4b6 deleted and replaced by tablet 5fda32cc65fa49b09067b61d2d2cd581
I20260810 19:48:12.801828 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 7a51811b14da4cddbea05f0cf30aad9b
I20260810 19:48:12.802213 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet ab5814fc52ab418e8e3701458210d4b6 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fda32cc65fa49b09067b61d2d2cd581) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:12.802492 9901 tablet_service.cc:1558] Processing DeleteTablet for tablet d59e5607e4184683bc3924266ed6ca20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:12.802505 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet d59e5607e4184683bc3924266ed6ca20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.802749 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet ab5814fc52ab418e8e3701458210d4b6 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fda32cc65fa49b09067b61d2d2cd581) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.803162 9415 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 5230bf5989f6444e8d353da78b157b84
I20260810 19:48:12.803167 9901 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a51811b14da4cddbea05f0cf30aad9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:12.803589 10377 ts_tablet_manager.cc:1929] T 19e2bf7b7d254894a07c5a75bf24e742 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.803623 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a51811b14da4cddbea05f0cf30aad9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.803700 10377 log.cc:1199] T 19e2bf7b7d254894a07c5a75bf24e742 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/19e2bf7b7d254894a07c5a75bf24e742
I20260810 19:48:12.804013 10377 ts_tablet_manager.cc:1950] T 19e2bf7b7d254894a07c5a75bf24e742 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:12.804721 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89793065d3eb48ecab1340e7621a40c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.806460 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet ab5814fc52ab418e8e3701458210d4b6 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fda32cc65fa49b09067b61d2d2cd581) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:12.806793 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a51811b14da4cddbea05f0cf30aad9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:12.807233 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_4b65055403904f0a8b3ded5be5ffdd4e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.807858 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b65055403904f0a8b3ded5be5ffdd4e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.808377 9413 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet f3e3dde1c29e4275bafb27df63b117be (table default.Table_da45ba37a0804616b521723bc724e0f0 [id=d5afb5c8b2d042e5aec4a0721e2cae1d]). Expected version 1 got 0
I20260810 19:48:12.809700 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ed73161398f4f54a20a9173c18b4d3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:04 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:12.810850 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d93821ff46a4096a8ebbac83faabed7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:12.814041 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 89793065d3eb48ecab1340e7621a40c6 (DEFAULT_TABLE table=default.Table_d1ef74ea96924073acb57beb996e40fd [id=3c9c061c47584e99970c2291e1aaf5a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.814244 9135 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu pid 11541
I20260810 19:48:12.814535 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89793065d3eb48ecab1340e7621a40c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.815515 12677 raft_consensus.cc:493] T 5aa0f24443a34714a44137a77c12bbc3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:12.815661 12677 raft_consensus.cc:515] T 5aa0f24443a34714a44137a77c12bbc3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.816320 12677 leader_election.cc:290] T 5aa0f24443a34714a44137a77c12bbc3 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:12.817549 9831 leader_election.cc:343] T 5aa0f24443a34714a44137a77c12bbc3 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 5aa0f24443a34714a44137a77c12bbc3
I20260810 19:48:12.818238 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa0f24443a34714a44137a77c12bbc3" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:12.818719 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet d59e5607e4184683bc3924266ed6ca20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:12.819420 9830 leader_election.cc:343] T 5aa0f24443a34714a44137a77c12bbc3 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:12.819557 9830 leader_election.cc:304] T 5aa0f24443a34714a44137a77c12bbc3 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:12.819995 12677 raft_consensus.cc:2749] T 5aa0f24443a34714a44137a77c12bbc3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:12.820302 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfc3ac0bec4243bc91e2b6a847405d1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.829402 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 31c2b9a4b8334e678b4632fc2f58dd0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.829577 12941 raft_consensus.cc:493] T 2d72c72f90964f34bbc2232118dc5172 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:12.829804 12941 raft_consensus.cc:515] T 2d72c72f90964f34bbc2232118dc5172 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.830865 12941 leader_election.cc:290] T 2d72c72f90964f34bbc2232118dc5172 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:12.831420 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d72c72f90964f34bbc2232118dc5172" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:12.832050 9611 leader_election.cc:343] T 2d72c72f90964f34bbc2232118dc5172 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:12.832625 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d72c72f90964f34bbc2232118dc5172" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:12.833220 9611 leader_election.cc:343] T 2d72c72f90964f34bbc2232118dc5172 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:12.833329 9611 leader_election.cc:304] T 2d72c72f90964f34bbc2232118dc5172 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:12.833567 12941 raft_consensus.cc:2749] T 2d72c72f90964f34bbc2232118dc5172 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:12.833922 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1055) took 1077 ms. Trace:
I20260810 19:48:12.834041 10377 rpcz_store.cc:276] 0810 19:48:11.756400 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:11.756445 (+ 45us) service_pool.cc:224] Handling call
0810 19:48:12.680614 (+924169us) ts_tablet_manager.cc:1151] Deleting tablet 19e2bf7b7d254894a07c5a75bf24e742
0810 19:48:12.680628 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.788402 (+107774us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.803532 (+ 15130us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.833901 (+ 30369us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":924003}
I20260810 19:48:12.835561 12266 ts_tablet_manager.cc:1929] T 87bbcc651d034e2a826478b805792e48 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.839021 10370 tablet_bootstrap.cc:492] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:12.840581 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 19e2bf7b7d254894a07c5a75bf24e742 (table default.Table_688c01e53a344393b3471974bad3b972 [id=7112ce97719c47919a3d24d1af7d07cd]) successfully deleted
I20260810 19:48:12.841101 10377 tablet_replica.cc:333] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:12.841545 12796 catalog_manager.cc:1295] Loaded cluster ID: 8abb52f4596a48b3a090b657ee482300
I20260810 19:48:12.841732 12796 catalog_manager.cc:1588] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e: loading cluster ID for follower catalog manager: success
I20260810 19:48:12.841952 12266 log.cc:1199] T 87bbcc651d034e2a826478b805792e48 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/87bbcc651d034e2a826478b805792e48
I20260810 19:48:12.842741 10377 raft_consensus.cc:2243] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.842933 10377 raft_consensus.cc:2272] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.843542 10377 ts_tablet_manager.cc:1916] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.843801 10370 ts_tablet_manager.cc:1403] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.066s user 0.002s sys 0.002s
I20260810 19:48:12.844929 10370 raft_consensus.cc:359] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.843406 12266 ts_tablet_manager.cc:1950] T 87bbcc651d034e2a826478b805792e48 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:12.846668 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 87bbcc651d034e2a826478b805792e48 (table default.Table_07cbcdfa939f47f0a8f10f834f5ce596 [id=51fc4051f8ac425e9b6b5f86acf32827]) successfully deleted
I20260810 19:48:12.849021 9913 tablet_service.cc:1511] Processing CreateTablet for tablet a3f48f9bb29b4be6ab6ce167159ae793 (DEFAULT_TABLE table=default.Table_20c0928e4abc4405930a9632cfdc0e8f [id=14a9c177d10d4fb39c9883372ba6542a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.849099 9666 tablet_service.cc:1511] Processing CreateTablet for tablet a3f48f9bb29b4be6ab6ce167159ae793 (DEFAULT_TABLE table=default.Table_20c0928e4abc4405930a9632cfdc0e8f [id=14a9c177d10d4fb39c9883372ba6542a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.849620 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3f48f9bb29b4be6ab6ce167159ae793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.352985 11937 rpcz_store.cc:276] 0810 19:48:11.305038 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:11.305099 (+ 61us) service_pool.cc:224] Handling call
0810 19:48:11.309878 (+ 4779us) raft_consensus.cc:1471] Updating replica for 306 ops
0810 19:48:11.354680 (+ 44802us) raft_consensus.cc:1534] Early marking committed up to index 932
0810 19:48:11.354757 (+ 77us) raft_consensus.cc:1539] Triggering prepare for 306 ops
0810 19:48:11.354903 (+ 146us) write_op.cc:270] Start()
0810 19:48:11.354937 (+ 34us) write_op.cc:276] Timestamp: P: 1786391283230044 usec, L: 0
0810 19:48:11.469677 (+114740us) write_op.cc:270] Start()
0810 19:48:11.469711 (+ 34us) write_op.cc:276] Timestamp: P: 1786391283231875 usec, L: 0
0810 19:48:11.469866 (+ 155us) write_op.cc:270] Start()
0810 19:48:11.469884 (+ 18us) write_op.cc:276] Timestamp: P: 1786391283233640 usec, L: 0
0810 19:48:11.489059 (+ 19175us) write_op.cc:270] Start()
0810 19:48:11.489111 (+ 52us) write_op.cc:276] Timestamp: P: 1786391283237743 usec, L: 0
0810 19:48:11.489376 (+ 265us) write_op.cc:270] Start()
0810 19:48:11.489398 (+ 22us) write_op.cc:276] Timestamp: P: 1786391283239563 usec, L: 0
0810 19:48:11.490027 (+ 629us) write_op.cc:270] Start()
0810 19:48:11.490060 (+ 33us) write_op.cc:276] Timestamp: P: 1786391283248025 usec, L: 0
0810 19:48:11.490243 (+ 183us) write_op.cc:270] Start()
0810 19:48:11.490302 (+ 59us) write_op.cc:276] Timestamp: P: 1786391283251556 usec, L: 0
0810 19:48:11.490543 (+ 241us) write_op.cc:270] Start()
0810 19:48:11.490563 (+ 20us) write_op.cc:276] Timestamp: P: 1786391283364482 usec, L: 0
0810 19:48:11.490717 (+ 154us) write_op.cc:270] Start()
0810 19:48:11.490735 (+ 18us) write_op.cc:276] Timestamp: P: 1786391283365230 usec, L: 0
0810 19:48:11.490876 (+ 141us) write_op.cc:270] Start()
0810 19:48:11.490896 (+ 20us) write_op.cc:276] Timestamp: P: 1786391283379050 usec, L: 0
0810 19:48:11.491055 (+ 159us) write_op.cc:270] Start()
0810 19:48:11.491073 (+ 18us) write_op.cc:276] Timestamp: P: 1786391283379754 usec, L: 0
0810 19:48:11.491181 (+ 108us) write_op.cc:270] Start()
0810 19:48:11.491196 (+ 15us) write_op.cc:276] Timestamp: P: 1786391283380314 usec, L: 0
0810 19:48:11.491323 (+ 127us) write_op.cc:270] Start()
0810 19:48:11.491339 (+ 16us) write_op.cc:276] Timestamp: P: 1786391283381113 usec, L: 0
0810 19:48:11.491449 (+ 110us) write_op.cc:270] Start()
0810 19:48:11.491464 (+ 15us) write_op.cc:276] Timestamp: P: 1786391283384930 usec, L: 0
0810 19:48:11.491576 (+ 112us) write_op.cc:270] Start()
0810 19:48:11.491592 (+ 16us) write_op.cc:276] Timestamp: P: 1786391283442574 usec, L: 0
0810 19:48:11.491703 (+ 111us) write_op.cc:270] Start()
0810 19:48:11.491719 (+ 16us) write_op.cc:276] Timestamp: P: 1786391283447631 usec, L: 0
0810 19:48:11.491895 (+ 176us) write_op.cc:270] Start()
0810 19:48:11.491916 (+ 21us) write_op.cc:276] Timestamp: P: 1786391283529406 usec, L: 0
0810 19:48:11.492074 (+ 158us) write_op.cc:270] Start()
0810 19:48:11.492093 (+ 19us) write_op.cc:276] Timestamp: P: 1786391283530212 usec, L: 0
0810 19:48:11.492225 (+ 132us) write_op.cc:270] Start()
0810 19:48:11.492244 (+ 19us) write_op.cc:276] Timestamp: P: 1786391283535679 usec, L: 0
0810 19:48:11.492390 (+ 146us) write_op.cc:270] Start()
0810 19:48:11.492409 (+ 19us) write_op.cc:276] Timestamp: P: 1786391283536361 usec, L: 0
0810 19:48:11.493346 (+ 937us) write_op.cc:270] Start()
0810 19:48:11.493373 (+ 27us) write_op.cc:276] Timestamp: P: 1786391284403783 usec, L: 0
0810 19:48:11.493558 (+ 185us) write_op.cc:270] Start()
0810 19:48:11.493577 (+ 19us) write_op.cc:276] Timestamp: P: 1786391284419536 usec, L: 0
0810 19:48:11.493754 (+ 177us) write_op.cc:270] Start()
0810 19:48:11.493776 (+ 22us) write_op.cc:276] Timestamp: P: 1786391284421796 usec, L: 0
0810 19:48:11.493915 (+ 139us) write_op.cc:270] Start()
0810 19:48:11.493933 (+ 18us) write_op.cc:276] Timestamp: P: 1786391284485966 usec, L: 0
0810 19:48:11.494070 (+ 137us) write_op.cc:270] Start()
0810 19:48:11.494086 (+ 16us) write_op.cc:276] Timestamp: P: 1786391284522795 usec, L: 0
0810 19:48:11.494189 (+ 103us) write_op.cc:270] Start()
0810 19:48:11.494207 (+ 18us) write_op.cc:276] Timestamp: P: 1786391284524079 usec, L: 0
0810 19:48:11.494376 (+ 169us) write_op.cc:270] Start()
0810 19:48:11.494395 (+ 19us) write_op.cc:276] Timestamp: P: 1786391284524662 usec, L: 0
0810 19:48:11.494535 (+ 140us) write_op.cc:270] Start()
0810 19:48:11.494552 (+ 17us) write_op.cc:276] Timestamp: P: 1786391284580914 usec, L: 0
0810 19:48:11.494665 (+ 113us) write_op.cc:270] Start()
0810 19:48:11.494682 (+ 17us) write_op.cc:276] Timestamp: P: 1786391284582050 usec, L: 0
0810 19:48:11.496548 (+ 1866us) write_op.cc:270] Start()
0810 19:48:11.496581 (+ 33us) write_op.cc:276] Timestamp: P: 1786391284583244 usec, L: 0
0810 19:48:11.496749 (+ 168us) write_op.cc:270] Start()
0810 19:48:11.496769 (+ 20us) write_op.cc:276] Timestamp: P: 1786391284584013 usec, L: 0
0810 19:48:11.496906 (+ 137us) write_op.cc:270] Start()
0810 19:48:11.496922 (+ 16us) write_op.cc:276] Timestamp: P: 1786391284584725 usec, L: 0
0810 19:48:11.497059 (+ 137us) write_op.cc:270] Start()
0810 19:48:11.497076 (+ 17us) write_op.cc:276] Timestamp: P: 1786391284585235 usec, L: 0
0810 19:48:11.497182 (+ 106us) write_op.cc:270] Start()
0810 19:48:11.497198 (+ 16us) write_op.cc:276] Timestamp: P: 1786391284593502 usec, L: 0
0810 19:48:11.497418 (+ 220us) write_op.cc:270] Start()
0810 19:48:11.497446 (+ 28us) write_op.cc:276] Timestamp: P: 1786391284597547 usec, L: 0
0810 19:48:11.497612 (+ 166us) write_op.cc:270] Start()
0810 19:48:11.497633 (+ 21us) write_op.cc:276] Timestamp: P: 1786391284627076 usec, L: 0
0810 19:48:11.497767 (+ 134us) write_op.cc:270] Start()
0810 19:48:11.497787 (+ 20us) write_op.cc:276] Timestamp: P: 1786391284651530 usec, L: 0
0810 19:48:11.562616 (+ 64829us) write_op.cc:270] Start()
0810 19:48:11.562664 (+ 48us) write_op.cc:276] Timestamp: P: 1786391284669253 usec, L: 0
0810 19:48:11.562917 (+ 253us) write_op.cc:270] Start()
0810 19:48:11.562945 (+ 28us) write_op.cc:276] Timestamp: P: 1786391284791047 usec, L: 0
0810 19:48:11.563111 (+ 166us) write_op.cc:270] Start()
0810 19:48:11.563132 (+ 21us) write_op.cc:276] Timestamp: P: 1786391284810014 usec, L: 0
0810 19:48:11.563322 (+ 190us) write_op.cc:270] Start()
0810 19:48:11.563342 (+ 20us) write_op.cc:276] Timestamp: P: 1786391284810753 usec, L: 0
0810 19:48:11.563472 (+ 130us) write_op.cc:270] Start()
0810 19:48:11.563493 (+ 21us) write_op.cc:276] Timestamp: P: 1786391284811356 usec, L: 0
0810 19:48:11.563629 (+ 136us) write_op.cc:270] Start()
0810 19:48:11.563648 (+ 19us) write_op.cc:276] Timestamp: P: 1786391284896982 usec, L: 0
0810 19:48:11.563779 (+ 131us) write_op.cc:270] Start()
0810 19:48:11.563797 (+ 18us) write_op.cc:276] Timestamp: P: 1786391284898336 usec, L: 0
0810 19:48:11.563933 (+ 136us) write_op.cc:270] Start()
0810 19:48:11.563951 (+ 18us) write_op.cc:276] Timestamp: P: 1786391284899494 usec, L: 0
0810 19:48:11.564089 (+ 138us) write_op.cc:270] Start()
0810 19:48:11.564105 (+ 16us) write_op.cc:276] Timestamp: P: 1786391284901107 usec, L: 0
0810 19:48:11.564223 (+ 118us) write_op.cc:270] Start()
0810 19:48:11.564239 (+ 16us) write_op.cc:276] Timestamp: P: 1786391284903013 usec, L: 0
0810 19:48:11.570830 (+ 6591us) write_op.cc:270] Start()
0810 19:48:11.570871 (+ 41us) write_op.cc:276] Timestamp: P: 1786391284904583 usec, L: 0
0810 19:48:11.571080 (+ 209us) write_op.cc:270] Start()
0810 19:48:11.571100 (+ 20us) write_op.cc:276] Timestamp: P: 1786391284908808 usec, L: 0
0810 19:48:11.571257 (+ 157us) write_op.cc:270] Start()
0810 19:48:11.571276 (+ 19us) write_op.cc:276] Timestamp: P: 1786391284910354 usec, L: 0
0810 19:48:11.571447 (+ 171us) write_op.cc:270] Start()
0810 19:48:11.571469 (+ 22us) write_op.cc:276] Timestamp: P: 1786391284912331 usec, L: 0
0810 19:48:11.571615 (+ 146us) write_op.cc:270] Start()
0810 19:48:11.571637 (+ 22us) write_op.cc:276] Timestamp: P: 1786391285065338 usec, L: 0
0810 19:48:11.571792 (+ 155us) write_op.cc:270] Start()
0810 19:48:11.571815 (+ 23us) write_op.cc:276] Timestamp: P: 1786391285075712 usec, L: 0
0810 19:48:11.571981 (+ 166us) write_op.cc:270] Start()
0810 19:48:11.572001 (+ 20us) write_op.cc:276] Timestamp: P: 1786391285076513 usec, L: 0
0810 19:48:11.572148 (+ 147us) write_op.cc:270] Start()
0810 19:48:11.572167 (+ 19us) write_op.cc:276] Timestamp: P: 1786391285077085 usec, L: 0
0810 19:48:11.572308 (+ 141us) write_op.cc:270] Start()
0810 19:48:11.572330 (+ 22us) write_op.cc:276] Timestamp: P: 1786391285077645 usec, L: 0
0810 19:48:11.572469 (+ 139us) write_op.cc:270] Start()
0810 19:48:11.572490 (+ 21us) write_op.cc:276] Timestamp: P: 1786391285123589 usec, L: 0
0810 19:48:11.572621 (+ 131us) write_op.cc:270] Start()
0810 19:48:11.572641 (+ 20us) write_op.cc:276] Timestamp: P: 1786391285163317 usec, L: 0
0810 19:48:11.572826 (+ 185us) write_op.cc:270] Start()
0810 19:48:11.572849 (+ 23us) write_op.cc:276] Timestamp: P: 1786391285164018 usec, L: 0
0810 19:48:11.572998 (+ 149us) write_op.cc:270] Start()
0810 19:48:11.573044 (+ 46us) write_op.cc:276] Timestamp: P: 1786391285164575 usec, L: 0
0810 19:48:11.573195 (+ 151us) write_op.cc:270] Start()
0810 19:48:11.573214 (+ 19us) write_op.cc:276] Timestamp: P: 1786391285251814 usec, L: 0
0810 19:48:11.573371 (+ 157us) write_op.cc:270] Start()
0810 19:48:11.573392 (+ 21us) write_op.cc:276] Timestamp: P: 1786391285271494 usec, L: 0
0810 19:48:11.573529 (+ 137us) write_op.cc:270] Start()
0810 19:48:11.573550 (+ 21us) write_op.cc:276] Timestamp: P: 1786391285422826 usec, L: 0
0810 19:48:11.573695 (+ 145us) write_op.cc:270] Start()
0810 19:48:11.573716 (+ 21us) write_op.cc:276] Timestamp: P: 1786391285424742 usec, L: 0
0810 19:48:11.573897 (+ 181us) write_op.cc:270] Start()
0810 19:48:11.573918 (+ 21us) write_op.cc:276] Timestamp: P: 1786391285506794 usec, L: 0
0810 19:48:11.574085 (+ 167us) write_op.cc:270] Start()
0810 19:48:11.574105 (+ 20us) write_op.cc:276] Timestamp: P: 1786391285635640 usec, L: 0
0810 19:48:11.574256 (+ 151us) write_op.cc:270] Start()
0810 19:48:11.574277 (+ 21us) write_op.cc:276] Timestamp: P: 1786391285692231 usec, L: 0
0810 19:48:11.574457 (+ 180us) write_op.cc:270] Start()
0810 19:48:11.574476 (+ 19us) write_op.cc:276] Timestamp: P: 1786391285695528 usec, L: 0
0810 19:48:11.574622 (+ 146us) write_op.cc:270] Start()
0810 19:48:11.574641 (+ 19us) write_op.cc:276] Timestamp: P: 1786391285748661 usec, L: 0
0810 19:48:11.574777 (+ 136us) write_op.cc:270] Start()
0810 19:48:11.574795 (+ 18us) write_op.cc:276] Timestamp: P: 1786391285768176 usec, L: 0
0810 19:48:11.574940 (+ 145us) write_op.cc:270] Start()
0810 19:48:11.574959 (+ 19us) write_op.cc:276] Timestamp: P: 1786391285777436 usec, L: 0
0810 19:48:11.584245 (+ 9286us) write_op.cc:270] Start()
0810 19:48:11.584311 (+ 66us) write_op.cc:276] Timestamp: P: 1786391285826655 usec, L: 0
0810 19:48:11.584609 (+ 298us) write_op.cc:270] Start()
0810 19:48:11.584639 (+ 30us) write_op.cc:276] Timestamp: P: 1786391285834504 usec, L: 0
0810 19:48:11.584816 (+ 177us) write_op.cc:270] Start()
0810 19:48:11.584876 (+ 60us) write_op.cc:276] Timestamp: P: 1786391285864372 usec, L: 0
0810 19:48:11.585035 (+ 159us) write_op.cc:270] Start()
0810 19:48:11.587163 (+ 2128us) write_op.cc:276] Timestamp: P: 1786391285873586 usec, L: 0
0810 19:48:11.587389 (+ 226us) write_op.cc:270] Start()
0810 19:48:11.587410 (+ 21us) write_op.cc:276] Timestamp: P: 1786391285893461 usec, L: 0
0810 19:48:11.587547 (+ 137us) write_op.cc:270] Start()
0810 19:48:11.587565 (+ 18us) write_op.cc:276] Timestamp: P: 1786391285914929 usec, L: 0
0810 19:48:11.587691 (+ 126us) write_op.cc:270] Start()
0810 19:48:11.587708 (+ 17us) write_op.cc:276] Timestamp: P: 1786391285942691 usec, L: 0
0810 19:48:11.587828 (+ 120us) write_op.cc:270] Start()
0810 19:48:11.587847 (+ 19us) write_op.cc:276] Timestamp: P: 1786391285973044 usec, L: 0
0810 19:48:11.587971 (+ 124us) write_op.cc:270] Start()
0810 19:48:11.587989 (+ 18us) write_op.cc:276] Timestamp: P: 1786391286062704 usec, L: 0
0810 19:48:11.588145 (+ 156us) write_op.cc:270] Start()
0810 19:48:11.588167 (+ 22us) write_op.cc:276] Timestamp: P: 1786391286063540 usec, L: 0
0810 19:48:11.588340 (+ 173us) write_op.cc:270] Start()
0810 19:48:11.588363 (+ 23us) write_op.cc:276] Timestamp: P: 1786391286064137 usec, L: 0
0810 19:48:11.588508 (+ 145us) write_op.cc:270] Start()
0810 19:48:11.588528 (+ 20us) write_op.cc:276] Timestamp: P: 1786391286064760 usec, L: 0
0810 19:48:11.588660 (+ 132us) write_op.cc:270] Start()
0810 19:48:11.588682 (+ 22us) write_op.cc:276] Timestamp: P: 1786391286068437 usec, L: 0
0810 19:48:11.588862 (+ 180us) write_op.cc:270] Start()
0810 19:48:11.588886 (+ 24us) write_op.cc:276] Timestamp: P: 1786391286069090 usec, L: 0
0810 19:48:11.589044 (+ 158us) write_op.cc:270] Start()
0810 19:48:11.589064 (+ 20us) write_op.cc:276] Timestamp: P: 1786391286069657 usec, L: 0
0810 19:48:11.589211 (+ 147us) write_op.cc:270] Start()
0810 19:48:11.589231 (+ 20us) write_op.cc:276] Timestamp: P: 1786391286070141 usec, L: 0
0810 19:48:11.589379 (+ 148us) write_op.cc:270] Start()
0810 19:48:11.589396 (+ 17us) write_op.cc:276] Timestamp: P: 1786391286226107 usec, L: 0
0810 19:48:11.589514 (+ 118us) write_op.cc:270] Start()
0810 19:48:11.589532 (+ 18us) write_op.cc:276] Timestamp: P: 1786391286256812 usec, L: 0
0810 19:48:11.593535 (+ 4003us) write_op.cc:270] Start()
0810 19:48:11.593568 (+ 33us) write_op.cc:276] Timestamp: P: 1786391286257489 usec, L: 0
0810 19:48:11.593786 (+ 218us) write_op.cc:270] Start()
0810 19:48:11.593811 (+ 25us) write_op.cc:276] Timestamp: P: 1786391286258088 usec, L: 0
0810 19:48:11.593977 (+ 166us) write_op.cc:270] Start()
0810 19:48:11.593998 (+ 21us) write_op.cc:276] Timestamp: P: 1786391286261215 usec, L: 0
0810 19:48:11.594166 (+ 168us) write_op.cc:270] Start()
0810 19:48:11.594187 (+ 21us) write_op.cc:276] Timestamp: P: 1786391286261742 usec, L: 0
0810 19:48:11.594380 (+ 193us) write_op.cc:270] Start()
0810 19:48:11.594403 (+ 23us) write_op.cc:276] Timestamp: P: 1786391286265636 usec, L: 0
0810 19:48:11.594541 (+ 138us) write_op.cc:270] Start()
0810 19:48:11.594559 (+ 18us) write_op.cc:276] Timestamp: P: 1786391286267604 usec, L: 0
0810 19:48:11.594760 (+ 201us) write_op.cc:270] Start()
0810 19:48:11.594783 (+ 23us) write_op.cc:276] Timestamp: P: 1786391286401647 usec, L: 0
0810 19:48:11.594944 (+ 161us) write_op.cc:270] Start()
0810 19:48:11.594964 (+ 20us) write_op.cc:276] Timestamp: P: 1786391286485286 usec, L: 0
0810 19:48:11.595117 (+ 153us) write_op.cc:270] Start()
0810 19:48:11.595138 (+ 21us) write_op.cc:276] Timestamp: P: 1786391286485965 usec, L: 0
0810 19:48:11.595313 (+ 175us) write_op.cc:270] Start()
0810 19:48:11.595335 (+ 22us) write_op.cc:276] Timestamp: P: 1786391286491399 usec, L: 0
0810 19:48:11.595483 (+ 148us) write_op.cc:270] Start()
0810 19:48:11.595504 (+ 21us) write_op.cc:276] Timestamp: P: 1786391286492045 usec, L: 0
0810 19:48:11.595652 (+ 148us) write_op.cc:270] Start()
0810 19:48:11.595705 (+ 53us) write_op.cc:276] Timestamp: P: 1786391286492575 usec, L: 0
0810 19:48:11.595852 (+ 147us) write_op.cc:270] Start()
0810 19:48:11.595873 (+ 21us) write_op.cc:276] Timestamp: P: 1786391286493141 usec, L: 0
0810 19:48:11.596003 (+ 130us) write_op.cc:270] Start()
0810 19:48:11.596021 (+ 18us) write_op.cc:276] Timestamp: P: 1786391286493618 usec, L: 0
0810 19:48:11.596159 (+ 138us) write_op.cc:270] Start()
0810 19:48:11.596178 (+ 19us) write_op.cc:276] Timestamp: P: 1786391286494159 usec, L: 0
0810 19:48:11.596340 (+ 162us) write_op.cc:270] Start()
0810 19:48:11.596360 (+ 20us) write_op.cc:276] Timestamp: P: 1786391286501674 usec, L: 0
0810 19:48:11.600495 (+ 4135us) write_op.cc:270] Start()
0810 19:48:11.600527 (+ 32us) write_op.cc:276] Timestamp: P: 1786391286526206 usec, L: 0
0810 19:48:11.600710 (+ 183us) write_op.cc:270] Start()
0810 19:48:11.600730 (+ 20us) write_op.cc:276] Timestamp: P: 1786391286651477 usec, L: 0
0810 19:48:11.600846 (+ 116us) write_op.cc:270] Start()
0810 19:48:11.600864 (+ 18us) write_op.cc:276] Timestamp: P: 1786391286652183 usec, L: 0
0810 19:48:11.600978 (+ 114us) write_op.cc:270] Start()
0810 19:48:11.600995 (+ 17us) write_op.cc:276] Timestamp: P: 1786391286803916 usec, L: 0
0810 19:48:11.601107 (+ 112us) write_op.cc:270] Start()
0810 19:48:11.601122 (+ 15us) write_op.cc:276] Timestamp: P: 1786391286809730 usec, L: 0
0810 19:48:11.601243 (+ 121us) write_op.cc:270] Start()
0810 19:48:11.601259 (+ 16us) write_op.cc:276] Timestamp: P: 1786391286811008 usec, L: 0
0810 19:48:11.601393 (+ 134us) write_op.cc:270] Start()
0810 19:48:11.601412 (+ 19us) write_op.cc:276] Timestamp: P: 1786391286811985 usec, L: 0
0810 19:48:11.601537 (+ 125us) write_op.cc:270] Start()
0810 19:48:11.601555 (+ 18us) write_op.cc:276] Timestamp: P: 1786391286813315 usec, L: 0
0810 19:48:11.601703 (+ 148us) write_op.cc:270] Start()
0810 19:48:11.601722 (+ 19us) write_op.cc:276] Timestamp: P: 1786391286814140 usec, L: 0
0810 19:48:11.601854 (+ 132us) write_op.cc:270] Start()
0810 19:48:11.601872 (+ 18us) write_op.cc:276] Timestamp: P: 1786391286815009 usec, L: 0
0810 19:48:11.601983 (+ 111us) write_op.cc:270] Start()
0810 19:48:11.601998 (+ 15us) write_op.cc:276] Timestamp: P: 1786391286900351 usec, L: 0
0810 19:48:11.602107 (+ 109us) write_op.cc:270] Start()
0810 19:48:11.602124 (+ 17us) write_op.cc:276] Timestamp: P: 1786391286978254 usec, L: 0
0810 19:48:11.602228 (+ 104us) write_op.cc:270] Start()
0810 19:48:11.602243 (+ 15us) write_op.cc:276] Timestamp: P: 1786391287007937 usec, L: 0
0810 19:48:11.604338 (+ 2095us) write_op.cc:270] Start()
0810 19:48:11.604369 (+ 31us) write_op.cc:276] Timestamp: P: 1786391287035363 usec, L: 0
0810 19:48:11.604556 (+ 187us) write_op.cc:270] Start()
0810 19:48:11.604579 (+ 23us) write_op.cc:276] Timestamp: P: 1786391287084306 usec, L: 0
0810 19:48:11.604727 (+ 148us) write_op.cc:270] Start()
0810 19:48:11.604746 (+ 19us) write_op.cc:276] Timestamp: P: 1786391287105946 usec, L: 0
0810 19:48:11.604871 (+ 125us) write_op.cc:270] Start()
0810 19:48:11.604887 (+ 16us) write_op.cc:276] Timestamp: P: 1786391287107460 usec, L: 0
0810 19:48:11.605019 (+ 132us) write_op.cc:270] Start()
0810 19:48:11.605036 (+ 17us) write_op.cc:276] Timestamp: P: 1786391287197295 usec, L: 0
0810 19:48:11.605164 (+ 128us) write_op.cc:270] Start()
0810 19:48:11.605180 (+ 16us) write_op.cc:276] Timestamp: P: 1786391287198150 usec, L: 0
0810 19:48:11.605284 (+ 104us) write_op.cc:270] Start()
0810 19:48:11.605312 (+ 28us) write_op.cc:276] Timestamp: P: 1786391287198811 usec, L: 0
0810 19:48:11.605424 (+ 112us) write_op.cc:270] Start()
0810 19:48:11.605439 (+ 15us) write_op.cc:276] Timestamp: P: 1786391287211777 usec, L: 0
0810 19:48:11.605548 (+ 109us) write_op.cc:270] Start()
0810 19:48:11.605567 (+ 19us) write_op.cc:276] Timestamp: P: 1786391287223285 usec, L: 0
0810 19:48:11.605675 (+ 108us) write_op.cc:270] Start()
0810 19:48:11.605691 (+ 16us) write_op.cc:276] Timestamp: P: 1786391287224000 usec, L: 0
0810 19:48:11.605867 (+ 176us) write_op.cc:270] Start()
0810 19:48:11.605889 (+ 22us) write_op.cc:276] Timestamp: P: 1786391287295620 usec, L: 0
0810 19:48:11.606011 (+ 122us) write_op.cc:270] Start()
0810 19:48:11.606028 (+ 17us) write_op.cc:276] Timestamp: P: 1786391287316305 usec, L: 0
0810 19:48:11.606140 (+ 112us) write_op.cc:270] Start()
0810 19:48:11.606180 (+ 40us) write_op.cc:276] Timestamp: P: 1786391287320732 usec, L: 0
0810 19:48:11.606297 (+ 117us) write_op.cc:270] Start()
0810 19:48:11.606336 (+ 39us) write_op.cc:276] Timestamp: P: 1786391287333649 usec, L: 0
0810 19:48:11.606471 (+ 135us) write_op.cc:270] Start()
0810 19:48:11.606487 (+ 16us) write_op.cc:276] Timestamp: P: 1786391287340263 usec, L: 0
0810 19:48:11.606607 (+ 120us) write_op.cc:270] Start()
0810 19:48:11.606625 (+ 18us) write_op.cc:276] Timestamp: P: 1786391287385948 usec, L: 0
0810 19:48:11.606776 (+ 151us) write_op.cc:270] Start()
0810 19:48:11.606797 (+ 21us) write_op.cc:276] Timestamp: P: 1786391287390149 usec, L: 0
0810 19:48:11.606954 (+ 157us) write_op.cc:270] Start()
0810 19:48:11.606974 (+ 20us) write_op.cc:276] Timestamp: P: 1786391287431993 usec, L: 0
0810 19:48:11.607116 (+ 142us) write_op.cc:270] Start()
0810 19:48:11.607136 (+ 20us) write_op.cc:276] Timestamp: P: 1786391287452300 usec, L: 0
0810 19:48:11.607284 (+ 148us) write_op.cc:270] Start()
0810 19:48:11.607319 (+ 35us) write_op.cc:276] Timestamp: P: 1786391287467389 usec, L: 0
0810 19:48:11.607456 (+ 137us) write_op.cc:270] Start()
0810 19:48:11.607487 (+ 31us) write_op.cc:276] Timestamp: P: 1786391287506091 usec, L: 0
0810 19:48:11.607612 (+ 125us) write_op.cc:270] Start()
0810 19:48:11.607631 (+ 19us) write_op.cc:276] Timestamp: P: 1786391287506821 usec, L: 0
0810 19:48:11.607791 (+ 160us) write_op.cc:270] Start()
0810 19:48:11.607810 (+ 19us) write_op.cc:276] Timestamp: P: 1786391287507387 usec, L: 0
0810 19:48:11.639331 (+ 31521us) write_op.cc:270] Start()
0810 19:48:11.639366 (+ 35us) write_op.cc:276] Timestamp: P: 1786391287534099 usec, L: 0
0810 19:48:11.639582 (+ 216us) write_op.cc:270] Start()
0810 19:48:11.639607 (+ 25us) write_op.cc:276] Timestamp: P: 1786391287535061 usec, L: 0
0810 19:48:11.639764 (+ 157us) write_op.cc:270] Start()
0810 19:48:11.639783 (+ 19us) write_op.cc:276] Timestamp: P: 1786391287535721 usec, L: 0
0810 19:48:11.639904 (+ 121us) write_op.cc:270] Start()
0810 19:48:11.639922 (+ 18us) write_op.cc:276] Timestamp: P: 1786391287562146 usec, L: 0
0810 19:48:11.640047 (+ 125us) write_op.cc:270] Start()
0810 19:48:11.640066 (+ 19us) write_op.cc:276] Timestamp: P: 1786391287714903 usec, L: 0
0810 19:48:11.648686 (+ 8620us) write_op.cc:270] Start()
0810 19:48:11.648762 (+ 76us) write_op.cc:276] Timestamp: P: 1786391287716583 usec, L: 0
0810 19:48:11.649015 (+ 253us) write_op.cc:270] Start()
0810 19:48:11.649041 (+ 26us) write_op.cc:276] Timestamp: P: 1786391288040952 usec, L: 0
0810 19:48:11.651046 (+ 2005us) write_op.cc:270] Start()
0810 19:48:11.651075 (+ 29us) write_op.cc:276] Timestamp: P: 1786391288085346 usec, L: 0
0810 19:48:11.651273 (+ 198us) write_op.cc:270] Start()
0810 19:48:11.651296 (+ 23us) write_op.cc:276] Timestamp: P: 1786391288108053 usec, L: 0
0810 19:48:11.651442 (+ 146us) write_op.cc:270] Start()
0810 19:48:11.651463 (+ 21us) write_op.cc:276] Timestamp: P: 1786391288130640 usec, L: 0
0810 19:48:11.651612 (+ 149us) write_op.cc:270] Start()
0810 19:48:11.651633 (+ 21us) write_op.cc:276] Timestamp: P: 1786391288131674 usec, L: 0
0810 19:48:11.651774 (+ 141us) write_op.cc:270] Start()
0810 19:48:11.651807 (+ 33us) write_op.cc:276] Timestamp: P: 1786391288132558 usec, L: 0
0810 19:48:11.651947 (+ 140us) write_op.cc:270] Start()
0810 19:48:11.651967 (+ 20us) write_op.cc:276] Timestamp: P: 1786391288133387 usec, L: 0
0810 19:48:11.652154 (+ 187us) write_op.cc:270] Start()
0810 19:48:11.652174 (+ 20us) write_op.cc:276] Timestamp: P: 1786391288134207 usec, L: 0
0810 19:48:11.652289 (+ 115us) write_op.cc:270] Start()
0810 19:48:11.652306 (+ 17us) write_op.cc:276] Timestamp: P: 1786391288135042 usec, L: 0
0810 19:48:11.652469 (+ 163us) write_op.cc:270] Start()
0810 19:48:11.652492 (+ 23us) write_op.cc:276] Timestamp: P: 1786391288162900 usec, L: 0
0810 19:48:11.652648 (+ 156us) write_op.cc:270] Start()
0810 19:48:11.652669 (+ 21us) write_op.cc:276] Timestamp: P: 1786391288214516 usec, L: 0
0810 19:48:11.652848 (+ 179us) write_op.cc:270] Start()
0810 19:48:11.652870 (+ 22us) write_op.cc:276] Timestamp: P: 1786391288365249 usec, L: 0
0810 19:48:11.653014 (+ 144us) write_op.cc:270] Start()
0810 19:48:11.653031 (+ 17us) write_op.cc:276] Timestamp: P: 1786391288371521 usec, L: 0
0810 19:48:11.653188 (+ 157us) write_op.cc:270] Start()
0810 19:48:11.653208 (+ 20us) write_op.cc:276] Timestamp: P: 1786391288375806 usec, L: 0
0810 19:48:11.653356 (+ 148us) write_op.cc:270] Start()
0810 19:48:11.653374 (+ 18us) write_op.cc:276] Timestamp: P: 1786391288380017 usec, L: 0
0810 19:48:11.653505 (+ 131us) write_op.cc:270] Start()
0810 19:48:11.653522 (+ 17us) write_op.cc:276] Timestamp: P: 1786391288380668 usec, L: 0
0810 19:48:11.653623 (+ 101us) write_op.cc:270] Start()
0810 19:48:11.653638 (+ 15us) write_op.cc:276] Timestamp: P: 1786391288404841 usec, L: 0
0810 19:48:11.653744 (+ 106us) write_op.cc:270] Start()
0810 19:48:11.653759 (+ 15us) write_op.cc:276] Timestamp: P: 1786391288564527 usec, L: 0
0810 19:48:11.653895 (+ 136us) write_op.cc:270] Start()
0810 19:48:11.653911 (+ 16us) write_op.cc:276] Timestamp: P: 1786391288596952 usec, L: 0
0810 19:48:11.654035 (+ 124us) write_op.cc:270] Start()
0810 19:48:11.654051 (+ 16us) write_op.cc:276] Timestamp: P: 1786391288597715 usec, L: 0
0810 19:48:11.654178 (+ 127us) write_op.cc:270] Start()
0810 19:48:11.654193 (+ 15us) write_op.cc:276] Timestamp: P: 1786391288598881 usec, L: 0
0810 19:48:11.664866 (+ 10673us) write_op.cc:270] Start()
0810 19:48:11.664906 (+ 40us) write_op.cc:276] Timestamp: P: 1786391288599707 usec, L: 0
0810 19:48:11.665140 (+ 234us) write_op.cc:270] Start()
0810 19:48:11.665167 (+ 27us) write_op.cc:276] Timestamp: P: 1786391288600589 usec, L: 0
0810 19:48:11.665336 (+ 169us) write_op.cc:270] Start()
0810 19:48:11.665358 (+ 22us) write_op.cc:276] Timestamp: P: 1786391288601334 usec, L: 0
0810 19:48:11.665497 (+ 139us) write_op.cc:270] Start()
0810 19:48:11.665515 (+ 18us) write_op.cc:276] Timestamp: P: 1786391288604327 usec, L: 0
0810 19:48:11.665659 (+ 144us) write_op.cc:270] Start()
0810 19:48:11.665681 (+ 22us) write_op.cc:276] Timestamp: P: 1786391288749074 usec, L: 0
0810 19:48:11.665837 (+ 156us) write_op.cc:270] Start()
0810 19:48:11.665857 (+ 20us) write_op.cc:276] Timestamp: P: 1786391288750025 usec, L: 0
0810 19:48:11.666002 (+ 145us) write_op.cc:270] Start()
0810 19:48:11.666021 (+ 19us) write_op.cc:276] Timestamp: P: 1786391288750641 usec, L: 0
0810 19:48:11.666188 (+ 167us) write_op.cc:270] Start()
0810 19:48:11.666207 (+ 19us) write_op.cc:276] Timestamp: P: 1786391288751221 usec, L: 0
0810 19:48:11.666347 (+ 140us) write_op.cc:270] Start()
0810 19:48:11.666366 (+ 19us) write_op.cc:276] Timestamp: P: 1786391288751781 usec, L: 0
0810 19:48:11.666508 (+ 142us) write_op.cc:270] Start()
0810 19:48:11.666526 (+ 18us) write_op.cc:276] Timestamp: P: 1786391288752333 usec, L: 0
0810 19:48:11.666643 (+ 117us) write_op.cc:270] Start()
0810 19:48:11.666660 (+ 17us) write_op.cc:276] Timestamp: P: 1786391288752851 usec, L: 0
0810 19:48:11.666790 (+ 130us) write_op.cc:270] Start()
0810 19:48:11.666807 (+ 17us) write_op.cc:276] Timestamp: P: 1786391288753451 usec, L: 0
0810 19:48:11.666946 (+ 139us) write_op.cc:270] Start()
0810 19:48:11.666963 (+ 17us) write_op.cc:276] Timestamp: P: 1786391288762476 usec, L: 0
0810 19:48:11.667080 (+ 117us) write_op.cc:270] Start()
0810 19:48:11.667097 (+ 17us) write_op.cc:276] Timestamp: P: 1786391288786376 usec, L: 0
0810 19:48:11.667201 (+ 104us) write_op.cc:270] Start()
0810 19:48:11.667216 (+ 15us) write_op.cc:276] Timestamp: P: 1786391288786997 usec, L: 0
0810 19:48:11.667376 (+ 160us) write_op.cc:270] Start()
0810 19:48:11.667401 (+ 25us) write_op.cc:276] Timestamp: P: 1786391288787713 usec, L: 0
0810 19:48:11.667532 (+ 131us) write_op.cc:270] Start()
0810 19:48:11.667548 (+ 16us) write_op.cc:276] Timestamp: P: 1786391288789714 usec, L: 0
0810 19:48:11.667656 (+ 108us) write_op.cc:270] Start()
0810 19:48:11.667673 (+ 17us) write_op.cc:276] Timestamp: P: 1786391288801812 usec, L: 0
0810 19:48:11.667840 (+ 167us) write_op.cc:270] Start()
0810 19:48:11.667860 (+ 20us) write_op.cc:276] Timestamp: P: 1786391288803040 usec, L: 0
0810 19:48:11.667983 (+ 123us) write_op.cc:270] Start()
0810 19:48:11.668000 (+ 17us) write_op.cc:276] Timestamp: P: 1786391288829718 usec, L: 0
0810 19:48:11.668127 (+ 127us) write_op.cc:270] Start()
0810 19:48:11.668145 (+ 18us) write_op.cc:276] Timestamp: P: 1786391288854715 usec, L: 0
0810 19:48:11.668257 (+ 112us) write_op.cc:270] Start()
0810 19:48:11.668274 (+ 17us) write_op.cc:276] Timestamp: P: 1786391288857577 usec, L: 0
0810 19:48:11.668386 (+ 112us) write_op.cc:270] Start()
0810 19:48:11.668402 (+ 16us) write_op.cc:276] Timestamp: P: 1786391288865993 usec, L: 0
0810 19:48:11.668521 (+ 119us) write_op.cc:270] Start()
0810 19:48:11.668538 (+ 17us) write_op.cc:276] Timestamp: P: 1786391288952604 usec, L: 0
0810 19:48:11.668655 (+ 117us) write_op.cc:270] Start()
0810 19:48:11.668672 (+ 17us) write_op.cc:276] Timestamp: P: 1786391288953386 usec, L: 0
0810 19:48:11.668810 (+ 138us) write_op.cc:270] Start()
0810 19:48:11.668827 (+ 17us) write_op.cc:276] Timestamp: P: 1786391288954097 usec, L: 0
0810 19:48:11.668947 (+ 120us) write_op.cc:270] Start()
0810 19:48:11.668963 (+ 16us) write_op.cc:276] Timestamp: P: 1786391288959994 usec, L: 0
0810 19:48:11.669071 (+ 108us) write_op.cc:270] Start()
0810 19:48:11.669087 (+ 16us) write_op.cc:276] Timestamp: P: 1786391288961398 usec, L: 0
0810 19:48:11.669213 (+ 126us) write_op.cc:270] Start()
0810 19:48:11.669230 (+ 17us) write_op.cc:276] Timestamp: P: 178639
I20260810 19:48:12.847951 12993 raft_consensus.cc:493] T 31c2b9a4b8334e678b4632fc2f58dd0c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:12.852550 12993 raft_consensus.cc:515] T 31c2b9a4b8334e678b4632fc2f58dd0c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.853159 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3f48f9bb29b4be6ab6ce167159ae793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.853299 12993 leader_election.cc:290] T 31c2b9a4b8334e678b4632fc2f58dd0c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:12.855199 10067 leader_election.cc:343] T 31c2b9a4b8334e678b4632fc2f58dd0c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 31c2b9a4b8334e678b4632fc2f58dd0c
W20260810 19:48:12.856201 10068 leader_election.cc:343] T 31c2b9a4b8334e678b4632fc2f58dd0c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 31c2b9a4b8334e678b4632fc2f58dd0c
I20260810 19:48:12.856312 10068 leader_election.cc:304] T 31c2b9a4b8334e678b4632fc2f58dd0c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:12.856696 12993 raft_consensus.cc:2749] T 31c2b9a4b8334e678b4632fc2f58dd0c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:12.856985 10370 raft_consensus.cc:385] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:12.857577 10370 raft_consensus.cc:740] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:12.857995 10370 consensus_queue.cc:260] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:12.855644 9830 consensus_peers.cc:597] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3bf9486839474b2a8ddff3a49b4fda2a. This is attempt 1: this message will repeat every 5th retry.
W20260810 19:48:12.858762 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 0f2a1ce4229340318460b50be053be39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f2a1ce4229340318460b50be053be39 already in progress: creating tablet
W20260810 19:48:12.859166 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 44e5c597335a4795b8dbb708af7726ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44e5c597335a4795b8dbb708af7726ee already in progress: creating tablet
I20260810 19:48:12.859222 12266 tablet_replica.cc:333] T 5f4e2adee0264e418ff8c54912973e60 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:12.859452 12266 raft_consensus.cc:2243] T 5f4e2adee0264e418ff8c54912973e60 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:12.859618 12266 raft_consensus.cc:2272] T 5f4e2adee0264e418ff8c54912973e60 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:12.860232 12266 ts_tablet_manager.cc:1916] T 5f4e2adee0264e418ff8c54912973e60 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:12.870003 10130 tablet_service.cc:1511] Processing CreateTablet for tablet a3f48f9bb29b4be6ab6ce167159ae793 (DEFAULT_TABLE table=default.Table_20c0928e4abc4405930a9632cfdc0e8f [id=14a9c177d10d4fb39c9883372ba6542a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.871289 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3f48f9bb29b4be6ab6ce167159ae793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.872329 10370 ts_tablet_manager.cc:1434] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20260810 19:48:12.872663 10370 tablet_bootstrap.cc:492] T 19e2bf7b7d254894a07c5a75bf24e742 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:12.876955 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_44478e93cffb460aaa8df9115b799594" } modify_external_catalogs: true
I20260810 19:48:12.876897 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_6bc5fb7fa62a42a99c0df6575d102a6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:12.877183 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_44478e93cffb460aaa8df9115b799594" } modify_external_catalogs: true
W20260810 19:48:12.877635 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6bc5fb7fa62a42a99c0df6575d102a6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.878708 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_650a584cca18434889f4b53784209535"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.879325 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_650a584cca18434889f4b53784209535 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.880599 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_fe8e192a01be4ef9917db24ac67ec0a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.881204 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe8e192a01be4ef9917db24ac67ec0a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.881604 9664 tablet_service.cc:1511] Processing CreateTablet for tablet ee49f02604554cc5801af9d41dcdf933 (DEFAULT_TABLE table=default.Table_1908057f69774dad9aba1261a71de96c [id=28039f0ecf434c6ca321bf8caa5c2bd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.882053 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee49f02604554cc5801af9d41dcdf933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.882174 9907 tablet_service.cc:1511] Processing CreateTablet for tablet ee49f02604554cc5801af9d41dcdf933 (DEFAULT_TABLE table=default.Table_1908057f69774dad9aba1261a71de96c [id=28039f0ecf434c6ca321bf8caa5c2bd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.882664 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_200650b28cfa4b268f5c68f6ec03018b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.883167 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_200650b28cfa4b268f5c68f6ec03018b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.884322 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_392e7373fd11463b851f18bc44b44450" } new_table_name: "default.Table_647c536d745f4c1e984b5a4c0b7c3b35" modify_external_catalogs: true
I20260810 19:48:12.884078 10137 tablet_service.cc:1511] Processing CreateTablet for tablet ee49f02604554cc5801af9d41dcdf933 (DEFAULT_TABLE table=default.Table_1908057f69774dad9aba1261a71de96c [id=28039f0ecf434c6ca321bf8caa5c2bd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.886409 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee49f02604554cc5801af9d41dcdf933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.887015 9410 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 3840b035b88243ecad17865d4716fcfc (table default.Table_e1cc6dd116324bf385dbc82e56283cf7 [id=6bf4ac94189d476d9ab5778e69d0b14f]). Expected version 1 got 0
I20260810 19:48:12.888536 9890 tablet_service.cc:1511] Processing CreateTablet for tablet 21041f65462744278244802ef867c2e9 (DEFAULT_TABLE table=default.Table_327c404433c9482fa11e3d685ddfb285 [id=2c139c8ed3e24dfe9134b62c729953d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.889973 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_d313ae200f4c40ca84375b6e8979c067"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.890587 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d313ae200f4c40ca84375b6e8979c067 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.894232 12993 raft_consensus.cc:493] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:12.894415 12993 raft_consensus.cc:515] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.895087 12993 leader_election.cc:290] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:12.874292 10370 tablet_bootstrap.cc:654] T 19e2bf7b7d254894a07c5a75bf24e742 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:12.895963 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab27734e3d974260a77f1d94e5f534fe" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:12.896185 9935 raft_consensus.cc:2468] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:12.896739 10067 leader_election.cc:304] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:12.897028 12993 raft_consensus.cc:2804] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:12.897099 12993 raft_consensus.cc:493] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:12.897156 12993 raft_consensus.cc:3060] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:12.900022 12993 raft_consensus.cc:515] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.901320 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet ab27734e3d974260a77f1d94e5f534fe with delete_type TABLET_DATA_DELETED (replaced by tablet f1c74666c3694ab881ba8ed452a73714) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:12.901594 10068 leader_election.cc:343] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: ab27734e3d974260a77f1d94e5f534fe
I20260810 19:48:12.902122 12993 leader_election.cc:290] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:12.902645 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab27734e3d974260a77f1d94e5f534fe" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:12.902760 10367 tablet_bootstrap.cc:492] T 985440898cc04a98877c15a5122a7dd3 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:12.902841 9935 raft_consensus.cc:3060] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:12.902909 10367 ts_tablet_manager.cc:1403] T 985440898cc04a98877c15a5122a7dd3 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.160s user 0.007s sys 0.004s
I20260810 19:48:12.902917 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 21041f65462744278244802ef867c2e9 (DEFAULT_TABLE table=default.Table_327c404433c9482fa11e3d685ddfb285 [id=2c139c8ed3e24dfe9134b62c729953d7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:12.903122 10068 leader_election.cc:343] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: ab27734e3d974260a77f1d94e5f534fe
I20260810 19:48:12.903381 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21041f65462744278244802ef867c2e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.903895 10367 raft_consensus.cc:359] T 985440898cc04a98877c15a5122a7dd3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.904055 10367 raft_consensus.cc:385] T 985440898cc04a98877c15a5122a7dd3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:12.904098 10367 raft_consensus.cc:740] T 985440898cc04a98877c15a5122a7dd3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:12.904201 10366 tablet_bootstrap.cc:492] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:12.904322 10366 ts_tablet_manager.cc:1403] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.267s user 0.000s sys 0.007s
I20260810 19:48:12.905283 10366 raft_consensus.cc:359] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.905444 10366 raft_consensus.cc:385] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:12.905519 10366 raft_consensus.cc:740] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:12.905794 9935 raft_consensus.cc:2468] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:12.905771 10366 consensus_queue.cc:260] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.908499 10067 leader_election.cc:304] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:12.909075 12993 raft_consensus.cc:2804] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:12.909348 12993 raft_consensus.cc:697] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:12.909636 12993 consensus_queue.cc:237] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.910218 10366 ts_tablet_manager.cc:1434] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260810 19:48:12.910624 10366 tablet_bootstrap.cc:492] T 9e861473094f42dfa22b9c00145ed1fe P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:12.913586 9410 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 4571e0c723f74c828220b33116fed9e9 (table default.Table_d9d83336ef124c2da242e77391b001c0 [id=8dbf3227e8ae402aa46b9b31b715faa6]). Expected version 1 got 0
I20260810 19:48:12.915043 10366 tablet_bootstrap.cc:654] T 9e861473094f42dfa22b9c00145ed1fe P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:12.922560 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21041f65462744278244802ef867c2e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.922833 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee49f02604554cc5801af9d41dcdf933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.926714 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 12c687c71bce439da9613257e8780cfc (DEFAULT_TABLE table=default.Table_4e5a130c086049a886c3cbaeeafc5458 [id=ac8ba6a07bb147eda396f24f0d51d953]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.927471 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 650ca46244e54bed89e96c4a09fc7a94 (DEFAULT_TABLE table=default.Table_1aa7012040f54866836d16c7d236a8a6 [id=e4841688e32c4ad9807d0e7aadb1ef7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.928087 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 9df805df8d564a838da0f2fc962d430d (DEFAULT_TABLE table=default.Table_b3daf051b3a147c09c80e0524fb5faf5 [id=957d466967d44a99abadd4ba7b634b8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.928277 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 12c687c71bce439da9613257e8780cfc (DEFAULT_TABLE table=default.Table_4e5a130c086049a886c3cbaeeafc5458 [id=ac8ba6a07bb147eda396f24f0d51d953]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.928493 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9df805df8d564a838da0f2fc962d430d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.928658 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12c687c71bce439da9613257e8780cfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.928969 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 12c687c71bce439da9613257e8780cfc (DEFAULT_TABLE table=default.Table_4e5a130c086049a886c3cbaeeafc5458 [id=ac8ba6a07bb147eda396f24f0d51d953]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.929407 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12c687c71bce439da9613257e8780cfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.930644 10118 tablet_service.cc:1511] Processing CreateTablet for tablet 44fe60ad52ed44ed979f03bd19cd82b5 (DEFAULT_TABLE table=default.Table_e9beb6e0dbe741c4a2582c7024a00ac1 [id=eb10f073d617485bab1a9472e9189377]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.930991 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44fe60ad52ed44ed979f03bd19cd82b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.933992 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 650ca46244e54bed89e96c4a09fc7a94 (DEFAULT_TABLE table=default.Table_1aa7012040f54866836d16c7d236a8a6 [id=e4841688e32c4ad9807d0e7aadb1ef7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.934389 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 650ca46244e54bed89e96c4a09fc7a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.938751 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12c687c71bce439da9613257e8780cfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.939123 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 650ca46244e54bed89e96c4a09fc7a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.948529 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 21041f65462744278244802ef867c2e9 (DEFAULT_TABLE table=default.Table_327c404433c9482fa11e3d685ddfb285 [id=2c139c8ed3e24dfe9134b62c729953d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.949008 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21041f65462744278244802ef867c2e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.950016 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 9df805df8d564a838da0f2fc962d430d (DEFAULT_TABLE table=default.Table_b3daf051b3a147c09c80e0524fb5faf5 [id=957d466967d44a99abadd4ba7b634b8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.950460 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9df805df8d564a838da0f2fc962d430d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.952834 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 44fe60ad52ed44ed979f03bd19cd82b5 (DEFAULT_TABLE table=default.Table_e9beb6e0dbe741c4a2582c7024a00ac1 [id=eb10f073d617485bab1a9472e9189377]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.953272 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44fe60ad52ed44ed979f03bd19cd82b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.954299 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet f06df4cdb79c440b91b0eff135d2dfac
I20260810 19:48:12.955359 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_cb085f4d70f74c8885b3f837c4c94501" } new_table_name: "default.Table_ca3fc8897d1a4f00a679e9eb49cdd2f1" modify_external_catalogs: true
I20260810 19:48:12.956197 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_89c56d57fc044981b88f6709942097d7" } new_table_name: "default.Table_4948fbc50149453bbd9cd1d993edab68" modify_external_catalogs: true
I20260810 19:48:12.957433 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 9df805df8d564a838da0f2fc962d430d (DEFAULT_TABLE table=default.Table_b3daf051b3a147c09c80e0524fb5faf5 [id=957d466967d44a99abadd4ba7b634b8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.957528 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3ebb38ab6d62481db36dda02cf32135c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:12.957763 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_09dc7c9d841f4f87a4451a93337fc43a" } new_table_name: "default.Table_232be4ae80c04c43bcd8bf52ac9569f0" modify_external_catalogs: true
I20260810 19:48:12.957855 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9df805df8d564a838da0f2fc962d430d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:12.958149 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ebb38ab6d62481db36dda02cf32135c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:12.959120 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 18c98ce06f5d4e6c8ba12557f1e33502 consensus state has no leader
I20260810 19:48:12.959494 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_961700636a7b4d19b41a7e26230b64a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:12.960026 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_961700636a7b4d19b41a7e26230b64a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:12.965040 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 44fe60ad52ed44ed979f03bd19cd82b5 (DEFAULT_TABLE table=default.Table_e9beb6e0dbe741c4a2582c7024a00ac1 [id=eb10f073d617485bab1a9472e9189377]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.965718 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44fe60ad52ed44ed979f03bd19cd82b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:12.965752 10377 ts_tablet_manager.cc:1929] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.965884 10377 log.cc:1199] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/827dce05c192467589e2692fabd2a84e
I20260810 19:48:12.966187 10377 ts_tablet_manager.cc:1950] T 827dce05c192467589e2692fabd2a84e P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:12.968250 10366 tablet_bootstrap.cc:492] T 9e861473094f42dfa22b9c00145ed1fe P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:12.968518 10366 ts_tablet_manager.cc:1403] T 9e861473094f42dfa22b9c00145ed1fe P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.058s user 0.003s sys 0.000s
I20260810 19:48:12.970202 10366 raft_consensus.cc:359] T 9e861473094f42dfa22b9c00145ed1fe P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.972692 10366 raft_consensus.cc:385] T 9e861473094f42dfa22b9c00145ed1fe P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:12.972821 10366 raft_consensus.cc:740] T 9e861473094f42dfa22b9c00145ed1fe P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:12.973179 10366 consensus_queue.cc:260] T 9e861473094f42dfa22b9c00145ed1fe P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.973636 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 410855f236004ad4b78839eb1c0c2f1f
I20260810 19:48:12.979576 10375 ts_tablet_manager.cc:1929] T ca733de7babe4343ab26dbca2c9020b2 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:12.979732 10375 log.cc:1199] T ca733de7babe4343ab26dbca2c9020b2 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/ca733de7babe4343ab26dbca2c9020b2
I20260810 19:48:12.980060 10375 ts_tablet_manager.cc:1950] T ca733de7babe4343ab26dbca2c9020b2 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:12.981138 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 410855f236004ad4b78839eb1c0c2f1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:12.981325 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet ca733de7babe4343ab26dbca2c9020b2 (table default.Table_99d4dfcac15d4d91b42b2a250bd58fc8 [id=5aaa48a6a5d94fef89881115cdd023ac]) successfully deleted
I20260810 19:48:12.982542 10366 ts_tablet_manager.cc:1434] T 9e861473094f42dfa22b9c00145ed1fe P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260810 19:48:12.982627 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 898b70d09c1d410fb75cd4dd32d844c8 (DEFAULT_TABLE table=default.Table_33ab9a72c1d543beb6a25830c7f1aa23 [id=4fe62c29683b4e5ca802b5cf74ae195e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.983050 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet 410855f236004ad4b78839eb1c0c2f1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:12.983300 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 410855f236004ad4b78839eb1c0c2f1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:12.983511 9890 tablet_service.cc:1511] Processing CreateTablet for tablet 04efdb236d4647098c89c90a593a0269 (DEFAULT_TABLE table=default.Table_7ee95575c8bd4022bd40fe7d6071950d [id=ef1ca5eb3c8f45bda8a36a3ed9243f4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.985194 10118 tablet_service.cc:1511] Processing CreateTablet for tablet 898b70d09c1d410fb75cd4dd32d844c8 (DEFAULT_TABLE table=default.Table_33ab9a72c1d543beb6a25830c7f1aa23 [id=4fe62c29683b4e5ca802b5cf74ae195e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.985653 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 898b70d09c1d410fb75cd4dd32d844c8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:12.992585 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5d2103bbb48f4ff196b61406896df656 consensus state has no leader
W20260810 19:48:12.993126 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f1300e3450204afc8951ed28341270cc consensus state has no leader
W20260810 19:48:12.994257 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 471ff7c225dd498fa39751202beec3a9 consensus state has no leader
I20260810 19:48:12.996007 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet f06df4cdb79c440b91b0eff135d2dfac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:12.996637 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 650ca46244e54bed89e96c4a09fc7a94 (DEFAULT_TABLE table=default.Table_1aa7012040f54866836d16c7d236a8a6 [id=e4841688e32c4ad9807d0e7aadb1ef7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.996753 9415 master_service.cc:960] ReplaceTablet: received request to replace tablet a1628a2a930a4819818df3ea480ab4db from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:12.966495 10367 consensus_queue.cc:260] T 985440898cc04a98877c15a5122a7dd3 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:12.971542 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 898b70d09c1d410fb75cd4dd32d844c8 (DEFAULT_TABLE table=default.Table_33ab9a72c1d543beb6a25830c7f1aa23 [id=4fe62c29683b4e5ca802b5cf74ae195e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.972361 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 04efdb236d4647098c89c90a593a0269 (DEFAULT_TABLE table=default.Table_7ee95575c8bd4022bd40fe7d6071950d [id=ef1ca5eb3c8f45bda8a36a3ed9243f4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:12.999948 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 650ca46244e54bed89e96c4a09fc7a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.007262 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet f06df4cdb79c440b91b0eff135d2dfac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:13.008423 10367 ts_tablet_manager.cc:1434] T 985440898cc04a98877c15a5122a7dd3 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.105s user 0.002s sys 0.000s
I20260810 19:48:13.008639 12941 raft_consensus.cc:493] T b9b567b3338845e4a37cff2a955056ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:13.008814 12941 raft_consensus.cc:515] T b9b567b3338845e4a37cff2a955056ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.009341 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8e32d50c139a4e4f96de1c5580964bf9" } modify_external_catalogs: true
I20260810 19:48:13.009513 12941 leader_election.cc:290] T b9b567b3338845e4a37cff2a955056ae P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:13.009536 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b4656177d37d4cb59b3e500f12b7999e" } new_table_name: "default.Table_e0cbf5c3255a4df480038df674f812b6" modify_external_catalogs: true
I20260810 19:48:13.009644 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8e32d50c139a4e4f96de1c5580964bf9" } modify_external_catalogs: true
I20260810 19:48:13.010558 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0ce62d56d03f4f9aa5441e1150e8fc6a" } modify_external_catalogs: true
I20260810 19:48:13.010777 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0ce62d56d03f4f9aa5441e1150e8fc6a" } modify_external_catalogs: true
I20260810 19:48:13.010931 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b567b3338845e4a37cff2a955056ae" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:13.013691 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_6209fa63063d4a6d992f1c3c74ca3720"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.014591 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6209fa63063d4a6d992f1c3c74ca3720 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.016945 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_956c60475b324cce9ff49890df2272a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.018775 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_956c60475b324cce9ff49890df2272a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.019234 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet 985440898cc04a98877c15a5122a7dd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:13.017462 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_31f5fbb1fbfc4d92a4e4ca2f2614be0b" } modify_external_catalogs: true
I20260810 19:48:13.020087 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_31f5fbb1fbfc4d92a4e4ca2f2614be0b" } modify_external_catalogs: true
I20260810 19:48:13.021860 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet f06df4cdb79c440b91b0eff135d2dfac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:13.023231 10367 tablet_bootstrap.cc:492] T 1bbd3fe2117c42058dc108b5dc18d560 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:13.023546 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet a1628a2a930a4819818df3ea480ab4db
I20260810 19:48:13.024050 9415 catalog_manager.cc:6807] ReplaceTablet: tablet a1628a2a930a4819818df3ea480ab4db deleted and replaced by tablet 533e173a395549e89d021ceba7407696
I20260810 19:48:13.025713 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet a1628a2a930a4819818df3ea480ab4db with delete_type TABLET_DATA_DELETED (replaced by tablet 533e173a395549e89d021ceba7407696) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:13.025863 9611 leader_election.cc:343] T b9b567b3338845e4a37cff2a955056ae P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:13.026935 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet d7595dbb46b6441dbb811611da116791 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7595dbb46b6441dbb811611da116791 already in progress: creating tablet
I20260810 19:48:13.027213 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet a1628a2a930a4819818df3ea480ab4db with delete_type TABLET_DATA_DELETED (replaced by tablet 533e173a395549e89d021ceba7407696) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:13.027567 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet a1628a2a930a4819818df3ea480ab4db with delete_type TABLET_DATA_DELETED (replaced by tablet 533e173a395549e89d021ceba7407696) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:13.027940 10370 tablet_bootstrap.cc:492] T 19e2bf7b7d254894a07c5a75bf24e742 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:13.028151 10370 ts_tablet_manager.cc:1403] T 19e2bf7b7d254894a07c5a75bf24e742 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.156s user 0.000s sys 0.004s
W20260810 19:48:13.028139 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 07856671e97e4f0089cd67f6b8b2ac42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 07856671e97e4f0089cd67f6b8b2ac42 already in progress: creating tablet
W20260810 19:48:13.029017 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 0f2a1ce4229340318460b50be053be39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f2a1ce4229340318460b50be053be39 already in progress: creating tablet
I20260810 19:48:13.029280 10375 tablet_replica.cc:333] T 82c3f619c76e40c583bfcdf2bb77fe42 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:13.029448 10370 raft_consensus.cc:359] T 19e2bf7b7d254894a07c5a75bf24e742 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.029740 10370 raft_consensus.cc:385] T 19e2bf7b7d254894a07c5a75bf24e742 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.029841 10370 raft_consensus.cc:740] T 19e2bf7b7d254894a07c5a75bf24e742 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.032605 10375 raft_consensus.cc:2243] T 82c3f619c76e40c583bfcdf2bb77fe42 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.032793 10375 raft_consensus.cc:2272] T 82c3f619c76e40c583bfcdf2bb77fe42 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.033355 10375 ts_tablet_manager.cc:1916] T 82c3f619c76e40c583bfcdf2bb77fe42 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.035800 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b567b3338845e4a37cff2a955056ae" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:13.030526 10370 consensus_queue.cc:260] T 19e2bf7b7d254894a07c5a75bf24e742 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:13.036546 9611 leader_election.cc:343] T b9b567b3338845e4a37cff2a955056ae P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:13.036697 9611 leader_election.cc:304] T b9b567b3338845e4a37cff2a955056ae P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:13.037177 12941 raft_consensus.cc:2749] T b9b567b3338845e4a37cff2a955056ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:13.041122 10370 ts_tablet_manager.cc:1434] T 19e2bf7b7d254894a07c5a75bf24e742 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260810 19:48:13.041145 9415 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 4571e0c723f74c828220b33116fed9e9 (table default.Table_d9d83336ef124c2da242e77391b001c0 [id=8dbf3227e8ae402aa46b9b31b715faa6]). Expected version 1 got 0
I20260810 19:48:13.042094 10370 tablet_bootstrap.cc:492] T 8fadd6f84c75466287b318ed7018b071 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:13.044476 10366 tablet_bootstrap.cc:492] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:13.046404 10366 tablet_bootstrap.cc:654] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:13.050547 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 898b70d09c1d410fb75cd4dd32d844c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.051134 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04efdb236d4647098c89c90a593a0269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.051293 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1056) took 1294 ms. Trace:
I20260810 19:48:13.051401 10377 rpcz_store.cc:276] 0810 19:48:11.756704 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:11.756745 (+ 41us) service_pool.cc:224] Handling call
0810 19:48:12.841039 (+1084294us) ts_tablet_manager.cc:1151] Deleting tablet 827dce05c192467589e2692fabd2a84e
0810 19:48:12.841052 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:12.962444 (+121392us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:12.965680 (+ 3236us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:13.051259 (+ 85579us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1084143}
I20260810 19:48:13.052479 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 827dce05c192467589e2692fabd2a84e (table default.Table_dca6b457fbf744e089c4a583fca06cbb [id=4bce0610a04641ff86ab3af94e12e31d]) successfully deleted
I20260810 19:48:13.053066 10377 tablet_replica.cc:333] T c285518ed49d4ed68a6039f98db3b700 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:13.053279 10377 raft_consensus.cc:2243] T c285518ed49d4ed68a6039f98db3b700 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.053467 10377 raft_consensus.cc:2272] T c285518ed49d4ed68a6039f98db3b700 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.054139 10377 ts_tablet_manager.cc:1916] T c285518ed49d4ed68a6039f98db3b700 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.062505 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 19e2bf7b7d254894a07c5a75bf24e742 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:13.071373 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e861473094f42dfa22b9c00145ed1fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:13.071928 12266 ts_tablet_manager.cc:1929] T 5f4e2adee0264e418ff8c54912973e60 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:13.072261 12266 log.cc:1199] T 5f4e2adee0264e418ff8c54912973e60 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/5f4e2adee0264e418ff8c54912973e60
I20260810 19:48:13.073031 12266 ts_tablet_manager.cc:1950] T 5f4e2adee0264e418ff8c54912973e60 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:13.074689 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 898b70d09c1d410fb75cd4dd32d844c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.075726 12266 tablet_replica.cc:333] T 2d72c72f90964f34bbc2232118dc5172 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:13.076179 12266 raft_consensus.cc:2243] T 2d72c72f90964f34bbc2232118dc5172 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.078565 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04efdb236d4647098c89c90a593a0269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.080936 10118 tablet_service.cc:1511] Processing CreateTablet for tablet 04efdb236d4647098c89c90a593a0269 (DEFAULT_TABLE table=default.Table_7ee95575c8bd4022bd40fe7d6071950d [id=ef1ca5eb3c8f45bda8a36a3ed9243f4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.081166 10370 tablet_bootstrap.cc:654] T 8fadd6f84c75466287b318ed7018b071 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:13.081368 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04efdb236d4647098c89c90a593a0269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.083586 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 5f4e2adee0264e418ff8c54912973e60 (table default.Table_4b3474ab5fac40a28a050d69fc60bfe5 [id=495386acd3524a388b83e38f07bf9967]) successfully deleted
I20260810 19:48:13.091444 10377 ts_tablet_manager.cc:1929] T c285518ed49d4ed68a6039f98db3b700 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:13.091260 12266 raft_consensus.cc:2272] T 2d72c72f90964f34bbc2232118dc5172 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.093047 9415 master_service.cc:960] ReplaceTablet: received request to replace tablet 18cd8adaa065425c846bc791c05fa67d from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:13.095973 10377 log.cc:1199] T c285518ed49d4ed68a6039f98db3b700 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/c285518ed49d4ed68a6039f98db3b700
I20260810 19:48:13.098905 10377 ts_tablet_manager.cc:1950] T c285518ed49d4ed68a6039f98db3b700 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:13.101501 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1057) took 1344 ms. Trace:
I20260810 19:48:13.102496 10377 rpcz_store.cc:276] 0810 19:48:11.757009 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:11.757045 (+ 36us) service_pool.cc:224] Handling call
0810 19:48:13.052997 (+1295952us) ts_tablet_manager.cc:1151] Deleting tablet c285518ed49d4ed68a6039f98db3b700
0810 19:48:13.053012 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.074897 (+ 21885us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:13.091372 (+ 16475us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:13.101469 (+ 10097us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1295815}
I20260810 19:48:13.104387 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet c285518ed49d4ed68a6039f98db3b700 (table default.Table_bb5a9a9ebfd340fba882f6db00cf2dac [id=4b0cbb23d570430bb2d95e9c1b27bb4d]) successfully deleted
I20260810 19:48:13.104218 12266 ts_tablet_manager.cc:1916] T 2d72c72f90964f34bbc2232118dc5172 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.105356 10375 ts_tablet_manager.cc:1929] T 82c3f619c76e40c583bfcdf2bb77fe42 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:13.105489 10375 log.cc:1199] T 82c3f619c76e40c583bfcdf2bb77fe42 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/82c3f619c76e40c583bfcdf2bb77fe42
I20260810 19:48:13.104575 10367 tablet_bootstrap.cc:654] T 1bbd3fe2117c42058dc108b5dc18d560 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:13.105821 10375 ts_tablet_manager.cc:1950] T 82c3f619c76e40c583bfcdf2bb77fe42 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:13.106153 10377 tablet_replica.cc:333] T 8fadd6f84c75466287b318ed7018b071 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:13.107590 10377 raft_consensus.cc:2243] T 8fadd6f84c75466287b318ed7018b071 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.108474 10377 raft_consensus.cc:2272] T 8fadd6f84c75466287b318ed7018b071 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.112103 10377 ts_tablet_manager.cc:1916] T 8fadd6f84c75466287b318ed7018b071 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.120360 9407 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet dee50a5934234b3c8385618521e1343c
I20260810 19:48:13.121634 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 79841de1d91c4961bc0742d89d570a7f
W20260810 19:48:13.123769 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e56d9c164d2b47abb004d13b7f2488d9 consensus state has no leader
I20260810 19:48:13.123903 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 79841de1d91c4961bc0742d89d570a7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:13.124207 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet 79841de1d91c4961bc0742d89d570a7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:13.124956 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet fafad8559b074dab958f03061e65b8c3
I20260810 19:48:13.126530 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet fafad8559b074dab958f03061e65b8c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:13.127063 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet fafad8559b074dab958f03061e65b8c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:13.128386 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 79841de1d91c4961bc0742d89d570a7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:13.129103 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet fafad8559b074dab958f03061e65b8c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:13.130267 12796 catalog_manager.cc:1610] T 00000000000000000000000000000000 P f52c40e347e24ab4b3129e7064f4a43e: acquiring CA information for follower catalog manager: success
I20260810 19:48:13.132330 10366 tablet_bootstrap.cc:492] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:13.132500 10366 ts_tablet_manager.cc:1403] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.088s user 0.002s sys 0.001s
I20260810 19:48:13.133031 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 18cd8adaa065425c846bc791c05fa67d
I20260810 19:48:13.133359 10366 raft_consensus.cc:359] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.133554 10366 raft_consensus.cc:385] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.133607 10366 raft_consensus.cc:740] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.134090 10366 consensus_queue.cc:260] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.134398 9415 catalog_manager.cc:6807] ReplaceTablet: tablet 18cd8adaa065425c846bc791c05fa67d deleted and replaced by tablet af1d322a56d0462fa795b98fbed5d07f
I20260810 19:48:13.135491 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet 18cd8adaa065425c846bc791c05fa67d with delete_type TABLET_DATA_DELETED (replaced by tablet af1d322a56d0462fa795b98fbed5d07f) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:13.135551 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 18cd8adaa065425c846bc791c05fa67d with delete_type TABLET_DATA_DELETED (replaced by tablet af1d322a56d0462fa795b98fbed5d07f) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:13.136550 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 82c3f619c76e40c583bfcdf2bb77fe42 (table default.Table_267ef2e8b32c47328dd2094f69e0940d [id=0f7622612fec444b93d9454f31849cd7]) successfully deleted
I20260810 19:48:13.136937 10375 tablet_replica.cc:333] T 4198f46be0194875aea6a7952321bc69 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:13.137184 10375 raft_consensus.cc:2243] T 4198f46be0194875aea6a7952321bc69 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.137399 10375 raft_consensus.cc:2272] T 4198f46be0194875aea6a7952321bc69 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.138005 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 18cd8adaa065425c846bc791c05fa67d with delete_type TABLET_DATA_DELETED (replaced by tablet af1d322a56d0462fa795b98fbed5d07f) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:13.138053 10375 ts_tablet_manager.cc:1916] T 4198f46be0194875aea6a7952321bc69 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.146279 10366 ts_tablet_manager.cc:1434] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260810 19:48:13.148655 10377 ts_tablet_manager.cc:1929] T 8fadd6f84c75466287b318ed7018b071 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:13.151758 10367 tablet_bootstrap.cc:492] T 1bbd3fe2117c42058dc108b5dc18d560 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:13.159152 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_327c404433c9482fa11e3d685ddfb285" } modify_external_catalogs: true
I20260810 19:48:13.159436 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_327c404433c9482fa11e3d685ddfb285" } modify_external_catalogs: true
I20260810 19:48:13.160391 10377 log.cc:1199] T 8fadd6f84c75466287b318ed7018b071 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/8fadd6f84c75466287b318ed7018b071
I20260810 19:48:13.160885 10377 ts_tablet_manager.cc:1950] T 8fadd6f84c75466287b318ed7018b071 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:13.163097 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b419a0a71fdf463aa340b7bb088ca240"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.163790 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b419a0a71fdf463aa340b7bb088ca240 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.165503 9413 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 85f1c7a75aac4d6a9462af4def91eaa4 (table default.Table_08c83fc388864b6f8a1ed597dc70bffe [id=2d55615cd797441c8abf6ea5a64f2f9f]). Expected version 1 got 0
I20260810 19:48:13.168030 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_9aae22fac7d84519b6a1c0620aaf46e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.168613 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9aae22fac7d84519b6a1c0620aaf46e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.169248 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_78040083fb05410ab04cbefee43fa0b5" } new_table_name: "default.Table_bfaec4943b1d4077b951ea1b272f162c" modify_external_catalogs: true
I20260810 19:48:13.169906 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f85c03bf4ccd4433987a0f0c36dc6f51"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.170460 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f85c03bf4ccd4433987a0f0c36dc6f51 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.171770 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e4db3fb13aa44a73816ed73c2085aabb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.172260 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4db3fb13aa44a73816ed73c2085aabb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.173131 9421 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 639c824ba4834734a4ebfd558181bebe (table default.Table_35ada13f5f5a41b0a93a57276b7756d9 [id=fa3844f34a5b4d55b6e87ec2164eb8fb]). Expected version 2 got 0
I20260810 19:48:13.177680 10367 ts_tablet_manager.cc:1403] T 1bbd3fe2117c42058dc108b5dc18d560 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.155s user 0.005s sys 0.000s
I20260810 19:48:13.178570 10367 raft_consensus.cc:359] T 1bbd3fe2117c42058dc108b5dc18d560 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.178751 10367 raft_consensus.cc:385] T 1bbd3fe2117c42058dc108b5dc18d560 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.178814 10367 raft_consensus.cc:740] T 1bbd3fe2117c42058dc108b5dc18d560 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.179320 10367 consensus_queue.cc:260] T 1bbd3fe2117c42058dc108b5dc18d560 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.156594 12941 raft_consensus.cc:493] T 8d93821ff46a4096a8ebbac83faabed7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:13.176855 13022 raft_consensus.cc:493] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:13.180037 13022 raft_consensus.cc:515] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.180011 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_02a17ae88cd04ad7ad4a2303291ea6c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:13.180910 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_582690e0f3bc4e399ad7f7d62c81ee63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:13.181186 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b19479978c46bf8a425ccf1225ef45" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:13.181407 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_582690e0f3bc4e399ad7f7d62c81ee63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:13.181831 9611 leader_election.cc:343] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:13.176981 13019 raft_consensus.cc:493] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:13.182029 13019 raft_consensus.cc:515] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.182765 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_886708c0fc644bb29d6dbd06061dac2a" } modify_external_catalogs: true
I20260810 19:48:13.182940 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_886708c0fc644bb29d6dbd06061dac2a" } modify_external_catalogs: true
I20260810 19:48:13.183126 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0292c3214aa84c40ace16760f414d912" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:13.180567 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02a17ae88cd04ad7ad4a2303291ea6c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:13.183671 9611 leader_election.cc:343] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:13.179782 12941 raft_consensus.cc:515] T 8d93821ff46a4096a8ebbac83faabed7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.184221 12941 leader_election.cc:290] T 8d93821ff46a4096a8ebbac83faabed7 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:13.188565 9418 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 85f1c7a75aac4d6a9462af4def91eaa4 (table default.Table_08c83fc388864b6f8a1ed597dc70bffe [id=2d55615cd797441c8abf6ea5a64f2f9f]). Expected version 1 got 0
I20260810 19:48:13.189435 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1058) took 1432 ms. Trace:
I20260810 19:48:13.189538 10377 rpcz_store.cc:276] 0810 19:48:11.757271 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:11.757321 (+ 50us) service_pool.cc:224] Handling call
0810 19:48:13.105719 (+1348398us) ts_tablet_manager.cc:1151] Deleting tablet 8fadd6f84c75466287b318ed7018b071
0810 19:48:13.105742 (+ 23us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.130408 (+ 24666us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:13.148587 (+ 18179us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:13.189405 (+ 40818us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1347890}
I20260810 19:48:13.190061 10377 tablet_replica.cc:333] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:13.190248 10377 raft_consensus.cc:2243] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.190430 10377 raft_consensus.cc:2272] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.190821 12993 raft_consensus.cc:493] T d6f410a1659c40f08ac274e63ad01b3d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:13.190970 12993 raft_consensus.cc:515] T d6f410a1659c40f08ac274e63ad01b3d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.191671 12993 leader_election.cc:290] T d6f410a1659c40f08ac274e63ad01b3d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:13.192557 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 8fadd6f84c75466287b318ed7018b071 (table default.Table_398b6d4ebbf742b99fad6aff42d2802b [id=453661c1f5834b56aad5d2d647338fc6]) successfully deleted
W20260810 19:48:13.192859 10067 leader_election.cc:343] T d6f410a1659c40f08ac274e63ad01b3d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: d6f410a1659c40f08ac274e63ad01b3d
W20260810 19:48:13.193946 10068 leader_election.cc:343] T d6f410a1659c40f08ac274e63ad01b3d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: d6f410a1659c40f08ac274e63ad01b3d
I20260810 19:48:13.194060 10068 leader_election.cc:304] T d6f410a1659c40f08ac274e63ad01b3d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:13.194574 12993 raft_consensus.cc:2749] T d6f410a1659c40f08ac274e63ad01b3d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:13.195825 10377 ts_tablet_manager.cc:1916] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.196822 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d64b095dd9e84a8c974131583cd0df88" } new_table_name: "default.Table_4db3e682f5c742918336d8194c9d4ccb" modify_external_catalogs: true
I20260810 19:48:13.197036 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_68a0e01c57ae4151ae692342c695108f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.197624 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68a0e01c57ae4151ae692342c695108f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.198390 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e10da6ead51548a985d3505c50a15bce" } new_table_name: "default.Table_682558b2f6f940a795815ea684be6922" modify_external_catalogs: true
I20260810 19:48:13.199419 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d93821ff46a4096a8ebbac83faabed7" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:13.199573 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1c7511005f554782a856d4660f40280b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.200147 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c7511005f554782a856d4660f40280b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.200434 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d93821ff46a4096a8ebbac83faabed7" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:13.202010 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6493b63f37da467b9c631e0081ffceef" } new_table_name: "default.Table_588b2fe708f6452faacf1e96ef145232" modify_external_catalogs: true
W20260810 19:48:13.203843 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c0fc251932454c378f94cbfaa4955232 consensus state has no leader
W20260810 19:48:13.205791 9611 leader_election.cc:343] T 8d93821ff46a4096a8ebbac83faabed7 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:13.206151 9611 leader_election.cc:343] T 8d93821ff46a4096a8ebbac83faabed7 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:13.206275 9611 leader_election.cc:304] T 8d93821ff46a4096a8ebbac83faabed7 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:13.209216 12941 raft_consensus.cc:2749] T 8d93821ff46a4096a8ebbac83faabed7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:13.209663 13022 leader_election.cc:290] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:13.210413 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b19479978c46bf8a425ccf1225ef45" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:13.210644 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bbd3fe2117c42058dc108b5dc18d560 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:04 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:13.211057 10366 tablet_bootstrap.cc:492] T 8fce298689e9415a8860b8734d73b10a P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
W20260810 19:48:13.211086 9611 leader_election.cc:343] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:13.211252 9611 leader_election.cc:304] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:13.211776 13019 leader_election.cc:290] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:13.211953 13019 raft_consensus.cc:2749] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:13.212554 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0292c3214aa84c40ace16760f414d912" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:13.214480 10366 tablet_bootstrap.cc:654] T 8fce298689e9415a8860b8734d73b10a P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:13.219094 9611 leader_election.cc:343] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:13.219367 9611 leader_election.cc:304] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:13.219879 13022 raft_consensus.cc:2749] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:13.221164 10370 tablet_bootstrap.cc:492] T 8fadd6f84c75466287b318ed7018b071 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:13.221395 10370 ts_tablet_manager.cc:1403] T 8fadd6f84c75466287b318ed7018b071 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.179s user 0.007s sys 0.001s
I20260810 19:48:13.221525 10377 ts_tablet_manager.cc:1929] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:13.221662 10377 log.cc:1199] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/ab27734e3d974260a77f1d94e5f534fe
I20260810 19:48:13.221982 10377 ts_tablet_manager.cc:1950] T ab27734e3d974260a77f1d94e5f534fe P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:13.222371 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1059) took 1464 ms. Trace:
I20260810 19:48:13.222537 10370 raft_consensus.cc:359] T 8fadd6f84c75466287b318ed7018b071 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.222827 10370 raft_consensus.cc:385] T 8fadd6f84c75466287b318ed7018b071 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 19:48:13.222877 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e663c45e1a1f4d4b8b09048d7c65f60e consensus state has no leader
I20260810 19:48:13.222930 10370 raft_consensus.cc:740] T 8fadd6f84c75466287b318ed7018b071 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.223300 10370 consensus_queue.cc:260] T 8fadd6f84c75466287b318ed7018b071 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:13.224984 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dc3164c171b84b04bc67c0218ece7e99 consensus state has no leader
W20260810 19:48:13.227016 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ab4a94ad4a64380b2e185327bbe0d0d consensus state has no leader
W20260810 19:48:13.231940 9142 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 57253.8us
I20260810 19:48:13.232023 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fadd6f84c75466287b318ed7018b071 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:53 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:13.233209 12066 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 19:48:13.235939 10370 ts_tablet_manager.cc:1434] T 8fadd6f84c75466287b318ed7018b071 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260810 19:48:13.243170 10377 rpcz_store.cc:276] 0810 19:48:11.757543 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:11.757577 (+ 34us) service_pool.cc:224] Handling call
0810 19:48:13.190003 (+1432426us) ts_tablet_manager.cc:1151] Deleting tablet ab27734e3d974260a77f1d94e5f534fe
0810 19:48:13.190014 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.218265 (+ 28251us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:13.221451 (+ 3186us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:13.222349 (+ 898us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1432311}
I20260810 19:48:13.243976 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet ab27734e3d974260a77f1d94e5f534fe (table default.Table_1954ac0ddba541af937bd2b421cb2f8e [id=bbf1b3708f9644d486aef32d1099aede]) successfully deleted
I20260810 19:48:13.244937 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1065) took 1337 ms. Trace:
I20260810 19:48:13.245705 10377 rpcz_store.cc:276] 0810 19:48:11.907051 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:11.907998 (+ 947us) service_pool.cc:224] Handling call
0810 19:48:13.244722 (+1336724us) ts_tablet_manager.cc:1151] Deleting tablet d857efeee4d3442ca065221e3095d421
0810 19:48:13.244746 (+ 24us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.244909 (+ 163us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1336513}
W20260810 19:48:13.246547 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet d857efeee4d3442ca065221e3095d421 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d857efeee4d3442ca065221e3095d421 already in progress: creating tablet
I20260810 19:48:13.247094 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1068) took 1308 ms. Trace:
I20260810 19:48:13.247643 9413 master_service.cc:960] ReplaceTablet: received request to replace tablet 25570b1795164aeca86a5313bd30a4c9 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:13.247823 10370 tablet_bootstrap.cc:492] T c285518ed49d4ed68a6039f98db3b700 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:13.247833 10377 rpcz_store.cc:276] 0810 19:48:11.938357 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:11.938411 (+ 54us) service_pool.cc:224] Handling call
0810 19:48:13.246954 (+1308543us) ts_tablet_manager.cc:1151] Deleting tablet 065536e52b4a477a824ab0261168cbd3
0810 19:48:13.246966 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.247072 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1308215}
W20260810 19:48:13.248625 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 065536e52b4a477a824ab0261168cbd3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 065536e52b4a477a824ab0261168cbd3 already in progress: creating tablet
I20260810 19:48:13.249567 12266 ts_tablet_manager.cc:1929] T 2d72c72f90964f34bbc2232118dc5172 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:13.249651 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1072) took 1204 ms. Trace:
I20260810 19:48:13.249744 10377 rpcz_store.cc:276] 0810 19:48:12.045031 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:12.045085 (+ 54us) service_pool.cc:224] Handling call
0810 19:48:13.249522 (+1204437us) ts_tablet_manager.cc:1151] Deleting tablet 4abd3c95aa394e1cad066d49d22b5764
0810 19:48:13.249533 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.249630 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1204217}
I20260810 19:48:13.250036 10375 ts_tablet_manager.cc:1929] T 4198f46be0194875aea6a7952321bc69 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:13.250171 10375 log.cc:1199] T 4198f46be0194875aea6a7952321bc69 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/4198f46be0194875aea6a7952321bc69
W20260810 19:48:13.250295 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 4abd3c95aa394e1cad066d49d22b5764 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4abd3c95aa394e1cad066d49d22b5764 already in progress: creating tablet
I20260810 19:48:13.250552 10375 ts_tablet_manager.cc:1950] T 4198f46be0194875aea6a7952321bc69 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:13.251225 10377 tablet_replica.cc:333] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:13.251935 10375 tablet_replica.cc:333] T d6f410a1659c40f08ac274e63ad01b3d P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:13.251953 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 4198f46be0194875aea6a7952321bc69 (table default.Table_066ecd6fc0e0441eb69e39d946ba0b9a [id=f5ad4bd8b30e44e9b14bd6dfcc2bbb28]) successfully deleted
I20260810 19:48:13.252138 10375 raft_consensus.cc:2243] T d6f410a1659c40f08ac274e63ad01b3d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.252185 10377 raft_consensus.cc:2243] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:13.252293 10375 raft_consensus.cc:2272] T d6f410a1659c40f08ac274e63ad01b3d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:13.252281 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 44e5c597335a4795b8dbb708af7726ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44e5c597335a4795b8dbb708af7726ee already in progress: creating tablet
I20260810 19:48:13.252527 10377 raft_consensus.cc:2272] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:13.252856 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet e1993fe2402f485481c36a5b41ba2571 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1993fe2402f485481c36a5b41ba2571 already in progress: creating tablet
I20260810 19:48:13.252873 10375 ts_tablet_manager.cc:1916] T d6f410a1659c40f08ac274e63ad01b3d P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.253154 12266 log.cc:1199] T 2d72c72f90964f34bbc2232118dc5172 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/2d72c72f90964f34bbc2232118dc5172
I20260810 19:48:13.253551 12266 ts_tablet_manager.cc:1950] T 2d72c72f90964f34bbc2232118dc5172 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:13.254737 10367 ts_tablet_manager.cc:1434] T 1bbd3fe2117c42058dc108b5dc18d560 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.077s user 0.002s sys 0.000s
I20260810 19:48:13.259657 10377 ts_tablet_manager.cc:1916] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.264336 10366 tablet_bootstrap.cc:492] T 8fce298689e9415a8860b8734d73b10a P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:13.264521 10367 tablet_bootstrap.cc:492] T eb3e7d34b5314bc7a7c5ed53792728ca P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:13.264519 10366 ts_tablet_manager.cc:1403] T 8fce298689e9415a8860b8734d73b10a P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.054s user 0.000s sys 0.004s
I20260810 19:48:13.265376 10366 raft_consensus.cc:359] T 8fce298689e9415a8860b8734d73b10a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.265564 10366 raft_consensus.cc:385] T 8fce298689e9415a8860b8734d73b10a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.265630 10366 raft_consensus.cc:740] T 8fce298689e9415a8860b8734d73b10a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.265851 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 2d72c72f90964f34bbc2232118dc5172 (table default.Table_83e700e09b2a43c3b2133def7eb871bc [id=85104f90d64e4270a62cab5a7814a36d]) successfully deleted
I20260810 19:48:13.266700 10377 ts_tablet_manager.cc:1929] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:13.268137 10367 tablet_bootstrap.cc:654] T eb3e7d34b5314bc7a7c5ed53792728ca P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:13.269279 12266 tablet_replica.cc:333] T b9b567b3338845e4a37cff2a955056ae P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:13.269632 12266 raft_consensus.cc:2243] T b9b567b3338845e4a37cff2a955056ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.271729 10370 tablet_bootstrap.cc:654] T c285518ed49d4ed68a6039f98db3b700 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:13.273239 12266 raft_consensus.cc:2272] T b9b567b3338845e4a37cff2a955056ae P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.274430 10377 log.cc:1199] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/3bf9486839474b2a8ddff3a49b4fda2a
I20260810 19:48:13.274856 10377 ts_tablet_manager.cc:1950] T 3bf9486839474b2a8ddff3a49b4fda2a P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:13.275218 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1070) took 1236 ms. Trace:
I20260810 19:48:13.275310 10377 rpcz_store.cc:276] 0810 19:48:12.038530 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:12.047458 (+ 8928us) service_pool.cc:224] Handling call
0810 19:48:13.251175 (+1203717us) ts_tablet_manager.cc:1151] Deleting tablet 3bf9486839474b2a8ddff3a49b4fda2a
0810 19:48:13.251186 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.263175 (+ 11989us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:13.266636 (+ 3461us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:13.275196 (+ 8560us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1203096}
I20260810 19:48:13.275781 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1071) took 1231 ms. Trace:
I20260810 19:48:13.275895 10377 rpcz_store.cc:276] 0810 19:48:12.044105 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:12.049477 (+ 5372us) service_pool.cc:224] Handling call
0810 19:48:13.275642 (+1226165us) ts_tablet_manager.cc:1151] Deleting tablet b5ec15d8a0d241e3b6238c408d2fb436
0810 19:48:13.275653 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.275763 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1225986}
I20260810 19:48:13.276012 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 3bf9486839474b2a8ddff3a49b4fda2a (table default.Table_0bbfea1f106c4df1921c642928671792 [id=d628448cf7b94ebab79194e81fcaf040]) successfully deleted
I20260810 19:48:13.276295 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1069) took 1266 ms. Trace:
I20260810 19:48:13.276368 10377 rpcz_store.cc:276] 0810 19:48:12.009782 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:12.106811 (+ 97029us) service_pool.cc:224] Handling call
0810 19:48:13.276178 (+1169367us) ts_tablet_manager.cc:1151] Deleting tablet 625b0e4eedb946908bd00c6af5f06c08
0810 19:48:13.276189 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.276279 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1169006}
W20260810 19:48:13.276672 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet b5ec15d8a0d241e3b6238c408d2fb436 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5ec15d8a0d241e3b6238c408d2fb436 already in progress: creating tablet
I20260810 19:48:13.276711 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1074) took 1143 ms. Trace:
I20260810 19:48:13.276774 10377 rpcz_store.cc:276] 0810 19:48:12.132936 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:12.133073 (+ 137us) service_pool.cc:224] Handling call
0810 19:48:13.276612 (+1143539us) ts_tablet_manager.cc:1151] Deleting tablet d7595dbb46b6441dbb811611da116791
0810 19:48:13.276622 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.276696 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1143284}
I20260810 19:48:13.276852 12266 ts_tablet_manager.cc:1916] T b9b567b3338845e4a37cff2a955056ae P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.277088 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1075) took 1027 ms. Trace:
I20260810 19:48:13.277156 10377 rpcz_store.cc:276] 0810 19:48:12.249588 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:12.249779 (+ 191us) service_pool.cc:224] Handling call
0810 19:48:13.276988 (+1027209us) ts_tablet_manager.cc:1151] Deleting tablet 07856671e97e4f0089cd67f6b8b2ac42
0810 19:48:13.276997 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.277073 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":997680}
I20260810 19:48:13.277406 10377 tablet_replica.cc:333] T bafc42f0cdf94ebd823dfb678df8a83b P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
W20260810 19:48:13.277412 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 625b0e4eedb946908bd00c6af5f06c08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 625b0e4eedb946908bd00c6af5f06c08 already in progress: creating tablet
I20260810 19:48:13.277583 10377 raft_consensus.cc:2243] T bafc42f0cdf94ebd823dfb678df8a83b P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260810 19:48:13.277652 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet d7595dbb46b6441dbb811611da116791 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7595dbb46b6441dbb811611da116791 already in progress: creating tablet
I20260810 19:48:13.277729 10377 raft_consensus.cc:2272] T bafc42f0cdf94ebd823dfb678df8a83b P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:13.279696 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 07856671e97e4f0089cd67f6b8b2ac42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 07856671e97e4f0089cd67f6b8b2ac42 already in progress: creating tablet
I20260810 19:48:13.282029 10366 consensus_queue.cc:260] T 8fce298689e9415a8860b8734d73b10a P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.289552 10377 ts_tablet_manager.cc:1916] T bafc42f0cdf94ebd823dfb678df8a83b P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.290158 12899 raft_consensus.cc:493] T 9e861473094f42dfa22b9c00145ed1fe P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:13.290299 12899 raft_consensus.cc:515] T 9e861473094f42dfa22b9c00145ed1fe P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.291083 12899 leader_election.cc:290] T 9e861473094f42dfa22b9c00145ed1fe P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:13.292506 9831 leader_election.cc:343] T 9e861473094f42dfa22b9c00145ed1fe P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 9e861473094f42dfa22b9c00145ed1fe
I20260810 19:48:13.293356 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e861473094f42dfa22b9c00145ed1fe" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:13.294296 9830 leader_election.cc:343] T 9e861473094f42dfa22b9c00145ed1fe P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:13.294438 9830 leader_election.cc:304] T 9e861473094f42dfa22b9c00145ed1fe P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:13.294665 12899 raft_consensus.cc:2749] T 9e861473094f42dfa22b9c00145ed1fe P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:13.297628 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fce298689e9415a8860b8734d73b10a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:13.300020 10366 ts_tablet_manager.cc:1434] T 8fce298689e9415a8860b8734d73b10a P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.035s user 0.002s sys 0.001s
I20260810 19:48:13.303504 10370 tablet_bootstrap.cc:492] T c285518ed49d4ed68a6039f98db3b700 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:13.303814 10370 ts_tablet_manager.cc:1403] T c285518ed49d4ed68a6039f98db3b700 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.056s user 0.004s sys 0.002s
I20260810 19:48:13.304908 10370 raft_consensus.cc:359] T c285518ed49d4ed68a6039f98db3b700 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.306202 10370 raft_consensus.cc:385] T c285518ed49d4ed68a6039f98db3b700 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.306380 10370 raft_consensus.cc:740] T c285518ed49d4ed68a6039f98db3b700 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.307168 10370 consensus_queue.cc:260] T c285518ed49d4ed68a6039f98db3b700 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.307245 12899 raft_consensus.cc:493] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:13.307389 12899 raft_consensus.cc:515] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.307953 10366 tablet_bootstrap.cc:492] T 1a393149727043f3a3c9f58aa051b065 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:13.308007 12899 leader_election.cc:290] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:13.308846 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f1c7a75aac4d6a9462af4def91eaa4" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:13.308967 10377 ts_tablet_manager.cc:1929] T bafc42f0cdf94ebd823dfb678df8a83b P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:13.309075 10377 log.cc:1199] T bafc42f0cdf94ebd823dfb678df8a83b P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/bafc42f0cdf94ebd823dfb678df8a83b
I20260810 19:48:13.309074 9710 raft_consensus.cc:2468] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:13.309409 10377 ts_tablet_manager.cc:1950] T bafc42f0cdf94ebd823dfb678df8a83b P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:13.309731 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1077) took 1055 ms. Trace:
I20260810 19:48:13.309835 10366 tablet_bootstrap.cc:654] T 1a393149727043f3a3c9f58aa051b065 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:13.310892 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f1c7a75aac4d6a9462af4def91eaa4" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:13.311729 9416 master_service.cc:960] ReplaceTablet: received request to replace tablet f46571d9b4d948d3938607ebef926c40 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:13.316992 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet c285518ed49d4ed68a6039f98db3b700 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:13.317396 13024 raft_consensus.cc:493] T 9ed73161398f4f54a20a9173c18b4d3c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:13.317572 13024 raft_consensus.cc:515] T 9ed73161398f4f54a20a9173c18b4d3c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.318477 13024 leader_election.cc:290] T 9ed73161398f4f54a20a9173c18b4d3c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:13.321063 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ed73161398f4f54a20a9173c18b4d3c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:13.321964 9611 leader_election.cc:343] T 9ed73161398f4f54a20a9173c18b4d3c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:13.323208 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3ed9bf4f04b84f50a6c180549217eaef" } modify_external_catalogs: true
I20260810 19:48:13.323437 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3ed9bf4f04b84f50a6c180549217eaef" } modify_external_catalogs: true
I20260810 19:48:13.323753 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8ce93209c7104f5cb5d786470e0fbf94" } modify_external_catalogs: true
I20260810 19:48:13.323964 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8ce93209c7104f5cb5d786470e0fbf94" } modify_external_catalogs: true
I20260810 19:48:13.324204 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_94035ceea51a46b78f6bd96e4f02633b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.324841 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94035ceea51a46b78f6bd96e4f02633b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.325498 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a49e1248aac4485dbe3017d35ed27b9d" } new_table_name: "default.Table_2c9aa482e51c48f6bd512effb1144fa9" modify_external_catalogs: true
I20260810 19:48:13.326455 10370 ts_tablet_manager.cc:1434] T c285518ed49d4ed68a6039f98db3b700 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.022s user 0.001s sys 0.001s
I20260810 19:48:13.327510 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5f2085e8097146c1a9f517a1e25fdaa4" } modify_external_catalogs: true
I20260810 19:48:13.327699 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5f2085e8097146c1a9f517a1e25fdaa4" } modify_external_catalogs: true
I20260810 19:48:13.328763 10367 tablet_bootstrap.cc:492] T eb3e7d34b5314bc7a7c5ed53792728ca P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:13.328989 10367 ts_tablet_manager.cc:1403] T eb3e7d34b5314bc7a7c5ed53792728ca P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.065s user 0.007s sys 0.000s
I20260810 19:48:13.329295 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0a2bf4992a02450587c532fe41b6d0b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.329843 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a2bf4992a02450587c532fe41b6d0b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.329901 10367 raft_consensus.cc:359] T eb3e7d34b5314bc7a7c5ed53792728ca P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.330065 10367 raft_consensus.cc:385] T eb3e7d34b5314bc7a7c5ed53792728ca P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.330113 10367 raft_consensus.cc:740] T eb3e7d34b5314bc7a7c5ed53792728ca P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.330422 10367 consensus_queue.cc:260] T eb3e7d34b5314bc7a7c5ed53792728ca P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.337008 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet f46571d9b4d948d3938607ebef926c40
I20260810 19:48:13.337535 9416 catalog_manager.cc:6807] ReplaceTablet: tablet f46571d9b4d948d3938607ebef926c40 deleted and replaced by tablet e785857b6be84721b286398f627dc9a0
I20260810 19:48:13.337760 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet f46571d9b4d948d3938607ebef926c40 with delete_type TABLET_DATA_DELETED (replaced by tablet e785857b6be84721b286398f627dc9a0) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:13.341234 10367 ts_tablet_manager.cc:1434] T eb3e7d34b5314bc7a7c5ed53792728ca P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260810 19:48:13.340268 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet f46571d9b4d948d3938607ebef926c40 with delete_type TABLET_DATA_DELETED (replaced by tablet e785857b6be84721b286398f627dc9a0) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:13.346127 10375 ts_tablet_manager.cc:1929] T d6f410a1659c40f08ac274e63ad01b3d P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:13.346379 10375 log.cc:1199] T d6f410a1659c40f08ac274e63ad01b3d P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/d6f410a1659c40f08ac274e63ad01b3d
I20260810 19:48:13.346688 10375 ts_tablet_manager.cc:1950] T d6f410a1659c40f08ac274e63ad01b3d P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:13.347857 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet eb3e7d34b5314bc7a7c5ed53792728ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:13.347885 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet d6f410a1659c40f08ac274e63ad01b3d (table default.Table_82e33c23f0d84cbc9203727b5216d5b9 [id=36e72d60ff074c289171c16d86625441]) successfully deleted
W20260810 19:48:13.348695 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 65605d404d42467ab6d7eabc8b685c3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65605d404d42467ab6d7eabc8b685c3e already in progress: creating tablet
W20260810 19:48:13.349364 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet a7d3a90046d74f4087fd5b283581970d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7d3a90046d74f4087fd5b283581970d already in progress: creating tablet
W20260810 19:48:13.350085 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 81de4b3e05604a34b305ca0ad744d769 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81de4b3e05604a34b305ca0ad744d769 already in progress: creating tablet
I20260810 19:48:13.309809 10377 rpcz_store.cc:276] 0810 19:48:12.254446 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:12.254532 (+ 86us) service_pool.cc:224] Handling call
0810 19:48:13.277361 (+1022829us) ts_tablet_manager.cc:1151] Deleting tablet bafc42f0cdf94ebd823dfb678df8a83b
0810 19:48:13.277369 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.305581 (+ 28212us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:13.308903 (+ 3322us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:13.309713 (+ 810us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":997992}
W20260810 19:48:13.350819 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0c6565aebe894508b4cbbcd3cd0a849a consensus state has no leader
I20260810 19:48:13.310261 9831 leader_election.cc:304] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
W20260810 19:48:13.350914 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet c01bde86f6d14c4db35f7211b84b7cb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c01bde86f6d14c4db35f7211b84b7cb9 already in progress: creating tablet
W20260810 19:48:13.351531 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet b8ad239a5d4a410581d93b66d3982120 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8ad239a5d4a410581d93b66d3982120 already in progress: creating tablet
I20260810 19:48:13.351629 12899 raft_consensus.cc:2804] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:13.351725 12899 raft_consensus.cc:493] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:13.351785 12899 raft_consensus.cc:3060] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:13.352133 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 60c45125545340059d49b5faa8025c73 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60c45125545340059d49b5faa8025c73 already in progress: creating tablet
I20260810 19:48:13.352401 10375 tablet_replica.cc:333] T 60bd14fb8c2e40dc955352518d463ccb P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:13.352598 10375 raft_consensus.cc:2243] T 60bd14fb8c2e40dc955352518d463ccb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.352744 10375 raft_consensus.cc:2272] T 60bd14fb8c2e40dc955352518d463ccb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.353322 10375 ts_tablet_manager.cc:1916] T 60bd14fb8c2e40dc955352518d463ccb P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.354686 10367 tablet_bootstrap.cc:492] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:13.356464 10367 tablet_bootstrap.cc:654] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:13.356738 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ed73161398f4f54a20a9173c18b4d3c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:13.357380 9830 leader_election.cc:343] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:13.357903 9830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.195:43797, user_credentials={real_user=slave}} blocked reactor thread for 46362.5us
W20260810 19:48:13.358938 9395 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 8569d63bbd8e4753b376ee6a5127fd3d (table default.Table_16ef5360f2e14f14854335370de7da9d [id=0607b06dd44a4804a84538c61db98c34], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8569d63bbd8e4753b376ee6a5127fd3d consensus state has no leader
I20260810 19:48:13.358959 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet f46571d9b4d948d3938607ebef926c40 with delete_type TABLET_DATA_DELETED (replaced by tablet e785857b6be84721b286398f627dc9a0) from {username='slave'} at 127.0.0.1:38276
W20260810 19:48:13.360198 9611 leader_election.cc:343] T 9ed73161398f4f54a20a9173c18b4d3c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:13.360350 9611 leader_election.cc:304] T 9ed73161398f4f54a20a9173c18b4d3c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:13.360790 13024 raft_consensus.cc:2749] T 9ed73161398f4f54a20a9173c18b4d3c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:13.360754 12899 raft_consensus.cc:515] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.361430 12899 leader_election.cc:290] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:13.361852 10375 ts_tablet_manager.cc:1929] T 60bd14fb8c2e40dc955352518d463ccb P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:13.361971 10375 log.cc:1199] T 60bd14fb8c2e40dc955352518d463ccb P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/60bd14fb8c2e40dc955352518d463ccb
I20260810 19:48:13.362176 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f1c7a75aac4d6a9462af4def91eaa4" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:13.362270 10375 ts_tablet_manager.cc:1950] T 60bd14fb8c2e40dc955352518d463ccb P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:13.362452 9709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f1c7a75aac4d6a9462af4def91eaa4" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:13.362643 9709 raft_consensus.cc:3060] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:13.362829 9830 leader_election.cc:343] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:13.363409 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 60bd14fb8c2e40dc955352518d463ccb (table default.Table_e9290dde7b6e467584d7cdf7b0ceae58 [id=72ed9704a69b4a26a1edd95ad525650a]) successfully deleted
I20260810 19:48:13.365401 9709 raft_consensus.cc:2468] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:13.366721 9831 leader_election.cc:304] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:13.367403 12716 raft_consensus.cc:2804] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
W20260810 19:48:13.380606 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 5c637a1138ef43f9ac67bb7e72a0ab1b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c637a1138ef43f9ac67bb7e72a0ab1b already in progress: creating tablet
I20260810 19:48:13.380679 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_17d44a33a01d4be38948cce627bb4baf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.381428 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet d59e5607e4184683bc3924266ed6ca20 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d59e5607e4184683bc3924266ed6ca20 already in progress: creating tablet
W20260810 19:48:13.381665 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17d44a33a01d4be38948cce627bb4baf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:13.382145 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet ab5814fc52ab418e8e3701458210d4b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab5814fc52ab418e8e3701458210d4b6 already in progress: creating tablet
W20260810 19:48:13.382802 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 7a51811b14da4cddbea05f0cf30aad9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a51811b14da4cddbea05f0cf30aad9b already in progress: creating tablet
I20260810 19:48:13.383113 10375 tablet_replica.cc:333] T 31c2b9a4b8334e678b4632fc2f58dd0c P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:13.383343 10375 raft_consensus.cc:2243] T 31c2b9a4b8334e678b4632fc2f58dd0c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.383531 10375 raft_consensus.cc:2272] T 31c2b9a4b8334e678b4632fc2f58dd0c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.384208 10375 ts_tablet_manager.cc:1916] T 31c2b9a4b8334e678b4632fc2f58dd0c P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.385758 10370 tablet_bootstrap.cc:492] T 5aa0f24443a34714a44137a77c12bbc3 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:13.389619 12266 ts_tablet_manager.cc:1929] T b9b567b3338845e4a37cff2a955056ae P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:13.389780 12266 log.cc:1199] T b9b567b3338845e4a37cff2a955056ae P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/b9b567b3338845e4a37cff2a955056ae
I20260810 19:48:13.390095 12266 ts_tablet_manager.cc:1950] T b9b567b3338845e4a37cff2a955056ae P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:13.393661 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet bafc42f0cdf94ebd823dfb678df8a83b (table default.Table_f0bb702e0c7148519ccd7a84a5e9e574 [id=df54120a0a0140fe9561db53b23364b9]) successfully deleted
I20260810 19:48:13.394049 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_d60487a55e0c46939d0a8e1192c5d5d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.394729 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d60487a55e0c46939d0a8e1192c5d5d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.394829 10377 tablet_replica.cc:333] T ee5f38d91bb349a9ae1da8ba69d2ddbc P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:13.395049 10377 raft_consensus.cc:2243] T ee5f38d91bb349a9ae1da8ba69d2ddbc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.395231 10377 raft_consensus.cc:2272] T ee5f38d91bb349a9ae1da8ba69d2ddbc P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.396909 12993 raft_consensus.cc:493] T 19e2bf7b7d254894a07c5a75bf24e742 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:13.397006 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_112ea9a25c8642548fc7d4e0b2156b8e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:13.397069 12993 raft_consensus.cc:515] T 19e2bf7b7d254894a07c5a75bf24e742 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.397418 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_812e48be52f64234afba6d80c1738a56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.397593 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_112ea9a25c8642548fc7d4e0b2156b8e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.397754 12993 leader_election.cc:290] T 19e2bf7b7d254894a07c5a75bf24e742 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:13.397986 10370 tablet_bootstrap.cc:654] T 5aa0f24443a34714a44137a77c12bbc3 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:13.397960 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_812e48be52f64234afba6d80c1738a56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:13.399936 10068 leader_election.cc:343] T 19e2bf7b7d254894a07c5a75bf24e742 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 19e2bf7b7d254894a07c5a75bf24e742
I20260810 19:48:13.404036 12899 raft_consensus.cc:493] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:13.404182 12899 raft_consensus.cc:515] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.405565 12899 leader_election.cc:290] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:13.406424 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4571e0c723f74c828220b33116fed9e9" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:13.406930 10375 ts_tablet_manager.cc:1929] T 31c2b9a4b8334e678b4632fc2f58dd0c P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:13.407059 10375 log.cc:1199] T 31c2b9a4b8334e678b4632fc2f58dd0c P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/31c2b9a4b8334e678b4632fc2f58dd0c
W20260810 19:48:13.407146 9830 leader_election.cc:343] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:13.407387 10375 ts_tablet_manager.cc:1950] T 31c2b9a4b8334e678b4632fc2f58dd0c P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:13.408645 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 31c2b9a4b8334e678b4632fc2f58dd0c (table default.Table_05b1dcc5bf9f412c87505d19c57d7025 [id=a6004b573d3e47feb446328fa64530f4]) successfully deleted
I20260810 19:48:13.410826 10377 ts_tablet_manager.cc:1916] T ee5f38d91bb349a9ae1da8ba69d2ddbc P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.411206 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_4d54510e39fe48b4bb48143495ed1f11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:13.411667 12716 raft_consensus.cc:697] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
W20260810 19:48:13.411837 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d54510e39fe48b4bb48143495ed1f11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.411969 12716 consensus_queue.cc:237] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.416364 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4571e0c723f74c828220b33116fed9e9" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:13.416591 9710 raft_consensus.cc:2468] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:13.417111 9831 leader_election.cc:304] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:13.418529 13037 raft_consensus.cc:2804] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:13.418681 13037 raft_consensus.cc:493] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:13.418815 13037 raft_consensus.cc:3060] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:13.419489 10367 tablet_bootstrap.cc:492] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:13.419696 10367 ts_tablet_manager.cc:1403] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.065s user 0.003s sys 0.001s
I20260810 19:48:13.420542 10367 raft_consensus.cc:359] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.420794 10367 raft_consensus.cc:385] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.420892 10367 raft_consensus.cc:740] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.421259 10367 consensus_queue.cc:260] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.426203 13037 raft_consensus.cc:515] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.428248 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0bf175363efe4e62a23cf86713325670" } new_table_name: "default.Table_79b812377bb844eebb38e83c3e8e35ae" modify_external_catalogs: true
I20260810 19:48:13.429329 10375 tablet_replica.cc:333] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:13.429561 10375 raft_consensus.cc:2243] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:13.429481 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_88b47a908e474b33a3543452ef60adf9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:13.429836 10375 pending_rounds.cc:70] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:13.429888 10375 pending_rounds.cc:77] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058735760793600 op_type: NO_OP noop_request { }
I20260810 19:48:13.429869 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4571e0c723f74c828220b33116fed9e9" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:13.429981 10375 raft_consensus.cc:2889] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:13.430007 9407 master_service.cc:960] ReplaceTablet: received request to replace tablet 0b71af7492854f32b26887f8cbead122 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:13.430068 10375 raft_consensus.cc:2272] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.430078 9710 raft_consensus.cc:3060] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:13.430119 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88b47a908e474b33a3543452ef60adf9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.432578 10375 ts_tablet_manager.cc:1916] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.433038 9710 raft_consensus.cc:2468] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:13.433812 9831 leader_election.cc:304] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:13.434698 13038 raft_consensus.cc:2804] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:13.435024 13038 raft_consensus.cc:697] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:13.435377 13038 consensus_queue.cc:237] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.438434 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1058) took 1136 ms. Trace:
I20260810 19:48:13.438536 12266 rpcz_store.cc:276] 0810 19:48:12.301945 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:12.302035 (+ 90us) service_pool.cc:224] Handling call
0810 19:48:13.269221 (+967186us) ts_tablet_manager.cc:1151] Deleting tablet b9b567b3338845e4a37cff2a955056ae
0810 19:48:13.269230 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.286401 (+ 17171us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:13.389535 (+103134us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:13.438403 (+ 48868us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":966941}
I20260810 19:48:13.439074 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1061) took 1071 ms. Trace:
I20260810 19:48:13.439158 12266 rpcz_store.cc:276] 0810 19:48:12.367625 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:12.367750 (+ 125us) service_pool.cc:224] Handling call
0810 19:48:13.438905 (+1071155us) ts_tablet_manager.cc:1151] Deleting tablet e1993fe2402f485481c36a5b41ba2571
0810 19:48:13.438918 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.439052 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1070945}
I20260810 19:48:13.440269 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet b9b567b3338845e4a37cff2a955056ae (table default.Table_5f059e9b730d466a8e8e0437ac1edbe8 [id=a102fdb234e04e4e8512e9062b5cfaaa]) successfully deleted
W20260810 19:48:13.440618 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet e1993fe2402f485481c36a5b41ba2571 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1993fe2402f485481c36a5b41ba2571 already in progress: creating tablet
I20260810 19:48:13.441973 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1062) took 1040 ms. Trace:
I20260810 19:48:13.442046 12266 rpcz_store.cc:276] 0810 19:48:12.401127 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:12.404173 (+ 3046us) service_pool.cc:224] Handling call
0810 19:48:13.439401 (+1035228us) ts_tablet_manager.cc:1151] Deleting tablet 65605d404d42467ab6d7eabc8b685c3e
0810 19:48:13.439411 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.441951 (+ 2540us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1035000}
I20260810 19:48:13.444756 12266 tablet_replica.cc:333] T 9ed73161398f4f54a20a9173c18b4d3c P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:13.444962 12266 raft_consensus.cc:2243] T 9ed73161398f4f54a20a9173c18b4d3c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260810 19:48:13.445456 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 65605d404d42467ab6d7eabc8b685c3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65605d404d42467ab6d7eabc8b685c3e already in progress: creating tablet
W20260810 19:48:13.448344 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet a7d3a90046d74f4087fd5b283581970d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7d3a90046d74f4087fd5b283581970d already in progress: creating tablet
W20260810 19:48:13.448635 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet c01bde86f6d14c4db35f7211b84b7cb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c01bde86f6d14c4db35f7211b84b7cb9 already in progress: creating tablet
W20260810 19:48:13.448866 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 81de4b3e05604a34b305ca0ad744d769 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81de4b3e05604a34b305ca0ad744d769 already in progress: creating tablet
W20260810 19:48:13.449110 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet b8ad239a5d4a410581d93b66d3982120 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8ad239a5d4a410581d93b66d3982120 already in progress: creating tablet
W20260810 19:48:13.449348 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 60c45125545340059d49b5faa8025c73 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60c45125545340059d49b5faa8025c73 already in progress: creating tablet
W20260810 19:48:13.449596 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 5c637a1138ef43f9ac67bb7e72a0ab1b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c637a1138ef43f9ac67bb7e72a0ab1b already in progress: creating tablet
W20260810 19:48:13.449832 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet ab5814fc52ab418e8e3701458210d4b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab5814fc52ab418e8e3701458210d4b6 already in progress: creating tablet
W20260810 19:48:13.450091 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 7a51811b14da4cddbea05f0cf30aad9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a51811b14da4cddbea05f0cf30aad9b already in progress: creating tablet
I20260810 19:48:13.450600 10366 tablet_bootstrap.cc:492] T 1a393149727043f3a3c9f58aa051b065 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
W20260810 19:48:13.450609 10067 leader_election.cc:343] T 19e2bf7b7d254894a07c5a75bf24e742 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 19e2bf7b7d254894a07c5a75bf24e742
I20260810 19:48:13.450757 10067 leader_election.cc:304] T 19e2bf7b7d254894a07c5a75bf24e742 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:13.450812 10366 ts_tablet_manager.cc:1403] T 1a393149727043f3a3c9f58aa051b065 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.143s user 0.003s sys 0.003s
I20260810 19:48:13.451222 12993 raft_consensus.cc:2749] T 19e2bf7b7d254894a07c5a75bf24e742 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:13.451632 10370 tablet_bootstrap.cc:492] T 5aa0f24443a34714a44137a77c12bbc3 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:13.451795 10370 ts_tablet_manager.cc:1403] T 5aa0f24443a34714a44137a77c12bbc3 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.066s user 0.004s sys 0.000s
I20260810 19:48:13.451710 10366 raft_consensus.cc:359] T 1a393149727043f3a3c9f58aa051b065 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.451889 10366 raft_consensus.cc:385] T 1a393149727043f3a3c9f58aa051b065 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.451952 10366 raft_consensus.cc:740] T 1a393149727043f3a3c9f58aa051b065 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.452607 10370 raft_consensus.cc:359] T 5aa0f24443a34714a44137a77c12bbc3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.452805 10370 raft_consensus.cc:385] T 5aa0f24443a34714a44137a77c12bbc3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.452872 10370 raft_consensus.cc:740] T 5aa0f24443a34714a44137a77c12bbc3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.453094 10370 consensus_queue.cc:260] T 5aa0f24443a34714a44137a77c12bbc3 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.453619 10370 ts_tablet_manager.cc:1434] T 5aa0f24443a34714a44137a77c12bbc3 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:13.453958 10370 tablet_bootstrap.cc:492] T ee5f38d91bb349a9ae1da8ba69d2ddbc P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:48:13.454115 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf1a85faabf4403096a37034ae6ea2e4 consensus state has no leader
I20260810 19:48:13.456326 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_47b3a69e4e0047e6b59c1f92cc57e4f6" } new_table_name: "default.Table_c5d225842c4a41da95a6926891b82619" modify_external_catalogs: true
I20260810 19:48:13.459038 13037 leader_election.cc:290] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:13.459323 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4571e0c723f74c828220b33116fed9e9" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:13.461628 12266 raft_consensus.cc:2272] T 9ed73161398f4f54a20a9173c18b4d3c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.462399 12266 ts_tablet_manager.cc:1916] T 9ed73161398f4f54a20a9173c18b4d3c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.446991 10367 ts_tablet_manager.cc:1434] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.027s user 0.001s sys 0.001s
I20260810 19:48:13.464668 10367 tablet_bootstrap.cc:492] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:13.466753 10367 tablet_bootstrap.cc:654] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:13.468726 10375 ts_tablet_manager.cc:1929] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:13.468869 10375 log.cc:1199] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/ab27734e3d974260a77f1d94e5f534fe
I20260810 19:48:13.469204 10375 ts_tablet_manager.cc:1950] T ab27734e3d974260a77f1d94e5f534fe P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:13.470537 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet ab27734e3d974260a77f1d94e5f534fe (table default.Table_1954ac0ddba541af937bd2b421cb2f8e [id=bbf1b3708f9644d486aef32d1099aede]) successfully deleted
W20260810 19:48:13.471257 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 788c2879a50c4acbb3fdde4833d9d9e3 consensus state has no leader
I20260810 19:48:13.475894 10370 tablet_bootstrap.cc:654] T ee5f38d91bb349a9ae1da8ba69d2ddbc P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:13.460114 9830 leader_election.cc:343] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:13.460959 10366 consensus_queue.cc:260] T 1a393149727043f3a3c9f58aa051b065 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.477686 10366 ts_tablet_manager.cc:1434] T 1a393149727043f3a3c9f58aa051b065 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.027s user 0.001s sys 0.001s
I20260810 19:48:13.478133 10366 tablet_bootstrap.cc:492] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:13.481765 10366 tablet_bootstrap.cc:654] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:13.485184 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0d1801a690ed475badef36affe215228"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:13.485666 10377 ts_tablet_manager.cc:1929] T ee5f38d91bb349a9ae1da8ba69d2ddbc P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:13.485848 10377 log.cc:1199] T ee5f38d91bb349a9ae1da8ba69d2ddbc P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/ee5f38d91bb349a9ae1da8ba69d2ddbc
W20260810 19:48:13.485883 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d1801a690ed475badef36affe215228 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.486374 10377 ts_tablet_manager.cc:1950] T ee5f38d91bb349a9ae1da8ba69d2ddbc P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:13.487298 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1079) took 1232 ms. Trace:
I20260810 19:48:13.489432 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aa0f24443a34714a44137a77c12bbc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:13.500258 10375 tablet_replica.cc:333] T 410855f236004ad4b78839eb1c0c2f1f P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:13.502533 12993 raft_consensus.cc:493] T c285518ed49d4ed68a6039f98db3b700 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:13.502676 10367 tablet_bootstrap.cc:492] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:13.502678 12993 raft_consensus.cc:515] T c285518ed49d4ed68a6039f98db3b700 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.502827 10367 ts_tablet_manager.cc:1403] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.002s
I20260810 19:48:13.502957 10370 tablet_bootstrap.cc:492] T ee5f38d91bb349a9ae1da8ba69d2ddbc P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:13.503083 10370 ts_tablet_manager.cc:1403] T ee5f38d91bb349a9ae1da8ba69d2ddbc P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.000s
I20260810 19:48:13.503388 12993 leader_election.cc:290] T c285518ed49d4ed68a6039f98db3b700 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:13.503526 10367 raft_consensus.cc:359] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:13.504495 10067 leader_election.cc:343] T c285518ed49d4ed68a6039f98db3b700 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: c285518ed49d4ed68a6039f98db3b700
I20260810 19:48:13.504614 10367 raft_consensus.cc:385] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.504769 10367 raft_consensus.cc:740] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
W20260810 19:48:13.504840 10068 leader_election.cc:343] T c285518ed49d4ed68a6039f98db3b700 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: c285518ed49d4ed68a6039f98db3b700
I20260810 19:48:13.504951 10068 leader_election.cc:304] T c285518ed49d4ed68a6039f98db3b700 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:13.505191 10367 consensus_queue.cc:260] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.505312 12993 raft_consensus.cc:2749] T c285518ed49d4ed68a6039f98db3b700 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:13.504516 10366 tablet_bootstrap.cc:492] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:13.505352 10377 rpcz_store.cc:276] 0810 19:48:12.254674 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:12.258412 (+ 3738us) service_pool.cc:224] Handling call
0810 19:48:13.394751 (+1136339us) ts_tablet_manager.cc:1151] Deleting tablet ee5f38d91bb349a9ae1da8ba69d2ddbc
0810 19:48:13.394766 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.426477 (+ 31711us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:13.485594 (+ 59117us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:13.487273 (+ 1679us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1113112}
I20260810 19:48:13.505630 10375 raft_consensus.cc:2243] T 410855f236004ad4b78839eb1c0c2f1f P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.505640 10366 ts_tablet_manager.cc:1403] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.001s
I20260810 19:48:13.506131 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet ee5f38d91bb349a9ae1da8ba69d2ddbc (table default.Table_0a16454a2da548e3a7130a52dbd5143a [id=b1b37ac7ddef44d7b86d2d668527a046]) successfully deleted
I20260810 19:48:13.506189 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1080) took 1231 ms. Trace:
I20260810 19:48:13.506392 10375 raft_consensus.cc:2272] T 410855f236004ad4b78839eb1c0c2f1f P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.506361 10377 rpcz_store.cc:276] 0810 19:48:12.275069 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:12.275171 (+ 102us) service_pool.cc:224] Handling call
0810 19:48:13.505926 (+1230755us) ts_tablet_manager.cc:1151] Deleting tablet 0f2a1ce4229340318460b50be053be39
0810 19:48:13.505939 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.506142 (+ 203us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1223234}
I20260810 19:48:13.506987 10366 raft_consensus.cc:359] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:13.507098 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 0f2a1ce4229340318460b50be053be39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f2a1ce4229340318460b50be053be39 already in progress: creating tablet
I20260810 19:48:13.507261 10366 raft_consensus.cc:385] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.507373 10366 raft_consensus.cc:740] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.507601 10375 ts_tablet_manager.cc:1916] T 410855f236004ad4b78839eb1c0c2f1f P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.507544 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1081) took 1214 ms. Trace:
I20260810 19:48:13.507757 10366 consensus_queue.cc:260] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.507808 10377 rpcz_store.cc:276] 0810 19:48:12.292888 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:12.292949 (+ 61us) service_pool.cc:224] Handling call
0810 19:48:13.507020 (+1214071us) ts_tablet_manager.cc:1151] Deleting tablet 44e5c597335a4795b8dbb708af7726ee
0810 19:48:13.507034 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.507429 (+ 395us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1213758}
W20260810 19:48:13.508810 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 44e5c597335a4795b8dbb708af7726ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44e5c597335a4795b8dbb708af7726ee already in progress: creating tablet
I20260810 19:48:13.509502 10366 ts_tablet_manager.cc:1434] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 19:48:13.513880 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1085) took 1145 ms. Trace:
I20260810 19:48:13.514618 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_12c2d074b668459b8fb2b34d33add2f1" } new_table_name: "default.Table_9a6dd48ac78349b4ab7f2b7920c05839" modify_external_catalogs: true
I20260810 19:48:13.515000 10370 raft_consensus.cc:359] T ee5f38d91bb349a9ae1da8ba69d2ddbc P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.515273 10370 raft_consensus.cc:385] T ee5f38d91bb349a9ae1da8ba69d2ddbc P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.515383 10370 raft_consensus.cc:740] T ee5f38d91bb349a9ae1da8ba69d2ddbc P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.515691 10370 consensus_queue.cc:260] T ee5f38d91bb349a9ae1da8ba69d2ddbc P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.517180 10375 ts_tablet_manager.cc:1929] T 410855f236004ad4b78839eb1c0c2f1f P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:13.517295 10375 log.cc:1199] T 410855f236004ad4b78839eb1c0c2f1f P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/410855f236004ad4b78839eb1c0c2f1f
I20260810 19:48:13.517637 10375 ts_tablet_manager.cc:1950] T 410855f236004ad4b78839eb1c0c2f1f P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:13.518545 10370 ts_tablet_manager.cc:1434] T ee5f38d91bb349a9ae1da8ba69d2ddbc P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
W20260810 19:48:13.523855 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ee6027c32f6492398110a82d75b9b7e consensus state has no leader
I20260810 19:48:13.525065 10367 ts_tablet_manager.cc:1434] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260810 19:48:13.525213 10377 rpcz_store.cc:276] 0810 19:48:12.368403 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:12.368482 (+ 79us) service_pool.cc:224] Handling call
0810 19:48:13.508891 (+1140409us) ts_tablet_manager.cc:1151] Deleting tablet e1993fe2402f485481c36a5b41ba2571
0810 19:48:13.509642 (+ 751us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.513850 (+ 4208us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1140182}
I20260810 19:48:13.525781 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1086) took 1123 ms. Trace:
W20260810 19:48:13.525910 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet e1993fe2402f485481c36a5b41ba2571 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1993fe2402f485481c36a5b41ba2571 already in progress: creating tablet
I20260810 19:48:13.525951 10377 rpcz_store.cc:276] 0810 19:48:12.402520 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:12.403968 (+ 1448us) service_pool.cc:224] Handling call
0810 19:48:13.525611 (+1121643us) ts_tablet_manager.cc:1151] Deleting tablet 65605d404d42467ab6d7eabc8b685c3e
0810 19:48:13.525625 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.525757 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1121397}
W20260810 19:48:13.526463 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 65605d404d42467ab6d7eabc8b685c3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65605d404d42467ab6d7eabc8b685c3e already in progress: creating tablet
I20260810 19:48:13.524408 10366 tablet_bootstrap.cc:492] T 64470598ccec45a7ae3e3c77fe4b9518 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:13.528514 10366 tablet_bootstrap.cc:654] T 64470598ccec45a7ae3e3c77fe4b9518 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:13.528961 10367 tablet_bootstrap.cc:492] T 749cea5cd8f842b891f4e2cab07c054e P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:13.530997 10367 tablet_bootstrap.cc:654] T 749cea5cd8f842b891f4e2cab07c054e P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:13.531311 10377 tablet_replica.cc:333] T 5aa0f24443a34714a44137a77c12bbc3 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:13.532128 10377 raft_consensus.cc:2243] T 5aa0f24443a34714a44137a77c12bbc3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.532394 10377 raft_consensus.cc:2272] T 5aa0f24443a34714a44137a77c12bbc3 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.533077 10377 ts_tablet_manager.cc:1916] T 5aa0f24443a34714a44137a77c12bbc3 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.533160 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 410855f236004ad4b78839eb1c0c2f1f (table default.Table_44478e93cffb460aaa8df9115b799594 [id=1d363ce63686462f9f4c15669773ee22]) successfully deleted
I20260810 19:48:13.535988 10370 tablet_bootstrap.cc:492] T bafc42f0cdf94ebd823dfb678df8a83b P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:48:13.535945 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet f06df4cdb79c440b91b0eff135d2dfac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f06df4cdb79c440b91b0eff135d2dfac already in progress: creating tablet
W20260810 19:48:13.536674 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet a1628a2a930a4819818df3ea480ab4db because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1628a2a930a4819818df3ea480ab4db already in progress: creating tablet
I20260810 19:48:13.537190 10375 tablet_replica.cc:333] T 19e2bf7b7d254894a07c5a75bf24e742 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:13.537393 10375 raft_consensus.cc:2243] T 19e2bf7b7d254894a07c5a75bf24e742 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.537555 10375 raft_consensus.cc:2272] T 19e2bf7b7d254894a07c5a75bf24e742 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.537822 10370 tablet_bootstrap.cc:654] T bafc42f0cdf94ebd823dfb678df8a83b P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:13.539700 10375 ts_tablet_manager.cc:1916] T 19e2bf7b7d254894a07c5a75bf24e742 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.544288 13024 raft_consensus.cc:493] T eb3e7d34b5314bc7a7c5ed53792728ca P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:13.544445 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet ee5f38d91bb349a9ae1da8ba69d2ddbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:13.544469 13024 raft_consensus.cc:515] T eb3e7d34b5314bc7a7c5ed53792728ca P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.545197 13024 leader_election.cc:290] T eb3e7d34b5314bc7a7c5ed53792728ca P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:13.546060 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e7d34b5314bc7a7c5ed53792728ca" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:13.546779 9611 leader_election.cc:343] T eb3e7d34b5314bc7a7c5ed53792728ca P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:13.547423 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e7d34b5314bc7a7c5ed53792728ca" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:13.548035 9611 leader_election.cc:343] T eb3e7d34b5314bc7a7c5ed53792728ca P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:13.548147 9611 leader_election.cc:304] T eb3e7d34b5314bc7a7c5ed53792728ca P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:13.548621 13024 raft_consensus.cc:2749] T eb3e7d34b5314bc7a7c5ed53792728ca P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:13.551337 10367 tablet_bootstrap.cc:492] T 749cea5cd8f842b891f4e2cab07c054e P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:13.552796 13041 raft_consensus.cc:493] T 988d87b2b00a459d9afc44ba0ae1961e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:13.552958 13041 raft_consensus.cc:515] T 988d87b2b00a459d9afc44ba0ae1961e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.553675 13041 leader_election.cc:290] T 988d87b2b00a459d9afc44ba0ae1961e P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:13.554253 10375 ts_tablet_manager.cc:1929] T 19e2bf7b7d254894a07c5a75bf24e742 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:13.554402 10375 log.cc:1199] T 19e2bf7b7d254894a07c5a75bf24e742 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/19e2bf7b7d254894a07c5a75bf24e742
I20260810 19:48:13.554477 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988d87b2b00a459d9afc44ba0ae1961e" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:13.554715 10375 ts_tablet_manager.cc:1950] T 19e2bf7b7d254894a07c5a75bf24e742 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
W20260810 19:48:13.555210 9830 leader_election.cc:343] T 988d87b2b00a459d9afc44ba0ae1961e P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:13.555893 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 19e2bf7b7d254894a07c5a75bf24e742 (table default.Table_688c01e53a344393b3471974bad3b972 [id=7112ce97719c47919a3d24d1af7d07cd]) successfully deleted
W20260810 19:48:13.556398 9831 leader_election.cc:343] T 988d87b2b00a459d9afc44ba0ae1961e P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 988d87b2b00a459d9afc44ba0ae1961e
I20260810 19:48:13.556524 9831 leader_election.cc:304] T 988d87b2b00a459d9afc44ba0ae1961e P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:13.556950 13041 raft_consensus.cc:2749] T 988d87b2b00a459d9afc44ba0ae1961e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:13.556021 12266 ts_tablet_manager.cc:1929] T 9ed73161398f4f54a20a9173c18b4d3c P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:13.557426 12266 log.cc:1199] T 9ed73161398f4f54a20a9173c18b4d3c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/9ed73161398f4f54a20a9173c18b4d3c
I20260810 19:48:13.557817 12266 ts_tablet_manager.cc:1950] T 9ed73161398f4f54a20a9173c18b4d3c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
W20260810 19:48:13.558965 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 79841de1d91c4961bc0742d89d570a7f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79841de1d91c4961bc0742d89d570a7f already in progress: creating tablet
I20260810 19:48:13.559038 10377 ts_tablet_manager.cc:1929] T 5aa0f24443a34714a44137a77c12bbc3 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:13.559077 10370 tablet_bootstrap.cc:492] T bafc42f0cdf94ebd823dfb678df8a83b P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:13.559147 10377 log.cc:1199] T 5aa0f24443a34714a44137a77c12bbc3 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/5aa0f24443a34714a44137a77c12bbc3
I20260810 19:48:13.559211 10370 ts_tablet_manager.cc:1403] T bafc42f0cdf94ebd823dfb678df8a83b P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.002s
I20260810 19:48:13.559437 10377 ts_tablet_manager.cc:1950] T 5aa0f24443a34714a44137a77c12bbc3 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
W20260810 19:48:13.560118 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet fafad8559b074dab958f03061e65b8c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fafad8559b074dab958f03061e65b8c3 already in progress: creating tablet
I20260810 19:48:13.560190 10370 raft_consensus.cc:359] T bafc42f0cdf94ebd823dfb678df8a83b P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.560417 10366 tablet_bootstrap.cc:492] T 64470598ccec45a7ae3e3c77fe4b9518 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:13.560539 10370 raft_consensus.cc:385] T bafc42f0cdf94ebd823dfb678df8a83b P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.560561 10366 ts_tablet_manager.cc:1403] T 64470598ccec45a7ae3e3c77fe4b9518 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.002s
I20260810 19:48:13.560647 10370 raft_consensus.cc:740] T bafc42f0cdf94ebd823dfb678df8a83b P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.560942 10370 consensus_queue.cc:260] T bafc42f0cdf94ebd823dfb678df8a83b P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.561197 10375 tablet_replica.cc:333] T 18cd8adaa065425c846bc791c05fa67d P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:13.561388 10375 raft_consensus.cc:2243] T 18cd8adaa065425c846bc791c05fa67d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.561564 10375 raft_consensus.cc:2272] T 18cd8adaa065425c846bc791c05fa67d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.561597 10366 raft_consensus.cc:359] T 64470598ccec45a7ae3e3c77fe4b9518 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.561777 10366 raft_consensus.cc:385] T 64470598ccec45a7ae3e3c77fe4b9518 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.561833 10366 raft_consensus.cc:740] T 64470598ccec45a7ae3e3c77fe4b9518 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.562112 10375 ts_tablet_manager.cc:1916] T 18cd8adaa065425c846bc791c05fa67d P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.562110 10366 consensus_queue.cc:260] T 64470598ccec45a7ae3e3c77fe4b9518 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.563436 12266 tablet_replica.cc:333] T 8d93821ff46a4096a8ebbac83faabed7 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:13.563649 10370 ts_tablet_manager.cc:1434] T bafc42f0cdf94ebd823dfb678df8a83b P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260810 19:48:13.563663 12266 raft_consensus.cc:2243] T 8d93821ff46a4096a8ebbac83faabed7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.563671 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 9ed73161398f4f54a20a9173c18b4d3c (table default.Table_2adfdcdb33f543d49ea6f361bf8a55c4 [id=cfd27e7efc8f4c529e7dace21742b656]) successfully deleted
I20260810 19:48:13.563817 12266 raft_consensus.cc:2272] T 8d93821ff46a4096a8ebbac83faabed7 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.564095 10370 tablet_bootstrap.cc:492] T 85f1c7a75aac4d6a9462af4def91eaa4 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:13.564404 12266 ts_tablet_manager.cc:1916] T 8d93821ff46a4096a8ebbac83faabed7 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.565903 10370 tablet_bootstrap.cc:654] T 85f1c7a75aac4d6a9462af4def91eaa4 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:13.557299 10367 ts_tablet_manager.cc:1403] T 749cea5cd8f842b891f4e2cab07c054e P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.001s
I20260810 19:48:13.571779 10367 raft_consensus.cc:359] T 749cea5cd8f842b891f4e2cab07c054e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.573428 12993 raft_consensus.cc:493] T ee5f38d91bb349a9ae1da8ba69d2ddbc P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:13.573558 10366 ts_tablet_manager.cc:1434] T 64470598ccec45a7ae3e3c77fe4b9518 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.013s user 0.000s sys 0.002s
I20260810 19:48:13.573587 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet bafc42f0cdf94ebd823dfb678df8a83b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:13.573822 10367 raft_consensus.cc:385] T 749cea5cd8f842b891f4e2cab07c054e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.573594 12993 raft_consensus.cc:515] T ee5f38d91bb349a9ae1da8ba69d2ddbc P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.573968 10367 raft_consensus.cc:740] T 749cea5cd8f842b891f4e2cab07c054e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.574453 12993 leader_election.cc:290] T ee5f38d91bb349a9ae1da8ba69d2ddbc P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:13.574852 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_5a8a91433def4a2e98b23673f707d5fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.575551 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a8a91433def4a2e98b23673f707d5fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.574223 10367 consensus_queue.cc:260] T 749cea5cd8f842b891f4e2cab07c054e P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:13.576118 10068 leader_election.cc:343] T ee5f38d91bb349a9ae1da8ba69d2ddbc P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: ee5f38d91bb349a9ae1da8ba69d2ddbc
W20260810 19:48:13.576256 10067 leader_election.cc:343] T ee5f38d91bb349a9ae1da8ba69d2ddbc P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: ee5f38d91bb349a9ae1da8ba69d2ddbc
I20260810 19:48:13.576352 10067 leader_election.cc:304] T ee5f38d91bb349a9ae1da8ba69d2ddbc P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:13.576805 12993 raft_consensus.cc:2749] T ee5f38d91bb349a9ae1da8ba69d2ddbc P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:13.578421 10367 ts_tablet_manager.cc:1434] T 749cea5cd8f842b891f4e2cab07c054e P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260810 19:48:13.580940 10366 tablet_bootstrap.cc:492] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:13.582680 10375 ts_tablet_manager.cc:1929] T 18cd8adaa065425c846bc791c05fa67d P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:13.582803 10375 log.cc:1199] T 18cd8adaa065425c846bc791c05fa67d P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/18cd8adaa065425c846bc791c05fa67d
I20260810 19:48:13.583144 10375 ts_tablet_manager.cc:1950] T 18cd8adaa065425c846bc791c05fa67d P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:13.583781 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1089) took 1102 ms. Trace:
I20260810 19:48:13.584151 10377 rpcz_store.cc:276] 0810 19:48:12.480915 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:12.481311 (+ 396us) service_pool.cc:224] Handling call
0810 19:48:13.531246 (+1049935us) ts_tablet_manager.cc:1151] Deleting tablet 5aa0f24443a34714a44137a77c12bbc3
0810 19:48:13.531260 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.541875 (+ 10615us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:13.558970 (+ 17095us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:13.583749 (+ 24779us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1000566}
I20260810 19:48:13.584089 10366 tablet_bootstrap.cc:654] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:13.584712 10375 tablet_replica.cc:333] T 8fadd6f84c75466287b318ed7018b071 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:13.584910 10375 raft_consensus.cc:2243] T 8fadd6f84c75466287b318ed7018b071 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.585054 10375 raft_consensus.cc:2272] T 8fadd6f84c75466287b318ed7018b071 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.586248 13024 raft_consensus.cc:493] T 1bbd3fe2117c42058dc108b5dc18d560 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:13.586428 13024 raft_consensus.cc:515] T 1bbd3fe2117c42058dc108b5dc18d560 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.586622 10370 tablet_bootstrap.cc:492] T 85f1c7a75aac4d6a9462af4def91eaa4 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:13.586750 10370 ts_tablet_manager.cc:1403] T 85f1c7a75aac4d6a9462af4def91eaa4 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.002s
I20260810 19:48:13.587147 13024 leader_election.cc:290] T 1bbd3fe2117c42058dc108b5dc18d560 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:13.587531 10370 raft_consensus.cc:359] T 85f1c7a75aac4d6a9462af4def91eaa4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.587644 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1092) took 1067 ms. Trace:
I20260810 19:48:13.587692 10370 raft_consensus.cc:385] T 85f1c7a75aac4d6a9462af4def91eaa4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.587734 10370 raft_consensus.cc:740] T 85f1c7a75aac4d6a9462af4def91eaa4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.587729 10377 rpcz_store.cc:276] 0810 19:48:12.519771 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:12.519847 (+ 76us) service_pool.cc:224] Handling call
0810 19:48:13.587467 (+1067620us) ts_tablet_manager.cc:1151] Deleting tablet a7d3a90046d74f4087fd5b283581970d
0810 19:48:13.587480 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.587617 (+ 137us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1052366}
I20260810 19:48:13.587991 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bbd3fe2117c42058dc108b5dc18d560" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:13.588201 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bbd3fe2117c42058dc108b5dc18d560" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:13.588482 10370 consensus_queue.cc:260] T 85f1c7a75aac4d6a9462af4def91eaa4 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.588927 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1095) took 1052 ms. Trace:
I20260810 19:48:13.589010 10377 rpcz_store.cc:276] 0810 19:48:12.536543 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:12.536599 (+ 56us) service_pool.cc:224] Handling call
0810 19:48:13.588798 (+1052199us) ts_tablet_manager.cc:1151] Deleting tablet c01bde86f6d14c4db35f7211b84b7cb9
0810 19:48:13.588810 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.588906 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1051970}
W20260810 19:48:13.589190 9611 leader_election.cc:343] T 1bbd3fe2117c42058dc108b5dc18d560 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:13.589427 9611 leader_election.cc:343] T 1bbd3fe2117c42058dc108b5dc18d560 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:13.589516 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1094) took 1053 ms. Trace:
I20260810 19:48:13.589512 9611 leader_election.cc:304] T 1bbd3fe2117c42058dc108b5dc18d560 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:13.589577 10377 rpcz_store.cc:276] 0810 19:48:12.536390 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:12.536606 (+ 216us) service_pool.cc:224] Handling call
0810 19:48:13.589400 (+1052794us) ts_tablet_manager.cc:1151] Deleting tablet 81de4b3e05604a34b305ca0ad744d769
0810 19:48:13.589411 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.589500 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1052271}
I20260810 19:48:13.589941 13024 raft_consensus.cc:2749] T 1bbd3fe2117c42058dc108b5dc18d560 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:13.590407 10367 tablet_bootstrap.cc:492] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:13.590526 10375 ts_tablet_manager.cc:1916] T 8fadd6f84c75466287b318ed7018b071 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.584444 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 18cd8adaa065425c846bc791c05fa67d (table default.Table_a1645668cf79415ca029a01169fbf874 [id=aec405416e584af6bfb8194b357d6dbc]) successfully deleted
I20260810 19:48:13.592521 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 5aa0f24443a34714a44137a77c12bbc3 (table default.Table_6487065cb4a442eebc88bd267aede484 [id=27c3951fbb3e4e4fb7bb119cec174eb1]) successfully deleted
W20260810 19:48:13.592871 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet a7d3a90046d74f4087fd5b283581970d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7d3a90046d74f4087fd5b283581970d already in progress: creating tablet
I20260810 19:48:13.593072 10370 ts_tablet_manager.cc:1434] T 85f1c7a75aac4d6a9462af4def91eaa4 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
W20260810 19:48:13.593115 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet c01bde86f6d14c4db35f7211b84b7cb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c01bde86f6d14c4db35f7211b84b7cb9 already in progress: creating tablet
I20260810 19:48:13.593405 10370 tablet_bootstrap.cc:492] T 988d87b2b00a459d9afc44ba0ae1961e P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:48:13.593391 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 81de4b3e05604a34b305ca0ad744d769 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81de4b3e05604a34b305ca0ad744d769 already in progress: creating tablet
I20260810 19:48:13.595173 10370 tablet_bootstrap.cc:654] T 988d87b2b00a459d9afc44ba0ae1961e P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:13.600313 10367 tablet_bootstrap.cc:654] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:13.605075 13041 raft_consensus.cc:493] T 64470598ccec45a7ae3e3c77fe4b9518 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:13.605252 13041 raft_consensus.cc:515] T 64470598ccec45a7ae3e3c77fe4b9518 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.605976 13041 leader_election.cc:290] T 64470598ccec45a7ae3e3c77fe4b9518 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:13.606842 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64470598ccec45a7ae3e3c77fe4b9518" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:13.606935 9831 leader_election.cc:343] T 64470598ccec45a7ae3e3c77fe4b9518 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 64470598ccec45a7ae3e3c77fe4b9518
I20260810 19:48:13.607046 10375 ts_tablet_manager.cc:1929] T 8fadd6f84c75466287b318ed7018b071 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:13.607152 10375 log.cc:1199] T 8fadd6f84c75466287b318ed7018b071 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/8fadd6f84c75466287b318ed7018b071
I20260810 19:48:13.607416 10375 ts_tablet_manager.cc:1950] T 8fadd6f84c75466287b318ed7018b071 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
W20260810 19:48:13.607583 9830 leader_election.cc:343] T 64470598ccec45a7ae3e3c77fe4b9518 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:13.607693 9830 leader_election.cc:304] T 64470598ccec45a7ae3e3c77fe4b9518 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:13.608510 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 8fadd6f84c75466287b318ed7018b071 (table default.Table_398b6d4ebbf742b99fad6aff42d2802b [id=453661c1f5834b56aad5d2d647338fc6]) successfully deleted
I20260810 19:48:13.608904 10375 tablet_replica.cc:333] T c285518ed49d4ed68a6039f98db3b700 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:13.609146 10375 raft_consensus.cc:2243] T c285518ed49d4ed68a6039f98db3b700 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.609359 10375 raft_consensus.cc:2272] T c285518ed49d4ed68a6039f98db3b700 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.611626 13041 raft_consensus.cc:2749] T 64470598ccec45a7ae3e3c77fe4b9518 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:13.612911 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1096) took 1044 ms. Trace:
I20260810 19:48:13.613073 10377 rpcz_store.cc:276] 0810 19:48:12.568317 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:12.576129 (+ 7812us) service_pool.cc:224] Handling call
0810 19:48:13.598482 (+1022353us) ts_tablet_manager.cc:1151] Deleting tablet b8ad239a5d4a410581d93b66d3982120
0810 19:48:13.598498 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.612884 (+ 14386us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1022099}
I20260810 19:48:13.614853 12266 ts_tablet_manager.cc:1929] T 8d93821ff46a4096a8ebbac83faabed7 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:13.615082 12266 log.cc:1199] T 8d93821ff46a4096a8ebbac83faabed7 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/8d93821ff46a4096a8ebbac83faabed7
I20260810 19:48:13.615504 12266 ts_tablet_manager.cc:1950] T 8d93821ff46a4096a8ebbac83faabed7 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:13.615644 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1097) took 1030 ms. Trace:
I20260810 19:48:13.615746 10377 rpcz_store.cc:276] 0810 19:48:12.585078 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:12.585703 (+ 625us) service_pool.cc:224] Handling call
0810 19:48:13.615503 (+1029800us) ts_tablet_manager.cc:1151] Deleting tablet 60c45125545340059d49b5faa8025c73
0810 19:48:13.615516 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.615623 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1029476}
I20260810 19:48:13.616940 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 8d93821ff46a4096a8ebbac83faabed7 (table default.Table_422e53637be84964a1cd4bb082fec236 [id=79d6de9ae42e416fba0595834b38ce40]) successfully deleted
W20260810 19:48:13.617767 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet d59e5607e4184683bc3924266ed6ca20 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d59e5607e4184683bc3924266ed6ca20 already in progress: creating tablet
W20260810 19:48:13.618532 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet b8ad239a5d4a410581d93b66d3982120 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8ad239a5d4a410581d93b66d3982120 already in progress: creating tablet
W20260810 19:48:13.618803 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 60c45125545340059d49b5faa8025c73 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60c45125545340059d49b5faa8025c73 already in progress: creating tablet
I20260810 19:48:13.623564 10370 tablet_bootstrap.cc:492] T 988d87b2b00a459d9afc44ba0ae1961e P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:13.623792 10370 ts_tablet_manager.cc:1403] T 988d87b2b00a459d9afc44ba0ae1961e P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.003s
I20260810 19:48:13.623575 10375 ts_tablet_manager.cc:1916] T c285518ed49d4ed68a6039f98db3b700 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.624349 10377 tablet_replica.cc:333] T 988d87b2b00a459d9afc44ba0ae1961e P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:13.624640 10367 tablet_bootstrap.cc:492] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:13.624804 10367 ts_tablet_manager.cc:1403] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.000s
I20260810 19:48:13.624809 10370 raft_consensus.cc:359] T 988d87b2b00a459d9afc44ba0ae1961e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.625067 10370 raft_consensus.cc:385] T 988d87b2b00a459d9afc44ba0ae1961e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.625165 10370 raft_consensus.cc:740] T 988d87b2b00a459d9afc44ba0ae1961e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.625483 10370 consensus_queue.cc:260] T 988d87b2b00a459d9afc44ba0ae1961e P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.625634 10367 raft_consensus.cc:359] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.625816 10367 raft_consensus.cc:385] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.625869 10367 raft_consensus.cc:740] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.626125 10367 consensus_queue.cc:260] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.626780 10367 ts_tablet_manager.cc:1434] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:13.627068 10367 tablet_bootstrap.cc:492] T 22a77c72f2244a08a65e3779c5895752 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:13.628016 10370 ts_tablet_manager.cc:1434] T 988d87b2b00a459d9afc44ba0ae1961e P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260810 19:48:13.628363 10370 tablet_bootstrap.cc:492] T 4571e0c723f74c828220b33116fed9e9 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:13.628793 10367 tablet_bootstrap.cc:654] T 22a77c72f2244a08a65e3779c5895752 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:13.631526 10370 tablet_bootstrap.cc:654] T 4571e0c723f74c828220b33116fed9e9 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:13.633284 10377 raft_consensus.cc:2243] T 988d87b2b00a459d9afc44ba0ae1961e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.633939 10377 raft_consensus.cc:2272] T 988d87b2b00a459d9afc44ba0ae1961e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.634596 10377 ts_tablet_manager.cc:1916] T 988d87b2b00a459d9afc44ba0ae1961e P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.641830 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 0b71af7492854f32b26887f8cbead122
I20260810 19:48:13.642505 9407 catalog_manager.cc:6807] ReplaceTablet: tablet 0b71af7492854f32b26887f8cbead122 deleted and replaced by tablet 372cf2e53aa64c65baa384e047a2a973
I20260810 19:48:13.642791 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b71af7492854f32b26887f8cbead122 with delete_type TABLET_DATA_DELETED (replaced by tablet 372cf2e53aa64c65baa384e047a2a973) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:13.642961 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1f4252825a324dc8a245a626aa10c7d1" } new_table_name: "default.Table_13227e9c94cb4f10b7ae3588f3a03c56" modify_external_catalogs: true
I20260810 19:48:13.643251 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b71af7492854f32b26887f8cbead122 with delete_type TABLET_DATA_DELETED (replaced by tablet 372cf2e53aa64c65baa384e047a2a973) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:13.644400 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b71af7492854f32b26887f8cbead122 with delete_type TABLET_DATA_DELETED (replaced by tablet 372cf2e53aa64c65baa384e047a2a973) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:13.646095 10375 ts_tablet_manager.cc:1929] T c285518ed49d4ed68a6039f98db3b700 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:13.646215 10375 log.cc:1199] T c285518ed49d4ed68a6039f98db3b700 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/c285518ed49d4ed68a6039f98db3b700
I20260810 19:48:13.646533 10375 ts_tablet_manager.cc:1950] T c285518ed49d4ed68a6039f98db3b700 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:13.647665 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet c285518ed49d4ed68a6039f98db3b700 (table default.Table_bb5a9a9ebfd340fba882f6db00cf2dac [id=4b0cbb23d570430bb2d95e9c1b27bb4d]) successfully deleted
I20260810 19:48:13.652580 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 21041f65462744278244802ef867c2e9
I20260810 19:48:13.653409 9415 master_service.cc:960] ReplaceTablet: received request to replace tablet 27c75f3340e24fe1a10de5bd6bcdfb2f from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:13.653446 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 21041f65462744278244802ef867c2e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:13.654093 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet 21041f65462744278244802ef867c2e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:13.654874 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c0b17ed76ac64dfaa9c99c3a6e618770 consensus state has no leader
I20260810 19:48:13.654951 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 21041f65462744278244802ef867c2e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:13.655232 9407 master_service.cc:960] ReplaceTablet: received request to replace tablet 8565cd6fc9e34c5fbabba6e573df9939 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:13.655880 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_59dd0d940c174b9f9998bec1b5c54a68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.656450 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59dd0d940c174b9f9998bec1b5c54a68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:13.656746 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet f46571d9b4d948d3938607ebef926c40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f46571d9b4d948d3938607ebef926c40 already in progress: creating tablet
I20260810 19:48:13.657099 10375 tablet_replica.cc:333] T 5aa0f24443a34714a44137a77c12bbc3 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:13.657325 10375 raft_consensus.cc:2243] T 5aa0f24443a34714a44137a77c12bbc3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.657517 10375 raft_consensus.cc:2272] T 5aa0f24443a34714a44137a77c12bbc3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.659230 10370 tablet_bootstrap.cc:492] T 4571e0c723f74c828220b33116fed9e9 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:13.659452 10370 ts_tablet_manager.cc:1403] T 4571e0c723f74c828220b33116fed9e9 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.031s user 0.001s sys 0.005s
I20260810 19:48:13.660352 10370 raft_consensus.cc:359] T 4571e0c723f74c828220b33116fed9e9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.660627 10370 raft_consensus.cc:385] T 4571e0c723f74c828220b33116fed9e9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.660352 10375 ts_tablet_manager.cc:1916] T 5aa0f24443a34714a44137a77c12bbc3 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.660746 10370 raft_consensus.cc:740] T 4571e0c723f74c828220b33116fed9e9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.661118 10370 consensus_queue.cc:260] T 4571e0c723f74c828220b33116fed9e9 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.663445 10370 ts_tablet_manager.cc:1434] T 4571e0c723f74c828220b33116fed9e9 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260810 19:48:13.663789 10370 tablet_bootstrap.cc:492] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:13.666760 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 25570b1795164aeca86a5313bd30a4c9
I20260810 19:48:13.667364 9413 catalog_manager.cc:6807] ReplaceTablet: tablet 25570b1795164aeca86a5313bd30a4c9 deleted and replaced by tablet 0a3a9f1729c848d59ad6cc6a056b882b
I20260810 19:48:13.667765 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet 25570b1795164aeca86a5313bd30a4c9 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a3a9f1729c848d59ad6cc6a056b882b) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:13.667763 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e497f222f0fe4a5f9358a38adc2a381f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:13.668222 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 25570b1795164aeca86a5313bd30a4c9 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a3a9f1729c848d59ad6cc6a056b882b) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:13.668300 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 3194d795b1ee4b17bd91c27bb6a86fb8
W20260810 19:48:13.668401 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e497f222f0fe4a5f9358a38adc2a381f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.669076 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet 3194d795b1ee4b17bd91c27bb6a86fb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:13.669015 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_272c5bdbf1f34804af6051ffc4f2ec5f" } new_table_name: "default.Table_8b3ed2c956f0452f803f61f3dc2f85f8" modify_external_catalogs: true
I20260810 19:48:13.669222 10370 tablet_bootstrap.cc:654] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:13.669512 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 3194d795b1ee4b17bd91c27bb6a86fb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:13.672936 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 25570b1795164aeca86a5313bd30a4c9 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a3a9f1729c848d59ad6cc6a056b882b) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:13.673568 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 3194d795b1ee4b17bd91c27bb6a86fb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:13.674832 9420 catalog_manager.cc:5719] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:13.675297 9420 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 85f1c7a75aac4d6a9462af4def91eaa4 (table default.Table_08c83fc388864b6f8a1ed597dc70bffe [id=2d55615cd797441c8abf6ea5a64f2f9f]). Expected version 1 got 0
I20260810 19:48:13.678618 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_28bf291b203b4f7e984f4f5622c03a36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.679225 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28bf291b203b4f7e984f4f5622c03a36 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.680617 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 5f593e2ff4ef467da4a1b2dacd17c899
I20260810 19:48:13.682030 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f593e2ff4ef467da4a1b2dacd17c899 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:13.682219 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a4ee3af9a4234fd494ed609f405412d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.682816 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4ee3af9a4234fd494ed609f405412d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.683247 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f593e2ff4ef467da4a1b2dacd17c899 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:13.684088 10370 tablet_bootstrap.cc:492] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:13.684331 10370 ts_tablet_manager.cc:1403] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.002s
I20260810 19:48:13.685273 10370 raft_consensus.cc:359] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.685542 10370 raft_consensus.cc:385] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.685652 10370 raft_consensus.cc:740] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.685372 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f593e2ff4ef467da4a1b2dacd17c899 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:13.685989 10370 consensus_queue.cc:260] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.687621 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 27c75f3340e24fe1a10de5bd6bcdfb2f
I20260810 19:48:13.688593 10370 ts_tablet_manager.cc:1434] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260810 19:48:13.688170 9415 catalog_manager.cc:6807] ReplaceTablet: tablet 27c75f3340e24fe1a10de5bd6bcdfb2f deleted and replaced by tablet 1031461c40a749b88f4f9e93c15abcff
I20260810 19:48:13.688923 10370 tablet_bootstrap.cc:492] T 1a393149727043f3a3c9f58aa051b065 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:13.689123 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_76c8eb2dfe7a4a6d9dda2a6d422d2006"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.689747 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76c8eb2dfe7a4a6d9dda2a6d422d2006 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.689883 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet 27c75f3340e24fe1a10de5bd6bcdfb2f with delete_type TABLET_DATA_DELETED (replaced by tablet 1031461c40a749b88f4f9e93c15abcff) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:13.690208 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 27c75f3340e24fe1a10de5bd6bcdfb2f with delete_type TABLET_DATA_DELETED (replaced by tablet 1031461c40a749b88f4f9e93c15abcff) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:13.690408 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 27c75f3340e24fe1a10de5bd6bcdfb2f with delete_type TABLET_DATA_DELETED (replaced by tablet 1031461c40a749b88f4f9e93c15abcff) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:13.690785 10370 tablet_bootstrap.cc:654] T 1a393149727043f3a3c9f58aa051b065 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:13.691594 9421 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet a2fe67e8bd014acaa202c022c193cdc6 (table default.Table_28b8191a242a4d8ea55fdaeaec9c1c41 [id=3b14f80137654337b24c2bb4131e58d3]). Expected version 3 got 0
I20260810 19:48:13.692518 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e6f4fa85056c4f82a753908c00e7bcd0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.693114 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e6f4fa85056c4f82a753908c00e7bcd0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.693481 10118 tablet_service.cc:1511] Processing CreateTablet for tablet be5062c24bc942ddb6dc8a6feef9c5ab (DEFAULT_TABLE table=default.Table_3ebb38ab6d62481db36dda02cf32135c [id=464f0c9c1d6f428b9c3aeccfa870ffd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.693931 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5062c24bc942ddb6dc8a6feef9c5ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.698570 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 684fd292f5ca4d0284a5036b039c640b
I20260810 19:48:13.700575 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 684fd292f5ca4d0284a5036b039c640b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:13.701104 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 684fd292f5ca4d0284a5036b039c640b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:13.701696 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 684fd292f5ca4d0284a5036b039c640b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:13.704556 10375 ts_tablet_manager.cc:1929] T 5aa0f24443a34714a44137a77c12bbc3 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:13.707456 10375 log.cc:1199] T 5aa0f24443a34714a44137a77c12bbc3 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/5aa0f24443a34714a44137a77c12bbc3
I20260810 19:48:13.708267 12266 tablet_replica.cc:333] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:13.711196 12266 raft_consensus.cc:2243] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.714017 12266 raft_consensus.cc:2272] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.714794 10375 ts_tablet_manager.cc:1950] T 5aa0f24443a34714a44137a77c12bbc3 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:13.716065 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 5aa0f24443a34714a44137a77c12bbc3 (table default.Table_6487065cb4a442eebc88bd267aede484 [id=27c3951fbb3e4e4fb7bb119cec174eb1]) successfully deleted
I20260810 19:48:13.716890 12266 ts_tablet_manager.cc:1916] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.716959 10375 tablet_replica.cc:333] T ee5f38d91bb349a9ae1da8ba69d2ddbc P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:13.718055 9890 tablet_service.cc:1511] Processing CreateTablet for tablet be5062c24bc942ddb6dc8a6feef9c5ab (DEFAULT_TABLE table=default.Table_3ebb38ab6d62481db36dda02cf32135c [id=464f0c9c1d6f428b9c3aeccfa870ffd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.718355 9666 tablet_service.cc:1511] Processing CreateTablet for tablet be5062c24bc942ddb6dc8a6feef9c5ab (DEFAULT_TABLE table=default.Table_3ebb38ab6d62481db36dda02cf32135c [id=464f0c9c1d6f428b9c3aeccfa870ffd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.718618 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5062c24bc942ddb6dc8a6feef9c5ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.718900 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5062c24bc942ddb6dc8a6feef9c5ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.725013 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_9c5f46c45ece4bba9bd0e781b1ad3ec7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.725754 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c5f46c45ece4bba9bd0e781b1ad3ec7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.726150 10375 raft_consensus.cc:2243] T ee5f38d91bb349a9ae1da8ba69d2ddbc P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.726382 10375 raft_consensus.cc:2272] T ee5f38d91bb349a9ae1da8ba69d2ddbc P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.727224 10375 ts_tablet_manager.cc:1916] T ee5f38d91bb349a9ae1da8ba69d2ddbc P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.730104 9420 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet a2fe67e8bd014acaa202c022c193cdc6 (table default.Table_28b8191a242a4d8ea55fdaeaec9c1c41 [id=3b14f80137654337b24c2bb4131e58d3]). Expected version 3 got 0
W20260810 19:48:13.730969 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ae368e32900e428196d8a7d0098ca7f7 consensus state has no leader
I20260810 19:48:13.731443 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_55f86ee6a029499f9f22fc17edfb7ffa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.732126 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55f86ee6a029499f9f22fc17edfb7ffa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:13.734393 9830 consensus_peers.cc:597] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 410855f236004ad4b78839eb1c0c2f1f. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:13.735087 10370 tablet_bootstrap.cc:492] T 1a393149727043f3a3c9f58aa051b065 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:13.735332 10370 ts_tablet_manager.cc:1403] T 1a393149727043f3a3c9f58aa051b065 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.046s user 0.014s sys 0.001s
I20260810 19:48:13.735581 10375 ts_tablet_manager.cc:1929] T ee5f38d91bb349a9ae1da8ba69d2ddbc P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:13.735697 10375 log.cc:1199] T ee5f38d91bb349a9ae1da8ba69d2ddbc P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/ee5f38d91bb349a9ae1da8ba69d2ddbc
I20260810 19:48:13.736004 10375 ts_tablet_manager.cc:1950] T ee5f38d91bb349a9ae1da8ba69d2ddbc P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:13.735977 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 749cea5cd8f842b891f4e2cab07c054e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:13.736367 12993 raft_consensus.cc:493] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:13.736495 12993 raft_consensus.cc:515] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.737003 10375 tablet_replica.cc:333] T bafc42f0cdf94ebd823dfb678df8a83b P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:13.737174 12993 leader_election.cc:290] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:13.737196 10375 raft_consensus.cc:2243] T bafc42f0cdf94ebd823dfb678df8a83b P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.737402 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet ee5f38d91bb349a9ae1da8ba69d2ddbc (table default.Table_0a16454a2da548e3a7130a52dbd5143a [id=b1b37ac7ddef44d7b86d2d668527a046]) successfully deleted
I20260810 19:48:13.737789 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce298689e9415a8860b8734d73b10a" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:13.738021 9935 raft_consensus.cc:2468] T 8fce298689e9415a8860b8734d73b10a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:13.738097 10118 tablet_service.cc:1511] Processing CreateTablet for tablet 07f67e10734f483cba8e02ef31624e84 (DEFAULT_TABLE table=default.Table_200650b28cfa4b268f5c68f6ec03018b [id=0eb080baa0a441ddb5480c191940f709]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.738559 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07f67e10734f483cba8e02ef31624e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.738497 10067 leader_election.cc:304] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:13.738602 9416 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 85f1c7a75aac4d6a9462af4def91eaa4 (table default.Table_08c83fc388864b6f8a1ed597dc70bffe [id=2d55615cd797441c8abf6ea5a64f2f9f]). Expected version 1 got 0
I20260810 19:48:13.739398 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0d164894b2e9487bb8bfbd80407e3ec5" } new_table_name: "default.Table_fd6edb0f090848feb79e0310d8752d7b" modify_external_catalogs: true
W20260810 19:48:13.740103 10068 leader_election.cc:343] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 8fce298689e9415a8860b8734d73b10a
I20260810 19:48:13.740438 12993 raft_consensus.cc:2804] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:13.740511 12993 raft_consensus.cc:493] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:13.740562 12993 raft_consensus.cc:3060] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:13.742484 10375 raft_consensus.cc:2272] T bafc42f0cdf94ebd823dfb678df8a83b P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.742852 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_02a17ae88cd04ad7ad4a2303291ea6c1" } new_table_name: "default.Table_2850745584164af1b23ae3b8d3a4d312" modify_external_catalogs: true
I20260810 19:48:13.743952 12993 raft_consensus.cc:515] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.738204 9420 catalog_manager.cc:5719] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:13.745092 9420 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 4571e0c723f74c828220b33116fed9e9 (table default.Table_d9d83336ef124c2da242e77391b001c0 [id=8dbf3227e8ae402aa46b9b31b715faa6]). Expected version 1 got 0
I20260810 19:48:13.747110 10375 ts_tablet_manager.cc:1916] T bafc42f0cdf94ebd823dfb678df8a83b P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:13.749030 10068 leader_election.cc:343] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 8fce298689e9415a8860b8734d73b10a
I20260810 19:48:13.750479 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce298689e9415a8860b8734d73b10a" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:13.750722 9935 raft_consensus.cc:3060] T 8fce298689e9415a8860b8734d73b10a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:13.752736 9890 tablet_service.cc:1511] Processing CreateTablet for tablet 07f67e10734f483cba8e02ef31624e84 (DEFAULT_TABLE table=default.Table_200650b28cfa4b268f5c68f6ec03018b [id=0eb080baa0a441ddb5480c191940f709]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.753204 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07f67e10734f483cba8e02ef31624e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.753448 10375 ts_tablet_manager.cc:1929] T bafc42f0cdf94ebd823dfb678df8a83b P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:13.753497 9935 raft_consensus.cc:2468] T 8fce298689e9415a8860b8734d73b10a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:13.753525 10377 ts_tablet_manager.cc:1929] T 988d87b2b00a459d9afc44ba0ae1961e P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:13.753566 10375 log.cc:1199] T bafc42f0cdf94ebd823dfb678df8a83b P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/bafc42f0cdf94ebd823dfb678df8a83b
I20260810 19:48:13.753631 10377 log.cc:1199] T 988d87b2b00a459d9afc44ba0ae1961e P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/988d87b2b00a459d9afc44ba0ae1961e
I20260810 19:48:13.753859 10375 ts_tablet_manager.cc:1950] T bafc42f0cdf94ebd823dfb678df8a83b P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:13.753912 10377 ts_tablet_manager.cc:1950] T 988d87b2b00a459d9afc44ba0ae1961e P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:13.754243 10067 leader_election.cc:304] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:13.754611 12993 leader_election.cc:290] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:13.754714 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1099) took 1116 ms. Trace:
I20260810 19:48:13.754835 10377 rpcz_store.cc:276] 0810 19:48:12.637943 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:12.640443 (+ 2500us) service_pool.cc:224] Handling call
0810 19:48:13.624284 (+983841us) ts_tablet_manager.cc:1151] Deleting tablet 988d87b2b00a459d9afc44ba0ae1961e
0810 19:48:13.624298 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.649952 (+ 25654us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:13.753460 (+103508us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:13.754692 (+ 1232us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":983605}
I20260810 19:48:13.758533 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 988d87b2b00a459d9afc44ba0ae1961e (table default.Table_f283a0bdf6b94182a12f9b5f5dfe167a [id=f881fab647be45f786665629ab8baaee]) successfully deleted
I20260810 19:48:13.759143 12993 raft_consensus.cc:2804] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:13.759270 12993 raft_consensus.cc:697] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:13.759513 12993 consensus_queue.cc:237] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.760941 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1100) took 1114 ms. Trace:
I20260810 19:48:13.761050 10377 rpcz_store.cc:276] 0810 19:48:12.646959 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:12.647050 (+ 91us) service_pool.cc:224] Handling call
0810 19:48:13.760799 (+1113749us) ts_tablet_manager.cc:1151] Deleting tablet 5c637a1138ef43f9ac67bb7e72a0ab1b
0810 19:48:13.760810 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.760917 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1113533}
W20260810 19:48:13.761565 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 5c637a1138ef43f9ac67bb7e72a0ab1b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c637a1138ef43f9ac67bb7e72a0ab1b already in progress: creating tablet
I20260810 19:48:13.762094 10370 raft_consensus.cc:359] T 1a393149727043f3a3c9f58aa051b065 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.762276 10370 raft_consensus.cc:385] T 1a393149727043f3a3c9f58aa051b065 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.762365 10370 raft_consensus.cc:740] T 1a393149727043f3a3c9f58aa051b065 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.763157 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet bafc42f0cdf94ebd823dfb678df8a83b (table default.Table_f0bb702e0c7148519ccd7a84a5e9e574 [id=df54120a0a0140fe9561db53b23364b9]) successfully deleted
W20260810 19:48:13.763995 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 0b71af7492854f32b26887f8cbead122 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b71af7492854f32b26887f8cbead122 already in progress: creating tablet
I20260810 19:48:13.764158 10370 consensus_queue.cc:260] T 1a393149727043f3a3c9f58aa051b065 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.764482 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 8ab74d7fd2fe485d935aef4076382add
W20260810 19:48:13.765108 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 21041f65462744278244802ef867c2e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21041f65462744278244802ef867c2e9 already in progress: creating tablet
I20260810 19:48:13.765976 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ab74d7fd2fe485d935aef4076382add with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:13.766458 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ab74d7fd2fe485d935aef4076382add with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:13.766698 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 25570b1795164aeca86a5313bd30a4c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25570b1795164aeca86a5313bd30a4c9 already in progress: creating tablet
I20260810 19:48:13.766868 9666 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ab74d7fd2fe485d935aef4076382add with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:13.767323 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ecfd2b6f417644beb5f796aa15a3fa13"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.767911 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ecfd2b6f417644beb5f796aa15a3fa13 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:13.769225 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 3194d795b1ee4b17bd91c27bb6a86fb8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3194d795b1ee4b17bd91c27bb6a86fb8 already in progress: creating tablet
W20260810 19:48:13.769502 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 5f593e2ff4ef467da4a1b2dacd17c899 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f593e2ff4ef467da4a1b2dacd17c899 already in progress: creating tablet
W20260810 19:48:13.769747 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 27c75f3340e24fe1a10de5bd6bcdfb2f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 27c75f3340e24fe1a10de5bd6bcdfb2f already in progress: creating tablet
W20260810 19:48:13.769977 9395 catalog_manager.cc:5017] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 684fd292f5ca4d0284a5036b039c640b because the tablet was not found. No further retry: Not found: Tablet not found: 684fd292f5ca4d0284a5036b039c640b
W20260810 19:48:13.770251 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 8ab74d7fd2fe485d935aef4076382add because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ab74d7fd2fe485d935aef4076382add already in progress: creating tablet
I20260810 19:48:13.771595 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 07f67e10734f483cba8e02ef31624e84 (DEFAULT_TABLE table=default.Table_200650b28cfa4b268f5c68f6ec03018b [id=0eb080baa0a441ddb5480c191940f709]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.772089 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07f67e10734f483cba8e02ef31624e84. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:13.773103 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet ab5814fc52ab418e8e3701458210d4b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab5814fc52ab418e8e3701458210d4b6 already in progress: creating tablet
I20260810 19:48:13.771595 10367 tablet_bootstrap.cc:492] T 22a77c72f2244a08a65e3779c5895752 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:13.774533 10367 ts_tablet_manager.cc:1403] T 22a77c72f2244a08a65e3779c5895752 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.148s user 0.004s sys 0.000s
I20260810 19:48:13.775389 10367 raft_consensus.cc:359] T 22a77c72f2244a08a65e3779c5895752 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.775591 10367 raft_consensus.cc:385] T 22a77c72f2244a08a65e3779c5895752 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.775647 10367 raft_consensus.cc:740] T 22a77c72f2244a08a65e3779c5895752 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.775910 10367 consensus_queue.cc:260] T 22a77c72f2244a08a65e3779c5895752 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.776458 10367 ts_tablet_manager.cc:1434] T 22a77c72f2244a08a65e3779c5895752 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260810 19:48:13.777058 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet d59e5607e4184683bc3924266ed6ca20 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d59e5607e4184683bc3924266ed6ca20 already in progress: creating tablet
W20260810 19:48:13.777885 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 7a51811b14da4cddbea05f0cf30aad9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a51811b14da4cddbea05f0cf30aad9b already in progress: creating tablet
I20260810 19:48:13.778302 10377 tablet_replica.cc:333] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:13.778854 10377 raft_consensus.cc:2243] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:13.782730 10130 tablet_service.cc:1511] Processing CreateTablet for tablet fb5ce0c8aba347c5a06791dc711d191c (DEFAULT_TABLE table=default.Table_6bc5fb7fa62a42a99c0df6575d102a6d [id=97543bb72eee4036a5cf0e4424c6acd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.783010 10367 tablet_bootstrap.cc:492] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:13.783187 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb5ce0c8aba347c5a06791dc711d191c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.784823 10367 tablet_bootstrap.cc:654] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:13.787253 9415 master_service.cc:960] ReplaceTablet: received request to replace tablet fb9950c69605416e9e784b41ed77f9cf from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:13.790987 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8cb4f850b74f26a5814cdd48840f9d (DEFAULT_TABLE table=default.Table_fe8e192a01be4ef9917db24ac67ec0a2 [id=db6faa7bfb8a4ea7a1b37e0aeee690ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.791450 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8cb4f850b74f26a5814cdd48840f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.790653 9664 tablet_service.cc:1511] Processing CreateTablet for tablet fb5ce0c8aba347c5a06791dc711d191c (DEFAULT_TABLE table=default.Table_6bc5fb7fa62a42a99c0df6575d102a6d [id=97543bb72eee4036a5cf0e4424c6acd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.800324 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb5ce0c8aba347c5a06791dc711d191c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.798724 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8cb4f850b74f26a5814cdd48840f9d (DEFAULT_TABLE table=default.Table_fe8e192a01be4ef9917db24ac67ec0a2 [id=db6faa7bfb8a4ea7a1b37e0aeee690ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.802767 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8cb4f850b74f26a5814cdd48840f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.804898 10377 raft_consensus.cc:2272] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.805517 10377 ts_tablet_manager.cc:1916] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.786155 9890 tablet_service.cc:1511] Processing CreateTablet for tablet fb5ce0c8aba347c5a06791dc711d191c (DEFAULT_TABLE table=default.Table_6bc5fb7fa62a42a99c0df6575d102a6d [id=97543bb72eee4036a5cf0e4424c6acd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.793578 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8cb4f850b74f26a5814cdd48840f9d (DEFAULT_TABLE table=default.Table_fe8e192a01be4ef9917db24ac67ec0a2 [id=db6faa7bfb8a4ea7a1b37e0aeee690ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.806689 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8cb4f850b74f26a5814cdd48840f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.807014 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb5ce0c8aba347c5a06791dc711d191c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:13.816727 9135 external_mini_cluster.cc:1721] Unable to check leaks on /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu pid 11541: Timed out: CheckLeaks RPC to 127.8.235.253:37397 timed out after 1.000s (SENT)
I20260810 19:48:13.816901 9135 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu with pid 11541
I20260810 19:48:13.830960 12266 ts_tablet_manager.cc:1929] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260810 19:48:13.835235 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f416d4f6a81f4f9988f3211b98c0f485 consensus state has no leader
I20260810 19:48:13.835151 10137 tablet_service.cc:1511] Processing CreateTablet for tablet f3883a2df11a49c7af62458a4d5565c7 (DEFAULT_TABLE table=default.Table_6f90d8ae9e154aa5ad31454eabb04b3e [id=d508cbc298af42899eaa2ebe13a36cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.835629 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3883a2df11a49c7af62458a4d5565c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.838097 10370 ts_tablet_manager.cc:1434] T 1a393149727043f3a3c9f58aa051b065 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.103s user 0.007s sys 0.003s
I20260810 19:48:13.838471 10370 tablet_bootstrap.cc:492] T 9e861473094f42dfa22b9c00145ed1fe P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:13.838608 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3e78e13c8ecc464eb6af12a2bc3f2eba" } new_table_name: "default.Table_b14c1059b55a46fbb6d451b5a96c619b" modify_external_catalogs: true
I20260810 19:48:13.840169 10370 tablet_bootstrap.cc:654] T 9e861473094f42dfa22b9c00145ed1fe P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:13.842000 9898 tablet_service.cc:1511] Processing CreateTablet for tablet f3883a2df11a49c7af62458a4d5565c7 (DEFAULT_TABLE table=default.Table_6f90d8ae9e154aa5ad31454eabb04b3e [id=d508cbc298af42899eaa2ebe13a36cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.842572 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3883a2df11a49c7af62458a4d5565c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.842804 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b3cae548e1b5490bac7d5bc078ad507e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:13.843189 9890 tablet_service.cc:1511] Processing CreateTablet for tablet da4a406374d04d5c87957926cec1bc86 (DEFAULT_TABLE table=default.Table_650a584cca18434889f4b53784209535 [id=21a6b80fbeba4e318df0dc09381f69bf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:13.843401 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3cae548e1b5490bac7d5bc078ad507e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.844877 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da4a406374d04d5c87957926cec1bc86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.845116 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 8b006c24801d4a23a26f3c294a711eac (DEFAULT_TABLE table=default.Table_fa7206e2e20a419cb082d3e4ea0eeeb5 [id=bc57fd4526b54f429138da0ff0725549]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.845532 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b006c24801d4a23a26f3c294a711eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.848022 10118 tablet_service.cc:1511] Processing CreateTablet for tablet da4a406374d04d5c87957926cec1bc86 (DEFAULT_TABLE table=default.Table_650a584cca18434889f4b53784209535 [id=21a6b80fbeba4e318df0dc09381f69bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.848635 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da4a406374d04d5c87957926cec1bc86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.854585 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 8b006c24801d4a23a26f3c294a711eac (DEFAULT_TABLE table=default.Table_fa7206e2e20a419cb082d3e4ea0eeeb5 [id=bc57fd4526b54f429138da0ff0725549]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.855053 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b006c24801d4a23a26f3c294a711eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.855659 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7a0fc5c4560f422c80521b1c04c6f9e5" } modify_external_catalogs: true
I20260810 19:48:13.855966 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7a0fc5c4560f422c80521b1c04c6f9e5" } modify_external_catalogs: true
I20260810 19:48:13.860021 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1aa7012040f54866836d16c7d236a8a6" } new_table_name: "default.Table_116d1fd5c78f43bc829d4ac9875d2583" modify_external_catalogs: true
W20260810 19:48:13.865562 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 50eb51ef39e443668e2e5c32c7e9c89e has no consensus state
I20260810 19:48:13.867156 9408 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 85f1c7a75aac4d6a9462af4def91eaa4 (table default.Table_08c83fc388864b6f8a1ed597dc70bffe [id=2d55615cd797441c8abf6ea5a64f2f9f]). Expected version 1 got 0
I20260810 19:48:13.867470 9408 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 4571e0c723f74c828220b33116fed9e9 (table default.Table_d9d83336ef124c2da242e77391b001c0 [id=8dbf3227e8ae402aa46b9b31b715faa6]). Expected version 1 got 0
I20260810 19:48:13.867764 10370 tablet_bootstrap.cc:492] T 9e861473094f42dfa22b9c00145ed1fe P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:13.867920 10370 ts_tablet_manager.cc:1403] T 9e861473094f42dfa22b9c00145ed1fe P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.000s
I20260810 19:48:13.868770 10370 raft_consensus.cc:359] T 9e861473094f42dfa22b9c00145ed1fe P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.868964 10370 raft_consensus.cc:385] T 9e861473094f42dfa22b9c00145ed1fe P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.869022 10370 raft_consensus.cc:740] T 9e861473094f42dfa22b9c00145ed1fe P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.869221 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fce298689e9415a8860b8734d73b10a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:13.869485 10375 tablet_replica.cc:333] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:13.869674 10375 raft_consensus.cc:2243] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:13.869935 10375 pending_rounds.cc:70] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:13.869979 10375 pending_rounds.cc:77] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058739241443328 op_type: NO_OP noop_request { }
I20260810 19:48:13.870059 10375 raft_consensus.cc:2889] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:13.870123 10375 raft_consensus.cc:2272] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.873795 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0a2bf4992a02450587c532fe41b6d0b5" } modify_external_catalogs: true
I20260810 19:48:13.874037 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0a2bf4992a02450587c532fe41b6d0b5" } modify_external_catalogs: true
I20260810 19:48:13.874468 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a393149727043f3a3c9f58aa051b065 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:48:13.877009 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 041844571695425eb6de69d251dffcf0 consensus state has no leader
I20260810 19:48:13.877339 13041 raft_consensus.cc:493] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:13.877508 13041 raft_consensus.cc:515] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.878254 13041 leader_election.cc:290] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:13.878239 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a393149727043f3a3c9f58aa051b065 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:13.879184 10375 ts_tablet_manager.cc:1916] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:13.879457 9831 leader_election.cc:343] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 5654c48929564a96a55ed0444c9e1a04
I20260810 19:48:13.879491 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet fb9950c69605416e9e784b41ed77f9cf
I20260810 19:48:13.880095 9415 catalog_manager.cc:6807] ReplaceTablet: tablet fb9950c69605416e9e784b41ed77f9cf deleted and replaced by tablet 90da240ef084465a980536035a326f83
I20260810 19:48:13.881268 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet fb9950c69605416e9e784b41ed77f9cf with delete_type TABLET_DATA_DELETED (replaced by tablet 90da240ef084465a980536035a326f83) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:13.883665 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5654c48929564a96a55ed0444c9e1a04" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:13.883893 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 2f3d9408288f47aaaa384428c94a73b0 (DEFAULT_TABLE table=default.Table_b9afcbc98870448c9acc76cbe6c2d12e [id=6e64d543068c43408d78e0d4f6772ba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.884258 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet fb9950c69605416e9e784b41ed77f9cf with delete_type TABLET_DATA_DELETED (replaced by tablet 90da240ef084465a980536035a326f83) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:13.884856 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_25e42fcb9ec64d5080333f608ae0c7b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:13.885115 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ad71d1a139444738b47b2cbbf23e10e4" } modify_external_catalogs: true
I20260810 19:48:13.885319 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ad71d1a139444738b47b2cbbf23e10e4" } modify_external_catalogs: true
W20260810 19:48:13.885541 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25e42fcb9ec64d5080333f608ae0c7b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:13.886240 9830 leader_election.cc:343] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:13.886390 9830 leader_election.cc:304] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:13.887048 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 2f3d9408288f47aaaa384428c94a73b0 (DEFAULT_TABLE table=default.Table_b9afcbc98870448c9acc76cbe6c2d12e [id=6e64d543068c43408d78e0d4f6772ba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.887558 13041 raft_consensus.cc:2749] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:13.887995 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f3d9408288f47aaaa384428c94a73b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.888130 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 9d77ff1b151e496d9a5238260cfb7508 (DEFAULT_TABLE table=default.Table_410ce6c736c14fa39121fc3c487ee2ab [id=e75c45ccd10042268f21a3c68c4f8d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.889617 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 9d77ff1b151e496d9a5238260cfb7508 (DEFAULT_TABLE table=default.Table_410ce6c736c14fa39121fc3c487ee2ab [id=e75c45ccd10042268f21a3c68c4f8d09]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:13.889739 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 650ca46244e54bed89e96c4a09fc7a94 consensus state has no leader
I20260810 19:48:13.890107 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d77ff1b151e496d9a5238260cfb7508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.887498 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 5654c48929564a96a55ed0444c9e1a04 with delete_type TABLET_DATA_DELETED (replaced by tablet e87fd882e6b6413480a0cb06aee74722) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:13.899219 12266 log.cc:1199] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/410855f236004ad4b78839eb1c0c2f1f
I20260810 19:48:13.901371 9407 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 7748a3914fe54f18a81b95fd7c31279b
I20260810 19:48:13.903403 10366 tablet_bootstrap.cc:492] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:13.903540 10370 consensus_queue.cc:260] T 9e861473094f42dfa22b9c00145ed1fe P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.904203 10370 ts_tablet_manager.cc:1434] T 9e861473094f42dfa22b9c00145ed1fe P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.036s user 0.001s sys 0.001s
I20260810 19:48:13.842810 9666 tablet_service.cc:1511] Processing CreateTablet for tablet f3883a2df11a49c7af62458a4d5565c7 (DEFAULT_TABLE table=default.Table_6f90d8ae9e154aa5ad31454eabb04b3e [id=d508cbc298af42899eaa2ebe13a36cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.859902 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 8b006c24801d4a23a26f3c294a711eac (DEFAULT_TABLE table=default.Table_fa7206e2e20a419cb082d3e4ea0eeeb5 [id=bc57fd4526b54f429138da0ff0725549]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.905224 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b006c24801d4a23a26f3c294a711eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.880587 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet fb9950c69605416e9e784b41ed77f9cf with delete_type TABLET_DATA_DELETED (replaced by tablet 90da240ef084465a980536035a326f83) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:13.906661 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 9d77ff1b151e496d9a5238260cfb7508 (DEFAULT_TABLE table=default.Table_410ce6c736c14fa39121fc3c487ee2ab [id=e75c45ccd10042268f21a3c68c4f8d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.907076 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d77ff1b151e496d9a5238260cfb7508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.908046 10370 tablet_bootstrap.cc:492] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:13.909822 10370 tablet_bootstrap.cc:654] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:13.881345 10367 tablet_bootstrap.cc:492] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:13.885761 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 2f3d9408288f47aaaa384428c94a73b0 (DEFAULT_TABLE table=default.Table_b9afcbc98870448c9acc76cbe6c2d12e [id=6e64d543068c43408d78e0d4f6772ba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.896003 13019 raft_consensus.cc:493] T 985440898cc04a98877c15a5122a7dd3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:13.910132 13019 raft_consensus.cc:515] T 985440898cc04a98877c15a5122a7dd3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.910302 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f3d9408288f47aaaa384428c94a73b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.910387 12266 ts_tablet_manager.cc:1950] T 410855f236004ad4b78839eb1c0c2f1f P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:13.910943 13019 leader_election.cc:290] T 985440898cc04a98877c15a5122a7dd3 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:13.911603 12266 tablet_replica.cc:333] T 985440898cc04a98877c15a5122a7dd3 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:13.911814 12266 raft_consensus.cc:2243] T 985440898cc04a98877c15a5122a7dd3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.911948 12266 raft_consensus.cc:2272] T 985440898cc04a98877c15a5122a7dd3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.912477 12266 ts_tablet_manager.cc:1916] T 985440898cc04a98877c15a5122a7dd3 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.914714 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 410855f236004ad4b78839eb1c0c2f1f (table default.Table_44478e93cffb460aaa8df9115b799594 [id=1d363ce63686462f9f4c15669773ee22]) successfully deleted
W20260810 19:48:13.915057 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet f06df4cdb79c440b91b0eff135d2dfac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f06df4cdb79c440b91b0eff135d2dfac already in progress: creating tablet
I20260810 19:48:13.915206 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985440898cc04a98877c15a5122a7dd3" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:13.915804 9611 leader_election.cc:343] T 985440898cc04a98877c15a5122a7dd3 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:13.839095 9684 tablet_service.cc:1511] Processing CreateTablet for tablet da4a406374d04d5c87957926cec1bc86 (DEFAULT_TABLE table=default.Table_650a584cca18434889f4b53784209535 [id=21a6b80fbeba4e318df0dc09381f69bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.916286 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da4a406374d04d5c87957926cec1bc86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.911768 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985440898cc04a98877c15a5122a7dd3" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:13.917050 10366 ts_tablet_manager.cc:1403] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.336s user 0.023s sys 0.000s
I20260810 19:48:13.917362 10367 ts_tablet_manager.cc:1403] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.134s user 0.004s sys 0.000s
I20260810 19:48:13.917490 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 64470598ccec45a7ae3e3c77fe4b9518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:53 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:13.917847 10366 raft_consensus.cc:359] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.918051 10366 raft_consensus.cc:385] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.918110 10366 raft_consensus.cc:740] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.918172 10367 raft_consensus.cc:359] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.918349 10367 raft_consensus.cc:385] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:13.918402 10367 raft_consensus.cc:740] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:13.918335 10366 consensus_queue.cc:260] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:13.918710 9611 leader_election.cc:343] T 985440898cc04a98877c15a5122a7dd3 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:13.918823 9611 leader_election.cc:304] T 985440898cc04a98877c15a5122a7dd3 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
W20260810 19:48:13.919066 9611 raft_consensus.cc:2686] T 985440898cc04a98877c15a5122a7dd3 P fcd31b1bbb0340cbacfce652b4ad8da4: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 19:48:13.919658 10367 consensus_queue.cc:260] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.920204 10367 ts_tablet_manager.cc:1434] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260810 19:48:13.920526 10367 tablet_bootstrap.cc:492] T 25570b1795164aeca86a5313bd30a4c9 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:13.920440 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_50b4be8902f94126906b08db861107b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:13.918808 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3883a2df11a49c7af62458a4d5565c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.922216 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e861473094f42dfa22b9c00145ed1fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:13.922684 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2594ece5242247b5a59bd25aec31ad82" } modify_external_catalogs: true
I20260810 19:48:13.922880 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2594ece5242247b5a59bd25aec31ad82" } modify_external_catalogs: true
I20260810 19:48:13.925750 9408 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet d5aaedde75d54341a87764c6e89a03d6 (table default.Table_92a5dea12ac142e4ae87c3fa6d55e3db [id=4a442dde52a84379bc58bc03c3e80beb]). Expected version 1 got 0
I20260810 19:48:13.929256 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet 988d87b2b00a459d9afc44ba0ae1961e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:13.931137 9408 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet d5aaedde75d54341a87764c6e89a03d6 (table default.Table_92a5dea12ac142e4ae87c3fa6d55e3db [id=4a442dde52a84379bc58bc03c3e80beb]). Expected version 1 got 0
I20260810 19:48:13.943150 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f3d9408288f47aaaa384428c94a73b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.943164 13019 raft_consensus.cc:493] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:13.943327 13019 raft_consensus.cc:515] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.943813 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d77ff1b151e496d9a5238260cfb7508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.944044 13019 leader_election.cc:290] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:13.947413 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cf30d2d79f404798378ab01af53b8c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:13.947515 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cf30d2d79f404798378ab01af53b8c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:13.948069 9611 leader_election.cc:343] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:13.948298 9611 leader_election.cc:343] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:13.948381 9611 leader_election.cc:304] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:13.948770 13019 raft_consensus.cc:2749] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:13.948793 10375 ts_tablet_manager.cc:1929] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:13.948899 10375 log.cc:1199] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/8fce298689e9415a8860b8734d73b10a
I20260810 19:48:13.949210 10375 ts_tablet_manager.cc:1950] T 8fce298689e9415a8860b8734d73b10a P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:13.954530 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet a7770d570b6b4ee487309785581af219
I20260810 19:48:13.955538 10118 tablet_service.cc:1511] Processing CreateTablet for tablet d466a47b30874237b3f634afbb529598 (DEFAULT_TABLE table=default.Table_a91426db4fba4e90a7fba3cf473ed1e5 [id=8f3883dff553428593393eedea2ca1ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.955925 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet a7770d570b6b4ee487309785581af219 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:13.957660 9901 tablet_service.cc:1558] Processing DeleteTablet for tablet a7770d570b6b4ee487309785581af219 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:13.957877 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ea318eddd8349a79d27ce5746f03798 with delete_type TABLET_DATA_DELETED (replaced by tablet e7ea2f50f9f9423b99af3bd190cfd5a5) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:13.958405 10366 ts_tablet_manager.cc:1434] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.041s user 0.002s sys 0.000s
I20260810 19:48:13.958477 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet a7770d570b6b4ee487309785581af219 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:13.958907 10377 ts_tablet_manager.cc:1929] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:13.960093 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9c5f46c45ece4bba9bd0e781b1ad3ec7" } new_table_name: "default.Table_1458a7c3a0ed4be0a426300cc69c92ca" modify_external_catalogs: true
I20260810 19:48:13.963203 9688 tablet_service.cc:1511] Processing CreateTablet for tablet d466a47b30874237b3f634afbb529598 (DEFAULT_TABLE table=default.Table_a91426db4fba4e90a7fba3cf473ed1e5 [id=8f3883dff553428593393eedea2ca1ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.963999 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d466a47b30874237b3f634afbb529598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.967361 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8751cb940a0d4dc38a56b594b9d65519" } modify_external_catalogs: true
I20260810 19:48:13.967566 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8751cb940a0d4dc38a56b594b9d65519" } modify_external_catalogs: true
I20260810 19:48:13.968029 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 9b5b21bff7634b1dbb6dfe1f4a85ce23
I20260810 19:48:13.969432 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b5b21bff7634b1dbb6dfe1f4a85ce23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:13.969825 13019 raft_consensus.cc:493] T 22a77c72f2244a08a65e3779c5895752 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:13.970007 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b5b21bff7634b1dbb6dfe1f4a85ce23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:13.969976 13019 raft_consensus.cc:515] T 22a77c72f2244a08a65e3779c5895752 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:13.970795 13019 leader_election.cc:290] T 22a77c72f2244a08a65e3779c5895752 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:13.971936 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a77c72f2244a08a65e3779c5895752" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:13.972111 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 6cf45667f466419d8577f72ce2110f11 (DEFAULT_TABLE table=default.Table_10672eb0663b47feafccbbfe7d561940 [id=8fe797ec49ac4d9ab101a6c3aa92bd30]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:13.972637 9611 leader_election.cc:343] T 22a77c72f2244a08a65e3779c5895752 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:13.972803 10377 log.cc:1199] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/410855f236004ad4b78839eb1c0c2f1f
I20260810 19:48:13.973198 10377 ts_tablet_manager.cc:1950] T 410855f236004ad4b78839eb1c0c2f1f P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:13.973948 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_4a7879b46d414ea78cd53eede045fce1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.974577 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a7879b46d414ea78cd53eede045fce1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.959784 9890 tablet_service.cc:1511] Processing CreateTablet for tablet d466a47b30874237b3f634afbb529598 (DEFAULT_TABLE table=default.Table_a91426db4fba4e90a7fba3cf473ed1e5 [id=8f3883dff553428593393eedea2ca1ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.971670 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a77c72f2244a08a65e3779c5895752" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:13.976397 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 8fce298689e9415a8860b8734d73b10a (table default.Table_987f321d06054ef782d6aa76b7be0ae9 [id=4c476fd4be224f719254ec5da0f5e2ee]) successfully deleted
W20260810 19:48:13.976657 9611 leader_election.cc:343] T 22a77c72f2244a08a65e3779c5895752 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:13.976819 10375 tablet_replica.cc:333] T 1a393149727043f3a3c9f58aa051b065 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:13.976801 9611 leader_election.cc:304] T 22a77c72f2244a08a65e3779c5895752 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:13.977062 10375 raft_consensus.cc:2243] T 1a393149727043f3a3c9f58aa051b065 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:13.977239 10375 raft_consensus.cc:2272] T 1a393149727043f3a3c9f58aa051b065 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:13.977246 13019 raft_consensus.cc:2749] T 22a77c72f2244a08a65e3779c5895752 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:13.977864 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d466a47b30874237b3f634afbb529598. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:13.978641 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50b4be8902f94126906b08db861107b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:13.980160 9400 connection.cc:573] client connection to 127.8.235.253:37397 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 19:48:13.980296 9400 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 2 similar messages]
W20260810 19:48:13.980530 9835 connection.cc:573] client connection to 127.8.235.253:37397 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 19:48:13.981252 10375 ts_tablet_manager.cc:1916] T 1a393149727043f3a3c9f58aa051b065 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:13.986044 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cf45667f466419d8577f72ce2110f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.988051 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 6cf45667f466419d8577f72ce2110f11 (DEFAULT_TABLE table=default.Table_10672eb0663b47feafccbbfe7d561940 [id=8fe797ec49ac4d9ab101a6c3aa92bd30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:13.991815 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cf45667f466419d8577f72ce2110f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.993320 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_d8e6b3a8ee554914bf34612fe63b3056"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.993959 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8e6b3a8ee554914bf34612fe63b3056 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.995643 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_78f097d877bd4d56980f6bb5eed2e314"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.996194 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78f097d877bd4d56980f6bb5eed2e314 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.997408 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d466a47b30874237b3f634afbb529598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:13.997779 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c339da99a2ef4aaf978f48774cf7197a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:13.998373 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c339da99a2ef4aaf978f48774cf7197a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:13.999967 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_542ae6490ce046f299724c7afb076b83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:14.000433 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_542ae6490ce046f299724c7afb076b83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:14.002748 10370 tablet_bootstrap.cc:492] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:14.002918 10370 ts_tablet_manager.cc:1403] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.095s user 0.010s sys 0.001s
I20260810 19:48:14.003196 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 3ddc1bc292a243338235ea1396cc08f8
I20260810 19:48:14.003773 10370 raft_consensus.cc:359] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.003921 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet e3f04460d9cc440580e9a7f4ec56bf40
I20260810 19:48:14.003971 10370 raft_consensus.cc:385] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:14.004029 10370 raft_consensus.cc:740] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
W20260810 19:48:14.004848 13089 negotiation.cc:336] Failed RPC negotiation. Trace:
0810 19:48:13.981917 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.8.235.253:37397 (local address 127.8.235.194:54067)
0810 19:48:14.003521 (+ 21604us) negotiation.cc:107] Waiting for socket to connect
0810 19:48:14.003542 (+ 21us) client_negotiation.cc:175] Beginning negotiation
0810 19:48:14.003680 (+ 138us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0810 19:48:14.004541 (+ 861us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.235.253:37397: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":21489,"thread_start_us":21851,"threads_started":1}
W20260810 19:48:14.005239 13086 negotiation.cc:336] Failed RPC negotiation. Trace:
0810 19:48:13.981032 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.8.235.253:37397 (local address 127.8.235.195:57315)
0810 19:48:13.999836 (+ 18804us) negotiation.cc:107] Waiting for socket to connect
0810 19:48:13.999857 (+ 21us) client_negotiation.cc:175] Beginning negotiation
0810 19:48:14.000011 (+ 154us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0810 19:48:14.005013 (+ 5002us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.235.253:37397: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":18688,"thread_start_us":18855,"threads_started":1}
W20260810 19:48:14.005813 13087 negotiation.cc:336] Failed RPC negotiation. Trace:
0810 19:48:13.981707 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.8.235.253:37397 (local address 127.8.235.193:40327)
0810 19:48:14.001703 (+ 19996us) negotiation.cc:107] Waiting for socket to connect
0810 19:48:14.001728 (+ 25us) client_negotiation.cc:175] Beginning negotiation
0810 19:48:14.001881 (+ 153us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0810 19:48:14.005629 (+ 3748us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.235.253:37397: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":19858,"threads_started":1}
I20260810 19:48:14.005908 13041 raft_consensus.cc:493] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:14.006052 13041 raft_consensus.cc:515] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.006698 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ddc1bc292a243338235ea1396cc08f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:14.006800 13041 leader_election.cc:290] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:14.006953 10136 tablet_service.cc:1558] Processing DeleteTablet for tablet e3f04460d9cc440580e9a7f4ec56bf40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:14.007890 9831 leader_election.cc:343] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 6ea318eddd8349a79d27ce5746f03798
I20260810 19:48:14.008581 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea318eddd8349a79d27ce5746f03798" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:14.008782 9898 tablet_service.cc:1511] Processing CreateTablet for tablet f416d4f6a81f4f9988f3211b98c0f485 (DEFAULT_TABLE table=default.Table_fd6edb0f090848feb79e0310d8752d7b [id=e1dfbd518ca444af9fd9cb170cde2108]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:14.009130 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 23c5332560614e99b9bc66a0b81f9a47 has no consensus state
I20260810 19:48:14.009131 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 4dcd3b4017f9455683ce6bc3f48ab851 (DEFAULT_TABLE table=default.Table_2056fc593131401e9f2f70d9afd76ace [id=99bea79601b5432d962fb3d0d16be314]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.009222 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet e3f04460d9cc440580e9a7f4ec56bf40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:14.009498 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ddc1bc292a243338235ea1396cc08f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:14.009619 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 4dcd3b4017f9455683ce6bc3f48ab851 (DEFAULT_TABLE table=default.Table_2056fc593131401e9f2f70d9afd76ace [id=99bea79601b5432d962fb3d0d16be314]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.010043 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dcd3b4017f9455683ce6bc3f48ab851. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:14.010294 9830 leader_election.cc:343] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:14.010598 9830 leader_election.cc:304] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:14.011097 13041 raft_consensus.cc:2749] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:14.011914 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 4dcd3b4017f9455683ce6bc3f48ab851 (DEFAULT_TABLE table=default.Table_2056fc593131401e9f2f70d9afd76ace [id=99bea79601b5432d962fb3d0d16be314]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.012323 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dcd3b4017f9455683ce6bc3f48ab851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.012172 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 6cf45667f466419d8577f72ce2110f11 (DEFAULT_TABLE table=default.Table_10672eb0663b47feafccbbfe7d561940 [id=8fe797ec49ac4d9ab101a6c3aa92bd30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.012944 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cf45667f466419d8577f72ce2110f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.014710 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet e3f04460d9cc440580e9a7f4ec56bf40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:14.015954 13019 raft_consensus.cc:493] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:14.016086 13019 raft_consensus.cc:515] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.016152 9684 tablet_service.cc:1511] Processing CreateTablet for tablet f416d4f6a81f4f9988f3211b98c0f485 (DEFAULT_TABLE table=default.Table_fd6edb0f090848feb79e0310d8752d7b [id=e1dfbd518ca444af9fd9cb170cde2108]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.016506 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f416d4f6a81f4f9988f3211b98c0f485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.016738 13019 leader_election.cc:290] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:14.017609 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deeb390ae00646089e9f1d453ddb54a1" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:14.018476 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f416d4f6a81f4f9988f3211b98c0f485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.018709 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dcd3b4017f9455683ce6bc3f48ab851. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:14.018776 9611 leader_election.cc:343] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:14.019187 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ddc1bc292a243338235ea1396cc08f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:14.028684 9913 tablet_service.cc:1511] Processing CreateTablet for tablet ce0a2d422a7146ac86d75449d876807e (DEFAULT_TABLE table=default.Table_897f0a603fed42b6b45f1b9d730491d0 [id=765ea6d9a863412585581f32de84cefb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.029222 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0a2d422a7146ac86d75449d876807e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.029786 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 5f67ea7942dd4f5a8ae651f38e12489e (DEFAULT_TABLE table=default.Table_db92859a63cc4b6290e90e5b7d4ef344 [id=cba07fa6ba064442a88f0ef27c31ce25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.030215 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f67ea7942dd4f5a8ae651f38e12489e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.030237 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 0622bb3b3f4345129eb5f0f91be3a922 (DEFAULT_TABLE table=default.Table_5fd2a309ec6f484f8b2c2dc66fb79a3f [id=5f54f7b01a974776a32810ed03d2dc2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.030614 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0622bb3b3f4345129eb5f0f91be3a922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.030858 9666 tablet_service.cc:1511] Processing CreateTablet for tablet ce0a2d422a7146ac86d75449d876807e (DEFAULT_TABLE table=default.Table_897f0a603fed42b6b45f1b9d730491d0 [id=765ea6d9a863412585581f32de84cefb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.031042 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 6622f1c485cf4f8c85ccf4b1b428a812 (DEFAULT_TABLE table=default.Table_4d5e244280274336986ed743fd862073 [id=4960647cdc9243a09cf2fc97bfefd048]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.031304 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0a2d422a7146ac86d75449d876807e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.031494 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6622f1c485cf4f8c85ccf4b1b428a812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.038772 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 5f67ea7942dd4f5a8ae651f38e12489e (DEFAULT_TABLE table=default.Table_db92859a63cc4b6290e90e5b7d4ef344 [id=cba07fa6ba064442a88f0ef27c31ce25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.038796 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_89373162e84f4605be0d2f1f7cca6d6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:14.039252 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f67ea7942dd4f5a8ae651f38e12489e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:14.039419 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89373162e84f4605be0d2f1f7cca6d6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:14.040797 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_dca6b457fbf744e089c4a583fca06cbb" } new_table_name: "default.Table_1488511b73d243c6b7384aaf88fb6a15" modify_external_catalogs: true
I20260810 19:48:14.046164 9668 tablet_service.cc:1511] Processing CreateTablet for tablet 0622bb3b3f4345129eb5f0f91be3a922 (DEFAULT_TABLE table=default.Table_5fd2a309ec6f484f8b2c2dc66fb79a3f [id=5f54f7b01a974776a32810ed03d2dc2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.046663 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0622bb3b3f4345129eb5f0f91be3a922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.046921 10375 ts_tablet_manager.cc:1929] T 1a393149727043f3a3c9f58aa051b065 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:14.047039 10375 log.cc:1199] T 1a393149727043f3a3c9f58aa051b065 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/1a393149727043f3a3c9f58aa051b065
I20260810 19:48:14.047339 10375 ts_tablet_manager.cc:1950] T 1a393149727043f3a3c9f58aa051b065 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:14.050889 9677 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6996f880e847c39a3a4e173d28ed9f (DEFAULT_TABLE table=default.Table_ad4c8111945d44589f5608226af55c5b [id=5b536acd9cc944048119d8d3909b81b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.051347 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6996f880e847c39a3a4e173d28ed9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.055895 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6996f880e847c39a3a4e173d28ed9f (DEFAULT_TABLE table=default.Table_ad4c8111945d44589f5608226af55c5b [id=5b536acd9cc944048119d8d3909b81b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.056075 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 1a393149727043f3a3c9f58aa051b065 (table default.Table_f752dd58f7fe415f85280cbb9adb306c [id=8f9c3952ab4b4930943001c3d43d6d7d]) successfully deleted
I20260810 19:48:14.056357 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6996f880e847c39a3a4e173d28ed9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.056324 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 82d62493159c4b1fb0e7537b9f64a431 (DEFAULT_TABLE table=default.Table_de018de17ae54300873a272247929e46 [id=6e7f5a0205314496be1a9f1f25259850]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.056670 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d62493159c4b1fb0e7537b9f64a431. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.057319 9907 tablet_service.cc:1511] Processing CreateTablet for tablet a7770d570b6b4ee487309785581af219 (DEFAULT_TABLE table=default.Table_ad71d1a139444738b47b2cbbf23e10e4 [id=3b31c557410c4e5eb7cc68846b89b378]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.057804 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7770d570b6b4ee487309785581af219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.061810 10119 tablet_service.cc:1511] Processing CreateTablet for tablet dbfdf8c9b54340f2ad97aa817f8eb0ad (DEFAULT_TABLE table=default.Table_b29c1da447c64a1e84fe8717e23c4c60 [id=f9cdc3e55e72412f9c44dda5d7ee91c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.062201 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbfdf8c9b54340f2ad97aa817f8eb0ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.063696 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 31526aa9c74e45e585e280f88f73cfa9 (DEFAULT_TABLE table=default.Table_585a8a9b06434703beb484747743577d [id=7c31710c9bc64b43ba21c524cd39cc3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.064132 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31526aa9c74e45e585e280f88f73cfa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.066629 10140 tablet_service.cc:1511] Processing CreateTablet for tablet a7770d570b6b4ee487309785581af219 (DEFAULT_TABLE table=default.Table_ad71d1a139444738b47b2cbbf23e10e4 [id=3b31c557410c4e5eb7cc68846b89b378]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.066704 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6996f880e847c39a3a4e173d28ed9f (DEFAULT_TABLE table=default.Table_ad4c8111945d44589f5608226af55c5b [id=5b536acd9cc944048119d8d3909b81b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.066866 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 684fd292f5ca4d0284a5036b039c640b (DEFAULT_TABLE table=default.Table_8ce93209c7104f5cb5d786470e0fbf94 [id=fba0d480dd204d98b540f1972f1eb99f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.067039 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7770d570b6b4ee487309785581af219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.067935 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5fd992f1afe5496eb8ca25a8409e3348" } new_table_name: "default.Table_bae8401b558c435d8d1317c6d9c7f7a3" modify_external_catalogs: true
I20260810 19:48:14.069865 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet 09a8da9ecf1042bfae5d34e263f501d6 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:14.070638 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 31526aa9c74e45e585e280f88f73cfa9 (DEFAULT_TABLE table=default.Table_585a8a9b06434703beb484747743577d [id=7c31710c9bc64b43ba21c524cd39cc3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.070996 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31526aa9c74e45e585e280f88f73cfa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.067651 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 985f4cf25d0f485eafa26d19bc74fe26 (DEFAULT_TABLE table=default.Table_bf518ebf11a34609befb3cef7a20e7ea [id=85f38e299833496e90dbc210a5a13935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.069687 9902 tablet_service.cc:1511] Processing CreateTablet for tablet caf1d369978744eeb8ff7f678ab74851 (DEFAULT_TABLE table=default.Table_db9ba9fcc2774506a2c86fe376f8314e [id=d41657e43de44dd09bba04ff01fc3843]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.067037 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6996f880e847c39a3a4e173d28ed9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.070205 9883 tablet_service.cc:1511] Processing CreateTablet for tablet ef71075eb2cc4dcaa310786b3333f070 (DEFAULT_TABLE table=default.Table_a96082c210af46e4acbf221a98d946eb [id=df1166ed03a7440180526bd8e8b4164d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.072131 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caf1d369978744eeb8ff7f678ab74851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.070758 9894 tablet_service.cc:1511] Processing CreateTablet for tablet 6793ac6820ca43ca8070bb7e1a93a110 (DEFAULT_TABLE table=default.Table_a388312470544fb89f54d782ffd6f7c8 [id=1a81d3d25cda47c8aa6326bfc2edd685]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.072521 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6793ac6820ca43ca8070bb7e1a93a110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.074436 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985f4cf25d0f485eafa26d19bc74fe26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.075480 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 6793ac6820ca43ca8070bb7e1a93a110 (DEFAULT_TABLE table=default.Table_a388312470544fb89f54d782ffd6f7c8 [id=1a81d3d25cda47c8aa6326bfc2edd685]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.075877 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6793ac6820ca43ca8070bb7e1a93a110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.078626 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 985f4cf25d0f485eafa26d19bc74fe26 (DEFAULT_TABLE table=default.Table_bf518ebf11a34609befb3cef7a20e7ea [id=85f38e299833496e90dbc210a5a13935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.078980 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985f4cf25d0f485eafa26d19bc74fe26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.070917 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 533e173a395549e89d021ceba7407696 (DEFAULT_TABLE table=default.Table_1b436c9645b44aaaa1f939d9c544bdf3 [id=68641130e17a489caad195cbe3307fc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.082510 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 533e173a395549e89d021ceba7407696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.082638 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 684fd292f5ca4d0284a5036b039c640b (DEFAULT_TABLE table=default.Table_8ce93209c7104f5cb5d786470e0fbf94 [id=fba0d480dd204d98b540f1972f1eb99f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.082836 10115 tablet_service.cc:1511] Processing CreateTablet for tablet ef71075eb2cc4dcaa310786b3333f070 (DEFAULT_TABLE table=default.Table_a96082c210af46e4acbf221a98d946eb [id=df1166ed03a7440180526bd8e8b4164d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.083006 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 684fd292f5ca4d0284a5036b039c640b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.083309 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 533e173a395549e89d021ceba7407696 (DEFAULT_TABLE table=default.Table_1b436c9645b44aaaa1f939d9c544bdf3 [id=68641130e17a489caad195cbe3307fc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.083662 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 533e173a395549e89d021ceba7407696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.086583 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 66fa9d773797412cb53d34ecdf3d0f61 (DEFAULT_TABLE table=default.Table_465ab367cd274ae493b639b9811d5a03 [id=3469f49b4e01405f98e4a729da951429]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.086918 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66fa9d773797412cb53d34ecdf3d0f61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.089629 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 81d60f7028ce474f92c4c1336badcbd5 (DEFAULT_TABLE table=default.Table_961700636a7b4d19b41a7e26230b64a7 [id=46c908aeae304afc8ab7813b344a6925]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.089955 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81d60f7028ce474f92c4c1336badcbd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.090469 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef71075eb2cc4dcaa310786b3333f070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.091068 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 0a89814930994195bad45121d1157598 (DEFAULT_TABLE table=default.Table_fa2d4835f00b4e80955453185ee56272 [id=4eed2e87f1aa4d4fa4928b1b3ae1b2d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.091384 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a89814930994195bad45121d1157598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.082638 10142 tablet_service.cc:1511] Processing CreateTablet for tablet caf1d369978744eeb8ff7f678ab74851 (DEFAULT_TABLE table=default.Table_db9ba9fcc2774506a2c86fe376f8314e [id=d41657e43de44dd09bba04ff01fc3843]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.092245 10142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caf1d369978744eeb8ff7f678ab74851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.093040 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 82d62493159c4b1fb0e7537b9f64a431 (DEFAULT_TABLE table=default.Table_de018de17ae54300873a272247929e46 [id=6e7f5a0205314496be1a9f1f25259850]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.093407 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d62493159c4b1fb0e7537b9f64a431. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.094431 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 684fd292f5ca4d0284a5036b039c640b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.095383 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_10470b028a754435980ba9eb9ccce17f" } new_table_name: "default.Table_1be69c6952644380910194264563eea4" modify_external_catalogs: true
I20260810 19:48:14.096825 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_bb9ee8b5a96a42d2be03ff52cf3d6d63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:14.097337 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb9ee8b5a96a42d2be03ff52cf3d6d63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:14.099098 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef71075eb2cc4dcaa310786b3333f070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.102551 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f4f2d054565f42e8843cbff1e2c8cc5a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:14.103049 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4f2d054565f42e8843cbff1e2c8cc5a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:14.108886 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 36f29d8ea37247f6835ffef41d0e3b31 (DEFAULT_TABLE table=default.Table_43d705e812c24da3876d013deb20ac5d [id=90493e961775414085ce04681e72124c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.115630 13041 raft_consensus.cc:493] T 1a393149727043f3a3c9f58aa051b065 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:14.115767 13041 raft_consensus.cc:515] T 1a393149727043f3a3c9f58aa051b065 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.116460 13041 leader_election.cc:290] T 1a393149727043f3a3c9f58aa051b065 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:14.117738 9831 leader_election.cc:343] T 1a393149727043f3a3c9f58aa051b065 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 1a393149727043f3a3c9f58aa051b065
W20260810 19:48:14.121124 9830 leader_election.cc:343] T 1a393149727043f3a3c9f58aa051b065 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Not found: Tablet not found: 1a393149727043f3a3c9f58aa051b065
I20260810 19:48:14.121376 9830 leader_election.cc:304] T 1a393149727043f3a3c9f58aa051b065 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:14.121686 13041 raft_consensus.cc:2749] T 1a393149727043f3a3c9f58aa051b065 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:14.123417 9885 tablet_service.cc:1511] Processing CreateTablet for tablet 5fda32cc65fa49b09067b61d2d2cd581 (DEFAULT_TABLE table=default.Table_56ed643105684c67b9ee649bcbbb993c [id=7bdd0ebb0b5e4c418dd996ebd02b08a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.123907 9885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fda32cc65fa49b09067b61d2d2cd581. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.125255 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 9632cca1eccf4d9ca17e3d99c744b881 (DEFAULT_TABLE table=default.Table_28f6d1fdbe464aeca07552d5916714f3 [id=4662a282259748eb90e48b1ed4904e58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.125663 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9632cca1eccf4d9ca17e3d99c744b881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.131559 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 82d62493159c4b1fb0e7537b9f64a431 (DEFAULT_TABLE table=default.Table_de018de17ae54300873a272247929e46 [id=6e7f5a0205314496be1a9f1f25259850]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.132021 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d62493159c4b1fb0e7537b9f64a431. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.131961 9659 tablet_service.cc:1511] Processing CreateTablet for tablet a7770d570b6b4ee487309785581af219 (DEFAULT_TABLE table=default.Table_ad71d1a139444738b47b2cbbf23e10e4 [id=3b31c557410c4e5eb7cc68846b89b378]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.132265 9659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7770d570b6b4ee487309785581af219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.131559 9673 tablet_service.cc:1511] Processing CreateTablet for tablet dbfdf8c9b54340f2ad97aa817f8eb0ad (DEFAULT_TABLE table=default.Table_b29c1da447c64a1e84fe8717e23c4c60 [id=f9cdc3e55e72412f9c44dda5d7ee91c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.132709 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbfdf8c9b54340f2ad97aa817f8eb0ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.013738 10370 consensus_queue.cc:260] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.136487 10370 ts_tablet_manager.cc:1434] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.133s user 0.003s sys 0.000s
I20260810 19:48:14.136433 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 31526aa9c74e45e585e280f88f73cfa9 (DEFAULT_TABLE table=default.Table_585a8a9b06434703beb484747743577d [id=7c31710c9bc64b43ba21c524cd39cc3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.136858 10370 tablet_bootstrap.cc:492] T 05059ef70a8e440ca2988bfeb610645d P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:14.136874 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31526aa9c74e45e585e280f88f73cfa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.136976 9685 tablet_service.cc:1511] Processing CreateTablet for tablet 533e173a395549e89d021ceba7407696 (DEFAULT_TABLE table=default.Table_1b436c9645b44aaaa1f939d9c544bdf3 [id=68641130e17a489caad195cbe3307fc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.137331 9685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 533e173a395549e89d021ceba7407696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.018507 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deeb390ae00646089e9f1d453ddb54a1" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:14.138579 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 684fd292f5ca4d0284a5036b039c640b (DEFAULT_TABLE table=default.Table_8ce93209c7104f5cb5d786470e0fbf94 [id=fba0d480dd204d98b540f1972f1eb99f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.138661 13067 raft_consensus.cc:493] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:14.138805 13067 raft_consensus.cc:515] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.138928 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 684fd292f5ca4d0284a5036b039c640b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.139705 13067 leader_election.cc:290] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:14.140364 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36f29d8ea37247f6835ffef41d0e3b31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.140966 9660 tablet_service.cc:1511] Processing CreateTablet for tablet 66fa9d773797412cb53d34ecdf3d0f61 (DEFAULT_TABLE table=default.Table_465ab367cd274ae493b639b9811d5a03 [id=3469f49b4e01405f98e4a729da951429]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.141309 9660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66fa9d773797412cb53d34ecdf3d0f61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.142246 9663 tablet_service.cc:1511] Processing CreateTablet for tablet 985f4cf25d0f485eafa26d19bc74fe26 (DEFAULT_TABLE table=default.Table_bf518ebf11a34609befb3cef7a20e7ea [id=85f38e299833496e90dbc210a5a13935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.142601 9663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985f4cf25d0f485eafa26d19bc74fe26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.144991 9655 tablet_service.cc:1511] Processing CreateTablet for tablet 81d60f7028ce474f92c4c1336badcbd5 (DEFAULT_TABLE table=default.Table_961700636a7b4d19b41a7e26230b64a7 [id=46c908aeae304afc8ab7813b344a6925]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.145401 9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81d60f7028ce474f92c4c1336badcbd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.145946 9658 tablet_service.cc:1511] Processing CreateTablet for tablet caf1d369978744eeb8ff7f678ab74851 (DEFAULT_TABLE table=default.Table_db9ba9fcc2774506a2c86fe376f8314e [id=d41657e43de44dd09bba04ff01fc3843]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.146267 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caf1d369978744eeb8ff7f678ab74851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.146560 9665 tablet_service.cc:1511] Processing CreateTablet for tablet ef71075eb2cc4dcaa310786b3333f070 (DEFAULT_TABLE table=default.Table_a96082c210af46e4acbf221a98d946eb [id=df1166ed03a7440180526bd8e8b4164d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.027607 10136 tablet_service.cc:1511] Processing CreateTablet for tablet ce0a2d422a7146ac86d75449d876807e (DEFAULT_TABLE table=default.Table_897f0a603fed42b6b45f1b9d730491d0 [id=765ea6d9a863412585581f32de84cefb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.147020 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 6793ac6820ca43ca8070bb7e1a93a110 (DEFAULT_TABLE table=default.Table_a388312470544fb89f54d782ffd6f7c8 [id=1a81d3d25cda47c8aa6326bfc2edd685]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.147253 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0a2d422a7146ac86d75449d876807e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.147801 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5654c48929564a96a55ed0444c9e1a04" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:14.148015 9935 raft_consensus.cc:2468] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:14.028049 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 5f67ea7942dd4f5a8ae651f38e12489e (DEFAULT_TABLE table=default.Table_db92859a63cc4b6290e90e5b7d4ef344 [id=cba07fa6ba064442a88f0ef27c31ce25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.057319 9901 tablet_service.cc:1511] Processing CreateTablet for tablet dbfdf8c9b54340f2ad97aa817f8eb0ad (DEFAULT_TABLE table=default.Table_b29c1da447c64a1e84fe8717e23c4c60 [id=f9cdc3e55e72412f9c44dda5d7ee91c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.150666 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbfdf8c9b54340f2ad97aa817f8eb0ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.150665 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f67ea7942dd4f5a8ae651f38e12489e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.151961 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef71075eb2cc4dcaa310786b3333f070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.153121 10375 tablet_replica.cc:333] T 9e861473094f42dfa22b9c00145ed1fe P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:14.029472 10120 tablet_service.cc:1511] Processing CreateTablet for tablet 6622f1c485cf4f8c85ccf4b1b428a812 (DEFAULT_TABLE table=default.Table_4d5e244280274336986ed743fd862073 [id=4960647cdc9243a09cf2fc97bfefd048]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.029570 10116 tablet_service.cc:1511] Processing CreateTablet for tablet 0622bb3b3f4345129eb5f0f91be3a922 (DEFAULT_TABLE table=default.Table_5fd2a309ec6f484f8b2c2dc66fb79a3f [id=5f54f7b01a974776a32810ed03d2dc2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.111336 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 9632cca1eccf4d9ca17e3d99c744b881 (DEFAULT_TABLE table=default.Table_28f6d1fdbe464aeca07552d5916714f3 [id=4662a282259748eb90e48b1ed4904e58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.153340 10375 raft_consensus.cc:2243] T 9e861473094f42dfa22b9c00145ed1fe P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:14.153496 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6622f1c485cf4f8c85ccf4b1b428a812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.153517 10375 raft_consensus.cc:2272] T 9e861473094f42dfa22b9c00145ed1fe P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:14.154443 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6793ac6820ca43ca8070bb7e1a93a110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.157991 10067 leader_election.cc:304] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:14.158489 12993 raft_consensus.cc:2804] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:14.158569 12993 raft_consensus.cc:493] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:14.158625 12993 raft_consensus.cc:3060] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:14.159183 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet fb9950c69605416e9e784b41ed77f9cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb9950c69605416e9e784b41ed77f9cf already in progress: creating tablet
I20260810 19:48:14.159430 10375 ts_tablet_manager.cc:1916] T 9e861473094f42dfa22b9c00145ed1fe P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:14.161552 12993 raft_consensus.cc:515] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.162271 9894 tablet_service.cc:1511] Processing CreateTablet for tablet 3b30e169659e44faa626ee3a22649c60 (DEFAULT_TABLE table=default.Table_02612994a1ec4e07ab667d3b965e6fe8 [id=b5e7f9ec4b094fc4863b2356c823244b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.162923 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b30e169659e44faa626ee3a22649c60. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:14.162909 9611 leader_election.cc:343] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:14.163056 9611 leader_election.cc:304] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:14.163389 13019 raft_consensus.cc:2749] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:14.010409 10137 tablet_service.cc:1511] Processing CreateTablet for tablet f416d4f6a81f4f9988f3211b98c0f485 (DEFAULT_TABLE table=default.Table_fd6edb0f090848feb79e0310d8752d7b [id=e1dfbd518ca444af9fd9cb170cde2108]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.112730 10140 tablet_service.cc:1511] Processing CreateTablet for tablet 5fda32cc65fa49b09067b61d2d2cd581 (DEFAULT_TABLE table=default.Table_56ed643105684c67b9ee649bcbbb993c [id=7bdd0ebb0b5e4c418dd996ebd02b08a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.114190 10128 tablet_service.cc:1511] Processing CreateTablet for tablet bdc75cfc6d73476bba81d00f5ccd342d (DEFAULT_TABLE table=default.Table_4458e0094c7a4f2fbe18a9101886249d [id=9a8bd15d60714761ac544832d8ce9bad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.112388 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 3b30e169659e44faa626ee3a22649c60 (DEFAULT_TABLE table=default.Table_02612994a1ec4e07ab667d3b965e6fe8 [id=b5e7f9ec4b094fc4863b2356c823244b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.129472 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 8857aaeb0e3442ec98738f46f3a63442 (DEFAULT_TABLE table=default.Table_4b65055403904f0a8b3ded5be5ffdd4e [id=b33e78d762584ed6ba66e940a83e8adc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.132515 10122 tablet_service.cc:1511] Processing CreateTablet for tablet e3f04460d9cc440580e9a7f4ec56bf40 (DEFAULT_TABLE table=default.Table_2594ece5242247b5a59bd25aec31ad82 [id=c172f514f9bd4fab9063c6857b5ba6f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.135382 10142 tablet_service.cc:1511] Processing CreateTablet for tablet 1f18360a1ad84fdfb6285525aea51200 (DEFAULT_TABLE table=default.Table_97d2fd6539194595b1a536e612315869 [id=6f4662312d934a3fb16f904821170f92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.166265 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 81d60f7028ce474f92c4c1336badcbd5 (DEFAULT_TABLE table=default.Table_961700636a7b4d19b41a7e26230b64a7 [id=46c908aeae304afc8ab7813b344a6925]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.135641 10119 tablet_service.cc:1511] Processing CreateTablet for tablet dbb69ab3dafa44fdaa41bacf4bc71602 (DEFAULT_TABLE table=default.Table_d313ae200f4c40ca84375b6e8979c067 [id=a99abe6dbe45409dac8762706ff46f60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.126250 10115 tablet_service.cc:1511] Processing CreateTablet for tablet e86cbef82d3c4d0fad94480ea31a4c3b (DEFAULT_TABLE table=default.Table_2ca134cde4db4944a8ec84eacc06d5eb [id=891889ab896b49918b842f3ea23d0989]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.166610 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9632cca1eccf4d9ca17e3d99c744b881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.166723 12993 leader_election.cc:290] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:14.166882 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81d60f7028ce474f92c4c1336badcbd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.170051 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 36f29d8ea37247f6835ffef41d0e3b31 (DEFAULT_TABLE table=default.Table_43d705e812c24da3876d013deb20ac5d [id=90493e961775414085ce04681e72124c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.170718 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36f29d8ea37247f6835ffef41d0e3b31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.173768 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 0a89814930994195bad45121d1157598 (DEFAULT_TABLE table=default.Table_fa2d4835f00b4e80955453185ee56272 [id=4eed2e87f1aa4d4fa4928b1b3ae1b2d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.174495 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a89814930994195bad45121d1157598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.175159 10370 tablet_bootstrap.cc:654] T 05059ef70a8e440ca2988bfeb610645d P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:14.178103 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 66fa9d773797412cb53d34ecdf3d0f61 (DEFAULT_TABLE table=default.Table_465ab367cd274ae493b639b9811d5a03 [id=3469f49b4e01405f98e4a729da951429]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.179025 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66fa9d773797412cb53d34ecdf3d0f61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.180193 10142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f18360a1ad84fdfb6285525aea51200. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.183218 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 18880c0c1717411181a457f1f75e1118 (DEFAULT_TABLE table=default.Table_ad46f1256ca54dfca9927ca88a9829f5 [id=9911efa5a94643ad9b58aa2b35a3eb79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.183879 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f416d4f6a81f4f9988f3211b98c0f485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.124620 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 9b5b21bff7634b1dbb6dfe1f4a85ce23 (DEFAULT_TABLE table=default.Table_7a0fc5c4560f422c80521b1c04c6f9e5 [id=5f29a0eb2dbb44069d47bde733d798ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.186693 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b5b21bff7634b1dbb6dfe1f4a85ce23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.187240 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 4e5022d4d6524352be3e461cfa170ccc (DEFAULT_TABLE table=default.Table_e5535527b8e2442fa4edc7b798960924 [id=7ac554af109f4125b86a0884049d5fbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.187685 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e5022d4d6524352be3e461cfa170ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.192145 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e86cbef82d3c4d0fad94480ea31a4c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.194995 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 0a89814930994195bad45121d1157598 (DEFAULT_TABLE table=default.Table_fa2d4835f00b4e80955453185ee56272 [id=4eed2e87f1aa4d4fa4928b1b3ae1b2d9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:14.195189 10068 leader_election.cc:343] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 5654c48929564a96a55ed0444c9e1a04
I20260810 19:48:14.195495 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a89814930994195bad45121d1157598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.198100 9668 tablet_service.cc:1511] Processing CreateTablet for tablet 9632cca1eccf4d9ca17e3d99c744b881 (DEFAULT_TABLE table=default.Table_28f6d1fdbe464aeca07552d5916714f3 [id=4662a282259748eb90e48b1ed4904e58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.201465 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 3b30e169659e44faa626ee3a22649c60 (DEFAULT_TABLE table=default.Table_02612994a1ec4e07ab667d3b965e6fe8 [id=b5e7f9ec4b094fc4863b2356c823244b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.201829 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 5fda32cc65fa49b09067b61d2d2cd581 (DEFAULT_TABLE table=default.Table_56ed643105684c67b9ee649bcbbb993c [id=7bdd0ebb0b5e4c418dd996ebd02b08a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.201851 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b30e169659e44faa626ee3a22649c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.202459 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb69ab3dafa44fdaa41bacf4bc71602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.206794 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9632cca1eccf4d9ca17e3d99c744b881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.207996 10116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0622bb3b3f4345129eb5f0f91be3a922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.210538 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3f04460d9cc440580e9a7f4ec56bf40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.212863 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18880c0c1717411181a457f1f75e1118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.213254 9673 tablet_service.cc:1511] Processing CreateTablet for tablet bdc75cfc6d73476bba81d00f5ccd342d (DEFAULT_TABLE table=default.Table_4458e0094c7a4f2fbe18a9101886249d [id=9a8bd15d60714761ac544832d8ce9bad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.213683 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc75cfc6d73476bba81d00f5ccd342d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.214268 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8857aaeb0e3442ec98738f46f3a63442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.179703 10375 ts_tablet_manager.cc:1929] T 9e861473094f42dfa22b9c00145ed1fe P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:13.972659 10366 tablet_bootstrap.cc:492] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:14.216856 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 9b5b21bff7634b1dbb6dfe1f4a85ce23 (DEFAULT_TABLE table=default.Table_7a0fc5c4560f422c80521b1c04c6f9e5 [id=5f29a0eb2dbb44069d47bde733d798ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.217350 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b5b21bff7634b1dbb6dfe1f4a85ce23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.217360 10375 log.cc:1199] T 9e861473094f42dfa22b9c00145ed1fe P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/9e861473094f42dfa22b9c00145ed1fe
I20260810 19:48:13.971860 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b5b21bff7634b1dbb6dfe1f4a85ce23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:14.219615 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc75cfc6d73476bba81d00f5ccd342d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.219937 10366 tablet_bootstrap.cc:654] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:14.220471 9663 tablet_service.cc:1511] Processing CreateTablet for tablet e86cbef82d3c4d0fad94480ea31a4c3b (DEFAULT_TABLE table=default.Table_2ca134cde4db4944a8ec84eacc06d5eb [id=891889ab896b49918b842f3ea23d0989]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.220896 9663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e86cbef82d3c4d0fad94480ea31a4c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.222584 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fda32cc65fa49b09067b61d2d2cd581. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.222712 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5654c48929564a96a55ed0444c9e1a04" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:14.222923 9931 raft_consensus.cc:3060] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:14.225737 9931 raft_consensus.cc:2468] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:14.226052 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b30e169659e44faa626ee3a22649c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.226397 10067 leader_election.cc:304] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:14.226740 12993 raft_consensus.cc:2804] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:14.226882 12993 raft_consensus.cc:697] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:14.227996 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 8857aaeb0e3442ec98738f46f3a63442 (DEFAULT_TABLE table=default.Table_4b65055403904f0a8b3ded5be5ffdd4e [id=b33e78d762584ed6ba66e940a83e8adc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.228438 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8857aaeb0e3442ec98738f46f3a63442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.220654 10375 ts_tablet_manager.cc:1950] T 9e861473094f42dfa22b9c00145ed1fe P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:14.230407 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 9e861473094f42dfa22b9c00145ed1fe (table default.Table_cc256890a9a1416588021bfab5b9ee71 [id=33b51db437384acc95b35bc1868227e1]) successfully deleted
I20260810 19:48:14.232103 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fda32cc65fa49b09067b61d2d2cd581. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.232151 10375 tablet_replica.cc:333] T 988d87b2b00a459d9afc44ba0ae1961e P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:14.232373 10375 raft_consensus.cc:2243] T 988d87b2b00a459d9afc44ba0ae1961e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:14.232528 10375 raft_consensus.cc:2272] T 988d87b2b00a459d9afc44ba0ae1961e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:14.227146 12993 consensus_queue.cc:237] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.235077 9681 tablet_service.cc:1511] Processing CreateTablet for tablet e3f04460d9cc440580e9a7f4ec56bf40 (DEFAULT_TABLE table=default.Table_2594ece5242247b5a59bd25aec31ad82 [id=c172f514f9bd4fab9063c6857b5ba6f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.235175 9898 tablet_service.cc:1511] Processing CreateTablet for tablet e86cbef82d3c4d0fad94480ea31a4c3b (DEFAULT_TABLE table=default.Table_2ca134cde4db4944a8ec84eacc06d5eb [id=891889ab896b49918b842f3ea23d0989]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.235543 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3f04460d9cc440580e9a7f4ec56bf40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.235610 9897 tablet_service.cc:1511] Processing CreateTablet for tablet 4e5022d4d6524352be3e461cfa170ccc (DEFAULT_TABLE table=default.Table_e5535527b8e2442fa4edc7b798960924 [id=7ac554af109f4125b86a0884049d5fbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.235607 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e86cbef82d3c4d0fad94480ea31a4c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.236227 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 1f18360a1ad84fdfb6285525aea51200 (DEFAULT_TABLE table=default.Table_97d2fd6539194595b1a536e612315869 [id=6f4662312d934a3fb16f904821170f92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.236564 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f18360a1ad84fdfb6285525aea51200. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.235881 9913 tablet_service.cc:1511] Processing CreateTablet for tablet e3f04460d9cc440580e9a7f4ec56bf40 (DEFAULT_TABLE table=default.Table_2594ece5242247b5a59bd25aec31ad82 [id=c172f514f9bd4fab9063c6857b5ba6f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.238694 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3f04460d9cc440580e9a7f4ec56bf40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.239327 9892 tablet_service.cc:1511] Processing CreateTablet for tablet bdc75cfc6d73476bba81d00f5ccd342d (DEFAULT_TABLE table=default.Table_4458e0094c7a4f2fbe18a9101886249d [id=9a8bd15d60714761ac544832d8ce9bad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.239686 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc75cfc6d73476bba81d00f5ccd342d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.242444 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e5022d4d6524352be3e461cfa170ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.242659 9906 tablet_service.cc:1511] Processing CreateTablet for tablet dbb69ab3dafa44fdaa41bacf4bc71602 (DEFAULT_TABLE table=default.Table_d313ae200f4c40ca84375b6e8979c067 [id=a99abe6dbe45409dac8762706ff46f60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.243055 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb69ab3dafa44fdaa41bacf4bc71602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.243036 9665 tablet_service.cc:1511] Processing CreateTablet for tablet 1f18360a1ad84fdfb6285525aea51200 (DEFAULT_TABLE table=default.Table_97d2fd6539194595b1a536e612315869 [id=6f4662312d934a3fb16f904821170f92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.243428 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f18360a1ad84fdfb6285525aea51200. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:14.253268 10068 leader_election.cc:343] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 5654c48929564a96a55ed0444c9e1a04
I20260810 19:48:14.256662 9669 tablet_service.cc:1511] Processing CreateTablet for tablet 18880c0c1717411181a457f1f75e1118 (DEFAULT_TABLE table=default.Table_ad46f1256ca54dfca9927ca88a9829f5 [id=9911efa5a94643ad9b58aa2b35a3eb79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.257156 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18880c0c1717411181a457f1f75e1118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.267115 9655 tablet_service.cc:1511] Processing CreateTablet for tablet 4e5022d4d6524352be3e461cfa170ccc (DEFAULT_TABLE table=default.Table_e5535527b8e2442fa4edc7b798960924 [id=7ac554af109f4125b86a0884049d5fbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.267670 9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e5022d4d6524352be3e461cfa170ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.269292 10375 ts_tablet_manager.cc:1916] T 988d87b2b00a459d9afc44ba0ae1961e P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:14.270372 10370 tablet_bootstrap.cc:492] T 05059ef70a8e440ca2988bfeb610645d P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:14.270550 10370 ts_tablet_manager.cc:1403] T 05059ef70a8e440ca2988bfeb610645d P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.134s user 0.006s sys 0.000s
I20260810 19:48:14.274734 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 9b5b21bff7634b1dbb6dfe1f4a85ce23 (DEFAULT_TABLE table=default.Table_7a0fc5c4560f422c80521b1c04c6f9e5 [id=5f29a0eb2dbb44069d47bde733d798ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.275395 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b5b21bff7634b1dbb6dfe1f4a85ce23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.278697 9885 tablet_service.cc:1511] Processing CreateTablet for tablet 18880c0c1717411181a457f1f75e1118 (DEFAULT_TABLE table=default.Table_ad46f1256ca54dfca9927ca88a9829f5 [id=9911efa5a94643ad9b58aa2b35a3eb79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.279011 10370 raft_consensus.cc:359] T 05059ef70a8e440ca2988bfeb610645d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.279224 10370 raft_consensus.cc:385] T 05059ef70a8e440ca2988bfeb610645d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:14.279332 10370 raft_consensus.cc:740] T 05059ef70a8e440ca2988bfeb610645d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:14.279376 9885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18880c0c1717411181a457f1f75e1118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.279564 10370 consensus_queue.cc:260] T 05059ef70a8e440ca2988bfeb610645d P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.280153 10370 ts_tablet_manager.cc:1434] T 05059ef70a8e440ca2988bfeb610645d P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.009s user 0.000s sys 0.000s
I20260810 19:48:14.280535 10370 tablet_bootstrap.cc:492] T 64470598ccec45a7ae3e3c77fe4b9518 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:14.290678 10370 tablet_bootstrap.cc:654] T 64470598ccec45a7ae3e3c77fe4b9518 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:14.295135 10370 tablet_bootstrap.cc:492] T 64470598ccec45a7ae3e3c77fe4b9518 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:14.295150 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1118) took 1312 ms. Trace:
I20260810 19:48:14.295248 10377 rpcz_store.cc:276] 0810 19:48:12.982498 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:12.983250 (+ 752us) service_pool.cc:224] Handling call
0810 19:48:13.778247 (+794997us) ts_tablet_manager.cc:1151] Deleting tablet 410855f236004ad4b78839eb1c0c2f1f
0810 19:48:13.778257 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:13.821424 (+ 43167us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:13.958829 (+137405us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:14.295126 (+336297us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":794769}
I20260810 19:48:14.295743 10370 ts_tablet_manager.cc:1403] T 64470598ccec45a7ae3e3c77fe4b9518 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20260810 19:48:14.295923 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1115) took 1313 ms. Trace:
I20260810 19:48:14.296070 10377 rpcz_store.cc:276] 0810 19:48:12.982151 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.007175 (+ 25024us) service_pool.cc:224] Handling call
0810 19:48:14.295786 (+1288611us) ts_tablet_manager.cc:1151] Deleting tablet f06df4cdb79c440b91b0eff135d2dfac
0810 19:48:14.295798 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:14.295904 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1288179}
I20260810 19:48:14.296518 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1119) took 1271 ms. Trace:
I20260810 19:48:14.296648 10377 rpcz_store.cc:276] 0810 19:48:13.025499 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.027487 (+ 1988us) service_pool.cc:224] Handling call
0810 19:48:14.296404 (+1268917us) ts_tablet_manager.cc:1151] Deleting tablet a1628a2a930a4819818df3ea480ab4db
0810 19:48:14.296414 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:14.296502 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1268640}
I20260810 19:48:14.296962 10377 tablet_replica.cc:333] T 9e861473094f42dfa22b9c00145ed1fe P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:14.297187 10377 raft_consensus.cc:2243] T 9e861473094f42dfa22b9c00145ed1fe P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:14.297523 10377 raft_consensus.cc:2272] T 9e861473094f42dfa22b9c00145ed1fe P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:14.298187 10377 ts_tablet_manager.cc:1916] T 9e861473094f42dfa22b9c00145ed1fe P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:14.299135 10370 raft_consensus.cc:359] T 64470598ccec45a7ae3e3c77fe4b9518 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.300402 10370 raft_consensus.cc:385] T 64470598ccec45a7ae3e3c77fe4b9518 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:14.300655 10370 raft_consensus.cc:740] T 64470598ccec45a7ae3e3c77fe4b9518 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:14.300652 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 410855f236004ad4b78839eb1c0c2f1f (table default.Table_44478e93cffb460aaa8df9115b799594 [id=1d363ce63686462f9f4c15669773ee22]) successfully deleted
W20260810 19:48:14.300911 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet f06df4cdb79c440b91b0eff135d2dfac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f06df4cdb79c440b91b0eff135d2dfac already in progress: creating tablet
W20260810 19:48:14.301079 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet a1628a2a930a4819818df3ea480ab4db because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1628a2a930a4819818df3ea480ab4db already in progress: creating tablet
I20260810 19:48:14.302222 10151 raft_consensus.cc:3060] T 85f1c7a75aac4d6a9462af4def91eaa4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:14.310670 10370 consensus_queue.cc:260] T 64470598ccec45a7ae3e3c77fe4b9518 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.311748 10370 ts_tablet_manager.cc:1434] T 64470598ccec45a7ae3e3c77fe4b9518 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260810 19:48:14.312686 10370 tablet_bootstrap.cc:492] T 81aabb5656e7472f9223fd7acf10e43c P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:14.315397 10370 tablet_bootstrap.cc:654] T 81aabb5656e7472f9223fd7acf10e43c P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:14.313334 10375 ts_tablet_manager.cc:1929] T 988d87b2b00a459d9afc44ba0ae1961e P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:14.318502 10375 log.cc:1199] T 988d87b2b00a459d9afc44ba0ae1961e P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/988d87b2b00a459d9afc44ba0ae1961e
I20260810 19:48:14.318976 10375 ts_tablet_manager.cc:1950] T 988d87b2b00a459d9afc44ba0ae1961e P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:14.319589 13037 consensus_queue.cc:1048] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:14.320351 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 988d87b2b00a459d9afc44ba0ae1961e (table default.Table_f283a0bdf6b94182a12f9b5f5dfe167a [id=f881fab647be45f786665629ab8baaee]) successfully deleted
I20260810 19:48:14.320950 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6f90d8ae9e154aa5ad31454eabb04b3e" } new_table_name: "default.Table_20d988cc11984dff98e6929c98d05a73" modify_external_catalogs: true
W20260810 19:48:14.323064 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet a7770d570b6b4ee487309785581af219 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7770d570b6b4ee487309785581af219 already in progress: creating tablet
W20260810 19:48:14.323349 9395 catalog_manager.cc:5017] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 9b5b21bff7634b1dbb6dfe1f4a85ce23 because the tablet was not found. No further retry: Not found: Tablet not found: 9b5b21bff7634b1dbb6dfe1f4a85ce23
W20260810 19:48:14.323550 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 3ddc1bc292a243338235ea1396cc08f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ddc1bc292a243338235ea1396cc08f8 already in progress: creating tablet
W20260810 19:48:14.323738 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet e3f04460d9cc440580e9a7f4ec56bf40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e3f04460d9cc440580e9a7f4ec56bf40 already in progress: creating tablet
I20260810 19:48:14.323719 13019 raft_consensus.cc:493] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:14.323872 13019 raft_consensus.cc:515] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.324385 10370 tablet_bootstrap.cc:492] T 81aabb5656e7472f9223fd7acf10e43c P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:14.324530 13019 leader_election.cc:290] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:14.324513 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 5654c48929564a96a55ed0444c9e1a04 with delete_type TABLET_DATA_DELETED (replaced by tablet e87fd882e6b6413480a0cb06aee74722) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:14.325232 10370 ts_tablet_manager.cc:1403] T 81aabb5656e7472f9223fd7acf10e43c P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.004s
I20260810 19:48:14.325497 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fe67e8bd014acaa202c022c193cdc6" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:14.325690 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fe67e8bd014acaa202c022c193cdc6" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:14.325484 10375 tablet_replica.cc:333] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
W20260810 19:48:14.326584 9611 leader_election.cc:343] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:14.326853 9611 leader_election.cc:343] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:14.326929 9611 leader_election.cc:304] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:14.327412 13019 raft_consensus.cc:2749] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:14.328495 9681 tablet_service.cc:1511] Processing CreateTablet for tablet dbb69ab3dafa44fdaa41bacf4bc71602 (DEFAULT_TABLE table=default.Table_d313ae200f4c40ca84375b6e8979c067 [id=a99abe6dbe45409dac8762706ff46f60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.328989 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb69ab3dafa44fdaa41bacf4bc71602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.329747 10370 raft_consensus.cc:359] T 81aabb5656e7472f9223fd7acf10e43c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.330566 10370 raft_consensus.cc:385] T 81aabb5656e7472f9223fd7acf10e43c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:14.330771 10370 raft_consensus.cc:740] T 81aabb5656e7472f9223fd7acf10e43c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:14.331264 10370 consensus_queue.cc:260] T 81aabb5656e7472f9223fd7acf10e43c P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.332602 10370 ts_tablet_manager.cc:1434] T 81aabb5656e7472f9223fd7acf10e43c P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260810 19:48:14.333377 10370 tablet_bootstrap.cc:492] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:14.334218 13067 raft_consensus.cc:493] T 4571e0c723f74c828220b33116fed9e9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:14.334548 13067 raft_consensus.cc:515] T 4571e0c723f74c828220b33116fed9e9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.334554 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 36f29d8ea37247f6835ffef41d0e3b31 (DEFAULT_TABLE table=default.Table_43d705e812c24da3876d013deb20ac5d [id=90493e961775414085ce04681e72124c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.335208 13067 leader_election.cc:290] T 4571e0c723f74c828220b33116fed9e9 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:14.335433 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36f29d8ea37247f6835ffef41d0e3b31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.336109 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4571e0c723f74c828220b33116fed9e9" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:14.336225 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4571e0c723f74c828220b33116fed9e9" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:14.336453 9710 raft_consensus.cc:2393] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eadde59fd6504d679e47f03a60c64bb0 in current term 1: Already voted for candidate 6986ed920dcb4af29a5eeeda6f671691 in this term.
I20260810 19:48:14.336905 10067 leader_election.cc:304] T 4571e0c723f74c828220b33116fed9e9 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:14.337445 13067 raft_consensus.cc:3060] T 4571e0c723f74c828220b33116fed9e9 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:14.340606 13067 raft_consensus.cc:2749] T 4571e0c723f74c828220b33116fed9e9 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:14.341696 10370 tablet_bootstrap.cc:654] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:14.344825 10367 tablet_bootstrap.cc:654] T 25570b1795164aeca86a5313bd30a4c9 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:14.349097 10370 tablet_bootstrap.cc:492] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:14.349282 10370 ts_tablet_manager.cc:1403] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.003s
I20260810 19:48:14.350126 10370 raft_consensus.cc:359] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.350405 10370 raft_consensus.cc:385] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:14.350481 10370 raft_consensus.cc:740] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:14.355659 13037 consensus_queue.cc:1048] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:14.355836 12266 ts_tablet_manager.cc:1929] T 985440898cc04a98877c15a5122a7dd3 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:14.355955 12266 log.cc:1199] T 985440898cc04a98877c15a5122a7dd3 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/985440898cc04a98877c15a5122a7dd3
I20260810 19:48:14.356231 12266 ts_tablet_manager.cc:1950] T 985440898cc04a98877c15a5122a7dd3 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:14.357532 10370 consensus_queue.cc:260] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.362025 9890 tablet_service.cc:1511] Processing CreateTablet for tablet 6622f1c485cf4f8c85ccf4b1b428a812 (DEFAULT_TABLE table=default.Table_4d5e244280274336986ed743fd862073 [id=4960647cdc9243a09cf2fc97bfefd048]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:14.363101 9400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.253:37397, user_credentials={real_user=slave}} blocked reactor thread for 382766us
W20260810 19:48:14.364003 9395 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet c0fc251932454c378f94cbfaa4955232 (table default.Table_bfaec4943b1d4077b951ea1b272f162c [id=22e4e79a261c47e29580e8a8c8bc2ff0], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet c0fc251932454c378f94cbfaa4955232 consensus state has no leader
I20260810 19:48:14.363991 10375 raft_consensus.cc:2243] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:14.374768 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 8857aaeb0e3442ec98738f46f3a63442 (DEFAULT_TABLE table=default.Table_4b65055403904f0a8b3ded5be5ffdd4e [id=b33e78d762584ed6ba66e940a83e8adc]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:14.377943 9400 consensus_peers.cc:597] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a -> Peer f52c40e347e24ab4b3129e7064f4a43e (127.8.235.253:37397): Couldn't send request to peer f52c40e347e24ab4b3129e7064f4a43e. Status: Network error: Client connection negotiation failed: client connection to 127.8.235.253:37397: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:14.386210 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1095) took 1369 ms. Trace:
I20260810 19:48:14.365831 10367 tablet_bootstrap.cc:492] T 25570b1795164aeca86a5313bd30a4c9 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:14.386916 10367 ts_tablet_manager.cc:1403] T 25570b1795164aeca86a5313bd30a4c9 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.466s user 0.011s sys 0.000s
I20260810 19:48:14.387866 10367 raft_consensus.cc:359] T 25570b1795164aeca86a5313bd30a4c9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.388150 10367 raft_consensus.cc:385] T 25570b1795164aeca86a5313bd30a4c9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:14.388252 10367 raft_consensus.cc:740] T 25570b1795164aeca86a5313bd30a4c9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:14.388583 10367 consensus_queue.cc:260] T 25570b1795164aeca86a5313bd30a4c9 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.389567 10367 ts_tablet_manager.cc:1434] T 25570b1795164aeca86a5313bd30a4c9 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:14.389921 10367 tablet_bootstrap.cc:492] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:14.392198 10367 tablet_bootstrap.cc:654] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:14.394042 10366 tablet_bootstrap.cc:492] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:14.394264 10366 ts_tablet_manager.cc:1403] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.422s user 0.004s sys 0.000s
I20260810 19:48:14.395102 10366 raft_consensus.cc:359] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.395357 10366 raft_consensus.cc:385] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:14.395460 10366 raft_consensus.cc:740] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:14.395713 10366 consensus_queue.cc:260] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.396301 10366 ts_tablet_manager.cc:1434] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 19:48:14.396721 10366 tablet_bootstrap.cc:492] T 05059ef70a8e440ca2988bfeb610645d P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:14.398519 10366 tablet_bootstrap.cc:654] T 05059ef70a8e440ca2988bfeb610645d P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:14.404434 13019 raft_consensus.cc:493] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:14.404597 13019 raft_consensus.cc:515] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.405251 13019 leader_election.cc:290] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:14.406550 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59942eba1014659b6f601e74d53d880" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:14.407231 9611 leader_election.cc:343] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:14.413443 10377 ts_tablet_manager.cc:1929] T 9e861473094f42dfa22b9c00145ed1fe P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:14.413861 12266 rpcz_store.cc:276] 0810 19:48:13.017229 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.019154 (+ 1925us) service_pool.cc:224] Handling call
0810 19:48:13.911565 (+892411us) ts_tablet_manager.cc:1151] Deleting tablet 985440898cc04a98877c15a5122a7dd3
0810 19:48:13.911572 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:14.316413 (+404841us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:14.355758 (+ 39345us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:14.386174 (+ 30416us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":892106}
I20260810 19:48:14.415203 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 985440898cc04a98877c15a5122a7dd3 (table default.Table_1d3d54acd6074609919e2db8b3c01576 [id=e974ea8378194b808889a3255371374e]) successfully deleted
I20260810 19:48:14.415987 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1096) took 1389 ms. Trace:
I20260810 19:48:14.416493 12266 rpcz_store.cc:276] 0810 19:48:13.026891 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.027146 (+ 255us) service_pool.cc:224] Handling call
0810 19:48:14.415835 (+1388689us) ts_tablet_manager.cc:1151] Deleting tablet a1628a2a930a4819818df3ea480ab4db
0810 19:48:14.415846 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:14.415963 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1388469}
W20260810 19:48:14.417255 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet a1628a2a930a4819818df3ea480ab4db because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1628a2a930a4819818df3ea480ab4db already in progress: creating tablet
I20260810 19:48:14.417865 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1097) took 1289 ms. Trace:
I20260810 19:48:14.418359 12266 rpcz_store.cc:276] 0810 19:48:13.128248 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.128316 (+ 68us) service_pool.cc:224] Handling call
0810 19:48:14.417732 (+1289416us) ts_tablet_manager.cc:1151] Deleting tablet 79841de1d91c4961bc0742d89d570a7f
0810 19:48:14.417743 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:14.417845 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1289136}
I20260810 19:48:14.418944 13019 raft_consensus.cc:493] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 19:48:14.419056 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 79841de1d91c4961bc0742d89d570a7f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79841de1d91c4961bc0742d89d570a7f already in progress: creating tablet
I20260810 19:48:14.419088 13019 raft_consensus.cc:515] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.419492 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1098) took 1290 ms. Trace:
I20260810 19:48:14.419569 12266 rpcz_store.cc:276] 0810 19:48:13.128978 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.129036 (+ 58us) service_pool.cc:224] Handling call
0810 19:48:14.419365 (+1290329us) ts_tablet_manager.cc:1151] Deleting tablet fafad8559b074dab958f03061e65b8c3
0810 19:48:14.419375 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:14.419471 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1290090}
I20260810 19:48:14.419710 13019 leader_election.cc:290] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:14.420907 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5518a17337794a478179be2f1e73ed88" } modify_external_catalogs: true
I20260810 19:48:14.421116 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5518a17337794a478179be2f1e73ed88" } modify_external_catalogs: true
W20260810 19:48:14.426839 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5a35be79a8924213ab860a9da04a598c consensus state has no leader
W20260810 19:48:14.427587 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4b1224d4d9ed48f2806ec353f1e59de9 consensus state has no leader
W20260810 19:48:14.429766 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2ecf7e4eb5f467789a784ad27e68907 consensus state has no leader
I20260810 19:48:14.430099 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5566f9d152794e309dd817727a18e4cf" } modify_external_catalogs: true
I20260810 19:48:14.430258 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5566f9d152794e309dd817727a18e4cf" } modify_external_catalogs: true
I20260810 19:48:14.431265 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8f2b600b476e4a3ea8e7a450dad062a0" } modify_external_catalogs: true
I20260810 19:48:14.431305 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0844c946c41146f38e51790cd8baed2a" } modify_external_catalogs: true
I20260810 19:48:14.431437 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8f2b600b476e4a3ea8e7a450dad062a0" } modify_external_catalogs: true
I20260810 19:48:14.431475 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0844c946c41146f38e51790cd8baed2a" } modify_external_catalogs: true
I20260810 19:48:14.431982 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_fc97ee5a42ee4675a917c147f576b647"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:14.432554 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc97ee5a42ee4675a917c147f576b647 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:14.432998 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_bfaec4943b1d4077b951ea1b272f162c" } modify_external_catalogs: true
I20260810 19:48:14.433130 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_bfaec4943b1d4077b951ea1b272f162c" } modify_external_catalogs: true
I20260810 19:48:14.435312 9420 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 85f1c7a75aac4d6a9462af4def91eaa4 (table default.Table_08c83fc388864b6f8a1ed597dc70bffe [id=2d55615cd797441c8abf6ea5a64f2f9f]). Expected version 1 got 0
I20260810 19:48:14.436069 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_64e1f4b9b7e84ac59c8a35c1b44a74bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:14.436612 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64e1f4b9b7e84ac59c8a35c1b44a74bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:14.444556 9410 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 85f1c7a75aac4d6a9462af4def91eaa4 (table default.Table_08c83fc388864b6f8a1ed597dc70bffe [id=2d55615cd797441c8abf6ea5a64f2f9f]). Expected version 1 got 0
I20260810 19:48:14.445590 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4948fbc50149453bbd9cd1d993edab68" } new_table_name: "default.Table_d8fe68f4b5ac49d98f359b324784b08d" modify_external_catalogs: true
I20260810 19:48:14.462392 10370 ts_tablet_manager.cc:1434] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.093s user 0.002s sys 0.000s
I20260810 19:48:14.462827 10370 tablet_bootstrap.cc:492] T 444b49a69c8245b6944a76d53041154c P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:14.464804 10370 tablet_bootstrap.cc:654] T 444b49a69c8245b6944a76d53041154c P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:14.465776 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59942eba1014659b6f601e74d53d880" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:14.466948 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5aaedde75d54341a87764c6e89a03d6" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:14.467772 9611 leader_election.cc:343] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:14.467926 9611 leader_election.cc:304] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
W20260810 19:48:14.468410 9611 leader_election.cc:343] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:14.468624 13019 raft_consensus.cc:2749] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:14.468895 10375 pending_rounds.cc:70] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:14.468961 10375 pending_rounds.cc:77] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058741179863040 op_type: NO_OP noop_request { }
I20260810 19:48:14.469058 10375 raft_consensus.cc:2889] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:14.469154 10375 raft_consensus.cc:2272] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:14.469509 13094 consensus_queue.cc:1175] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "eadde59fd6504d679e47f03a60c64bb0" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260810 19:48:14.470530 10375 ts_tablet_manager.cc:1916] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:14.479656 10375 ts_tablet_manager.cc:1929] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:14.489264 10375 log.cc:1199] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/5654c48929564a96a55ed0444c9e1a04
I20260810 19:48:14.489748 10375 ts_tablet_manager.cc:1950] T 5654c48929564a96a55ed0444c9e1a04 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:14.491911 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 5654c48929564a96a55ed0444c9e1a04 (table default.Table_f90f1a0c22fa4781812518f44c9d7b17 [id=d12cb82567fd409988672b04a2e05a5b]) successfully deleted
I20260810 19:48:14.482231 10370 tablet_bootstrap.cc:492] T 444b49a69c8245b6944a76d53041154c P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:14.492725 10370 ts_tablet_manager.cc:1403] T 444b49a69c8245b6944a76d53041154c P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.002s
I20260810 19:48:14.493762 12266 tablet_replica.cc:333] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:14.493636 10370 raft_consensus.cc:359] T 444b49a69c8245b6944a76d53041154c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.493841 10370 raft_consensus.cc:385] T 444b49a69c8245b6944a76d53041154c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:14.493896 10370 raft_consensus.cc:740] T 444b49a69c8245b6944a76d53041154c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:14.494112 10370 consensus_queue.cc:260] T 444b49a69c8245b6944a76d53041154c P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:14.494555 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet fafad8559b074dab958f03061e65b8c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fafad8559b074dab958f03061e65b8c3 already in progress: creating tablet
I20260810 19:48:14.494935 10377 log.cc:1199] T 9e861473094f42dfa22b9c00145ed1fe P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/9e861473094f42dfa22b9c00145ed1fe
I20260810 19:48:14.421096 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5aaedde75d54341a87764c6e89a03d6" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:14.495306 10377 ts_tablet_manager.cc:1950] T 9e861473094f42dfa22b9c00145ed1fe P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:14.495646 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1120) took 1449 ms. Trace:
I20260810 19:48:14.495728 10377 rpcz_store.cc:276] 0810 19:48:13.046280 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.071301 (+ 25021us) service_pool.cc:224] Handling call
0810 19:48:14.296918 (+1225617us) ts_tablet_manager.cc:1151] Deleting tablet 9e861473094f42dfa22b9c00145ed1fe
0810 19:48:14.296926 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:14.301341 (+ 4415us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:14.413373 (+112032us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:14.495627 (+ 82254us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1225245}
I20260810 19:48:14.496162 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1121) took 1372 ms. Trace:
I20260810 19:48:14.496253 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 9e861473094f42dfa22b9c00145ed1fe (table default.Table_cc256890a9a1416588021bfab5b9ee71 [id=33b51db437384acc95b35bc1868227e1]) successfully deleted
I20260810 19:48:14.496240 10377 rpcz_store.cc:276] 0810 19:48:13.123500 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.123809 (+ 309us) service_pool.cc:224] Handling call
0810 19:48:14.496025 (+1372216us) ts_tablet_manager.cc:1151] Deleting tablet 79841de1d91c4961bc0742d89d570a7f
0810 19:48:14.496037 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:14.496142 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1371962}
I20260810 19:48:14.421277 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6622f1c485cf4f8c85ccf4b1b428a812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.496606 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1122) took 1370 ms. Trace:
I20260810 19:48:14.496711 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8857aaeb0e3442ec98738f46f3a63442. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:14.496742 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 79841de1d91c4961bc0742d89d570a7f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79841de1d91c4961bc0742d89d570a7f already in progress: creating tablet
W20260810 19:48:14.502650 9611 leader_election.cc:343] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:14.502709 12266 raft_consensus.cc:2243] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:14.502795 9611 leader_election.cc:304] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:14.502947 12266 raft_consensus.cc:2272] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:14.503261 13019 raft_consensus.cc:2749] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:14.503578 12266 ts_tablet_manager.cc:1916] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:14.504176 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f3883a2df11a49c7af62458a4d5565c7 consensus state has no leader
I20260810 19:48:14.433943 10366 tablet_bootstrap.cc:492] T 05059ef70a8e440ca2988bfeb610645d P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:14.504547 10366 ts_tablet_manager.cc:1403] T 05059ef70a8e440ca2988bfeb610645d P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.108s user 0.002s sys 0.002s
I20260810 19:48:14.505336 10366 raft_consensus.cc:359] T 05059ef70a8e440ca2988bfeb610645d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.505513 10366 raft_consensus.cc:385] T 05059ef70a8e440ca2988bfeb610645d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:14.505563 10366 raft_consensus.cc:740] T 05059ef70a8e440ca2988bfeb610645d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:14.505713 13067 raft_consensus.cc:493] T 81aabb5656e7472f9223fd7acf10e43c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:14.505787 10366 consensus_queue.cc:260] T 05059ef70a8e440ca2988bfeb610645d P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.505863 13067 raft_consensus.cc:515] T 81aabb5656e7472f9223fd7acf10e43c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.506295 10366 ts_tablet_manager.cc:1434] T 05059ef70a8e440ca2988bfeb610645d P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:14.506635 13067 leader_election.cc:290] T 81aabb5656e7472f9223fd7acf10e43c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:14.506722 10366 tablet_bootstrap.cc:492] T 77cf30d2d79f404798378ab01af53b8c P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:14.494712 10367 tablet_bootstrap.cc:492] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:14.507124 10367 ts_tablet_manager.cc:1403] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.117s user 0.004s sys 0.000s
I20260810 19:48:14.507912 10367 raft_consensus.cc:359] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.508085 10367 raft_consensus.cc:385] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:14.508137 10367 raft_consensus.cc:740] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:14.508348 10367 consensus_queue.cc:260] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.508890 10367 ts_tablet_manager.cc:1434] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:14.509179 10367 tablet_bootstrap.cc:492] T b54feebc7c9841d89808054602be7913 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:14.509698 9418 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 85f1c7a75aac4d6a9462af4def91eaa4 (table default.Table_08c83fc388864b6f8a1ed597dc70bffe [id=2d55615cd797441c8abf6ea5a64f2f9f]). Expected version 1 got 0
I20260810 19:48:14.434289 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet f6f9eb86c6c84b4a84d109d4741238e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:14.450678 13037 consensus_queue.cc:1048] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 19:48:14.515395 10068 leader_election.cc:343] T 81aabb5656e7472f9223fd7acf10e43c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 81aabb5656e7472f9223fd7acf10e43c
I20260810 19:48:14.516577 9135 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskcRGNMp/build/asan/bin/kudu
/tmp/dist-test-taskcRGNMp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.235.253:37397
--webserver_interface=127.8.235.253
--webserver_port=37717
--builtin_ntp_servers=127.8.235.212:46393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.235.254:33891,127.8.235.253:37397,127.8.235.252:43301
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260810 19:48:14.496675 10377 rpcz_store.cc:276] 0810 19:48:13.125828 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.126996 (+ 1168us) service_pool.cc:224] Handling call
0810 19:48:14.496496 (+1369500us) ts_tablet_manager.cc:1151] Deleting tablet fafad8559b074dab958f03061e65b8c3
0810 19:48:14.496505 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:14.496589 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1369284}
I20260810 19:48:14.518911 10377 tablet_replica.cc:333] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:14.519114 10377 raft_consensus.cc:2243] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:14.519496 10377 raft_consensus.cc:2272] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:14.520143 10377 ts_tablet_manager.cc:1916] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:14.520083 13104 consensus_queue.cc:1048] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:14.522451 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81aabb5656e7472f9223fd7acf10e43c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:14.523267 10067 leader_election.cc:343] T 81aabb5656e7472f9223fd7acf10e43c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:14.523389 10067 leader_election.cc:304] T 81aabb5656e7472f9223fd7acf10e43c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:14.525477 13067 raft_consensus.cc:2749] T 81aabb5656e7472f9223fd7acf10e43c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:14.526751 10370 ts_tablet_manager.cc:1434] T 444b49a69c8245b6944a76d53041154c P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.034s user 0.002s sys 0.000s
I20260810 19:48:14.527108 10370 tablet_bootstrap.cc:492] T f6f9eb86c6c84b4a84d109d4741238e1 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:14.529279 10370 tablet_bootstrap.cc:654] T f6f9eb86c6c84b4a84d109d4741238e1 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:14.521081 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet fafad8559b074dab958f03061e65b8c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fafad8559b074dab958f03061e65b8c3 already in progress: creating tablet
I20260810 19:48:14.532666 10367 tablet_bootstrap.cc:654] T b54feebc7c9841d89808054602be7913 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:14.533304 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 9a13b0f5b6b14bb9b72740a8521e4ea5
I20260810 19:48:14.535151 9420 master_service.cc:960] ReplaceTablet: received request to replace tablet 6914b47e0cac4cd28ee4fd199684a280 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:14.536906 9901 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a13b0f5b6b14bb9b72740a8521e4ea5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:14.536859 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a13b0f5b6b14bb9b72740a8521e4ea5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:14.540498 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a13b0f5b6b14bb9b72740a8521e4ea5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:14.541802 10375 tablet_replica.cc:333] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:14.542039 10375 raft_consensus.cc:2243] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:14.542243 10375 raft_consensus.cc:2272] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:14.542191 9415 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 85f1c7a75aac4d6a9462af4def91eaa4 (table default.Table_08c83fc388864b6f8a1ed597dc70bffe [id=2d55615cd797441c8abf6ea5a64f2f9f]). Expected version 1 got 0
I20260810 19:48:14.542999 10375 ts_tablet_manager.cc:1916] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:14.545182 10366 tablet_bootstrap.cc:654] T 77cf30d2d79f404798378ab01af53b8c P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:14.545773 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet 05059ef70a8e440ca2988bfeb610645d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:14.545990 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 64470598ccec45a7ae3e3c77fe4b9518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:53 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:14.546155 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet 5654c48929564a96a55ed0444c9e1a04 with delete_type TABLET_DATA_DELETED (replaced by tablet e87fd882e6b6413480a0cb06aee74722) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:14.549265 13019 raft_consensus.cc:493] T 749cea5cd8f842b891f4e2cab07c054e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:14.549463 13019 raft_consensus.cc:515] T 749cea5cd8f842b891f4e2cab07c054e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.550179 13019 leader_election.cc:290] T 749cea5cd8f842b891f4e2cab07c054e P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:14.550916 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749cea5cd8f842b891f4e2cab07c054e" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:14.551576 12266 ts_tablet_manager.cc:1929] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260810 19:48:14.551657 9611 leader_election.cc:343] T 749cea5cd8f842b891f4e2cab07c054e P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:14.551741 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749cea5cd8f842b891f4e2cab07c054e" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:14.552436 9611 leader_election.cc:343] T 749cea5cd8f842b891f4e2cab07c054e P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:14.552549 9611 leader_election.cc:304] T 749cea5cd8f842b891f4e2cab07c054e P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:14.553025 13019 raft_consensus.cc:2749] T 749cea5cd8f842b891f4e2cab07c054e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:14.556706 10375 ts_tablet_manager.cc:1929] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:14.556923 10375 log.cc:1199] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/9a13b0f5b6b14bb9b72740a8521e4ea5
I20260810 19:48:14.557512 10375 ts_tablet_manager.cc:1950] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:14.559331 10375 tablet_replica.cc:333] T 05059ef70a8e440ca2988bfeb610645d P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:14.559669 10375 raft_consensus.cc:2243] T 05059ef70a8e440ca2988bfeb610645d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:14.559948 10375 raft_consensus.cc:2272] T 05059ef70a8e440ca2988bfeb610645d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:14.551700 12266 log.cc:1199] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/18cd8adaa065425c846bc791c05fa67d
I20260810 19:48:14.560901 10375 ts_tablet_manager.cc:1916] T 05059ef70a8e440ca2988bfeb610645d P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:14.560963 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 9a13b0f5b6b14bb9b72740a8521e4ea5 (table default.Table_0844c946c41146f38e51790cd8baed2a [id=4830b444314a4bb6a605cb73432e772f]) successfully deleted
I20260810 19:48:14.566753 12266 ts_tablet_manager.cc:1950] T 18cd8adaa065425c846bc791c05fa67d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:14.567655 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1099) took 1431 ms. Trace:
I20260810 19:48:14.570261 12266 rpcz_store.cc:276] 0810 19:48:13.136322 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.137903 (+ 1581us) service_pool.cc:224] Handling call
0810 19:48:14.493694 (+1355791us) ts_tablet_manager.cc:1151] Deleting tablet 18cd8adaa065425c846bc791c05fa67d
0810 19:48:14.493705 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:14.530882 (+ 37177us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:14.551502 (+ 20620us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:14.567630 (+ 16128us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1355533}
I20260810 19:48:14.569192 10367 tablet_bootstrap.cc:492] T b54feebc7c9841d89808054602be7913 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:14.572746 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 18cd8adaa065425c846bc791c05fa67d (table default.Table_a1645668cf79415ca029a01169fbf874 [id=aec405416e584af6bfb8194b357d6dbc]) successfully deleted
I20260810 19:48:14.573248 10367 ts_tablet_manager.cc:1403] T b54feebc7c9841d89808054602be7913 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.064s user 0.004s sys 0.000s
I20260810 19:48:14.574183 10367 raft_consensus.cc:359] T b54feebc7c9841d89808054602be7913 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.574424 10367 raft_consensus.cc:385] T b54feebc7c9841d89808054602be7913 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:14.574492 10367 raft_consensus.cc:740] T b54feebc7c9841d89808054602be7913 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:14.574704 10367 consensus_queue.cc:260] T b54feebc7c9841d89808054602be7913 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.575222 10367 ts_tablet_manager.cc:1434] T b54feebc7c9841d89808054602be7913 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 19:48:14.582155 10367 tablet_bootstrap.cc:492] T 4bc41ad892a247848f5d2c1a0d3333ef P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:14.584079 10367 tablet_bootstrap.cc:654] T 4bc41ad892a247848f5d2c1a0d3333ef P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:14.584941 12266 tablet_replica.cc:333] T 1bbd3fe2117c42058dc108b5dc18d560 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:14.586412 10370 tablet_bootstrap.cc:492] T f6f9eb86c6c84b4a84d109d4741238e1 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:14.586094 12266 raft_consensus.cc:2243] T 1bbd3fe2117c42058dc108b5dc18d560 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:14.587100 10370 ts_tablet_manager.cc:1403] T f6f9eb86c6c84b4a84d109d4741238e1 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.060s user 0.005s sys 0.000s
I20260810 19:48:14.588145 10370 raft_consensus.cc:359] T f6f9eb86c6c84b4a84d109d4741238e1 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.588332 10370 raft_consensus.cc:385] T f6f9eb86c6c84b4a84d109d4741238e1 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:14.588387 10370 raft_consensus.cc:740] T f6f9eb86c6c84b4a84d109d4741238e1 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:14.588923 10370 consensus_queue.cc:260] T f6f9eb86c6c84b4a84d109d4741238e1 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.590746 10370 ts_tablet_manager.cc:1434] T f6f9eb86c6c84b4a84d109d4741238e1 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 19:48:14.591404 10375 ts_tablet_manager.cc:1929] T 05059ef70a8e440ca2988bfeb610645d P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:14.591526 10375 log.cc:1199] T 05059ef70a8e440ca2988bfeb610645d P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/05059ef70a8e440ca2988bfeb610645d
I20260810 19:48:14.591176 12266 raft_consensus.cc:2272] T 1bbd3fe2117c42058dc108b5dc18d560 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:14.591862 10375 ts_tablet_manager.cc:1950] T 05059ef70a8e440ca2988bfeb610645d P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:14.592391 10370 tablet_bootstrap.cc:492] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:14.592869 10375 tablet_replica.cc:333] T 64470598ccec45a7ae3e3c77fe4b9518 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:14.593068 10375 raft_consensus.cc:2243] T 64470598ccec45a7ae3e3c77fe4b9518 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:14.593218 10375 raft_consensus.cc:2272] T 64470598ccec45a7ae3e3c77fe4b9518 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:14.594660 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 05059ef70a8e440ca2988bfeb610645d (table default.Table_39297078d5434aed9d01e90ff26623c8 [id=79f209949d0247619f04d8faa6f4568f]) successfully deleted
I20260810 19:48:14.594856 10375 ts_tablet_manager.cc:1916] T 64470598ccec45a7ae3e3c77fe4b9518 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:14.595469 13019 raft_consensus.cc:493] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:14.595603 13019 raft_consensus.cc:515] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.596210 13019 leader_election.cc:290] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:14.596263 10366 tablet_bootstrap.cc:492] T 77cf30d2d79f404798378ab01af53b8c P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:14.596405 10366 ts_tablet_manager.cc:1403] T 77cf30d2d79f404798378ab01af53b8c P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.090s user 0.000s sys 0.009s
I20260810 19:48:14.596972 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e47086440ef4a249f1eed23db655879" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:14.597441 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e47086440ef4a249f1eed23db655879" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:14.598044 9611 leader_election.cc:343] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:14.598263 9611 leader_election.cc:343] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:14.598397 9611 leader_election.cc:304] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:14.598666 10370 tablet_bootstrap.cc:654] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:14.598834 13019 raft_consensus.cc:2749] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:14.601004 9415 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 4571e0c723f74c828220b33116fed9e9 (table default.Table_d9d83336ef124c2da242e77391b001c0 [id=8dbf3227e8ae402aa46b9b31b715faa6]). Expected version 1 got 0
I20260810 19:48:14.601224 9415 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 85f1c7a75aac4d6a9462af4def91eaa4 (table default.Table_08c83fc388864b6f8a1ed597dc70bffe [id=2d55615cd797441c8abf6ea5a64f2f9f]). Expected version 1 got 0
I20260810 19:48:14.602738 12266 ts_tablet_manager.cc:1916] T 1bbd3fe2117c42058dc108b5dc18d560 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:14.603243 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_6ef0f4509bd34a60864bfd0c5b66a082"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:14.603907 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ef0f4509bd34a60864bfd0c5b66a082 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:14.611095 10367 tablet_bootstrap.cc:492] T 4bc41ad892a247848f5d2c1a0d3333ef P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:14.612987 10367 ts_tablet_manager.cc:1403] T 4bc41ad892a247848f5d2c1a0d3333ef P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.031s user 0.010s sys 0.000s
I20260810 19:48:14.613976 10367 raft_consensus.cc:359] T 4bc41ad892a247848f5d2c1a0d3333ef P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.614244 10367 raft_consensus.cc:385] T 4bc41ad892a247848f5d2c1a0d3333ef P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:14.614385 10367 raft_consensus.cc:740] T 4bc41ad892a247848f5d2c1a0d3333ef P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:14.617861 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet 81aabb5656e7472f9223fd7acf10e43c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:14.618098 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet 444b49a69c8245b6944a76d53041154c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:14.618397 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ea318eddd8349a79d27ce5746f03798 with delete_type TABLET_DATA_DELETED (replaced by tablet e7ea2f50f9f9423b99af3bd190cfd5a5) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:14.618973 10367 consensus_queue.cc:260] T 4bc41ad892a247848f5d2c1a0d3333ef P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.619946 10367 ts_tablet_manager.cc:1434] T 4bc41ad892a247848f5d2c1a0d3333ef P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260810 19:48:14.620270 10367 tablet_bootstrap.cc:492] T fafad8559b074dab958f03061e65b8c3 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:14.622635 10367 tablet_bootstrap.cc:654] T fafad8559b074dab958f03061e65b8c3 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:14.623438 9415 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 4571e0c723f74c828220b33116fed9e9 (table default.Table_d9d83336ef124c2da242e77391b001c0 [id=8dbf3227e8ae402aa46b9b31b715faa6]). Expected version 1 got 0
I20260810 19:48:14.624590 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet f6f9eb86c6c84b4a84d109d4741238e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:14.629060 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 05059ef70a8e440ca2988bfeb610645d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:14.629503 10375 ts_tablet_manager.cc:1929] T 64470598ccec45a7ae3e3c77fe4b9518 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:14.629611 10375 log.cc:1199] T 64470598ccec45a7ae3e3c77fe4b9518 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/64470598ccec45a7ae3e3c77fe4b9518
I20260810 19:48:14.629912 10375 ts_tablet_manager.cc:1950] T 64470598ccec45a7ae3e3c77fe4b9518 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:14.632242 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 64470598ccec45a7ae3e3c77fe4b9518 (table default.Table_20489495f6794646b9eda0458ee58d91 [id=16ed3d0d9475472283f6d95c69c60f8d]) successfully deleted
W20260810 19:48:14.633615 9395 catalog_manager.cc:5017] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 5654c48929564a96a55ed0444c9e1a04 because the tablet was not found. No further retry: Not found: Tablet not found: 5654c48929564a96a55ed0444c9e1a04
I20260810 19:48:14.634281 10375 tablet_replica.cc:333] T 81aabb5656e7472f9223fd7acf10e43c P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
W20260810 19:48:14.634660 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5d2103bbb48f4ff196b61406896df656 consensus state has no leader
I20260810 19:48:14.634944 10375 raft_consensus.cc:2243] T 81aabb5656e7472f9223fd7acf10e43c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:14.635457 10375 raft_consensus.cc:2272] T 81aabb5656e7472f9223fd7acf10e43c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:14.637228 9408 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 18ed05a1eb4a4f6e9a7284caaa0bba05 (table default.Table_5f86aedb4db8406090f1dd83566d57f8 [id=04cfb59bcc4e460f9063fe742900ba92]). Expected version 1 got 0
I20260810 19:48:14.638569 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 7189d156844e4c5b83bc2341f81cca5b (DEFAULT_TABLE table=default.Table_50b4be8902f94126906b08db861107b1 [id=8deabd315d0148f5be202272a55b464c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.638729 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 7189d156844e4c5b83bc2341f81cca5b (DEFAULT_TABLE table=default.Table_50b4be8902f94126906b08db861107b1 [id=8deabd315d0148f5be202272a55b464c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.639002 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7189d156844e4c5b83bc2341f81cca5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.639719 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7189d156844e4c5b83bc2341f81cca5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.639708 9681 tablet_service.cc:1511] Processing CreateTablet for tablet a4411b0fbf0f47f6934c166b65744a2c (DEFAULT_TABLE table=default.Table_b3cae548e1b5490bac7d5bc078ad507e [id=e36b2cab93934ca8996b2a1c53190dba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.640172 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4411b0fbf0f47f6934c166b65744a2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.641067 9668 tablet_service.cc:1511] Processing CreateTablet for tablet 23c5332560614e99b9bc66a0b81f9a47 (DEFAULT_TABLE table=default.Table_1458a7c3a0ed4be0a426300cc69c92ca [id=2cc0ff125f69487f8919d4b44406f317]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.642596 9655 tablet_service.cc:1511] Processing CreateTablet for tablet 0d4a280f8c844272a6bab157be23d6b6 (DEFAULT_TABLE table=default.Table_e6f4fa85056c4f82a753908c00e7bcd0 [id=f78424abf353496db1405c4cdc5ff92b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.644097 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 23c5332560614e99b9bc66a0b81f9a47 (DEFAULT_TABLE table=default.Table_1458a7c3a0ed4be0a426300cc69c92ca [id=2cc0ff125f69487f8919d4b44406f317]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.644202 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 64cf7aad4c1a4e228641567afc95a5d3 (DEFAULT_TABLE table=default.Table_76c8eb2dfe7a4a6d9dda2a6d422d2006 [id=60fc3926a5e443328a1228089794c511]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.644480 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23c5332560614e99b9bc66a0b81f9a47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.644754 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 64cf7aad4c1a4e228641567afc95a5d3 (DEFAULT_TABLE table=default.Table_76c8eb2dfe7a4a6d9dda2a6d422d2006 [id=60fc3926a5e443328a1228089794c511]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.645027 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64cf7aad4c1a4e228641567afc95a5d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.646581 10118 tablet_service.cc:1511] Processing CreateTablet for tablet 0d4a280f8c844272a6bab157be23d6b6 (DEFAULT_TABLE table=default.Table_e6f4fa85056c4f82a753908c00e7bcd0 [id=f78424abf353496db1405c4cdc5ff92b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.646916 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d4a280f8c844272a6bab157be23d6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.650566 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23c5332560614e99b9bc66a0b81f9a47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.650928 10135 tablet_service.cc:1511] Processing CreateTablet for tablet a4411b0fbf0f47f6934c166b65744a2c (DEFAULT_TABLE table=default.Table_b3cae548e1b5490bac7d5bc078ad507e [id=e36b2cab93934ca8996b2a1c53190dba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.651321 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4411b0fbf0f47f6934c166b65744a2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.652359 12266 ts_tablet_manager.cc:1929] T 1bbd3fe2117c42058dc108b5dc18d560 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:14.652745 12266 log.cc:1199] T 1bbd3fe2117c42058dc108b5dc18d560 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/1bbd3fe2117c42058dc108b5dc18d560
I20260810 19:48:14.654414 12266 ts_tablet_manager.cc:1950] T 1bbd3fe2117c42058dc108b5dc18d560 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:14.654670 9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d4a280f8c844272a6bab157be23d6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.654891 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64cf7aad4c1a4e228641567afc95a5d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.655813 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 64cf7aad4c1a4e228641567afc95a5d3 (DEFAULT_TABLE table=default.Table_76c8eb2dfe7a4a6d9dda2a6d422d2006 [id=60fc3926a5e443328a1228089794c511]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.658643 9901 tablet_service.cc:1511] Processing CreateTablet for tablet a4411b0fbf0f47f6934c166b65744a2c (DEFAULT_TABLE table=default.Table_b3cae548e1b5490bac7d5bc078ad507e [id=e36b2cab93934ca8996b2a1c53190dba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.659135 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 23c5332560614e99b9bc66a0b81f9a47 (DEFAULT_TABLE table=default.Table_1458a7c3a0ed4be0a426300cc69c92ca [id=2cc0ff125f69487f8919d4b44406f317]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.659591 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 0d4a280f8c844272a6bab157be23d6b6 (DEFAULT_TABLE table=default.Table_e6f4fa85056c4f82a753908c00e7bcd0 [id=f78424abf353496db1405c4cdc5ff92b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.662700 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 0ff798aa9ef5439bbfc2c1aa3b7eac6d
I20260810 19:48:14.664149 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ff798aa9ef5439bbfc2c1aa3b7eac6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:14.665122 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ff798aa9ef5439bbfc2c1aa3b7eac6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:14.666168 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 8edf340dda644dd7a44ef307735eb097 (DEFAULT_TABLE table=default.Table_a4ee3af9a4234fd494ed609f405412d6 [id=d8fbd04138ae40b98719a40cc217ecc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.666644 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8edf340dda644dd7a44ef307735eb097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.666785 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ff798aa9ef5439bbfc2c1aa3b7eac6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:14.668059 9407 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 4571e0c723f74c828220b33116fed9e9 (table default.Table_d9d83336ef124c2da242e77391b001c0 [id=8dbf3227e8ae402aa46b9b31b715faa6]). Expected version 1 got 0
I20260810 19:48:14.668334 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 4bc41ad892a247848f5d2c1a0d3333ef
I20260810 19:48:14.668968 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bc41ad892a247848f5d2c1a0d3333ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:14.670094 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet b54feebc7c9841d89808054602be7913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:14.671293 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 8edf340dda644dd7a44ef307735eb097 (DEFAULT_TABLE table=default.Table_a4ee3af9a4234fd494ed609f405412d6 [id=d8fbd04138ae40b98719a40cc217ecc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.671792 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8edf340dda644dd7a44ef307735eb097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.672394 10367 tablet_bootstrap.cc:492] T fafad8559b074dab958f03061e65b8c3 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:14.673595 9668 tablet_service.cc:1511] Processing CreateTablet for tablet e2bb9815affb4fbd96918f34c761c035 (DEFAULT_TABLE table=default.Table_28bf291b203b4f7e984f4f5622c03a36 [id=31eb90b7317f43febdd01083cfb34eda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.673458 10367 ts_tablet_manager.cc:1403] T fafad8559b074dab958f03061e65b8c3 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.053s user 0.005s sys 0.001s
I20260810 19:48:14.673909 10139 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bc41ad892a247848f5d2c1a0d3333ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:14.674146 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2bb9815affb4fbd96918f34c761c035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.674345 10124 tablet_service.cc:1511] Processing CreateTablet for tablet e2bb9815affb4fbd96918f34c761c035 (DEFAULT_TABLE table=default.Table_28bf291b203b4f7e984f4f5622c03a36 [id=31eb90b7317f43febdd01083cfb34eda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.674707 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2bb9815affb4fbd96918f34c761c035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.674643 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1100) took 1464 ms. Trace:
I20260810 19:48:14.675212 12266 rpcz_store.cc:276] 0810 19:48:13.210439 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.210562 (+ 123us) service_pool.cc:224] Handling call
0810 19:48:14.572504 (+1361942us) ts_tablet_manager.cc:1151] Deleting tablet 1bbd3fe2117c42058dc108b5dc18d560
0810 19:48:14.581028 (+ 8524us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:14.621712 (+ 40684us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:14.652217 (+ 30505us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:14.674400 (+ 22183us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1361724}
I20260810 19:48:14.677294 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 1bbd3fe2117c42058dc108b5dc18d560 (table default.Table_3fb4a80c47304a3e815594625c44c7a1 [id=0b09de8d5e854ef9a8ede352326b381e]) successfully deleted
I20260810 19:48:14.679062 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1101) took 1341 ms. Trace:
I20260810 19:48:14.679327 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 1f286be362c745f1964fe2401832c6c1 (DEFAULT_TABLE table=default.Table_59dd0d940c174b9f9998bec1b5c54a68 [id=bc95c9e137c6489ead3ee4a2519bc6b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.679764 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f286be362c745f1964fe2401832c6c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.679675 12266 rpcz_store.cc:276] 0810 19:48:13.337616 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.337676 (+ 60us) service_pool.cc:224] Handling call
0810 19:48:14.677813 (+1340137us) ts_tablet_manager.cc:1151] Deleting tablet f46571d9b4d948d3938607ebef926c40
0810 19:48:14.677826 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:14.678821 (+ 995us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1339678}
W20260810 19:48:14.681521 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet f46571d9b4d948d3938607ebef926c40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f46571d9b4d948d3938607ebef926c40 already in progress: creating tablet
I20260810 19:48:14.680347 10367 raft_consensus.cc:359] T fafad8559b074dab958f03061e65b8c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.681653 10367 raft_consensus.cc:385] T fafad8559b074dab958f03061e65b8c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:14.683511 12266 tablet_replica.cc:333] T eb3e7d34b5314bc7a7c5ed53792728ca P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:14.683440 10367 raft_consensus.cc:740] T fafad8559b074dab958f03061e65b8c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:14.686034 12266 raft_consensus.cc:2243] T eb3e7d34b5314bc7a7c5ed53792728ca P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:14.686376 10367 consensus_queue.cc:260] T fafad8559b074dab958f03061e65b8c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.687501 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 9c9648dfc3f349a4ae69d1ae85351db9 (DEFAULT_TABLE table=default.Table_5a8a91433def4a2e98b23673f707d5fa [id=a60fd4669635442fbfdf7cae8b8a40a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.687340 12266 raft_consensus.cc:2272] T eb3e7d34b5314bc7a7c5ed53792728ca P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:14.687909 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9648dfc3f349a4ae69d1ae85351db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.690869 10367 ts_tablet_manager.cc:1434] T fafad8559b074dab958f03061e65b8c3 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260810 19:48:14.692684 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 8edf340dda644dd7a44ef307735eb097 (DEFAULT_TABLE table=default.Table_a4ee3af9a4234fd494ed609f405412d6 [id=d8fbd04138ae40b98719a40cc217ecc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.693019 9894 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bc41ad892a247848f5d2c1a0d3333ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:14.693174 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 1f286be362c745f1964fe2401832c6c1 (DEFAULT_TABLE table=default.Table_59dd0d940c174b9f9998bec1b5c54a68 [id=bc95c9e137c6489ead3ee4a2519bc6b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.693388 9907 tablet_service.cc:1511] Processing CreateTablet for tablet e2bb9815affb4fbd96918f34c761c035 (DEFAULT_TABLE table=default.Table_28bf291b203b4f7e984f4f5622c03a36 [id=31eb90b7317f43febdd01083cfb34eda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.695837 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet c0fc251932454c378f94cbfaa4955232
I20260810 19:48:14.696453 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 4a7ca999f502495fbc56bb6fc4e5c711
I20260810 19:48:14.697247 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet c0fc251932454c378f94cbfaa4955232 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:14.697474 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a7ca999f502495fbc56bb6fc4e5c711 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:14.698032 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet c0fc251932454c378f94cbfaa4955232 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:14.698246 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a7ca999f502495fbc56bb6fc4e5c711 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:14.699661 10366 raft_consensus.cc:359] T 77cf30d2d79f404798378ab01af53b8c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.705233 9416 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 4571e0c723f74c828220b33116fed9e9 (table default.Table_d9d83336ef124c2da242e77391b001c0 [id=8dbf3227e8ae402aa46b9b31b715faa6]). Expected version 1 got 0
I20260810 19:48:14.706386 10366 raft_consensus.cc:385] T 77cf30d2d79f404798378ab01af53b8c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:14.700769 9885 tablet_service.cc:1558] Processing DeleteTablet for tablet c0fc251932454c378f94cbfaa4955232 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:14.706544 10366 raft_consensus.cc:740] T 77cf30d2d79f404798378ab01af53b8c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:14.700911 9897 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a7ca999f502495fbc56bb6fc4e5c711 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:14.700557 9894 tablet_service.cc:1511] Processing CreateTablet for tablet 9c9648dfc3f349a4ae69d1ae85351db9 (DEFAULT_TABLE table=default.Table_5a8a91433def4a2e98b23673f707d5fa [id=a60fd4669635442fbfdf7cae8b8a40a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.706831 10366 consensus_queue.cc:260] T 77cf30d2d79f404798378ab01af53b8c P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.707422 10366 ts_tablet_manager.cc:1434] T 77cf30d2d79f404798378ab01af53b8c P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.111s user 0.000s sys 0.002s
I20260810 19:48:14.700217 12266 ts_tablet_manager.cc:1916] T eb3e7d34b5314bc7a7c5ed53792728ca P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:14.709239 10367 tablet_bootstrap.cc:492] T 3da297aac2644fcabfcb21769576dca4 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:14.710074 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 1f286be362c745f1964fe2401832c6c1 (DEFAULT_TABLE table=default.Table_59dd0d940c174b9f9998bec1b5c54a68 [id=bc95c9e137c6489ead3ee4a2519bc6b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.715011 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 1d743b5ee4d6413da5b0d0a1f904321f (DEFAULT_TABLE table=default.Table_88b47a908e474b33a3543452ef60adf9 [id=7ddf8414263542d8bfffa49ae3be565c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.715462 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d743b5ee4d6413da5b0d0a1f904321f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.710116 9668 tablet_service.cc:1511] Processing CreateTablet for tablet 9c9648dfc3f349a4ae69d1ae85351db9 (DEFAULT_TABLE table=default.Table_5a8a91433def4a2e98b23673f707d5fa [id=a60fd4669635442fbfdf7cae8b8a40a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.715950 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9648dfc3f349a4ae69d1ae85351db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.706460 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet fafad8559b074dab958f03061e65b8c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:13 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:14.719508 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 1d743b5ee4d6413da5b0d0a1f904321f (DEFAULT_TABLE table=default.Table_88b47a908e474b33a3543452ef60adf9 [id=7ddf8414263542d8bfffa49ae3be565c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.719936 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d743b5ee4d6413da5b0d0a1f904321f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.722148 9897 tablet_service.cc:1511] Processing CreateTablet for tablet 1d743b5ee4d6413da5b0d0a1f904321f (DEFAULT_TABLE table=default.Table_88b47a908e474b33a3543452ef60adf9 [id=7ddf8414263542d8bfffa49ae3be565c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.723119 10140 tablet_service.cc:1511] Processing CreateTablet for tablet 89191af180b542ce99bf0a798a945594 (DEFAULT_TABLE table=default.Table_112ea9a25c8642548fc7d4e0b2156b8e [id=c0ffcea5154b4c7581d3117c756bdfd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.723559 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89191af180b542ce99bf0a798a945594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.725018 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f286be362c745f1964fe2401832c6c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.725102 10367 tablet_bootstrap.cc:654] T 3da297aac2644fcabfcb21769576dca4 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:14.730116 9885 tablet_service.cc:1511] Processing CreateTablet for tablet 89191af180b542ce99bf0a798a945594 (DEFAULT_TABLE table=default.Table_112ea9a25c8642548fc7d4e0b2156b8e [id=c0ffcea5154b4c7581d3117c756bdfd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.730849 9890 tablet_service.cc:1511] Processing CreateTablet for tablet 7189d156844e4c5b83bc2341f81cca5b (DEFAULT_TABLE table=default.Table_50b4be8902f94126906b08db861107b1 [id=8deabd315d0148f5be202272a55b464c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.736204 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_176a2b848b3943e88638c5c1f8822824"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:14.736883 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_176a2b848b3943e88638c5c1f8822824 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:14.735670 9668 tablet_service.cc:1511] Processing CreateTablet for tablet 89191af180b542ce99bf0a798a945594 (DEFAULT_TABLE table=default.Table_112ea9a25c8642548fc7d4e0b2156b8e [id=c0ffcea5154b4c7581d3117c756bdfd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.738278 10140 tablet_service.cc:1511] Processing CreateTablet for tablet c6be01e105814de3aca2e5c5811de581 (DEFAULT_TABLE table=default.Table_d60487a55e0c46939d0a8e1192c5d5d0 [id=53c6d04546054bde846130a5faea5ce3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.739563 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6be01e105814de3aca2e5c5811de581. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.743286 10366 tablet_bootstrap.cc:492] T 444b49a69c8245b6944a76d53041154c P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:14.745827 9655 tablet_service.cc:1511] Processing CreateTablet for tablet c6be01e105814de3aca2e5c5811de581 (DEFAULT_TABLE table=default.Table_d60487a55e0c46939d0a8e1192c5d5d0 [id=53c6d04546054bde846130a5faea5ce3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.746272 9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6be01e105814de3aca2e5c5811de581. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.746928 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_073fe66f42db4d298e2aa03e9ddfb175"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:14.747526 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_073fe66f42db4d298e2aa03e9ddfb175 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:14.748265 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89191af180b542ce99bf0a798a945594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.748893 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_82e11ef45a7c49eda078cf80df544938" } new_table_name: "default.Table_d80b4eb7b5504465a083a50d5848d8ae" modify_external_catalogs: true
I20260810 19:48:14.750190 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_500a87af3dbc4007864d04aa1f2f7bcd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:14.751758 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_500a87af3dbc4007864d04aa1f2f7bcd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:14.753865 10375 ts_tablet_manager.cc:1916] T 81aabb5656e7472f9223fd7acf10e43c P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:14.758204 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 1fed118025d7401c9249505dd7d15c19 (DEFAULT_TABLE table=default.Table_94035ceea51a46b78f6bd96e4f02633b [id=e28654b4555941c19fbc4b33023629b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.759996 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_fd1701e5b67e4e7886261e68ecf09221" } new_table_name: "default.Table_e611ddebd1c247f8bf6027ad5a37c364" modify_external_catalogs: true
I20260810 19:48:14.760394 9655 tablet_service.cc:1511] Processing CreateTablet for tablet 1fed118025d7401c9249505dd7d15c19 (DEFAULT_TABLE table=default.Table_94035ceea51a46b78f6bd96e4f02633b [id=e28654b4555941c19fbc4b33023629b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.761082 9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fed118025d7401c9249505dd7d15c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.761837 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a5054a2e3e7c4bcf86bcc34a01d7e807"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:14.762380 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a5054a2e3e7c4bcf86bcc34a01d7e807 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:14.763609 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1bdee0eb4a634cb2beba49dadea53106" } new_table_name: "default.Table_7662f061cbff4e09972b889fc11ce033" modify_external_catalogs: true
I20260810 19:48:14.764838 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_9f26a3a8a41e43eab54c18c6bba196e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:14.765319 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f26a3a8a41e43eab54c18c6bba196e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:14.765686 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fed118025d7401c9249505dd7d15c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.766464 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_acf87d58880b426aa890dbf88e46a540" } new_table_name: "default.Table_604de74a4b054280baeb463018e8015f" modify_external_catalogs: true
I20260810 19:48:14.767692 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 938ea479941c4e369090974e6cee41b3 (DEFAULT_TABLE table=default.Table_68a0e01c57ae4151ae692342c695108f [id=b06286d78a6c4e5294e06b9010ae21cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.768103 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 938ea479941c4e369090974e6cee41b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.768071 13041 raft_consensus.cc:493] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:14.768226 13041 raft_consensus.cc:515] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.768923 13041 leader_election.cc:290] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:14.769985 9831 leader_election.cc:343] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: f6f9eb86c6c84b4a84d109d4741238e1
I20260810 19:48:14.770769 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_5c9eb4f561e84e7db222bd31d3ba1952"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:14.771317 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c9eb4f561e84e7db222bd31d3ba1952 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:14.774197 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 938ea479941c4e369090974e6cee41b3 (DEFAULT_TABLE table=default.Table_68a0e01c57ae4151ae692342c695108f [id=b06286d78a6c4e5294e06b9010ae21cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.774942 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 938ea479941c4e369090974e6cee41b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.779206 10370 tablet_bootstrap.cc:492] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:14.779623 10370 ts_tablet_manager.cc:1403] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.187s user 0.009s sys 0.000s
I20260810 19:48:14.782053 10370 raft_consensus.cc:359] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.782817 10370 raft_consensus.cc:385] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:14.783044 10370 raft_consensus.cc:740] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:14.783809 10370 consensus_queue.cc:260] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.791831 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f9eb86c6c84b4a84d109d4741238e1" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:14.792053 10165 raft_consensus.cc:2468] T f6f9eb86c6c84b4a84d109d4741238e1 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:14.794546 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 1fed118025d7401c9249505dd7d15c19 (DEFAULT_TABLE table=default.Table_94035ceea51a46b78f6bd96e4f02633b [id=e28654b4555941c19fbc4b33023629b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.794675 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 938ea479941c4e369090974e6cee41b3 (DEFAULT_TABLE table=default.Table_68a0e01c57ae4151ae692342c695108f [id=b06286d78a6c4e5294e06b9010ae21cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.794546 9892 tablet_service.cc:1511] Processing CreateTablet for tablet c6be01e105814de3aca2e5c5811de581 (DEFAULT_TABLE table=default.Table_d60487a55e0c46939d0a8e1192c5d5d0 [id=53c6d04546054bde846130a5faea5ce3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.795217 9830 leader_election.cc:304] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:14.795683 13041 raft_consensus.cc:2804] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:14.795795 13041 raft_consensus.cc:493] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:14.795885 13041 raft_consensus.cc:3060] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:14.798236 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 4b0b219dfcbe4becb02bfd813a61d0b9 (DEFAULT_TABLE table=default.Table_582690e0f3bc4e399ad7f7d62c81ee63 [id=46037d4b93c442afadef84691e972f3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.798717 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0b219dfcbe4becb02bfd813a61d0b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.800520 13041 raft_consensus.cc:515] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.801606 13041 leader_election.cc:290] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:14.802718 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 282bb13b02fc49a3945b18686b293ce4 (DEFAULT_TABLE table=default.Table_9aae22fac7d84519b6a1c0620aaf46e6 [id=53d9fd3c72f74a87b6a500808437f285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.802907 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f9eb86c6c84b4a84d109d4741238e1" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:14.803081 10165 raft_consensus.cc:3060] T f6f9eb86c6c84b4a84d109d4741238e1 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:14.803449 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 4b0b219dfcbe4becb02bfd813a61d0b9 (DEFAULT_TABLE table=default.Table_582690e0f3bc4e399ad7f7d62c81ee63 [id=46037d4b93c442afadef84691e972f3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.804565 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 282bb13b02fc49a3945b18686b293ce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.804857 13019 raft_consensus.cc:493] T b54feebc7c9841d89808054602be7913 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:14.804991 13019 raft_consensus.cc:515] T b54feebc7c9841d89808054602be7913 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.805154 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0b219dfcbe4becb02bfd813a61d0b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.806038 10165 raft_consensus.cc:2468] T f6f9eb86c6c84b4a84d109d4741238e1 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:14.806663 13019 leader_election.cc:290] T b54feebc7c9841d89808054602be7913 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:14.807408 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54feebc7c9841d89808054602be7913" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:14.807727 9831 leader_election.cc:343] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: f6f9eb86c6c84b4a84d109d4741238e1
I20260810 19:48:14.807753 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54feebc7c9841d89808054602be7913" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:14.808116 9611 leader_election.cc:343] T b54feebc7c9841d89808054602be7913 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:14.808351 9611 leader_election.cc:343] T b54feebc7c9841d89808054602be7913 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:14.808435 9611 leader_election.cc:304] T b54feebc7c9841d89808054602be7913 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:14.808928 13019 raft_consensus.cc:2749] T b54feebc7c9841d89808054602be7913 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:14.810984 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 282bb13b02fc49a3945b18686b293ce4 (DEFAULT_TABLE table=default.Table_9aae22fac7d84519b6a1c0620aaf46e6 [id=53d9fd3c72f74a87b6a500808437f285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.811321 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 0b7f39371dd64a34825403d8c9ca3cc1 (DEFAULT_TABLE table=default.Table_e4db3fb13aa44a73816ed73c2085aabb [id=cd7289fceb5b4375ab058c5d76fc72ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.811503 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 282bb13b02fc49a3945b18686b293ce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.811726 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b7f39371dd64a34825403d8c9ca3cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.813321 13067 raft_consensus.cc:493] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:14.813465 13067 raft_consensus.cc:515] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.814105 13067 leader_election.cc:290] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:14.814829 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cf30d2d79f404798378ab01af53b8c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:14.815037 9931 raft_consensus.cc:2468] T 77cf30d2d79f404798378ab01af53b8c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:14.815538 10067 leader_election.cc:304] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:14.815811 13067 raft_consensus.cc:2804] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:14.815881 13067 raft_consensus.cc:493] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:14.815938 13067 raft_consensus.cc:3060] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:14.819084 9709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cf30d2d79f404798378ab01af53b8c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:14.819109 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 4b0b219dfcbe4becb02bfd813a61d0b9 (DEFAULT_TABLE table=default.Table_582690e0f3bc4e399ad7f7d62c81ee63 [id=46037d4b93c442afadef84691e972f3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.819216 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 282bb13b02fc49a3945b18686b293ce4 (DEFAULT_TABLE table=default.Table_9aae22fac7d84519b6a1c0620aaf46e6 [id=53d9fd3c72f74a87b6a500808437f285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.819293 9709 raft_consensus.cc:2468] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:14.819646 9830 leader_election.cc:304] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:14.820178 13041 raft_consensus.cc:2804] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:14.821924 13041 raft_consensus.cc:697] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:14.822530 13041 consensus_queue.cc:237] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.823596 13067 raft_consensus.cc:515] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.824265 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 0b7f39371dd64a34825403d8c9ca3cc1 (DEFAULT_TABLE table=default.Table_e4db3fb13aa44a73816ed73c2085aabb [id=cd7289fceb5b4375ab058c5d76fc72ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.824750 9709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cf30d2d79f404798378ab01af53b8c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:14.824950 9709 raft_consensus.cc:3060] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:14.825675 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cf30d2d79f404798378ab01af53b8c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:14.825850 9931 raft_consensus.cc:3060] T 77cf30d2d79f404798378ab01af53b8c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:14.826468 10367 tablet_bootstrap.cc:492] T 3da297aac2644fcabfcb21769576dca4 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:14.826691 10367 ts_tablet_manager.cc:1403] T 3da297aac2644fcabfcb21769576dca4 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.118s user 0.007s sys 0.001s
I20260810 19:48:14.828907 9931 raft_consensus.cc:2468] T 77cf30d2d79f404798378ab01af53b8c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:14.829002 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 0b7f39371dd64a34825403d8c9ca3cc1 (DEFAULT_TABLE table=default.Table_e4db3fb13aa44a73816ed73c2085aabb [id=cd7289fceb5b4375ab058c5d76fc72ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.829433 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b7f39371dd64a34825403d8c9ca3cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.829409 10067 leader_election.cc:304] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:14.829725 12993 raft_consensus.cc:2804] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:14.829548 10367 raft_consensus.cc:359] T 3da297aac2644fcabfcb21769576dca4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.830554 10367 raft_consensus.cc:385] T 3da297aac2644fcabfcb21769576dca4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:14.831044 10367 raft_consensus.cc:740] T 3da297aac2644fcabfcb21769576dca4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:14.833446 10367 consensus_queue.cc:260] T 3da297aac2644fcabfcb21769576dca4 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:14.835716 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fd92028cb8c849d4b121cec3775cbe62 consensus state has no leader
I20260810 19:48:14.842065 9709 raft_consensus.cc:2468] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:14.846928 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 914146ba0d674ab0b9ec5a1d51472889 (DEFAULT_TABLE table=default.Table_b419a0a71fdf463aa340b7bb088ca240 [id=092324a62a2a48e68e694c466ddfc3fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.847412 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 914146ba0d674ab0b9ec5a1d51472889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.854871 13067 leader_election.cc:290] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:14.865705 13019 raft_consensus.cc:493] T 3da297aac2644fcabfcb21769576dca4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:14.865878 13019 raft_consensus.cc:515] T 3da297aac2644fcabfcb21769576dca4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.866580 13019 leader_election.cc:290] T 3da297aac2644fcabfcb21769576dca4 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:14.867539 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da297aac2644fcabfcb21769576dca4" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:14.868156 9611 leader_election.cc:343] T 3da297aac2644fcabfcb21769576dca4 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:14.868628 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da297aac2644fcabfcb21769576dca4" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:14.869215 9611 leader_election.cc:343] T 3da297aac2644fcabfcb21769576dca4 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:14.869323 9611 leader_election.cc:304] T 3da297aac2644fcabfcb21769576dca4 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:14.869807 13019 raft_consensus.cc:2749] T 3da297aac2644fcabfcb21769576dca4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:14.872267 12266 ts_tablet_manager.cc:1929] T eb3e7d34b5314bc7a7c5ed53792728ca P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:14.872529 12266 log.cc:1199] T eb3e7d34b5314bc7a7c5ed53792728ca P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/eb3e7d34b5314bc7a7c5ed53792728ca
I20260810 19:48:14.873128 12266 ts_tablet_manager.cc:1950] T eb3e7d34b5314bc7a7c5ed53792728ca P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:14.874882 10367 ts_tablet_manager.cc:1434] T 3da297aac2644fcabfcb21769576dca4 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.048s user 0.003s sys 0.000s
I20260810 19:48:14.877230 12872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0c56283079e74549afd0096f7e72046a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5268e710af3c43ddab70eb7dd1aaa575" member_type: VOTER last_known_addr { host: "127.8.235.254" port: 33891 } } peers { permanent_uuid: "f52c40e347e24ab4b3129e7064f4a43e" member_type: VOTER last_known_addr { host: "127.8.235.253" port: 37397 } } peers { permanent_uuid: "0c56283079e74549afd0096f7e72046a" member_type: VOTER last_known_addr { host: "127.8.235.252" port: 43301 } } }
I20260810 19:48:14.877439 12872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a [sys.catalog]: This master's current role is: LEADER
I20260810 19:48:14.880898 9887 tablet_service.cc:1511] Processing CreateTablet for tablet 914146ba0d674ab0b9ec5a1d51472889 (DEFAULT_TABLE table=default.Table_b419a0a71fdf463aa340b7bb088ca240 [id=092324a62a2a48e68e694c466ddfc3fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.885273 13067 raft_consensus.cc:493] T 444b49a69c8245b6944a76d53041154c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:14.885434 13067 raft_consensus.cc:515] T 444b49a69c8245b6944a76d53041154c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.886126 13067 leader_election.cc:290] T 444b49a69c8245b6944a76d53041154c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:14.886730 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444b49a69c8245b6944a76d53041154c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:14.886833 10367 tablet_bootstrap.cc:492] T b8a7c2857add422281542e7f187979ab P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
W20260810 19:48:14.887421 10067 leader_election.cc:343] T 444b49a69c8245b6944a76d53041154c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:14.888545 10068 leader_election.cc:343] T 444b49a69c8245b6944a76d53041154c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 444b49a69c8245b6944a76d53041154c
I20260810 19:48:14.888667 10068 leader_election.cc:304] T 444b49a69c8245b6944a76d53041154c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:14.889894 13067 raft_consensus.cc:2749] T 444b49a69c8245b6944a76d53041154c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:14.896392 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 914146ba0d674ab0b9ec5a1d51472889 (DEFAULT_TABLE table=default.Table_b419a0a71fdf463aa340b7bb088ca240 [id=092324a62a2a48e68e694c466ddfc3fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.896363 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_72a80c06c138411ab77f41d2d076aad0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:14.896852 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 914146ba0d674ab0b9ec5a1d51472889. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:14.896989 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72a80c06c138411ab77f41d2d076aad0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:14.902406 9416 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 3da297aac2644fcabfcb21769576dca4 (table default.Table_f6f4b21d44ba45339d95ca1933e92cd9 [id=67f177aa933f4f00a3dcab7e11f61624]). Expected version 1 got 0
W20260810 19:48:14.904400 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5dafda5a18bf4c44b8e75dcdee0e9506 consensus state has no leader
I20260810 19:48:14.906144 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 878257639b264519af0bfb1b71743357 (DEFAULT_TABLE table=default.Table_956c60475b324cce9ff49890df2272a1 [id=ef228072b19d4990ade66fed109710b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.906670 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 878257639b264519af0bfb1b71743357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.907804 9413 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 3da297aac2644fcabfcb21769576dca4 (table default.Table_f6f4b21d44ba45339d95ca1933e92cd9 [id=67f177aa933f4f00a3dcab7e11f61624]). Expected version 1 got 0
I20260810 19:48:14.908489 9911 tablet_service.cc:1511] Processing CreateTablet for tablet 878257639b264519af0bfb1b71743357 (DEFAULT_TABLE table=default.Table_956c60475b324cce9ff49890df2272a1 [id=ef228072b19d4990ade66fed109710b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.909649 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1102) took 1562 ms. Trace:
I20260810 19:48:14.909823 12266 rpcz_store.cc:276] 0810 19:48:13.346911 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.347765 (+ 854us) service_pool.cc:224] Handling call
0810 19:48:14.683225 (+1335460us) ts_tablet_manager.cc:1151] Deleting tablet eb3e7d34b5314bc7a7c5ed53792728ca
0810 19:48:14.683243 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:14.753943 (+ 70700us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:14.872148 (+118205us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:14.909623 (+ 37475us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1334786}
I20260810 19:48:14.910485 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet eb3e7d34b5314bc7a7c5ed53792728ca (table default.Table_c5eab30c1c344809be5b1289a88d2ca3 [id=64e2bbcc84434e268763f4ee1acc851d]) successfully deleted
I20260810 19:48:14.911142 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1103) took 1268 ms. Trace:
I20260810 19:48:14.911345 12266 rpcz_store.cc:276] 0810 19:48:13.642774 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.644319 (+ 1545us) service_pool.cc:224] Handling call
0810 19:48:14.910882 (+1266563us) ts_tablet_manager.cc:1151] Deleting tablet 0b71af7492854f32b26887f8cbead122
0810 19:48:14.910921 (+ 39us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:14.911116 (+ 195us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1266326}
W20260810 19:48:14.912361 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 0b71af7492854f32b26887f8cbead122 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b71af7492854f32b26887f8cbead122 already in progress: creating tablet
I20260810 19:48:14.912546 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 878257639b264519af0bfb1b71743357 (DEFAULT_TABLE table=default.Table_956c60475b324cce9ff49890df2272a1 [id=ef228072b19d4990ade66fed109710b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.913015 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 878257639b264519af0bfb1b71743357. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:14.917201 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c6ac20a42a6f4a3f95479acc5ed9602f consensus state has no leader
I20260810 19:48:14.918876 10370 ts_tablet_manager.cc:1434] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.139s user 0.003s sys 0.001s
I20260810 19:48:14.920208 10370 tablet_bootstrap.cc:492] T 3680db3f1a5945a89c1198eb4849e58c P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:14.921070 10367 tablet_bootstrap.cc:654] T b8a7c2857add422281542e7f187979ab P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:14.922943 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8edf340dda644dd7a44ef307735eb097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.923604 9887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 914146ba0d674ab0b9ec5a1d51472889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.923828 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d4a280f8c844272a6bab157be23d6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.924530 10366 tablet_bootstrap.cc:654] T 444b49a69c8245b6944a76d53041154c P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:14.925267 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d743b5ee4d6413da5b0d0a1f904321f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.926430 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23c5332560614e99b9bc66a0b81f9a47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.926620 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 878257639b264519af0bfb1b71743357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.926819 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f286be362c745f1964fe2401832c6c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.928975 13019 raft_consensus.cc:493] T 25570b1795164aeca86a5313bd30a4c9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:14.929126 13019 raft_consensus.cc:515] T 25570b1795164aeca86a5313bd30a4c9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:14.929857 13019 leader_election.cc:290] T 25570b1795164aeca86a5313bd30a4c9 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:14.930471 9885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89191af180b542ce99bf0a798a945594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.930747 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25570b1795164aeca86a5313bd30a4c9" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:14.930774 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25570b1795164aeca86a5313bd30a4c9" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:14.931228 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2bb9815affb4fbd96918f34c761c035. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:14.931362 9611 leader_election.cc:343] T 25570b1795164aeca86a5313bd30a4c9 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:14.932271 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b7f39371dd64a34825403d8c9ca3cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.932431 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1104) took 1277 ms. Trace:
I20260810 19:48:14.932520 12266 rpcz_store.cc:276] 0810 19:48:13.654793 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.654869 (+ 76us) service_pool.cc:224] Handling call
0810 19:48:14.912765 (+1257896us) ts_tablet_manager.cc:1151] Deleting tablet 21041f65462744278244802ef867c2e9
0810 19:48:14.932246 (+ 19481us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:14.932405 (+ 159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1920,"tablet-delete.queue_time_us":1257619}
W20260810 19:48:14.933081 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 21041f65462744278244802ef867c2e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21041f65462744278244802ef867c2e9 already in progress: creating tablet
I20260810 19:48:14.933496 12266 tablet_replica.cc:333] T 25570b1795164aeca86a5313bd30a4c9 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:14.933699 12266 raft_consensus.cc:2243] T 25570b1795164aeca86a5313bd30a4c9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:14.933847 12266 raft_consensus.cc:2272] T 25570b1795164aeca86a5313bd30a4c9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:14.934077 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7189d156844e4c5b83bc2341f81cca5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.934505 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4411b0fbf0f47f6934c166b65744a2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.934500 12266 ts_tablet_manager.cc:1916] T 25570b1795164aeca86a5313bd30a4c9 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:14.938763 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9648dfc3f349a4ae69d1ae85351db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.940325 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64cf7aad4c1a4e228641567afc95a5d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.942914 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fed118025d7401c9249505dd7d15c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.949752 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0b219dfcbe4becb02bfd813a61d0b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.950112 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 282bb13b02fc49a3945b18686b293ce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.953830 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6be01e105814de3aca2e5c5811de581. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:14.954089 9611 leader_election.cc:343] T 25570b1795164aeca86a5313bd30a4c9 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:14.954226 9611 leader_election.cc:304] T 25570b1795164aeca86a5313bd30a4c9 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
W20260810 19:48:14.954424 9611 raft_consensus.cc:2686] T 25570b1795164aeca86a5313bd30a4c9 P fcd31b1bbb0340cbacfce652b4ad8da4: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 19:48:14.958539 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 938ea479941c4e369090974e6cee41b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.970527 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b9afcbc98870448c9acc76cbe6c2d12e" } modify_external_catalogs: true
I20260810 19:48:14.970697 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b9afcbc98870448c9acc76cbe6c2d12e" } modify_external_catalogs: true
I20260810 19:48:14.970187 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2fd589ce44f442528ad417adff50cc0a" } modify_external_catalogs: true
I20260810 19:48:14.972203 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2fd589ce44f442528ad417adff50cc0a" } modify_external_catalogs: true
I20260810 19:48:14.973512 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_25f19f2032a74c4180cc62614260b2fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:14.974114 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25f19f2032a74c4180cc62614260b2fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:14.975370 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4b65055403904f0a8b3ded5be5ffdd4e" } new_table_name: "default.Table_7933ff75339f4820ad76d2aa778cf4f4" modify_external_catalogs: true
I20260810 19:48:14.976629 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_234beb75a2cf4a2b980e05b9d84375a2" } modify_external_catalogs: true
I20260810 19:48:14.976778 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_234beb75a2cf4a2b980e05b9d84375a2" } modify_external_catalogs: true
I20260810 19:48:14.979468 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ad46f1256ca54dfca9927ca88a9829f5" } modify_external_catalogs: true
I20260810 19:48:14.979678 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ad46f1256ca54dfca9927ca88a9829f5" } modify_external_catalogs: true
I20260810 19:48:14.985899 9675 tablet_service.cc:1511] Processing CreateTablet for tablet fddb0b1ffc6d47f49a74b8c522eb7d1e (DEFAULT_TABLE table=default.Table_e497f222f0fe4a5f9358a38adc2a381f [id=ea2ab1ca014f4986bbff81cc3a2344d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.986392 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fddb0b1ffc6d47f49a74b8c522eb7d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:14.989670 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_7f42e3c0170c41f6aab544a1d359c022"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:14.990300 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f42e3c0170c41f6aab544a1d359c022 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:14.992985 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 1031461c40a749b88f4f9e93c15abcff (DEFAULT_TABLE table=default.Table_47b60293596b47298fd66de06fff3f84 [id=6f28f38ede6e4e61b2df497c676858f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.995054 12266 ts_tablet_manager.cc:1929] T 25570b1795164aeca86a5313bd30a4c9 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:14.995383 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 1031461c40a749b88f4f9e93c15abcff (DEFAULT_TABLE table=default.Table_47b60293596b47298fd66de06fff3f84 [id=6f28f38ede6e4e61b2df497c676858f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:14.995898 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1031461c40a749b88f4f9e93c15abcff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.000662 12266 log.cc:1199] T 25570b1795164aeca86a5313bd30a4c9 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/25570b1795164aeca86a5313bd30a4c9
I20260810 19:48:15.001255 12266 ts_tablet_manager.cc:1950] T 25570b1795164aeca86a5313bd30a4c9 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:15.002612 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1105) took 1330 ms. Trace:
I20260810 19:48:15.003821 12266 rpcz_store.cc:276] 0810 19:48:13.672421 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.672845 (+ 424us) service_pool.cc:224] Handling call
0810 19:48:14.933440 (+1260595us) ts_tablet_manager.cc:1151] Deleting tablet 25570b1795164aeca86a5313bd30a4c9
0810 19:48:14.933452 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:14.968213 (+ 34761us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:14.994980 (+ 26767us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:15.002580 (+ 7600us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1260341}
I20260810 19:48:15.004135 10370 tablet_bootstrap.cc:654] T 3680db3f1a5945a89c1198eb4849e58c P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.004249 10130 tablet_service.cc:1511] Processing CreateTablet for tablet a3579cd011a74fa6aa424bdaefc6d059 (DEFAULT_TABLE table=default.Table_0d1801a690ed475badef36affe215228 [id=553a3ddce5a545b9a39d11338f71c105]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.004702 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3579cd011a74fa6aa424bdaefc6d059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.004926 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1106) took 1331 ms. Trace:
I20260810 19:48:15.004999 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 25570b1795164aeca86a5313bd30a4c9 (table default.Table_4e0b9ea93b4e4164a3580c481782f8f4 [id=684a4fd9a0674c9ab382b116e5849fff]) successfully deleted
I20260810 19:48:15.006147 12266 rpcz_store.cc:276] 0810 19:48:13.673444 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.673497 (+ 53us) service_pool.cc:224] Handling call
0810 19:48:15.004764 (+1331267us) ts_tablet_manager.cc:1151] Deleting tablet 3194d795b1ee4b17bd91c27bb6a86fb8
0810 19:48:15.004775 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.004903 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1331060}
I20260810 19:48:15.008322 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 8125bdde9e324db79be353f508df8376 (DEFAULT_TABLE table=default.Table_25e42fcb9ec64d5080333f608ae0c7b0 [id=0bd0102702a7496c8614372ee0216008]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.008772 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8125bdde9e324db79be353f508df8376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.009142 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1107) took 1327 ms. Trace:
I20260810 19:48:15.009366 12266 rpcz_store.cc:276] 0810 19:48:13.681891 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.681959 (+ 68us) service_pool.cc:224] Handling call
0810 19:48:15.008678 (+1326719us) ts_tablet_manager.cc:1151] Deleting tablet 5f593e2ff4ef467da4a1b2dacd17c899
0810 19:48:15.008690 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.008805 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1326491}
I20260810 19:48:15.009675 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 8125bdde9e324db79be353f508df8376 (DEFAULT_TABLE table=default.Table_25e42fcb9ec64d5080333f608ae0c7b0 [id=0bd0102702a7496c8614372ee0216008]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.010097 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1108) took 1320 ms. Trace:
I20260810 19:48:15.010136 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8125bdde9e324db79be353f508df8376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.010571 12266 rpcz_store.cc:276] 0810 19:48:13.690082 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.690147 (+ 65us) service_pool.cc:224] Handling call
0810 19:48:15.009961 (+1319814us) ts_tablet_manager.cc:1151] Deleting tablet 27c75f3340e24fe1a10de5bd6bcdfb2f
0810 19:48:15.009973 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.010076 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1319569}
W20260810 19:48:15.011121 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4e871bfa4b734154aa9cfe76b0902dbf consensus state has no leader
I20260810 19:48:15.011466 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1109) took 1309 ms. Trace:
I20260810 19:48:15.012710 12266 rpcz_store.cc:276] 0810 19:48:13.701566 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.701636 (+ 70us) service_pool.cc:224] Handling call
0810 19:48:15.011351 (+1309715us) ts_tablet_manager.cc:1151] Deleting tablet 684fd292f5ca4d0284a5036b039c640b
0810 19:48:15.011360 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.011448 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1309494}
I20260810 19:48:15.012748 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c8ffb29225064887b4bedaef7c9e4d90" } modify_external_catalogs: true
I20260810 19:48:15.012951 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c8ffb29225064887b4bedaef7c9e4d90" } modify_external_catalogs: true
I20260810 19:48:15.013247 12266 tablet_replica.cc:333] T 749cea5cd8f842b891f4e2cab07c054e P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:15.013645 12266 raft_consensus.cc:2243] T 749cea5cd8f842b891f4e2cab07c054e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:15.017863 12266 raft_consensus.cc:2272] T 749cea5cd8f842b891f4e2cab07c054e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:15.023226 12266 ts_tablet_manager.cc:1916] T 749cea5cd8f842b891f4e2cab07c054e P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:15.025025 10366 tablet_bootstrap.cc:492] T 444b49a69c8245b6944a76d53041154c P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:15.025220 10366 ts_tablet_manager.cc:1403] T 444b49a69c8245b6944a76d53041154c P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.282s user 0.005s sys 0.003s
I20260810 19:48:15.026000 10366 raft_consensus.cc:359] T 444b49a69c8245b6944a76d53041154c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.026225 10366 raft_consensus.cc:385] T 444b49a69c8245b6944a76d53041154c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 19:48:15.027215 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 3194d795b1ee4b17bd91c27bb6a86fb8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3194d795b1ee4b17bd91c27bb6a86fb8 already in progress: creating tablet
I20260810 19:48:15.023725 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1031461c40a749b88f4f9e93c15abcff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.027434 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 77f3479649464a7bbe59d730cbe3fa16 (DEFAULT_TABLE table=default.Table_6209fa63063d4a6d992f1c3c74ca3720 [id=965b45707eda49a89ba23abd55b90ac2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:15.027503 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 5f593e2ff4ef467da4a1b2dacd17c899 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f593e2ff4ef467da4a1b2dacd17c899 already in progress: creating tablet
W20260810 19:48:15.027707 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 27c75f3340e24fe1a10de5bd6bcdfb2f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 27c75f3340e24fe1a10de5bd6bcdfb2f already in progress: creating tablet
I20260810 19:48:15.027871 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77f3479649464a7bbe59d730cbe3fa16. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:15.027923 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 684fd292f5ca4d0284a5036b039c640b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 684fd292f5ca4d0284a5036b039c640b already in progress: creating tablet
I20260810 19:48:15.029063 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 8125bdde9e324db79be353f508df8376 (DEFAULT_TABLE table=default.Table_25e42fcb9ec64d5080333f608ae0c7b0 [id=0bd0102702a7496c8614372ee0216008]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.029438 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8125bdde9e324db79be353f508df8376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.033031 10145 tablet_service.cc:1511] Processing CreateTablet for tablet fddb0b1ffc6d47f49a74b8c522eb7d1e (DEFAULT_TABLE table=default.Table_e497f222f0fe4a5f9358a38adc2a381f [id=ea2ab1ca014f4986bbff81cc3a2344d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.033447 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fddb0b1ffc6d47f49a74b8c522eb7d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.027271 10367 tablet_bootstrap.cc:492] T b8a7c2857add422281542e7f187979ab P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:15.033756 10367 ts_tablet_manager.cc:1403] T b8a7c2857add422281542e7f187979ab P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.148s user 0.007s sys 0.008s
I20260810 19:48:15.034578 10367 raft_consensus.cc:359] T b8a7c2857add422281542e7f187979ab P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.034775 10367 raft_consensus.cc:385] T b8a7c2857add422281542e7f187979ab P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.034862 10367 raft_consensus.cc:740] T b8a7c2857add422281542e7f187979ab P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.035137 10367 consensus_queue.cc:260] T b8a7c2857add422281542e7f187979ab P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.026305 10366 raft_consensus.cc:740] T 444b49a69c8245b6944a76d53041154c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.035665 10366 consensus_queue.cc:260] T 444b49a69c8245b6944a76d53041154c P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.036260 10366 ts_tablet_manager.cc:1434] T 444b49a69c8245b6944a76d53041154c P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
I20260810 19:48:15.037161 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 50eb51ef39e443668e2e5c32c7e9c89e (DEFAULT_TABLE table=default.Table_2850745584164af1b23ae3b8d3a4d312 [id=4985c3840e0b40ddac30af3c865cdfcc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.037592 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50eb51ef39e443668e2e5c32c7e9c89e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.034768 9885 tablet_service.cc:1511] Processing CreateTablet for tablet 1031461c40a749b88f4f9e93c15abcff (DEFAULT_TABLE table=default.Table_47b60293596b47298fd66de06fff3f84 [id=6f28f38ede6e4e61b2df497c676858f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.039397 9885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1031461c40a749b88f4f9e93c15abcff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.042250 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 77f3479649464a7bbe59d730cbe3fa16 (DEFAULT_TABLE table=default.Table_6209fa63063d4a6d992f1c3c74ca3720 [id=965b45707eda49a89ba23abd55b90ac2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.035075 9892 tablet_service.cc:1511] Processing CreateTablet for tablet a3579cd011a74fa6aa424bdaefc6d059 (DEFAULT_TABLE table=default.Table_0d1801a690ed475badef36affe215228 [id=553a3ddce5a545b9a39d11338f71c105]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.042711 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77f3479649464a7bbe59d730cbe3fa16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.042840 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3579cd011a74fa6aa424bdaefc6d059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.043627 9897 tablet_service.cc:1511] Processing CreateTablet for tablet 77f3479649464a7bbe59d730cbe3fa16 (DEFAULT_TABLE table=default.Table_6209fa63063d4a6d992f1c3c74ca3720 [id=965b45707eda49a89ba23abd55b90ac2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.044384 10367 ts_tablet_manager.cc:1434] T b8a7c2857add422281542e7f187979ab P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260810 19:48:15.044875 9668 tablet_service.cc:1511] Processing CreateTablet for tablet 50eb51ef39e443668e2e5c32c7e9c89e (DEFAULT_TABLE table=default.Table_2850745584164af1b23ae3b8d3a4d312 [id=4985c3840e0b40ddac30af3c865cdfcc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.045236 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50eb51ef39e443668e2e5c32c7e9c89e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.046270 10137 tablet_service.cc:1511] Processing CreateTablet for tablet a4d3e5bede514d429608f8e43bee9a5c (DEFAULT_TABLE table=default.Table_1c7511005f554782a856d4660f40280b [id=fa524fa0a08c4762b53ab1a222f48f6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.046692 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4d3e5bede514d429608f8e43bee9a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.046728 9675 tablet_service.cc:1511] Processing CreateTablet for tablet a3579cd011a74fa6aa424bdaefc6d059 (DEFAULT_TABLE table=default.Table_0d1801a690ed475badef36affe215228 [id=553a3ddce5a545b9a39d11338f71c105]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.047057 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3579cd011a74fa6aa424bdaefc6d059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.035267 9906 tablet_service.cc:1511] Processing CreateTablet for tablet fddb0b1ffc6d47f49a74b8c522eb7d1e (DEFAULT_TABLE table=default.Table_e497f222f0fe4a5f9358a38adc2a381f [id=ea2ab1ca014f4986bbff81cc3a2344d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.050719 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77f3479649464a7bbe59d730cbe3fa16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.052152 9420 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 639c824ba4834734a4ebfd558181bebe (table default.Table_35ada13f5f5a41b0a93a57276b7756d9 [id=fa3844f34a5b4d55b6e87ec2164eb8fb]). Expected version 2 got 0
I20260810 19:48:15.053265 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_bda2b3d2548648839f545e6909459594"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:15.053800 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bda2b3d2548648839f545e6909459594 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:15.054750 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 50eb51ef39e443668e2e5c32c7e9c89e (DEFAULT_TABLE table=default.Table_2850745584164af1b23ae3b8d3a4d312 [id=4985c3840e0b40ddac30af3c865cdfcc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.055157 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50eb51ef39e443668e2e5c32c7e9c89e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.058866 9657 tablet_service.cc:1511] Processing CreateTablet for tablet a4d3e5bede514d429608f8e43bee9a5c (DEFAULT_TABLE table=default.Table_1c7511005f554782a856d4660f40280b [id=fa524fa0a08c4762b53ab1a222f48f6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.058902 9901 tablet_service.cc:1511] Processing CreateTablet for tablet d57a9b101e7d4399801a532482087649 (DEFAULT_TABLE table=default.Table_4d54510e39fe48b4bb48143495ed1f11 [id=beacc79f136b438bb4503239d89279ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.059266 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4d3e5bede514d429608f8e43bee9a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.059265 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d57a9b101e7d4399801a532482087649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.061395 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fddb0b1ffc6d47f49a74b8c522eb7d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.062441 9655 tablet_service.cc:1558] Processing DeleteTablet for tablet b8a7c2857add422281542e7f187979ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:15.062855 9664 tablet_service.cc:1511] Processing CreateTablet for tablet d57a9b101e7d4399801a532482087649 (DEFAULT_TABLE table=default.Table_4d54510e39fe48b4bb48143495ed1f11 [id=beacc79f136b438bb4503239d89279ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.063218 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d57a9b101e7d4399801a532482087649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.063398 10370 tablet_bootstrap.cc:492] T 3680db3f1a5945a89c1198eb4849e58c P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:15.063557 10370 ts_tablet_manager.cc:1403] T 3680db3f1a5945a89c1198eb4849e58c P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.144s user 0.004s sys 0.000s
I20260810 19:48:15.064427 10370 raft_consensus.cc:359] T 3680db3f1a5945a89c1198eb4849e58c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.064613 10370 raft_consensus.cc:385] T 3680db3f1a5945a89c1198eb4849e58c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.064666 10370 raft_consensus.cc:740] T 3680db3f1a5945a89c1198eb4849e58c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.066967 9907 tablet_service.cc:1511] Processing CreateTablet for tablet a4d3e5bede514d429608f8e43bee9a5c (DEFAULT_TABLE table=default.Table_1c7511005f554782a856d4660f40280b [id=fa524fa0a08c4762b53ab1a222f48f6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.067356 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4d3e5bede514d429608f8e43bee9a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.067766 10367 tablet_bootstrap.cc:492] T b3754889e4574fc3a936ac31cc6f496a P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:15.068912 12993 raft_consensus.cc:697] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:15.069298 12993 consensus_queue.cc:237] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.070518 10366 tablet_bootstrap.cc:492] T 81aabb5656e7472f9223fd7acf10e43c P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:15.072028 10366 tablet_bootstrap.cc:654] T 81aabb5656e7472f9223fd7acf10e43c P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.076632 10125 tablet_service.cc:1511] Processing CreateTablet for tablet d57a9b101e7d4399801a532482087649 (DEFAULT_TABLE table=default.Table_4d54510e39fe48b4bb48143495ed1f11 [id=beacc79f136b438bb4503239d89279ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.077144 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d57a9b101e7d4399801a532482087649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.078050 12266 ts_tablet_manager.cc:1929] T 749cea5cd8f842b891f4e2cab07c054e P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:15.083673 10370 consensus_queue.cc:260] T 3680db3f1a5945a89c1198eb4849e58c P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.084573 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2c8d0fdfa727465cb881c0d8ceaf26e2" } new_table_name: "default.Table_7a2591399bb84c54a45c5b7b5bf1e3d2" modify_external_catalogs: true
I20260810 19:48:15.086000 10375 ts_tablet_manager.cc:1929] T 81aabb5656e7472f9223fd7acf10e43c P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:15.086126 10375 log.cc:1199] T 81aabb5656e7472f9223fd7acf10e43c P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/81aabb5656e7472f9223fd7acf10e43c
I20260810 19:48:15.086506 10375 ts_tablet_manager.cc:1950] T 81aabb5656e7472f9223fd7acf10e43c P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:15.087620 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 81aabb5656e7472f9223fd7acf10e43c (table default.Table_3c331b2bd94d4303a3de78c1369771bc [id=f9a169cfd328466b908bc057a70a9668]) successfully deleted
I20260810 19:48:15.087965 10375 tablet_replica.cc:333] T 444b49a69c8245b6944a76d53041154c P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:15.088215 10375 raft_consensus.cc:2243] T 444b49a69c8245b6944a76d53041154c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:15.088435 10375 raft_consensus.cc:2272] T 444b49a69c8245b6944a76d53041154c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:15.089049 10375 ts_tablet_manager.cc:1916] T 444b49a69c8245b6944a76d53041154c P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:15.078428 10367 tablet_bootstrap.cc:654] T b3754889e4574fc3a936ac31cc6f496a P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.087373 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 90da240ef084465a980536035a326f83 (DEFAULT_TABLE table=default.Table_1c8f04aee36e49eaaac50ad68deb2303 [id=e8cf6f98fc554ad79fb4333be8f5ddb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.092819 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90da240ef084465a980536035a326f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.094870 12266 log.cc:1199] T 749cea5cd8f842b891f4e2cab07c054e P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/749cea5cd8f842b891f4e2cab07c054e
I20260810 19:48:15.095738 12266 ts_tablet_manager.cc:1950] T 749cea5cd8f842b891f4e2cab07c054e P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:15.087967 9655 tablet_service.cc:1511] Processing CreateTablet for tablet 71cebde162ad406b88f12fc1a313affe (DEFAULT_TABLE table=default.Table_ecfd2b6f417644beb5f796aa15a3fa13 [id=9033c9515f344ce98049a6a57c4660c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.097236 9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71cebde162ad406b88f12fc1a313affe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.098690 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 2f3d9408288f47aaaa384428c94a73b0
I20260810 19:48:15.100739 9665 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f3d9408288f47aaaa384428c94a73b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:15.103801 9901 tablet_service.cc:1558] Processing DeleteTablet for tablet 444b49a69c8245b6944a76d53041154c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:15.104372 9408 catalog_manager.cc:5719] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195). New cstate: current_term: 1 leader_uuid: "eadde59fd6504d679e47f03a60c64bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: HEALTHY } } }
I20260810 19:48:15.105527 10367 tablet_bootstrap.cc:492] T b3754889e4574fc3a936ac31cc6f496a P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:15.105723 10367 ts_tablet_manager.cc:1403] T b3754889e4574fc3a936ac31cc6f496a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.038s user 0.007s sys 0.001s
I20260810 19:48:15.106613 10367 raft_consensus.cc:359] T b3754889e4574fc3a936ac31cc6f496a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.106885 10367 raft_consensus.cc:385] T b3754889e4574fc3a936ac31cc6f496a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.107000 10367 raft_consensus.cc:740] T b3754889e4574fc3a936ac31cc6f496a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.107329 10367 consensus_queue.cc:260] T b3754889e4574fc3a936ac31cc6f496a P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.120221 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1111) took 1384 ms. Trace:
I20260810 19:48:15.120381 12266 rpcz_store.cc:276] 0810 19:48:13.735774 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.735907 (+ 133us) service_pool.cc:224] Handling call
0810 19:48:15.013196 (+1277289us) ts_tablet_manager.cc:1151] Deleting tablet 749cea5cd8f842b891f4e2cab07c054e
0810 19:48:15.013205 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.075121 (+ 61916us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:15.077988 (+ 2867us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:15.120190 (+ 42202us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1277070}
I20260810 19:48:15.121243 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1112) took 1355 ms. Trace:
I20260810 19:48:15.121332 12266 rpcz_store.cc:276] 0810 19:48:13.765877 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.766792 (+ 915us) service_pool.cc:224] Handling call
0810 19:48:15.120838 (+1354046us) ts_tablet_manager.cc:1151] Deleting tablet 8ab74d7fd2fe485d935aef4076382add
0810 19:48:15.120849 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.121219 (+ 370us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1353830}
I20260810 19:48:15.121855 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1119) took 1241 ms. Trace:
I20260810 19:48:15.121929 12266 rpcz_store.cc:276] 0810 19:48:13.880451 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.880519 (+ 68us) service_pool.cc:224] Handling call
0810 19:48:15.121733 (+1241214us) ts_tablet_manager.cc:1151] Deleting tablet fb9950c69605416e9e784b41ed77f9cf
0810 19:48:15.121743 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.121837 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1215553}
I20260810 19:48:15.122452 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1122) took 1167 ms. Trace:
I20260810 19:48:15.122538 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 749cea5cd8f842b891f4e2cab07c054e (table default.Table_eac904f0d8d945b3ab2e659358f3a485 [id=d319e3ece21e44b1860258156ffa0f72]) successfully deleted
I20260810 19:48:15.122526 12266 rpcz_store.cc:276] 0810 19:48:13.955471 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.958394 (+ 2923us) service_pool.cc:224] Handling call
0810 19:48:15.122274 (+1163880us) ts_tablet_manager.cc:1151] Deleting tablet a7770d570b6b4ee487309785581af219
0810 19:48:15.122286 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.122436 (+ 150us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1163529}
W20260810 19:48:15.122800 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 8ab74d7fd2fe485d935aef4076382add because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ab74d7fd2fe485d935aef4076382add already in progress: creating tablet
I20260810 19:48:15.122967 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1124) took 1153 ms. Trace:
W20260810 19:48:15.123049 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet fb9950c69605416e9e784b41ed77f9cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb9950c69605416e9e784b41ed77f9cf already in progress: creating tablet
I20260810 19:48:15.123030 12266 rpcz_store.cc:276] 0810 19:48:13.969262 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.969344 (+ 82us) service_pool.cc:224] Handling call
0810 19:48:15.122863 (+1153519us) ts_tablet_manager.cc:1151] Deleting tablet 9b5b21bff7634b1dbb6dfe1f4a85ce23
0810 19:48:15.122873 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.122949 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1153288}
W20260810 19:48:15.123382 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet a7770d570b6b4ee487309785581af219 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7770d570b6b4ee487309785581af219 already in progress: creating tablet
I20260810 19:48:15.123548 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1129) took 1108 ms. Trace:
W20260810 19:48:15.123623 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 9b5b21bff7634b1dbb6dfe1f4a85ce23 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b5b21bff7634b1dbb6dfe1f4a85ce23 already in progress: creating tablet
I20260810 19:48:15.123624 12266 rpcz_store.cc:276] 0810 19:48:14.014609 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:14.014659 (+ 50us) service_pool.cc:224] Handling call
0810 19:48:15.123445 (+1108786us) ts_tablet_manager.cc:1151] Deleting tablet e3f04460d9cc440580e9a7f4ec56bf40
0810 19:48:15.123454 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.123532 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1108581}
I20260810 19:48:15.124064 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1128) took 1109 ms. Trace:
I20260810 19:48:15.124140 12266 rpcz_store.cc:276] 0810 19:48:14.014505 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:14.019131 (+ 4626us) service_pool.cc:224] Handling call
0810 19:48:15.123961 (+1104830us) ts_tablet_manager.cc:1151] Deleting tablet 3ddc1bc292a243338235ea1396cc08f8
0810 19:48:15.123970 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.124048 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1104644}
I20260810 19:48:15.124428 13019 raft_consensus.cc:493] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:15.124545 12266 tablet_replica.cc:333] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:15.124558 13019 raft_consensus.cc:515] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.124763 12266 raft_consensus.cc:2243] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 19:48:15.124786 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet e3f04460d9cc440580e9a7f4ec56bf40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e3f04460d9cc440580e9a7f4ec56bf40 already in progress: creating tablet
I20260810 19:48:15.124953 12266 raft_consensus.cc:2272] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:15.125012 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 3ddc1bc292a243338235ea1396cc08f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ddc1bc292a243338235ea1396cc08f8 already in progress: creating tablet
I20260810 19:48:15.125260 13019 leader_election.cc:290] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:15.125556 12266 ts_tablet_manager.cc:1916] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:15.126384 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ed05a1eb4a4f6e9a7284caaa0bba05" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:15.126791 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 95905d5c18b94759893f6caada96e79e
W20260810 19:48:15.127458 9611 leader_election.cc:343] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:15.129874 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_75d30ea8a4b04e43831658c263cbc3f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:15.130116 10367 ts_tablet_manager.cc:1434] T b3754889e4574fc3a936ac31cc6f496a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260810 19:48:15.132664 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3653184e2aa24b82b6fc81998fd83734"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:15.133203 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3653184e2aa24b82b6fc81998fd83734 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:15.134495 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 71cebde162ad406b88f12fc1a313affe (DEFAULT_TABLE table=default.Table_ecfd2b6f417644beb5f796aa15a3fa13 [id=9033c9515f344ce98049a6a57c4660c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.134966 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71cebde162ad406b88f12fc1a313affe. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:15.138047 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75d30ea8a4b04e43831658c263cbc3f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:15.138819 13019 raft_consensus.cc:493] T fafad8559b074dab958f03061e65b8c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:15.138978 13019 raft_consensus.cc:515] T fafad8559b074dab958f03061e65b8c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.139667 13019 leader_election.cc:290] T fafad8559b074dab958f03061e65b8c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:15.141031 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fafad8559b074dab958f03061e65b8c3" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:15.142091 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet b3754889e4574fc3a936ac31cc6f496a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:15.142547 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 67a4f4920d4f4423bf1961a48ebb6d21 (DEFAULT_TABLE table=default.Table_55f86ee6a029499f9f22fc17edfb7ffa [id=9e36f6fc292e421580254b51023a731d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:15.142709 9611 leader_election.cc:343] T fafad8559b074dab958f03061e65b8c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:15.142970 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a4f4920d4f4423bf1961a48ebb6d21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.143266 9657 tablet_service.cc:1511] Processing CreateTablet for tablet e7ed638766d2499099fc7407e223a850 (DEFAULT_TABLE table=default.Table_f85c03bf4ccd4433987a0f0c36dc6f51 [id=d8b6d48c51fb428bb699893cdc2d153f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.143457 10377 ts_tablet_manager.cc:1929] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:15.143571 10377 log.cc:1199] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/18cd8adaa065425c846bc791c05fa67d
I20260810 19:48:15.143622 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ed638766d2499099fc7407e223a850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.145056 9894 tablet_service.cc:1511] Processing CreateTablet for tablet e7ed638766d2499099fc7407e223a850 (DEFAULT_TABLE table=default.Table_f85c03bf4ccd4433987a0f0c36dc6f51 [id=d8b6d48c51fb428bb699893cdc2d153f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.145190 9904 tablet_service.cc:1511] Processing CreateTablet for tablet af1d322a56d0462fa795b98fbed5d07f (DEFAULT_TABLE table=default.Table_a1645668cf79415ca029a01169fbf874 [id=aec405416e584af6bfb8194b357d6dbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.145408 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ed638766d2499099fc7407e223a850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.145573 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af1d322a56d0462fa795b98fbed5d07f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.146883 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet 95905d5c18b94759893f6caada96e79e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:15.147275 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 53a7a1f89a6f47078b1bacf47ffc88d0 (DEFAULT_TABLE table=default.Table_17d44a33a01d4be38948cce627bb4baf [id=cf8920e0b1644884a93be6bff96beb1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.147667 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53a7a1f89a6f47078b1bacf47ffc88d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.150612 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 67a4f4920d4f4423bf1961a48ebb6d21 (DEFAULT_TABLE table=default.Table_55f86ee6a029499f9f22fc17edfb7ffa [id=9e36f6fc292e421580254b51023a731d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.151000 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a4f4920d4f4423bf1961a48ebb6d21. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:15.151050 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8857aaeb0e3442ec98738f46f3a63442 consensus state has no leader
I20260810 19:48:15.153038 13019 raft_consensus.cc:493] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:15.153168 13019 raft_consensus.cc:515] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.153779 13019 leader_election.cc:290] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:15.154649 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66acbafdcc8540368693c8f463b41752" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:15.154598 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_733643d1126149498dc7b97d8549fc5c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:15.154862 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66acbafdcc8540368693c8f463b41752" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:15.155211 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_733643d1126149498dc7b97d8549fc5c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:15.155874 9611 leader_election.cc:343] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:15.156083 9611 leader_election.cc:343] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:15.156153 9611 leader_election.cc:304] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:15.156770 13019 raft_consensus.cc:2749] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:15.094090 10370 ts_tablet_manager.cc:1434] T 3680db3f1a5945a89c1198eb4849e58c P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.030s user 0.001s sys 0.001s
I20260810 19:48:15.102648 10139 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f3d9408288f47aaaa384428c94a73b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:15.157608 9655 tablet_service.cc:1511] Processing CreateTablet for tablet af1d322a56d0462fa795b98fbed5d07f (DEFAULT_TABLE table=default.Table_a1645668cf79415ca029a01169fbf874 [id=aec405416e584af6bfb8194b357d6dbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.157946 10377 ts_tablet_manager.cc:1950] T 18cd8adaa065425c846bc791c05fa67d P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:15.158025 9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af1d322a56d0462fa795b98fbed5d07f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.158774 10370 tablet_bootstrap.cc:492] T 253f302c00cc42ff84076b0c17f7670a P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:15.159439 9901 tablet_service.cc:1558] Processing DeleteTablet for tablet 95905d5c18b94759893f6caada96e79e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:15.159754 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1123) took 2024 ms. Trace:
I20260810 19:48:15.159862 10377 rpcz_store.cc:276] 0810 19:48:13.135431 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.135494 (+ 63us) service_pool.cc:224] Handling call
0810 19:48:14.518849 (+1383355us) ts_tablet_manager.cc:1151] Deleting tablet 18cd8adaa065425c846bc791c05fa67d
0810 19:48:14.518861 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:14.998835 (+479974us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:15.143391 (+144556us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:15.159728 (+ 16337us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1383151}
I20260810 19:48:15.160220 10377 tablet_replica.cc:333] T 8fce298689e9415a8860b8734d73b10a P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:15.160478 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 18cd8adaa065425c846bc791c05fa67d (table default.Table_a1645668cf79415ca029a01169fbf874 [id=aec405416e584af6bfb8194b357d6dbc]) successfully deleted
I20260810 19:48:15.160583 10370 tablet_bootstrap.cc:654] T 253f302c00cc42ff84076b0c17f7670a P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.162467 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet 95905d5c18b94759893f6caada96e79e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:15.105017 10140 tablet_service.cc:1511] Processing CreateTablet for tablet 71cebde162ad406b88f12fc1a313affe (DEFAULT_TABLE table=default.Table_ecfd2b6f417644beb5f796aa15a3fa13 [id=9033c9515f344ce98049a6a57c4660c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.164579 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71cebde162ad406b88f12fc1a313affe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.167652 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet ea9408ecf3784a80ac0c064e1689d25e
I20260810 19:48:15.106712 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 90da240ef084465a980536035a326f83 (DEFAULT_TABLE table=default.Table_1c8f04aee36e49eaaac50ad68deb2303 [id=e8cf6f98fc554ad79fb4333be8f5ddb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.168170 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90da240ef084465a980536035a326f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.168269 9421 master_service.cc:960] ReplaceTablet: received request to replace tablet c8311ccef92c48b2a94bbb9e9262ea9d from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:15.168833 12266 ts_tablet_manager.cc:1929] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:15.168963 12266 log.cc:1199] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/9a13b0f5b6b14bb9b72740a8521e4ea5
I20260810 19:48:15.169333 12266 ts_tablet_manager.cc:1950] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:15.169824 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet ea9408ecf3784a80ac0c064e1689d25e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:15.170356 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 372cf2e53aa64c65baa384e047a2a973 (DEFAULT_TABLE table=default.Table_2b4a171707e745c0b06d669df83755fe [id=d7336827451d418cb9b85848d42dee69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.171963 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet ea9408ecf3784a80ac0c064e1689d25e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:15.172943 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 372cf2e53aa64c65baa384e047a2a973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.107882 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 53a7a1f89a6f47078b1bacf47ffc88d0 (DEFAULT_TABLE table=default.Table_17d44a33a01d4be38948cce627bb4baf [id=cf8920e0b1644884a93be6bff96beb1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.128248 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ed05a1eb4a4f6e9a7284caaa0bba05" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:15.140497 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fafad8559b074dab958f03061e65b8c3" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:15.140981 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 67a4f4920d4f4423bf1961a48ebb6d21 (DEFAULT_TABLE table=default.Table_55f86ee6a029499f9f22fc17edfb7ffa [id=9e36f6fc292e421580254b51023a731d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.175046 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a4f4920d4f4423bf1961a48ebb6d21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.175660 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53a7a1f89a6f47078b1bacf47ffc88d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.176756 12993 raft_consensus.cc:493] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:15.176900 12993 raft_consensus.cc:515] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.177593 12993 leader_election.cc:290] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:15.172482 10367 tablet_bootstrap.cc:492] T 7add2dae2d1b4e8b9b95348e0334ba03 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
W20260810 19:48:15.175298 9611 leader_election.cc:343] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:15.178489 9611 leader_election.cc:304] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:15.178817 10377 raft_consensus.cc:2243] T 8fce298689e9415a8860b8734d73b10a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 19:48:15.178896 10068 leader_election.cc:343] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 6ea318eddd8349a79d27ce5746f03798
W20260810 19:48:15.178932 9611 leader_election.cc:343] T fafad8559b074dab958f03061e65b8c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:15.179006 10377 raft_consensus.cc:2272] T 8fce298689e9415a8860b8734d73b10a P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:15.179024 9611 leader_election.cc:304] T fafad8559b074dab958f03061e65b8c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:15.179503 13019 raft_consensus.cc:2749] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:15.179593 10377 ts_tablet_manager.cc:1916] T 8fce298689e9415a8860b8734d73b10a P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:15.179661 13019 raft_consensus.cc:2749] T fafad8559b074dab958f03061e65b8c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:15.141546 10145 tablet_service.cc:1511] Processing CreateTablet for tablet e7ed638766d2499099fc7407e223a850 (DEFAULT_TABLE table=default.Table_f85c03bf4ccd4433987a0f0c36dc6f51 [id=d8b6d48c51fb428bb699893cdc2d153f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.142258 10135 tablet_service.cc:1511] Processing CreateTablet for tablet af1d322a56d0462fa795b98fbed5d07f (DEFAULT_TABLE table=default.Table_a1645668cf79415ca029a01169fbf874 [id=aec405416e584af6bfb8194b357d6dbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.182425 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af1d322a56d0462fa795b98fbed5d07f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.183928 10367 tablet_bootstrap.cc:654] T 7add2dae2d1b4e8b9b95348e0334ba03 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.185261 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 18880c0c1717411181a457f1f75e1118
I20260810 19:48:15.188565 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ed638766d2499099fc7407e223a850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.188796 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet 18880c0c1717411181a457f1f75e1118 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:15.191321 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_97732b9bdb164afca8b82bedc2afb5b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:15.191908 9830 consensus_peers.cc:597] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a13b0f5b6b14bb9b72740a8521e4ea5. This is attempt 1: this message will repeat every 5th retry.
W20260810 19:48:15.192001 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97732b9bdb164afca8b82bedc2afb5b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:15.194092 10367 tablet_bootstrap.cc:492] T 7add2dae2d1b4e8b9b95348e0334ba03 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:15.162734 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f3d9408288f47aaaa384428c94a73b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:15.163111 9885 tablet_service.cc:1511] Processing CreateTablet for tablet 90da240ef084465a980536035a326f83 (DEFAULT_TABLE table=default.Table_1c8f04aee36e49eaaac50ad68deb2303 [id=e8cf6f98fc554ad79fb4333be8f5ddb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.194931 9885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90da240ef084465a980536035a326f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.195662 10367 ts_tablet_manager.cc:1403] T 7add2dae2d1b4e8b9b95348e0334ba03 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.003s
I20260810 19:48:15.198482 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet ea9408ecf3784a80ac0c064e1689d25e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:15.170857 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 53a7a1f89a6f47078b1bacf47ffc88d0 (DEFAULT_TABLE table=default.Table_17d44a33a01d4be38948cce627bb4baf [id=cf8920e0b1644884a93be6bff96beb1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.178195 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea318eddd8349a79d27ce5746f03798" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:15.198899 9931 raft_consensus.cc:2468] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:15.199405 10067 leader_election.cc:304] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:15.199994 12993 raft_consensus.cc:2804] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:15.200110 12993 raft_consensus.cc:493] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:15.200265 12993 raft_consensus.cc:3060] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:15.200930 9897 tablet_service.cc:1558] Processing DeleteTablet for tablet 18880c0c1717411181a457f1f75e1118 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:15.206986 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6ef0f4509bd34a60864bfd0c5b66a082" } new_table_name: "default.Table_d60b140f2ada47759b398feee8725b09" modify_external_catalogs: true
I20260810 19:48:15.207896 9897 tablet_service.cc:1511] Processing CreateTablet for tablet 372cf2e53aa64c65baa384e047a2a973 (DEFAULT_TABLE table=default.Table_2b4a171707e745c0b06d669df83755fe [id=d7336827451d418cb9b85848d42dee69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.208313 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 372cf2e53aa64c65baa384e047a2a973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.211128 12993 raft_consensus.cc:515] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.212550 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea318eddd8349a79d27ce5746f03798" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:15.212767 9931 raft_consensus.cc:3060] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:15.212884 10068 leader_election.cc:343] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 6ea318eddd8349a79d27ce5746f03798
I20260810 19:48:15.215142 10140 tablet_service.cc:1511] Processing CreateTablet for tablet 372cf2e53aa64c65baa384e047a2a973 (DEFAULT_TABLE table=default.Table_2b4a171707e745c0b06d669df83755fe [id=d7336827451d418cb9b85848d42dee69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.215641 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 372cf2e53aa64c65baa384e047a2a973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.215745 9931 raft_consensus.cc:2468] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:15.216361 10067 leader_election.cc:304] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:15.216749 13145 raft_consensus.cc:2804] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:15.216878 13145 raft_consensus.cc:697] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:15.217154 13145 consensus_queue.cc:237] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.220031 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet f864e82e2aa843ed867c6b95da2127ed
I20260810 19:48:15.220957 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet f864e82e2aa843ed867c6b95da2127ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:15 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:15.225636 12993 leader_election.cc:290] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:15.225826 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet f864e82e2aa843ed867c6b95da2127ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:15 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:15.227288 10366 tablet_bootstrap.cc:492] T 81aabb5656e7472f9223fd7acf10e43c P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:15.227569 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_116d1fd5c78f43bc829d4ac9875d2583" } new_table_name: "default.Table_d29e9a9dd94f48d5bae5e17c3e706428" modify_external_catalogs: true
I20260810 19:48:15.227751 10125 tablet_service.cc:1511] Processing CreateTablet for tablet f5b65c8a84b44b94896c62115144d386 (DEFAULT_TABLE table=default.Table_4a7879b46d414ea78cd53eede045fce1 [id=d95503fa9a7d4f14939e64b9a2057f27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.228241 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b65c8a84b44b94896c62115144d386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.230504 10366 ts_tablet_manager.cc:1403] T 81aabb5656e7472f9223fd7acf10e43c P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.163s user 0.000s sys 0.006s
I20260810 19:48:15.233844 10370 tablet_bootstrap.cc:492] T 253f302c00cc42ff84076b0c17f7670a P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:15.234894 10366 raft_consensus.cc:359] T 81aabb5656e7472f9223fd7acf10e43c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.238966 10370 ts_tablet_manager.cc:1403] T 253f302c00cc42ff84076b0c17f7670a P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.080s user 0.002s sys 0.002s
I20260810 19:48:15.240159 10370 raft_consensus.cc:359] T 253f302c00cc42ff84076b0c17f7670a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.241906 9681 tablet_service.cc:1511] Processing CreateTablet for tablet f5b65c8a84b44b94896c62115144d386 (DEFAULT_TABLE table=default.Table_4a7879b46d414ea78cd53eede045fce1 [id=d95503fa9a7d4f14939e64b9a2057f27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.242390 10366 raft_consensus.cc:385] T 81aabb5656e7472f9223fd7acf10e43c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.242506 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b65c8a84b44b94896c62115144d386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.242723 10366 raft_consensus.cc:740] T 81aabb5656e7472f9223fd7acf10e43c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.232892 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53a7a1f89a6f47078b1bacf47ffc88d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.238436 9892 tablet_service.cc:1511] Processing CreateTablet for tablet f5b65c8a84b44b94896c62115144d386 (DEFAULT_TABLE table=default.Table_4a7879b46d414ea78cd53eede045fce1 [id=d95503fa9a7d4f14939e64b9a2057f27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.239480 9894 tablet_service.cc:1511] Processing CreateTablet for tablet 0a3a9f1729c848d59ad6cc6a056b882b (DEFAULT_TABLE table=default.Table_4e0b9ea93b4e4164a3580c481782f8f4 [id=684a4fd9a0674c9ab382b116e5849fff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.244663 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3a9f1729c848d59ad6cc6a056b882b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.246691 9901 tablet_service.cc:1511] Processing CreateTablet for tablet e785857b6be84721b286398f627dc9a0 (DEFAULT_TABLE table=default.Table_fdb9a22aaf1046c7b949a64abb7f2fd5 [id=91410b334d9f46fc8794de0b13863d18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.247108 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e785857b6be84721b286398f627dc9a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.250385 9655 tablet_service.cc:1511] Processing CreateTablet for tablet e785857b6be84721b286398f627dc9a0 (DEFAULT_TABLE table=default.Table_fdb9a22aaf1046c7b949a64abb7f2fd5 [id=91410b334d9f46fc8794de0b13863d18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.250820 9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e785857b6be84721b286398f627dc9a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.250736 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 0a3a9f1729c848d59ad6cc6a056b882b (DEFAULT_TABLE table=default.Table_4e0b9ea93b4e4164a3580c481782f8f4 [id=684a4fd9a0674c9ab382b116e5849fff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.251118 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3a9f1729c848d59ad6cc6a056b882b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.254096 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b65c8a84b44b94896c62115144d386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.233057 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet f864e82e2aa843ed867c6b95da2127ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:15 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:15.261123 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_6d633a72880e44b6a591eeeb52f63d79"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:15.261879 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d633a72880e44b6a591eeeb52f63d79 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:15.262045 10366 consensus_queue.cc:260] T 81aabb5656e7472f9223fd7acf10e43c P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.266898 10366 ts_tablet_manager.cc:1434] T 81aabb5656e7472f9223fd7acf10e43c P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.033s user 0.002s sys 0.000s
I20260810 19:48:15.269719 9897 tablet_service.cc:1511] Processing CreateTablet for tablet 1c986592d4674930bd2900c30b84f0e1 (DEFAULT_TABLE table=default.Table_812e48be52f64234afba6d80c1738a56 [id=de7efde2ce384669aa1b5c938323669a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.270474 10370 raft_consensus.cc:385] T 253f302c00cc42ff84076b0c17f7670a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.270577 10370 raft_consensus.cc:740] T 253f302c00cc42ff84076b0c17f7670a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.242194 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet 18880c0c1717411181a457f1f75e1118 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:14 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:15.271238 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 1c986592d4674930bd2900c30b84f0e1 (DEFAULT_TABLE table=default.Table_812e48be52f64234afba6d80c1738a56 [id=de7efde2ce384669aa1b5c938323669a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.271752 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c986592d4674930bd2900c30b84f0e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.242530 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 0a3a9f1729c848d59ad6cc6a056b882b (DEFAULT_TABLE table=default.Table_4e0b9ea93b4e4164a3580c481782f8f4 [id=684a4fd9a0674c9ab382b116e5849fff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.278916 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3a9f1729c848d59ad6cc6a056b882b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:15.279579 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 60165d5c1664471fb665d1ed8bdda26d consensus state has no leader
I20260810 19:48:15.279855 9412 master_service.cc:960] ReplaceTablet: received request to replace tablet 5f9535152e6d45fa8ade32631b749678 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:15.267329 10140 tablet_service.cc:1511] Processing CreateTablet for tablet e785857b6be84721b286398f627dc9a0 (DEFAULT_TABLE table=default.Table_fdb9a22aaf1046c7b949a64abb7f2fd5 [id=91410b334d9f46fc8794de0b13863d18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.268554 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 1c986592d4674930bd2900c30b84f0e1 (DEFAULT_TABLE table=default.Table_812e48be52f64234afba6d80c1738a56 [id=de7efde2ce384669aa1b5c938323669a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.270879 10370 consensus_queue.cc:260] T 253f302c00cc42ff84076b0c17f7670a P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.286867 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c986592d4674930bd2900c30b84f0e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.287024 10370 ts_tablet_manager.cc:1434] T 253f302c00cc42ff84076b0c17f7670a P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.048s user 0.001s sys 0.001s
I20260810 19:48:15.287374 10370 tablet_bootstrap.cc:492] T d7595dbb46b6441dbb811611da116791 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:15.289145 10370 tablet_bootstrap.cc:654] T d7595dbb46b6441dbb811611da116791 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.290756 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e785857b6be84721b286398f627dc9a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.296025 10366 tablet_bootstrap.cc:492] T 253f302c00cc42ff84076b0c17f7670a P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:15.297755 10366 tablet_bootstrap.cc:654] T 253f302c00cc42ff84076b0c17f7670a P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.308470 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c986592d4674930bd2900c30b84f0e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.312952 10375 ts_tablet_manager.cc:1929] T 444b49a69c8245b6944a76d53041154c P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:15.313112 10375 log.cc:1199] T 444b49a69c8245b6944a76d53041154c P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/444b49a69c8245b6944a76d53041154c
I20260810 19:48:15.313441 10375 ts_tablet_manager.cc:1950] T 444b49a69c8245b6944a76d53041154c P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:15.317993 10370 tablet_bootstrap.cc:492] T d7595dbb46b6441dbb811611da116791 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:15.318173 10370 ts_tablet_manager.cc:1403] T d7595dbb46b6441dbb811611da116791 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.006s
I20260810 19:48:15.319064 10370 raft_consensus.cc:359] T d7595dbb46b6441dbb811611da116791 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.319278 10370 raft_consensus.cc:385] T d7595dbb46b6441dbb811611da116791 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.319334 10370 raft_consensus.cc:740] T d7595dbb46b6441dbb811611da116791 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.319643 10370 consensus_queue.cc:260] T d7595dbb46b6441dbb811611da116791 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.321645 10370 ts_tablet_manager.cc:1434] T d7595dbb46b6441dbb811611da116791 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:48:15.323145 10370 tablet_bootstrap.cc:492] T 99aa001db52149dd90ce86e7261f7424 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:15.323442 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_5910df4a049c4ae7a3f91a2b44614751" } new_table_name: "default.Table_0244c244fd7740cba3105e7c2d527b0d" modify_external_catalogs: true
I20260810 19:48:15.324965 10370 tablet_bootstrap.cc:654] T 99aa001db52149dd90ce86e7261f7424 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.332399 10377 ts_tablet_manager.cc:1929] T 8fce298689e9415a8860b8734d73b10a P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:15.332564 10377 log.cc:1199] T 8fce298689e9415a8860b8734d73b10a P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/8fce298689e9415a8860b8734d73b10a
I20260810 19:48:15.332903 10377 ts_tablet_manager.cc:1950] T 8fce298689e9415a8860b8734d73b10a P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:15.334507 10367 raft_consensus.cc:359] T 7add2dae2d1b4e8b9b95348e0334ba03 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.334673 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1125) took 2037 ms. Trace:
I20260810 19:48:15.334760 10367 raft_consensus.cc:385] T 7add2dae2d1b4e8b9b95348e0334ba03 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.334818 10367 raft_consensus.cc:740] T 7add2dae2d1b4e8b9b95348e0334ba03 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.334770 10377 rpcz_store.cc:276] 0810 19:48:13.297503 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.297563 (+ 60us) service_pool.cc:224] Handling call
0810 19:48:15.160168 (+1862605us) ts_tablet_manager.cc:1151] Deleting tablet 8fce298689e9415a8860b8734d73b10a
0810 19:48:15.160178 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.269891 (+109713us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:15.289718 (+ 19827us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:15.334647 (+ 44929us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1862385}
I20260810 19:48:15.335050 10367 consensus_queue.cc:260] T 7add2dae2d1b4e8b9b95348e0334ba03 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.335626 10367 ts_tablet_manager.cc:1434] T 7add2dae2d1b4e8b9b95348e0334ba03 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.140s user 0.002s sys 0.000s
I20260810 19:48:15.335961 10367 tablet_bootstrap.cc:492] T c9e2dbef6e7a48caa2964ab90fbf9b73 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:15.337831 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 8fce298689e9415a8860b8734d73b10a (table default.Table_987f321d06054ef782d6aa76b7be0ae9 [id=4c476fd4be224f719254ec5da0f5e2ee]) successfully deleted
I20260810 19:48:15.337939 10367 tablet_bootstrap.cc:654] T c9e2dbef6e7a48caa2964ab90fbf9b73 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.338353 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1126) took 1979 ms. Trace:
I20260810 19:48:15.338444 10377 rpcz_store.cc:276] 0810 19:48:13.358586 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.358896 (+ 310us) service_pool.cc:224] Handling call
0810 19:48:15.338155 (+1979259us) ts_tablet_manager.cc:1151] Deleting tablet f46571d9b4d948d3938607ebef926c40
0810 19:48:15.338171 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.338295 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1979062}
W20260810 19:48:15.338917 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet f46571d9b4d948d3938607ebef926c40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f46571d9b4d948d3938607ebef926c40 already in progress: creating tablet
I20260810 19:48:15.339318 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1127) took 1696 ms. Trace:
I20260810 19:48:15.339411 10377 rpcz_store.cc:276] 0810 19:48:13.643136 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.643195 (+ 59us) service_pool.cc:224] Handling call
0810 19:48:15.339188 (+1695993us) ts_tablet_manager.cc:1151] Deleting tablet 0b71af7492854f32b26887f8cbead122
0810 19:48:15.339200 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.339299 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1695775}
W20260810 19:48:15.339833 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 0b71af7492854f32b26887f8cbead122 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b71af7492854f32b26887f8cbead122 already in progress: creating tablet
I20260810 19:48:15.340266 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1128) took 1687 ms. Trace:
I20260810 19:48:15.340353 10377 rpcz_store.cc:276] 0810 19:48:13.653304 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.653367 (+ 63us) service_pool.cc:224] Handling call
0810 19:48:15.340141 (+1686774us) ts_tablet_manager.cc:1151] Deleting tablet 21041f65462744278244802ef867c2e9
0810 19:48:15.340152 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.340248 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1686548}
W20260810 19:48:15.340744 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 21041f65462744278244802ef867c2e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21041f65462744278244802ef867c2e9 already in progress: creating tablet
I20260810 19:48:15.340849 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 9a13b0f5b6b14bb9b72740a8521e4ea5 (table default.Table_0844c946c41146f38e51790cd8baed2a [id=4830b444314a4bb6a605cb73432e772f]) successfully deleted
I20260810 19:48:15.341560 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1129) took 1673 ms. Trace:
I20260810 19:48:15.341634 10377 rpcz_store.cc:276] 0810 19:48:13.668101 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.668161 (+ 60us) service_pool.cc:224] Handling call
0810 19:48:15.341449 (+1673288us) ts_tablet_manager.cc:1151] Deleting tablet 25570b1795164aeca86a5313bd30a4c9
0810 19:48:15.341459 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.341542 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1673090}
W20260810 19:48:15.342029 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 25570b1795164aeca86a5313bd30a4c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25570b1795164aeca86a5313bd30a4c9 already in progress: creating tablet
W20260810 19:48:15.342363 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 0ff798aa9ef5439bbfc2c1aa3b7eac6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ff798aa9ef5439bbfc2c1aa3b7eac6d already in progress: creating tablet
I20260810 19:48:15.346781 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1130) took 1677 ms. Trace:
I20260810 19:48:15.346879 10377 rpcz_store.cc:276] 0810 19:48:13.669376 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.669449 (+ 73us) service_pool.cc:224] Handling call
0810 19:48:15.346628 (+1677179us) ts_tablet_manager.cc:1151] Deleting tablet 3194d795b1ee4b17bd91c27bb6a86fb8
0810 19:48:15.346641 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.346750 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1676985}
W20260810 19:48:15.347368 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 3194d795b1ee4b17bd91c27bb6a86fb8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3194d795b1ee4b17bd91c27bb6a86fb8 already in progress: creating tablet
I20260810 19:48:15.348312 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1131) took 1665 ms. Trace:
I20260810 19:48:15.348408 10377 rpcz_store.cc:276] 0810 19:48:13.682987 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.683053 (+ 66us) service_pool.cc:224] Handling call
0810 19:48:15.348189 (+1665136us) ts_tablet_manager.cc:1151] Deleting tablet 5f593e2ff4ef467da4a1b2dacd17c899
0810 19:48:15.348200 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.348292 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1664645}
W20260810 19:48:15.348855 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 5f593e2ff4ef467da4a1b2dacd17c899 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f593e2ff4ef467da4a1b2dacd17c899 already in progress: creating tablet
I20260810 19:48:15.352468 12266 tablet_replica.cc:333] T 4bc41ad892a247848f5d2c1a0d3333ef P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:15.352710 12266 raft_consensus.cc:2243] T 4bc41ad892a247848f5d2c1a0d3333ef P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:15.352900 12266 raft_consensus.cc:2272] T 4bc41ad892a247848f5d2c1a0d3333ef P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:15.353250 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1132) took 1663 ms. Trace:
I20260810 19:48:15.353511 12266 ts_tablet_manager.cc:1916] T 4bc41ad892a247848f5d2c1a0d3333ef P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:15.353356 10377 rpcz_store.cc:276] 0810 19:48:13.690233 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.690296 (+ 63us) service_pool.cc:224] Handling call
0810 19:48:15.353122 (+1662826us) ts_tablet_manager.cc:1151] Deleting tablet 27c75f3340e24fe1a10de5bd6bcdfb2f
0810 19:48:15.353131 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.353228 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1662569}
W20260810 19:48:15.354890 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 27c75f3340e24fe1a10de5bd6bcdfb2f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 27c75f3340e24fe1a10de5bd6bcdfb2f already in progress: creating tablet
I20260810 19:48:15.355453 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1133) took 1655 ms. Trace:
I20260810 19:48:15.355927 10377 rpcz_store.cc:276] 0810 19:48:13.699627 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.700492 (+ 865us) service_pool.cc:224] Handling call
0810 19:48:15.355308 (+1654816us) ts_tablet_manager.cc:1151] Deleting tablet 684fd292f5ca4d0284a5036b039c640b
0810 19:48:15.355319 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.355431 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1654565}
W20260810 19:48:15.356822 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 684fd292f5ca4d0284a5036b039c640b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 684fd292f5ca4d0284a5036b039c640b already in progress: creating tablet
I20260810 19:48:15.357633 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1136) took 1592 ms. Trace:
I20260810 19:48:15.357646 10144 tablet_service.cc:1558] Processing DeleteTablet for tablet 253f302c00cc42ff84076b0c17f7670a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:15.358009 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 3680db3f1a5945a89c1198eb4849e58c with delete_type TABLET_DATA_DELETED (replaced by tablet 33f2ea0d46f44fca88e16ea83ad67bc2) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:15.358105 10377 rpcz_store.cc:276] 0810 19:48:13.765621 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.765900 (+ 279us) service_pool.cc:224] Handling call
0810 19:48:15.357469 (+1591569us) ts_tablet_manager.cc:1151] Deleting tablet 8ab74d7fd2fe485d935aef4076382add
0810 19:48:15.357482 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.357611 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1591338}
W20260810 19:48:15.358891 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 8ab74d7fd2fe485d935aef4076382add because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ab74d7fd2fe485d935aef4076382add already in progress: creating tablet
I20260810 19:48:15.359333 10377 tablet_replica.cc:333] T 1a393149727043f3a3c9f58aa051b065 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:15.359789 10377 raft_consensus.cc:2243] T 1a393149727043f3a3c9f58aa051b065 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:15.360255 10377 raft_consensus.cc:2272] T 1a393149727043f3a3c9f58aa051b065 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:15.361166 10377 ts_tablet_manager.cc:1916] T 1a393149727043f3a3c9f58aa051b065 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:15.362303 9407 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 85f1c7a75aac4d6a9462af4def91eaa4 (table default.Table_08c83fc388864b6f8a1ed597dc70bffe [id=2d55615cd797441c8abf6ea5a64f2f9f]). Expected version 1 got 0
I20260810 19:48:15.363817 10375 tablet_replica.cc:333] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:15.364053 10375 raft_consensus.cc:2243] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:15.364315 10375 pending_rounds.cc:70] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:15.358307 9885 tablet_service.cc:1558] Processing DeleteTablet for tablet 81aabb5656e7472f9223fd7acf10e43c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:15.364354 10375 pending_rounds.cc:77] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058745212493824 op_type: NO_OP noop_request { }
I20260810 19:48:15.365494 10375 raft_consensus.cc:2889] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:15.365602 10375 raft_consensus.cc:2272] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:15.367465 10366 tablet_bootstrap.cc:492] T 253f302c00cc42ff84076b0c17f7670a P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:15.368614 10366 ts_tablet_manager.cc:1403] T 253f302c00cc42ff84076b0c17f7670a P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.073s user 0.004s sys 0.000s
I20260810 19:48:15.369681 10366 raft_consensus.cc:359] T 253f302c00cc42ff84076b0c17f7670a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.370935 10366 raft_consensus.cc:385] T 253f302c00cc42ff84076b0c17f7670a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.371183 10366 raft_consensus.cc:740] T 253f302c00cc42ff84076b0c17f7670a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.371213 10375 ts_tablet_manager.cc:1916] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:15.371744 10366 consensus_queue.cc:260] T 253f302c00cc42ff84076b0c17f7670a P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.379315 10367 tablet_bootstrap.cc:492] T c9e2dbef6e7a48caa2964ab90fbf9b73 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:15.379505 10367 ts_tablet_manager.cc:1403] T c9e2dbef6e7a48caa2964ab90fbf9b73 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.044s user 0.000s sys 0.007s
I20260810 19:48:15.380277 10367 raft_consensus.cc:359] T c9e2dbef6e7a48caa2964ab90fbf9b73 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.380465 10367 raft_consensus.cc:385] T c9e2dbef6e7a48caa2964ab90fbf9b73 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.380515 10367 raft_consensus.cc:740] T c9e2dbef6e7a48caa2964ab90fbf9b73 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.380729 10367 consensus_queue.cc:260] T c9e2dbef6e7a48caa2964ab90fbf9b73 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.381445 10367 ts_tablet_manager.cc:1434] T c9e2dbef6e7a48caa2964ab90fbf9b73 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260810 19:48:15.383706 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 7add2dae2d1b4e8b9b95348e0334ba03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:59 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:15.385807 10366 ts_tablet_manager.cc:1434] T 253f302c00cc42ff84076b0c17f7670a P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260810 19:48:15.363754 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 444b49a69c8245b6944a76d53041154c (table default.Table_070cfe9bb949439ca652e166a5c0f63e [id=a16bb67de06846c38f490000206e507f]) successfully deleted
I20260810 19:48:15.378724 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a815f0b98f384b3c89974f65a73ed73f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:15.381986 9398 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 60165d5c1664471fb665d1ed8bdda26d (table default.Table_7a2591399bb84c54a45c5b7b5bf1e3d2 [id=001dab9496624153951d38cac8ade6d6], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 60165d5c1664471fb665d1ed8bdda26d consensus state has no leader
W20260810 19:48:15.388264 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a815f0b98f384b3c89974f65a73ed73f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:15.390905 10366 tablet_bootstrap.cc:492] T 3680db3f1a5945a89c1198eb4849e58c P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:15.394945 10366 tablet_bootstrap.cc:654] T 3680db3f1a5945a89c1198eb4849e58c P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.398864 10367 tablet_bootstrap.cc:492] T ea557438b7b74944b19e17d7fb8f20cf P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:15.404670 12266 ts_tablet_manager.cc:1929] T 4bc41ad892a247848f5d2c1a0d3333ef P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:15.404816 12266 log.cc:1199] T 4bc41ad892a247848f5d2c1a0d3333ef P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/4bc41ad892a247848f5d2c1a0d3333ef
I20260810 19:48:15.405140 12266 ts_tablet_manager.cc:1950] T 4bc41ad892a247848f5d2c1a0d3333ef P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:15.405944 10366 tablet_bootstrap.cc:492] T 3680db3f1a5945a89c1198eb4849e58c P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:15.406180 10366 ts_tablet_manager.cc:1403] T 3680db3f1a5945a89c1198eb4849e58c P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.000s
I20260810 19:48:15.406437 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 4bc41ad892a247848f5d2c1a0d3333ef (table default.Table_5566f9d152794e309dd817727a18e4cf [id=6aa7b61a3c6a419b8581e359ded42a50]) successfully deleted
I20260810 19:48:15.407039 10366 raft_consensus.cc:359] T 3680db3f1a5945a89c1198eb4849e58c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.407312 10366 raft_consensus.cc:385] T 3680db3f1a5945a89c1198eb4849e58c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.407447 10366 raft_consensus.cc:740] T 3680db3f1a5945a89c1198eb4849e58c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.407778 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet c9e2dbef6e7a48caa2964ab90fbf9b73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:15.407783 10366 consensus_queue.cc:260] T 3680db3f1a5945a89c1198eb4849e58c P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.418582 12266 tablet_replica.cc:333] T b54feebc7c9841d89808054602be7913 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:15.418891 12266 raft_consensus.cc:2243] T b54feebc7c9841d89808054602be7913 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:15.418910 13104 raft_consensus.cc:493] T 05059ef70a8e440ca2988bfeb610645d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:15.419111 12266 raft_consensus.cc:2272] T b54feebc7c9841d89808054602be7913 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:15.419104 13104 raft_consensus.cc:515] T 05059ef70a8e440ca2988bfeb610645d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.419767 12266 ts_tablet_manager.cc:1916] T b54feebc7c9841d89808054602be7913 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:15.419865 13104 leader_election.cc:290] T 05059ef70a8e440ca2988bfeb610645d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:15.421254 9830 leader_election.cc:343] T 05059ef70a8e440ca2988bfeb610645d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Not found: Tablet not found: 05059ef70a8e440ca2988bfeb610645d
I20260810 19:48:15.402272 10375 ts_tablet_manager.cc:1929] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:15.422533 10375 log.cc:1199] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/6ea318eddd8349a79d27ce5746f03798
W20260810 19:48:15.422590 9831 leader_election.cc:343] T 05059ef70a8e440ca2988bfeb610645d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 05059ef70a8e440ca2988bfeb610645d
I20260810 19:48:15.422724 9831 leader_election.cc:304] T 05059ef70a8e440ca2988bfeb610645d P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:15.423028 10375 ts_tablet_manager.cc:1950] T 6ea318eddd8349a79d27ce5746f03798 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:15.423175 13104 raft_consensus.cc:2749] T 05059ef70a8e440ca2988bfeb610645d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:15.424185 10375 tablet_replica.cc:333] T f6f9eb86c6c84b4a84d109d4741238e1 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:15.424398 10375 raft_consensus.cc:2243] T f6f9eb86c6c84b4a84d109d4741238e1 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:15.424571 10375 raft_consensus.cc:2272] T f6f9eb86c6c84b4a84d109d4741238e1 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:15.424687 10366 ts_tablet_manager.cc:1434] T 3680db3f1a5945a89c1198eb4849e58c P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260810 19:48:15.425181 10375 ts_tablet_manager.cc:1916] T f6f9eb86c6c84b4a84d109d4741238e1 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:15.425462 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 6ea318eddd8349a79d27ce5746f03798 (table default.Table_3d2a5a2863e24c4bb90af582b7f3a9bb [id=a8b0eeac86bf4ff5a8a71ca5432d07ec]) successfully deleted
I20260810 19:48:15.405593 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet d7595dbb46b6441dbb811611da116791 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:15.427470 10366 tablet_bootstrap.cc:492] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:15.429884 10366 tablet_bootstrap.cc:654] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.439247 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet 253f302c00cc42ff84076b0c17f7670a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:15.445494 10367 tablet_bootstrap.cc:654] T ea557438b7b74944b19e17d7fb8f20cf P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.447191 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet 3680db3f1a5945a89c1198eb4849e58c with delete_type TABLET_DATA_DELETED (replaced by tablet 33f2ea0d46f44fca88e16ea83ad67bc2) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:15.447961 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2b1699b3911947319e52307f4451f572"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:15.448865 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b1699b3911947319e52307f4451f572 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:15.450843 12266 ts_tablet_manager.cc:1929] T b54feebc7c9841d89808054602be7913 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:15.450996 12266 log.cc:1199] T b54feebc7c9841d89808054602be7913 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/b54feebc7c9841d89808054602be7913
I20260810 19:48:15.451340 12266 ts_tablet_manager.cc:1950] T b54feebc7c9841d89808054602be7913 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:15.452684 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet b54feebc7c9841d89808054602be7913 (table default.Table_a8eaabc9d0ef45729c9a7e9301083b99 [id=7dc6f3ec58a44497bab92e1853cdb894]) successfully deleted
I20260810 19:48:15.453155 10366 tablet_bootstrap.cc:492] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:15.453155 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9f15ead49f2144078612a81d1f03b63a" } modify_external_catalogs: true
I20260810 19:48:15.453378 10366 ts_tablet_manager.cc:1403] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.002s
I20260810 19:48:15.454196 10366 raft_consensus.cc:359] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.454257 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9f15ead49f2144078612a81d1f03b63a" } modify_external_catalogs: true
I20260810 19:48:15.454538 10366 raft_consensus.cc:385] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.455071 10366 raft_consensus.cc:740] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.455472 10366 consensus_queue.cc:260] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.460362 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet c8311ccef92c48b2a94bbb9e9262ea9d
I20260810 19:48:15.460984 9421 catalog_manager.cc:6807] ReplaceTablet: tablet c8311ccef92c48b2a94bbb9e9262ea9d deleted and replaced by tablet 6aca62e4566648cabfdae1c84246f230
I20260810 19:48:15.461665 10366 ts_tablet_manager.cc:1434] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260810 19:48:15.462105 10366 tablet_bootstrap.cc:492] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:15.462872 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet c8311ccef92c48b2a94bbb9e9262ea9d with delete_type TABLET_DATA_DELETED (replaced by tablet 6aca62e4566648cabfdae1c84246f230) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:15.463625 10367 tablet_bootstrap.cc:492] T ea557438b7b74944b19e17d7fb8f20cf P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:15.463783 10367 ts_tablet_manager.cc:1403] T ea557438b7b74944b19e17d7fb8f20cf P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.065s user 0.007s sys 0.003s
I20260810 19:48:15.464535 10367 raft_consensus.cc:359] T ea557438b7b74944b19e17d7fb8f20cf P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.464723 10367 raft_consensus.cc:385] T ea557438b7b74944b19e17d7fb8f20cf P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.464789 10367 raft_consensus.cc:740] T ea557438b7b74944b19e17d7fb8f20cf P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.464958 10366 tablet_bootstrap.cc:654] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.465034 10367 consensus_queue.cc:260] T ea557438b7b74944b19e17d7fb8f20cf P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.465592 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet c8311ccef92c48b2a94bbb9e9262ea9d with delete_type TABLET_DATA_DELETED (replaced by tablet 6aca62e4566648cabfdae1c84246f230) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:15.465484 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet c8311ccef92c48b2a94bbb9e9262ea9d with delete_type TABLET_DATA_DELETED (replaced by tablet 6aca62e4566648cabfdae1c84246f230) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:15.466643 10375 ts_tablet_manager.cc:1929] T f6f9eb86c6c84b4a84d109d4741238e1 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:15.466827 10375 log.cc:1199] T f6f9eb86c6c84b4a84d109d4741238e1 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/f6f9eb86c6c84b4a84d109d4741238e1
I20260810 19:48:15.467199 10375 ts_tablet_manager.cc:1950] T f6f9eb86c6c84b4a84d109d4741238e1 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:15.470584 10375 tablet_replica.cc:333] T 253f302c00cc42ff84076b0c17f7670a P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:15.472980 12266 tablet_replica.cc:333] T fafad8559b074dab958f03061e65b8c3 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
W20260810 19:48:15.475690 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet c0fc251932454c378f94cbfaa4955232 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0fc251932454c378f94cbfaa4955232 already in progress: creating tablet
W20260810 19:48:15.476027 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 4a7ca999f502495fbc56bb6fc4e5c711 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a7ca999f502495fbc56bb6fc4e5c711 already in progress: creating tablet
I20260810 19:48:15.476753 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet f6f9eb86c6c84b4a84d109d4741238e1 (table default.Table_3102211b2b544d6bae3547d4f9af2574 [id=c10c35b78ae24250a48631468376e8ea]) successfully deleted
W20260810 19:48:15.477003 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 0ff798aa9ef5439bbfc2c1aa3b7eac6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ff798aa9ef5439bbfc2c1aa3b7eac6d already in progress: creating tablet
W20260810 19:48:15.477190 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 4bc41ad892a247848f5d2c1a0d3333ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4bc41ad892a247848f5d2c1a0d3333ef already in progress: creating tablet
W20260810 19:48:15.477367 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet c0fc251932454c378f94cbfaa4955232 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0fc251932454c378f94cbfaa4955232 already in progress: creating tablet
W20260810 19:48:15.477551 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 4a7ca999f502495fbc56bb6fc4e5c711 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a7ca999f502495fbc56bb6fc4e5c711 already in progress: creating tablet
W20260810 19:48:15.477747 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 2f3d9408288f47aaaa384428c94a73b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f3d9408288f47aaaa384428c94a73b0 already in progress: creating tablet
W20260810 19:48:15.477945 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 95905d5c18b94759893f6caada96e79e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95905d5c18b94759893f6caada96e79e already in progress: creating tablet
W20260810 19:48:15.478171 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet ea9408ecf3784a80ac0c064e1689d25e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea9408ecf3784a80ac0c064e1689d25e already in progress: creating tablet
W20260810 19:48:15.478384 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet f864e82e2aa843ed867c6b95da2127ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f864e82e2aa843ed867c6b95da2127ed already in progress: creating tablet
W20260810 19:48:15.478615 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 18880c0c1717411181a457f1f75e1118 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18880c0c1717411181a457f1f75e1118 already in progress: creating tablet
I20260810 19:48:15.473377 10367 ts_tablet_manager.cc:1434] T ea557438b7b74944b19e17d7fb8f20cf P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260810 19:48:15.479843 10367 tablet_bootstrap.cc:492] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:15.482002 10367 tablet_bootstrap.cc:654] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.488207 13104 raft_consensus.cc:493] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:15.488411 13104 raft_consensus.cc:515] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.489069 13104 leader_election.cc:290] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:15.490863 13185 tablet.cc:1724] T 639c824ba4834734a4ebfd558181bebe P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260810 19:48:15.496248 9831 leader_election.cc:343] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: d7595dbb46b6441dbb811611da116791
I20260810 19:48:15.497316 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_94098d2314ef497c9b08deced9bed6ce" } modify_external_catalogs: true
I20260810 19:48:15.497524 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_94098d2314ef497c9b08deced9bed6ce" } modify_external_catalogs: true
I20260810 19:48:15.489885 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7595dbb46b6441dbb811611da116791" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:15.499068 10165 raft_consensus.cc:2468] T d7595dbb46b6441dbb811611da116791 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:15.499697 9830 leader_election.cc:304] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:15.498792 12266 raft_consensus.cc:2243] T fafad8559b074dab958f03061e65b8c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:15.500164 13104 raft_consensus.cc:2804] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:15.500190 12266 raft_consensus.cc:2272] T fafad8559b074dab958f03061e65b8c3 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:15.500247 13104 raft_consensus.cc:493] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:15.500308 13104 raft_consensus.cc:3060] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:15.500878 12266 ts_tablet_manager.cc:1916] T fafad8559b074dab958f03061e65b8c3 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:15.503048 13104 raft_consensus.cc:515] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:15.504992 9831 leader_election.cc:343] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: d7595dbb46b6441dbb811611da116791
I20260810 19:48:15.505901 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7595dbb46b6441dbb811611da116791" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:15.506120 10165 raft_consensus.cc:3060] T d7595dbb46b6441dbb811611da116791 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:15.506516 10375 raft_consensus.cc:2243] T 253f302c00cc42ff84076b0c17f7670a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:15.506702 10375 raft_consensus.cc:2272] T 253f302c00cc42ff84076b0c17f7670a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:15.507516 10375 ts_tablet_manager.cc:1916] T 253f302c00cc42ff84076b0c17f7670a P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:15.508983 10165 raft_consensus.cc:2468] T d7595dbb46b6441dbb811611da116791 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:15.509531 9830 leader_election.cc:304] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:15.509855 13041 raft_consensus.cc:2804] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:15.509917 13104 leader_election.cc:290] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:15.509984 13041 raft_consensus.cc:697] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:15.510231 13041 consensus_queue.cc:237] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.517436 10367 tablet_bootstrap.cc:492] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:15.517928 10370 tablet_bootstrap.cc:492] T 99aa001db52149dd90ce86e7261f7424 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:15.518136 10370 ts_tablet_manager.cc:1403] T 99aa001db52149dd90ce86e7261f7424 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.195s user 0.002s sys 0.030s
I20260810 19:48:15.518949 10370 raft_consensus.cc:359] T 99aa001db52149dd90ce86e7261f7424 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.519157 10370 raft_consensus.cc:385] T 99aa001db52149dd90ce86e7261f7424 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.519212 10370 raft_consensus.cc:740] T 99aa001db52149dd90ce86e7261f7424 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.519614 10370 consensus_queue.cc:260] T 99aa001db52149dd90ce86e7261f7424 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.519982 10367 ts_tablet_manager.cc:1403] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.002s
I20260810 19:48:15.521018 10367 raft_consensus.cc:359] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.522794 10370 ts_tablet_manager.cc:1434] T 99aa001db52149dd90ce86e7261f7424 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260810 19:48:15.523147 10370 tablet_bootstrap.cc:492] T f2606854f9954f2ea10610aeb1e60368 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:15.524930 10370 tablet_bootstrap.cc:654] T f2606854f9954f2ea10610aeb1e60368 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.530653 10367 raft_consensus.cc:385] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.531389 10367 raft_consensus.cc:740] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.531818 10367 consensus_queue.cc:260] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.537271 10367 ts_tablet_manager.cc:1434] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260810 19:48:15.542198 10367 tablet_bootstrap.cc:492] T 27aca44685be4a0b92767d13bad15daf P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:15.544236 10377 ts_tablet_manager.cc:1929] T 1a393149727043f3a3c9f58aa051b065 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:15.544489 10367 tablet_bootstrap.cc:654] T 27aca44685be4a0b92767d13bad15daf P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.550143 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet 99aa001db52149dd90ce86e7261f7424 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:05 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:15.548166 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet d7595dbb46b6441dbb811611da116791 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:12 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:15.551396 10377 log.cc:1199] T 1a393149727043f3a3c9f58aa051b065 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/1a393149727043f3a3c9f58aa051b065
I20260810 19:48:15.551748 10377 ts_tablet_manager.cc:1950] T 1a393149727043f3a3c9f58aa051b065 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:15.546249 12266 ts_tablet_manager.cc:1929] T fafad8559b074dab958f03061e65b8c3 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:15.547760 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet ea557438b7b74944b19e17d7fb8f20cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:02 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:15.552150 12266 log.cc:1199] T fafad8559b074dab958f03061e65b8c3 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/fafad8559b074dab958f03061e65b8c3
I20260810 19:48:15.552536 12266 ts_tablet_manager.cc:1950] T fafad8559b074dab958f03061e65b8c3 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:15.552604 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1146) took 1680 ms. Trace:
I20260810 19:48:15.552706 10377 rpcz_store.cc:276] 0810 19:48:13.871942 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.874394 (+ 2452us) service_pool.cc:224] Handling call
0810 19:48:15.359278 (+1484884us) ts_tablet_manager.cc:1151] Deleting tablet 1a393149727043f3a3c9f58aa051b065
0810 19:48:15.359289 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.373331 (+ 14042us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:15.544151 (+170820us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:15.552574 (+ 8423us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1484621}
I20260810 19:48:15.554039 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 1a393149727043f3a3c9f58aa051b065 (table default.Table_f752dd58f7fe415f85280cbb9adb306c [id=8f9c3952ab4b4930943001c3d43d6d7d]) successfully deleted
I20260810 19:48:15.555589 10375 ts_tablet_manager.cc:1929] T 253f302c00cc42ff84076b0c17f7670a P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:15.556965 10375 log.cc:1199] T 253f302c00cc42ff84076b0c17f7670a P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/253f302c00cc42ff84076b0c17f7670a
I20260810 19:48:15.558465 12266 tablet_replica.cc:333] T b8a7c2857add422281542e7f187979ab P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:15.558529 10375 ts_tablet_manager.cc:1950] T 253f302c00cc42ff84076b0c17f7670a P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:15.560621 12266 raft_consensus.cc:2243] T b8a7c2857add422281542e7f187979ab P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:15.556741 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet fafad8559b074dab958f03061e65b8c3 (table default.Table_31f5fbb1fbfc4d92a4e4ca2f2614be0b [id=b1c1f3f8b5a64a7597e09eaf29ee995f]) successfully deleted
I20260810 19:48:15.564544 9416 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 676004738985441985278313d6064530 (table default.Table_2d7f246476ac4544a3fa089ec3c52657 [id=c681008d2b5f43a9b7b6ed2d72653b1b]). Expected version 1 got 0
I20260810 19:48:15.565542 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 253f302c00cc42ff84076b0c17f7670a (table default.Table_ab79ddcb17e24ce7960c0c41dd451bc2 [id=9a73a382c71249058e61be3b0146826f]) successfully deleted
I20260810 19:48:15.566303 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1147) took 1683 ms. Trace:
I20260810 19:48:15.566556 10377 rpcz_store.cc:276] 0810 19:48:13.883296 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.884184 (+ 888us) service_pool.cc:224] Handling call
0810 19:48:15.566105 (+1681921us) ts_tablet_manager.cc:1151] Deleting tablet fb9950c69605416e9e784b41ed77f9cf
0810 19:48:15.566121 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.566269 (+ 148us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1681690}
W20260810 19:48:15.567219 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet fb9950c69605416e9e784b41ed77f9cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb9950c69605416e9e784b41ed77f9cf already in progress: creating tablet
I20260810 19:48:15.567675 10377 tablet_replica.cc:333] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:15.567946 10377 raft_consensus.cc:2243] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:15.562680 12266 raft_consensus.cc:2272] T b8a7c2857add422281542e7f187979ab P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:15.568037 13192 tablet.cc:1724] T 639c824ba4834734a4ebfd558181bebe P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:15.568995 12266 ts_tablet_manager.cc:1916] T b8a7c2857add422281542e7f187979ab P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:15.569290 10377 raft_consensus.cc:2272] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:15.565524 9416 catalog_manager.cc:5911] Failed to send AlterTable RPC for tablet 676004738985441985278313d6064530 (table default.Table_2d7f246476ac4544a3fa089ec3c52657 [id=c681008d2b5f43a9b7b6ed2d72653b1b], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 676004738985441985278313d6064530 consensus state has no leader
I20260810 19:48:15.570524 10375 tablet_replica.cc:333] T 3680db3f1a5945a89c1198eb4849e58c P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:15.570763 10375 raft_consensus.cc:2243] T 3680db3f1a5945a89c1198eb4849e58c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:15.570956 10375 raft_consensus.cc:2272] T 3680db3f1a5945a89c1198eb4849e58c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:15.570986 10377 ts_tablet_manager.cc:1916] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:15.571530 10375 ts_tablet_manager.cc:1916] T 3680db3f1a5945a89c1198eb4849e58c P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:15.581079 10367 tablet_bootstrap.cc:492] T 27aca44685be4a0b92767d13bad15daf P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:15.581362 10367 ts_tablet_manager.cc:1403] T 27aca44685be4a0b92767d13bad15daf P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.000s
I20260810 19:48:15.582242 10367 raft_consensus.cc:359] T 27aca44685be4a0b92767d13bad15daf P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.583609 10377 ts_tablet_manager.cc:1929] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:15.583806 10377 log.cc:1199] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/5654c48929564a96a55ed0444c9e1a04
W20260810 19:48:15.585162 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 23bcbfcab4a0409ebdcb75668c80ca54 has no consensus state
I20260810 19:48:15.585994 10367 raft_consensus.cc:385] T 27aca44685be4a0b92767d13bad15daf P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.586086 10367 raft_consensus.cc:740] T 27aca44685be4a0b92767d13bad15daf P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.587383 10370 tablet_bootstrap.cc:492] T f2606854f9954f2ea10610aeb1e60368 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:15.587549 10370 ts_tablet_manager.cc:1403] T f2606854f9954f2ea10610aeb1e60368 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.064s user 0.001s sys 0.003s
W20260810 19:48:15.588272 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 650ca46244e54bed89e96c4a09fc7a94 consensus state has no leader
I20260810 19:48:15.588724 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0c32faaf2cc249e5aeb42ca18ba243bd" } new_table_name: "default.Table_a1407136aca24e3b9219c694c0b5746f" modify_external_catalogs: true
I20260810 19:48:15.588967 10367 consensus_queue.cc:260] T 27aca44685be4a0b92767d13bad15daf P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.589275 9416 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet f3e3dde1c29e4275bafb27df63b117be (table default.Table_da45ba37a0804616b521723bc724e0f0 [id=d5afb5c8b2d042e5aec4a0721e2cae1d]). Expected version 1 got 0
I20260810 19:48:15.589576 10367 ts_tablet_manager.cc:1434] T 27aca44685be4a0b92767d13bad15daf P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260810 19:48:15.589799 9416 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 4571e0c723f74c828220b33116fed9e9 (table default.Table_d9d83336ef124c2da242e77391b001c0 [id=8dbf3227e8ae402aa46b9b31b715faa6]). Expected version 1 got 0
I20260810 19:48:15.590080 9416 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 85f1c7a75aac4d6a9462af4def91eaa4 (table default.Table_08c83fc388864b6f8a1ed597dc70bffe [id=2d55615cd797441c8abf6ea5a64f2f9f]). Expected version 1 got 0
I20260810 19:48:15.590271 9416 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 3840b035b88243ecad17865d4716fcfc (table default.Table_e1cc6dd116324bf385dbc82e56283cf7 [id=6bf4ac94189d476d9ab5778e69d0b14f]). Expected version 1 got 0
I20260810 19:48:15.592869 10377 ts_tablet_manager.cc:1950] T 5654c48929564a96a55ed0444c9e1a04 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:15.592872 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_968d4ecf85ff4060bb01bddd4d994029"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:15.593472 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_968d4ecf85ff4060bb01bddd4d994029 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:15.593842 10366 tablet_bootstrap.cc:492] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:15.593895 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1144) took 1722 ms. Trace:
I20260810 19:48:15.593981 10377 rpcz_store.cc:276] 0810 19:48:13.871661 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.887252 (+ 15591us) service_pool.cc:224] Handling call
0810 19:48:15.567615 (+1680363us) ts_tablet_manager.cc:1151] Deleting tablet 5654c48929564a96a55ed0444c9e1a04
0810 19:48:15.567627 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.580213 (+ 12586us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:15.583541 (+ 3328us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:15.593866 (+ 10325us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1670215}
I20260810 19:48:15.594485 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 5654c48929564a96a55ed0444c9e1a04 (table default.Table_f90f1a0c22fa4781812518f44c9d7b17 [id=d12cb82567fd409988672b04a2e05a5b]) successfully deleted
I20260810 19:48:15.594924 10377 tablet_replica.cc:333] T 64470598ccec45a7ae3e3c77fe4b9518 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:15.595013 13196 tablet.cc:1724] T 639c824ba4834734a4ebfd558181bebe P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:15.595173 10377 raft_consensus.cc:2243] T 64470598ccec45a7ae3e3c77fe4b9518 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:15.595356 10377 raft_consensus.cc:2272] T 64470598ccec45a7ae3e3c77fe4b9518 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:15.595788 10370 raft_consensus.cc:359] T f2606854f9954f2ea10610aeb1e60368 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.595927 10377 ts_tablet_manager.cc:1916] T 64470598ccec45a7ae3e3c77fe4b9518 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:15.596001 10370 raft_consensus.cc:385] T f2606854f9954f2ea10610aeb1e60368 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.596071 10370 raft_consensus.cc:740] T f2606854f9954f2ea10610aeb1e60368 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.596298 10370 consensus_queue.cc:260] T f2606854f9954f2ea10610aeb1e60368 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.596802 10370 ts_tablet_manager.cc:1434] T f2606854f9954f2ea10610aeb1e60368 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.009s user 0.000s sys 0.001s
I20260810 19:48:15.598498 10370 tablet_bootstrap.cc:492] T 5e47086440ef4a249f1eed23db655879 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:15.593976 10366 ts_tablet_manager.cc:1403] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.132s user 0.016s sys 0.006s
I20260810 19:48:15.600093 10370 tablet_bootstrap.cc:654] T 5e47086440ef4a249f1eed23db655879 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.600690 10366 raft_consensus.cc:359] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.600872 10366 raft_consensus.cc:385] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.600924 10366 raft_consensus.cc:740] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.601147 10366 consensus_queue.cc:260] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.604310 10367 tablet_bootstrap.cc:492] T f42e9b00e3da4d73b4beb1b325f09f4a P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:15.606268 10367 tablet_bootstrap.cc:654] T f42e9b00e3da4d73b4beb1b325f09f4a P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.606786 10366 ts_tablet_manager.cc:1434] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260810 19:48:15.609654 10377 ts_tablet_manager.cc:1929] T 64470598ccec45a7ae3e3c77fe4b9518 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:15.612938 10375 ts_tablet_manager.cc:1929] T 3680db3f1a5945a89c1198eb4849e58c P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:15.613075 10375 log.cc:1199] T 3680db3f1a5945a89c1198eb4849e58c P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/3680db3f1a5945a89c1198eb4849e58c
I20260810 19:48:15.613224 10377 log.cc:1199] T 64470598ccec45a7ae3e3c77fe4b9518 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/64470598ccec45a7ae3e3c77fe4b9518
I20260810 19:48:15.613420 10375 ts_tablet_manager.cc:1950] T 3680db3f1a5945a89c1198eb4849e58c P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:15.610085 10366 tablet_bootstrap.cc:492] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:15.615655 10366 tablet_bootstrap.cc:654] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.616677 10377 ts_tablet_manager.cc:1950] T 64470598ccec45a7ae3e3c77fe4b9518 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:15.619968 13159 raft_consensus.cc:493] T b3754889e4574fc3a936ac31cc6f496a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:15.620128 13159 raft_consensus.cc:515] T b3754889e4574fc3a936ac31cc6f496a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.620754 13159 leader_election.cc:290] T b3754889e4574fc3a936ac31cc6f496a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:15.621944 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3754889e4574fc3a936ac31cc6f496a" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:15.622728 9611 leader_election.cc:343] T b3754889e4574fc3a936ac31cc6f496a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:15.623514 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1145) took 1751 ms. Trace:
I20260810 19:48:15.623620 10377 rpcz_store.cc:276] 0810 19:48:13.871798 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.917426 (+ 45628us) service_pool.cc:224] Handling call
0810 19:48:15.594865 (+1677439us) ts_tablet_manager.cc:1151] Deleting tablet 64470598ccec45a7ae3e3c77fe4b9518
0810 19:48:15.594878 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.599205 (+ 4327us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:15.609583 (+ 10378us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:15.623488 (+ 13905us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1677237}
I20260810 19:48:15.630833 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1151) took 1674 ms. Trace:
I20260810 19:48:15.630954 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 64470598ccec45a7ae3e3c77fe4b9518 (table default.Table_20489495f6794646b9eda0458ee58d91 [id=16ed3d0d9475472283f6d95c69c60f8d]) successfully deleted
I20260810 19:48:15.630949 10377 rpcz_store.cc:276] 0810 19:48:13.956451 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.957584 (+ 1133us) service_pool.cc:224] Handling call
0810 19:48:15.630645 (+1673061us) ts_tablet_manager.cc:1151] Deleting tablet a7770d570b6b4ee487309785581af219
0810 19:48:15.630662 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.630805 (+ 143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1672714}
I20260810 19:48:15.631263 10377 tablet_replica.cc:333] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:15.631476 10377 raft_consensus.cc:2243] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 19:48:15.631546 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet a7770d570b6b4ee487309785581af219 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7770d570b6b4ee487309785581af219 already in progress: creating tablet
I20260810 19:48:15.631657 10377 raft_consensus.cc:2272] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:15.634164 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 5f9535152e6d45fa8ade32631b749678
I20260810 19:48:15.634397 10377 ts_tablet_manager.cc:1916] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:15.634720 9412 catalog_manager.cc:6807] ReplaceTablet: tablet 5f9535152e6d45fa8ade32631b749678 deleted and replaced by tablet 59826cbe61054ac8aec82c6be683defd
I20260810 19:48:15.635655 9897 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f9535152e6d45fa8ade32631b749678 with delete_type TABLET_DATA_DELETED (replaced by tablet 59826cbe61054ac8aec82c6be683defd) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:15.636037 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f9535152e6d45fa8ade32631b749678 with delete_type TABLET_DATA_DELETED (replaced by tablet 59826cbe61054ac8aec82c6be683defd) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:15.640271 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f9535152e6d45fa8ade32631b749678 with delete_type TABLET_DATA_DELETED (replaced by tablet 59826cbe61054ac8aec82c6be683defd) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:15.641884 10377 ts_tablet_manager.cc:1929] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:15.642027 10377 log.cc:1199] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/6ea318eddd8349a79d27ce5746f03798
I20260810 19:48:15.645179 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_99d4dfcac15d4d91b42b2a250bd58fc8" } modify_external_catalogs: true
I20260810 19:48:15.645378 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet f2606854f9954f2ea10610aeb1e60368 with delete_type TABLET_DATA_DELETED (replaced by tablet 898b70d09c1d410fb75cd4dd32d844c8) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:15.645383 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_99d4dfcac15d4d91b42b2a250bd58fc8" } modify_external_catalogs: true
I20260810 19:48:15.646397 10370 tablet_bootstrap.cc:492] T 5e47086440ef4a249f1eed23db655879 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:15.646555 10370 ts_tablet_manager.cc:1403] T 5e47086440ef4a249f1eed23db655879 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.048s user 0.013s sys 0.004s
I20260810 19:48:15.647339 10370 raft_consensus.cc:359] T 5e47086440ef4a249f1eed23db655879 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.647531 10370 raft_consensus.cc:385] T 5e47086440ef4a249f1eed23db655879 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.647583 10370 raft_consensus.cc:740] T 5e47086440ef4a249f1eed23db655879 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.647802 10370 consensus_queue.cc:260] T 5e47086440ef4a249f1eed23db655879 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:15.648439 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 25da36714b1d4e89a2c4af713331f4ec consensus state has no leader
I20260810 19:48:15.648826 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet c9e2dbef6e7a48caa2964ab90fbf9b73 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:15.650350 10370 ts_tablet_manager.cc:1434] T 5e47086440ef4a249f1eed23db655879 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 19:48:15.651810 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f8b2de930d9d40a3a41f9378594506d6" } modify_external_catalogs: true
I20260810 19:48:15.651995 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f8b2de930d9d40a3a41f9378594506d6" } modify_external_catalogs: true
I20260810 19:48:15.652499 10367 tablet_bootstrap.cc:492] T f42e9b00e3da4d73b4beb1b325f09f4a P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:15.652657 10367 ts_tablet_manager.cc:1403] T f42e9b00e3da4d73b4beb1b325f09f4a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.001s
I20260810 19:48:15.653463 10367 raft_consensus.cc:359] T f42e9b00e3da4d73b4beb1b325f09f4a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.653689 10367 raft_consensus.cc:385] T f42e9b00e3da4d73b4beb1b325f09f4a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.653759 10367 raft_consensus.cc:740] T f42e9b00e3da4d73b4beb1b325f09f4a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.653995 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c66a98aa6e1f4ef5a7fcc4d8a5f6ed4e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:15.654016 10367 consensus_queue.cc:260] T f42e9b00e3da4d73b4beb1b325f09f4a P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:15.654626 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c66a98aa6e1f4ef5a7fcc4d8a5f6ed4e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:15.654752 10377 ts_tablet_manager.cc:1950] T 6ea318eddd8349a79d27ce5746f03798 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:15.655769 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1150) took 1704 ms. Trace:
I20260810 19:48:15.655866 10377 rpcz_store.cc:276] 0810 19:48:13.951014 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.957823 (+ 6809us) service_pool.cc:224] Handling call
0810 19:48:15.631208 (+1673385us) ts_tablet_manager.cc:1151] Deleting tablet 6ea318eddd8349a79d27ce5746f03798
0810 19:48:15.631219 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.638193 (+ 6974us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:15.641812 (+ 3619us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:15.655739 (+ 13927us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1673188}
I20260810 19:48:15.656399 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 6ea318eddd8349a79d27ce5746f03798 (table default.Table_3d2a5a2863e24c4bb90af582b7f3a9bb [id=a8b0eeac86bf4ff5a8a71ca5432d07ec]) successfully deleted
I20260810 19:48:15.656932 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1158) took 1648 ms. Trace:
I20260810 19:48:15.657078 10377 rpcz_store.cc:276] 0810 19:48:14.008792 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:14.009160 (+ 368us) service_pool.cc:224] Handling call
0810 19:48:15.656767 (+1647607us) ts_tablet_manager.cc:1151] Deleting tablet e3f04460d9cc440580e9a7f4ec56bf40
0810 19:48:15.656780 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.656907 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1647438}
W20260810 19:48:15.658128 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet e3f04460d9cc440580e9a7f4ec56bf40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e3f04460d9cc440580e9a7f4ec56bf40 already in progress: creating tablet
I20260810 19:48:15.658682 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1157) took 1650 ms. Trace:
I20260810 19:48:15.660991 10367 ts_tablet_manager.cc:1434] T f42e9b00e3da4d73b4beb1b325f09f4a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260810 19:48:15.661823 9413 master_service.cc:960] ReplaceTablet: received request to replace tablet 0c6565aebe894508b4cbbcd3cd0a849a from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:15.661854 10366 tablet_bootstrap.cc:492] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:15.666586 10366 ts_tablet_manager.cc:1403] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.057s user 0.005s sys 0.005s
I20260810 19:48:15.668136 10366 raft_consensus.cc:359] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.668377 10366 raft_consensus.cc:385] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.668457 10366 raft_consensus.cc:740] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.668828 10366 consensus_queue.cc:260] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.670807 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3754889e4574fc3a936ac31cc6f496a" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:15.671643 9611 leader_election.cc:343] T b3754889e4574fc3a936ac31cc6f496a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:15.671782 9611 leader_election.cc:304] T b3754889e4574fc3a936ac31cc6f496a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:15.672492 13159 raft_consensus.cc:2749] T b3754889e4574fc3a936ac31cc6f496a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:15.673112 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 7d84ee2d39a64e7aa2ef066c2cbf30cf
I20260810 19:48:15.673841 10375 tablet_replica.cc:333] T d7595dbb46b6441dbb811611da116791 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:15.674069 10375 raft_consensus.cc:2243] T d7595dbb46b6441dbb811611da116791 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:15.674230 10375 raft_consensus.cc:2272] T d7595dbb46b6441dbb811611da116791 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:15.675112 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 3680db3f1a5945a89c1198eb4849e58c (table default.Table_68efca25ddd74752b30341b528693d1f [id=9601a761027047a2bbd739f0a1f86cd0]) successfully deleted
I20260810 19:48:15.675657 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d84ee2d39a64e7aa2ef066c2cbf30cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:15 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:15.678011 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d84ee2d39a64e7aa2ef066c2cbf30cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:15 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:15.678267 9897 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d84ee2d39a64e7aa2ef066c2cbf30cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:15 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:15.679105 10366 ts_tablet_manager.cc:1434] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260810 19:48:15.679406 10375 ts_tablet_manager.cc:1916] T d7595dbb46b6441dbb811611da116791 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:15.682874 10366 tablet_bootstrap.cc:492] T 3520274768ed41abb010bb109127affa P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:15.684656 10366 tablet_bootstrap.cc:654] T 3520274768ed41abb010bb109127affa P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.684814 10377 rpcz_store.cc:276] 0810 19:48:14.008666 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:14.009439 (+ 773us) service_pool.cc:224] Handling call
0810 19:48:15.658542 (+1649103us) ts_tablet_manager.cc:1151] Deleting tablet 3ddc1bc292a243338235ea1396cc08f8
0810 19:48:15.658554 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.658661 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1648939}
W20260810 19:48:15.686426 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 3ddc1bc292a243338235ea1396cc08f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ddc1bc292a243338235ea1396cc08f8 already in progress: creating tablet
I20260810 19:48:15.686692 10375 ts_tablet_manager.cc:1929] T d7595dbb46b6441dbb811611da116791 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:15.686817 10375 log.cc:1199] T d7595dbb46b6441dbb811611da116791 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/d7595dbb46b6441dbb811611da116791
I20260810 19:48:15.687124 10375 ts_tablet_manager.cc:1950] T d7595dbb46b6441dbb811611da116791 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:15.687366 10370 tablet_bootstrap.cc:492] T 3520274768ed41abb010bb109127affa P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:15.688426 10375 tablet_replica.cc:333] T 99aa001db52149dd90ce86e7261f7424 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:15.688625 10375 raft_consensus.cc:2243] T 99aa001db52149dd90ce86e7261f7424 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:15.688786 10375 raft_consensus.cc:2272] T 99aa001db52149dd90ce86e7261f7424 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:15.689412 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f6f4b21d44ba45339d95ca1933e92cd9" } modify_external_catalogs: true
I20260810 19:48:15.689638 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f6f4b21d44ba45339d95ca1933e92cd9" } modify_external_catalogs: true
W20260810 19:48:15.690073 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 70d410e0e3e046d898e0d7017e79e881 consensus state has no leader
I20260810 19:48:15.690443 9416 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_35ada13f5f5a41b0a93a57276b7756d9 [id=fa3844f34a5b4d55b6e87ec2164eb8fb] alter complete (version 2)
I20260810 19:48:15.691512 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_caad90751738441281755fc52e0a3bde"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:15.691829 10370 tablet_bootstrap.cc:654] T 3520274768ed41abb010bb109127affa P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:15.692122 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_caad90751738441281755fc52e0a3bde in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:15.693009 10367 tablet_bootstrap.cc:492] T b91737c2129e4ca385b4e1c8999c62b4 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:15.694505 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet d7595dbb46b6441dbb811611da116791 (table default.Table_d2b8c5a92e3d43b89de4938297a90542 [id=43f4ba98204449f6a0902c584b3e7eb2]) successfully deleted
W20260810 19:48:15.694844 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet c8311ccef92c48b2a94bbb9e9262ea9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c8311ccef92c48b2a94bbb9e9262ea9d already in progress: creating tablet
I20260810 19:48:15.695155 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_08c83fc388864b6f8a1ed597dc70bffe" } new_table_name: "default.Table_1470e58844d94b5ea8dbba9c10ff70d6" modify_external_catalogs: true
I20260810 19:48:15.696467 10367 tablet_bootstrap.cc:654] T b91737c2129e4ca385b4e1c8999c62b4 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.697963 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_80966c76104d4a36af2404b31057c5d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:15.698163 13159 raft_consensus.cc:493] T c9e2dbef6e7a48caa2964ab90fbf9b73 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:15.698341 13159 raft_consensus.cc:515] T c9e2dbef6e7a48caa2964ab90fbf9b73 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.699177 13159 leader_election.cc:290] T c9e2dbef6e7a48caa2964ab90fbf9b73 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:15.699378 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80966c76104d4a36af2404b31057c5d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:15.701613 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 27aca44685be4a0b92767d13bad15daf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:15.702932 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e2dbef6e7a48caa2964ab90fbf9b73" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:15.703974 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e2dbef6e7a48caa2964ab90fbf9b73" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:15.704128 9611 leader_election.cc:343] T c9e2dbef6e7a48caa2964ab90fbf9b73 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:15.704376 12266 ts_tablet_manager.cc:1929] T b8a7c2857add422281542e7f187979ab P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:15.704499 12266 log.cc:1199] T b8a7c2857add422281542e7f187979ab P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/b8a7c2857add422281542e7f187979ab
W20260810 19:48:15.704599 9611 leader_election.cc:343] T c9e2dbef6e7a48caa2964ab90fbf9b73 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:15.704737 9611 leader_election.cc:304] T c9e2dbef6e7a48caa2964ab90fbf9b73 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:15.704849 12266 ts_tablet_manager.cc:1950] T b8a7c2857add422281542e7f187979ab P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:15.705184 13159 raft_consensus.cc:2749] T c9e2dbef6e7a48caa2964ab90fbf9b73 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:15.707531 9831 consensus_peers.cc:597] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f6f9eb86c6c84b4a84d109d4741238e1. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:15.708282 10375 ts_tablet_manager.cc:1916] T 99aa001db52149dd90ce86e7261f7424 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:15.709604 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1154) took 1739 ms. Trace:
I20260810 19:48:15.709761 10377 rpcz_store.cc:276] 0810 19:48:13.970472 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:13.971799 (+ 1327us) service_pool.cc:224] Handling call
0810 19:48:15.709436 (+1737637us) ts_tablet_manager.cc:1151] Deleting tablet 9b5b21bff7634b1dbb6dfe1f4a85ce23
0810 19:48:15.709453 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.709576 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1489894}
W20260810 19:48:15.710813 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 9b5b21bff7634b1dbb6dfe1f4a85ce23 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b5b21bff7634b1dbb6dfe1f4a85ce23 already in progress: creating tablet
I20260810 19:48:15.711261 10377 tablet_replica.cc:333] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:15.711448 10367 tablet_bootstrap.cc:492] T b91737c2129e4ca385b4e1c8999c62b4 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:15.713590 10367 ts_tablet_manager.cc:1403] T b91737c2129e4ca385b4e1c8999c62b4 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.002s
I20260810 19:48:15.716369 10367 raft_consensus.cc:359] T b91737c2129e4ca385b4e1c8999c62b4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.716917 10377 raft_consensus.cc:2243] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:15.717341 10377 pending_rounds.cc:70] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691: Trying to abort 1 pending ops.
I20260810 19:48:15.717468 10377 pending_rounds.cc:77] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058743596503040 op_type: NO_OP noop_request { }
I20260810 19:48:15.717666 10377 raft_consensus.cc:2889] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:15.717926 10377 raft_consensus.cc:2272] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:15.718307 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet b8a7c2857add422281542e7f187979ab (table default.Table_f0a3683ed3074e529e9eff3dc1509f6d [id=f3ba4de841d44fbeaefab0db4c4a6a9b]) successfully deleted
I20260810 19:48:15.718739 10370 tablet_bootstrap.cc:492] T 3520274768ed41abb010bb109127affa P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:15.718911 10370 ts_tablet_manager.cc:1403] T 3520274768ed41abb010bb109127affa P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.032s user 0.005s sys 0.000s
I20260810 19:48:15.719309 10377 ts_tablet_manager.cc:1916] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:15.719671 10370 raft_consensus.cc:359] T 3520274768ed41abb010bb109127affa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.719873 10370 raft_consensus.cc:385] T 3520274768ed41abb010bb109127affa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.719935 10370 raft_consensus.cc:740] T 3520274768ed41abb010bb109127affa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.720212 10370 consensus_queue.cc:260] T 3520274768ed41abb010bb109127affa P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.721041 10370 ts_tablet_manager.cc:1434] T 3520274768ed41abb010bb109127affa P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:15.721335 10370 tablet_bootstrap.cc:492] T 1f895bcd21f647f2ab813903d600a31a P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:15.723553 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet abfa81d2eb2548d0b1688e23240f6d3a
I20260810 19:48:15.724387 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet abfa81d2eb2548d0b1688e23240f6d3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:15 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:15.725131 9897 tablet_service.cc:1558] Processing DeleteTablet for tablet abfa81d2eb2548d0b1688e23240f6d3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:15 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:15.725216 10367 raft_consensus.cc:385] T b91737c2129e4ca385b4e1c8999c62b4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.725303 10367 raft_consensus.cc:740] T b91737c2129e4ca385b4e1c8999c62b4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.725596 10367 consensus_queue.cc:260] T b91737c2129e4ca385b4e1c8999c62b4 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.726082 10370 tablet_bootstrap.cc:654] T 1f895bcd21f647f2ab813903d600a31a P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.730880 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet abfa81d2eb2548d0b1688e23240f6d3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:15 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:15.731843 10366 tablet_bootstrap.cc:492] T 3520274768ed41abb010bb109127affa P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:15.732208 10366 ts_tablet_manager.cc:1403] T 3520274768ed41abb010bb109127affa P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.002s
I20260810 19:48:15.731577 10367 ts_tablet_manager.cc:1434] T b91737c2129e4ca385b4e1c8999c62b4 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260810 19:48:15.733212 10366 raft_consensus.cc:359] T 3520274768ed41abb010bb109127affa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.733521 10366 raft_consensus.cc:385] T 3520274768ed41abb010bb109127affa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.733619 10366 raft_consensus.cc:740] T 3520274768ed41abb010bb109127affa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.734004 10366 consensus_queue.cc:260] T 3520274768ed41abb010bb109127affa P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.738461 10366 ts_tablet_manager.cc:1434] T 3520274768ed41abb010bb109127affa P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260810 19:48:15.739933 10366 tablet_bootstrap.cc:492] T 38b0c6a017dc4afc849090cca7ee8b26 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:15.741484 13159 raft_consensus.cc:493] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:15.741607 10366 tablet_bootstrap.cc:654] T 38b0c6a017dc4afc849090cca7ee8b26 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.741648 13159 raft_consensus.cc:515] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.742422 13159 leader_election.cc:290] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:15.743577 10165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24b75629ec423b90e4bf287e7cfd38" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:15.746905 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24b75629ec423b90e4bf287e7cfd38" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:15.747655 9611 leader_election.cc:343] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:15.751024 12266 tablet_replica.cc:333] T b3754889e4574fc3a936ac31cc6f496a P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:15.751271 12266 raft_consensus.cc:2243] T b3754889e4574fc3a936ac31cc6f496a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:15.751474 12266 raft_consensus.cc:2272] T b3754889e4574fc3a936ac31cc6f496a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:15.752095 12266 ts_tablet_manager.cc:1916] T b3754889e4574fc3a936ac31cc6f496a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:15.752152 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 2f3d9408288f47aaaa384428c94a73b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f3d9408288f47aaaa384428c94a73b0 already in progress: creating tablet
W20260810 19:48:15.752928 9611 leader_election.cc:343] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:15.753063 9611 leader_election.cc:304] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:15.753875 10377 ts_tablet_manager.cc:1929] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:15.753912 13159 raft_consensus.cc:2749] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:15.756032 10367 tablet_bootstrap.cc:492] T 8e8928f23c284477822d1f6308432dec P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:15.759320 10377 log.cc:1199] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/f6f9eb86c6c84b4a84d109d4741238e1
I20260810 19:48:15.759899 10377 ts_tablet_manager.cc:1950] T f6f9eb86c6c84b4a84d109d4741238e1 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:15.766532 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1190) took 1332 ms. Trace:
I20260810 19:48:15.766762 10377 rpcz_store.cc:276] 0810 19:48:14.434140 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:14.434221 (+ 81us) service_pool.cc:224] Handling call
0810 19:48:15.711186 (+1276965us) ts_tablet_manager.cc:1151] Deleting tablet f6f9eb86c6c84b4a84d109d4741238e1
0810 19:48:15.711199 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.731152 (+ 19953us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:15.753799 (+ 22647us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:15.766501 (+ 12702us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1199542}
I20260810 19:48:15.767419 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet f6f9eb86c6c84b4a84d109d4741238e1 (table default.Table_3102211b2b544d6bae3547d4f9af2574 [id=c10c35b78ae24250a48631468376e8ea]) successfully deleted
I20260810 19:48:15.767828 9418 master_service.cc:960] ReplaceTablet: received request to replace tablet f42e9b00e3da4d73b4beb1b325f09f4a from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:15.769793 10367 tablet_bootstrap.cc:654] T 8e8928f23c284477822d1f6308432dec P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.775424 10377 tablet_replica.cc:333] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:15.775696 10377 raft_consensus.cc:2243] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:15.776132 10377 raft_consensus.cc:2272] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:15.776887 10377 ts_tablet_manager.cc:1916] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:15.778697 10370 tablet_bootstrap.cc:492] T 1f895bcd21f647f2ab813903d600a31a P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:15.780604 10370 ts_tablet_manager.cc:1403] T 1f895bcd21f647f2ab813903d600a31a P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.059s user 0.007s sys 0.001s
I20260810 19:48:15.781227 10367 tablet_bootstrap.cc:492] T 8e8928f23c284477822d1f6308432dec P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:15.781459 10367 ts_tablet_manager.cc:1403] T 8e8928f23c284477822d1f6308432dec P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.026s user 0.008s sys 0.004s
I20260810 19:48:15.781719 10370 raft_consensus.cc:359] T 1f895bcd21f647f2ab813903d600a31a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.781919 10370 raft_consensus.cc:385] T 1f895bcd21f647f2ab813903d600a31a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.781980 10370 raft_consensus.cc:740] T 1f895bcd21f647f2ab813903d600a31a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.782217 10370 consensus_queue.cc:260] T 1f895bcd21f647f2ab813903d600a31a P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.779775 10366 tablet_bootstrap.cc:492] T 38b0c6a017dc4afc849090cca7ee8b26 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:15.782791 10367 raft_consensus.cc:359] T 8e8928f23c284477822d1f6308432dec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.783071 10366 ts_tablet_manager.cc:1403] T 38b0c6a017dc4afc849090cca7ee8b26 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.000s
I20260810 19:48:15.783070 10367 raft_consensus.cc:385] T 8e8928f23c284477822d1f6308432dec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.783190 10367 raft_consensus.cc:740] T 8e8928f23c284477822d1f6308432dec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.783542 10367 consensus_queue.cc:260] T 8e8928f23c284477822d1f6308432dec P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.783849 10366 raft_consensus.cc:359] T 38b0c6a017dc4afc849090cca7ee8b26 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.784322 10366 raft_consensus.cc:385] T 38b0c6a017dc4afc849090cca7ee8b26 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.784382 10366 raft_consensus.cc:740] T 38b0c6a017dc4afc849090cca7ee8b26 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.784585 10366 consensus_queue.cc:260] T 38b0c6a017dc4afc849090cca7ee8b26 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.786453 10366 ts_tablet_manager.cc:1434] T 38b0c6a017dc4afc849090cca7ee8b26 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:48:15.786487 10375 ts_tablet_manager.cc:1929] T 99aa001db52149dd90ce86e7261f7424 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:15.787886 10366 tablet_bootstrap.cc:492] T b4b6b17ce3354600b2f7450c6e483c69 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:15.789763 10366 tablet_bootstrap.cc:654] T b4b6b17ce3354600b2f7450c6e483c69 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.790548 12266 ts_tablet_manager.cc:1929] T b3754889e4574fc3a936ac31cc6f496a P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:15.790678 12266 log.cc:1199] T b3754889e4574fc3a936ac31cc6f496a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/b3754889e4574fc3a936ac31cc6f496a
I20260810 19:48:15.797415 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2ae916a777334f9a9265e324290edb60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:15.798089 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ae916a777334f9a9265e324290edb60 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:15.800060 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_d7f1b950b9084c219bf757e23cef21e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:15.800629 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7f1b950b9084c219bf757e23cef21e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:15.802016 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c23873a5843340709af27b3886f51b1b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:15.802652 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c23873a5843340709af27b3886f51b1b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:15.803776 10370 ts_tablet_manager.cc:1434] T 1f895bcd21f647f2ab813903d600a31a P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20260810 19:48:15.805050 13041 raft_consensus.cc:493] T 444b49a69c8245b6944a76d53041154c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:15.805199 13041 raft_consensus.cc:515] T 444b49a69c8245b6944a76d53041154c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.805857 13041 leader_election.cc:290] T 444b49a69c8245b6944a76d53041154c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:15.805950 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_caad90751738441281755fc52e0a3bde" } new_table_name: "default.Table_47c62dfd4e2f44d1994d2af7218e8862" modify_external_catalogs: true
I20260810 19:48:15.806841 10375 log.cc:1199] T 99aa001db52149dd90ce86e7261f7424 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/99aa001db52149dd90ce86e7261f7424
I20260810 19:48:15.806975 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet f42e9b00e3da4d73b4beb1b325f09f4a with delete_type TABLET_DATA_DELETED (replaced by tablet 054c725b88c34372a922fc5be27c35a0) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:15.807255 10370 tablet_bootstrap.cc:492] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:48:15.807564 9830 leader_election.cc:343] T 444b49a69c8245b6944a76d53041154c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Not found: Tablet not found: 444b49a69c8245b6944a76d53041154c
I20260810 19:48:15.809069 10370 tablet_bootstrap.cc:654] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.807261 10375 ts_tablet_manager.cc:1950] T 99aa001db52149dd90ce86e7261f7424 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:15.811903 10375 tablet_replica.cc:333] T f2606854f9954f2ea10610aeb1e60368 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:15.811898 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 99aa001db52149dd90ce86e7261f7424 (table default.Table_35de6164baf24ff79163d6b665fc6b8c [id=17f46f6e25bd4c3084a0fcb333694b71]) successfully deleted
I20260810 19:48:15.812119 10375 raft_consensus.cc:2243] T f2606854f9954f2ea10610aeb1e60368 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:15.812270 10375 raft_consensus.cc:2272] T f2606854f9954f2ea10610aeb1e60368 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:15.812409 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 5f9535152e6d45fa8ade32631b749678 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f9535152e6d45fa8ade32631b749678 already in progress: creating tablet
W20260810 19:48:15.814695 9831 leader_election.cc:343] T 444b49a69c8245b6944a76d53041154c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 444b49a69c8245b6944a76d53041154c
I20260810 19:48:15.814846 9831 leader_election.cc:304] T 444b49a69c8245b6944a76d53041154c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:15.815359 13041 raft_consensus.cc:2749] T 444b49a69c8245b6944a76d53041154c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:15.815690 10377 ts_tablet_manager.cc:1929] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:15.825043 13192 tablet.cc:1724] T 85f1c7a75aac4d6a9462af4def91eaa4 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:15.827440 10375 ts_tablet_manager.cc:1916] T f2606854f9954f2ea10610aeb1e60368 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:15.823872 13185 tablet.cc:1724] T 85f1c7a75aac4d6a9462af4def91eaa4 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:15.835970 9415 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 5e47086440ef4a249f1eed23db655879 (table default.Table_b38998c1916842f1aa85263f019bde23 [id=a2b6e3d955f3426781465b670f4fa727]). Expected version 1 got 0
I20260810 19:48:15.837270 10140 tablet_service.cc:1511] Processing CreateTablet for tablet 0bc7a1783b7a4ebc8c572f21393cea29 (DEFAULT_TABLE table=default.Table_176a2b848b3943e88638c5c1f8822824 [id=1c2aee3a15394350894ee6a25bead131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.837860 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bc7a1783b7a4ebc8c572f21393cea29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.840263 9408 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 5e47086440ef4a249f1eed23db655879 (table default.Table_b38998c1916842f1aa85263f019bde23 [id=a2b6e3d955f3426781465b670f4fa727]). Expected version 1 got 0
I20260810 19:48:15.840444 9408 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 56fa5de3bf7142b2b0978f9190091f33 (table default.Table_1881cd552cf54157a0a41766d5b1b259 [id=87220e53176e4254a5238c988b6a7311]). Expected version 2 got 0
I20260810 19:48:15.845201 10367 ts_tablet_manager.cc:1434] T 8e8928f23c284477822d1f6308432dec P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.064s user 0.002s sys 0.000s
I20260810 19:48:15.845865 10145 tablet_service.cc:1511] Processing CreateTablet for tablet af3ed915ee8b4c068649c87dec20a127 (DEFAULT_TABLE table=default.Table_fc97ee5a42ee4675a917c147f576b647 [id=c82ffebd9f7141008076f8662e1c826c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.846576 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 3ef34fb73f894fbe8aa1782fe5aae93f (DEFAULT_TABLE table=default.Table_bb9ee8b5a96a42d2be03ff52cf3d6d63 [id=48d9afc5861545a2bb9c66b5879a71ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.848223 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af3ed915ee8b4c068649c87dec20a127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.852907 10367 tablet_bootstrap.cc:492] T 7d939e3df62a45d9a964d4df01be4bfb P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:15.854450 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ef34fb73f894fbe8aa1782fe5aae93f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.855942 10367 tablet_bootstrap.cc:654] T 7d939e3df62a45d9a964d4df01be4bfb P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.860056 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 0bc7a1783b7a4ebc8c572f21393cea29 (DEFAULT_TABLE table=default.Table_176a2b848b3943e88638c5c1f8822824 [id=1c2aee3a15394350894ee6a25bead131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.860486 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bc7a1783b7a4ebc8c572f21393cea29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.862604 9675 tablet_service.cc:1511] Processing CreateTablet for tablet af3ed915ee8b4c068649c87dec20a127 (DEFAULT_TABLE table=default.Table_fc97ee5a42ee4675a917c147f576b647 [id=c82ffebd9f7141008076f8662e1c826c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.863000 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af3ed915ee8b4c068649c87dec20a127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.867122 13196 tablet.cc:1724] T 85f1c7a75aac4d6a9462af4def91eaa4 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:15.872558 10375 ts_tablet_manager.cc:1929] T f2606854f9954f2ea10610aeb1e60368 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:15.872702 10375 log.cc:1199] T f2606854f9954f2ea10610aeb1e60368 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/f2606854f9954f2ea10610aeb1e60368
I20260810 19:48:15.873014 10375 ts_tablet_manager.cc:1950] T f2606854f9954f2ea10610aeb1e60368 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:15.874188 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet f2606854f9954f2ea10610aeb1e60368 (table default.Table_33ab9a72c1d543beb6a25830c7f1aa23 [id=4fe62c29683b4e5ca802b5cf74ae195e]) successfully deleted
W20260810 19:48:15.874836 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 7d84ee2d39a64e7aa2ef066c2cbf30cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d84ee2d39a64e7aa2ef066c2cbf30cf already in progress: creating tablet
W20260810 19:48:15.875129 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet abfa81d2eb2548d0b1688e23240f6d3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet abfa81d2eb2548d0b1688e23240f6d3a already in progress: creating tablet
I20260810 19:48:15.832486 10377 log.cc:1199] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/9a13b0f5b6b14bb9b72740a8521e4ea5
I20260810 19:48:15.845395 9892 tablet_service.cc:1511] Processing CreateTablet for tablet af3ed915ee8b4c068649c87dec20a127 (DEFAULT_TABLE table=default.Table_fc97ee5a42ee4675a917c147f576b647 [id=c82ffebd9f7141008076f8662e1c826c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.887005 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af3ed915ee8b4c068649c87dec20a127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.887566 10366 tablet_bootstrap.cc:492] T b4b6b17ce3354600b2f7450c6e483c69 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:15.887782 10366 ts_tablet_manager.cc:1403] T b4b6b17ce3354600b2f7450c6e483c69 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.100s user 0.003s sys 0.004s
I20260810 19:48:15.888622 10366 raft_consensus.cc:359] T b4b6b17ce3354600b2f7450c6e483c69 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.888871 10366 raft_consensus.cc:385] T b4b6b17ce3354600b2f7450c6e483c69 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.888960 10366 raft_consensus.cc:740] T b4b6b17ce3354600b2f7450c6e483c69 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.889335 10366 consensus_queue.cc:260] T b4b6b17ce3354600b2f7450c6e483c69 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.847831 9897 tablet_service.cc:1511] Processing CreateTablet for tablet 0bc7a1783b7a4ebc8c572f21393cea29 (DEFAULT_TABLE table=default.Table_176a2b848b3943e88638c5c1f8822824 [id=1c2aee3a15394350894ee6a25bead131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.884840 9885 tablet_service.cc:1511] Processing CreateTablet for tablet 3ef34fb73f894fbe8aa1782fe5aae93f (DEFAULT_TABLE table=default.Table_bb9ee8b5a96a42d2be03ff52cf3d6d63 [id=48d9afc5861545a2bb9c66b5879a71ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.891868 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bc7a1783b7a4ebc8c572f21393cea29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.893545 10367 tablet_bootstrap.cc:492] T 7d939e3df62a45d9a964d4df01be4bfb P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:15.893684 10367 ts_tablet_manager.cc:1403] T 7d939e3df62a45d9a964d4df01be4bfb P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.041s user 0.017s sys 0.007s
I20260810 19:48:15.894503 10367 raft_consensus.cc:359] T 7d939e3df62a45d9a964d4df01be4bfb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.894672 10367 raft_consensus.cc:385] T 7d939e3df62a45d9a964d4df01be4bfb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.894721 10367 raft_consensus.cc:740] T 7d939e3df62a45d9a964d4df01be4bfb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.895000 10367 consensus_queue.cc:260] T 7d939e3df62a45d9a964d4df01be4bfb P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.896209 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 34b3a855d4bc4670b993b4ceab27b40f (DEFAULT_TABLE table=default.Table_d8e6b3a8ee554914bf34612fe63b3056 [id=954a7b52db5f4ce6aa0ecbf948758f8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.898696 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 34b3a855d4bc4670b993b4ceab27b40f (DEFAULT_TABLE table=default.Table_d8e6b3a8ee554914bf34612fe63b3056 [id=954a7b52db5f4ce6aa0ecbf948758f8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.899154 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b3a855d4bc4670b993b4ceab27b40f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.901855 10367 ts_tablet_manager.cc:1434] T 7d939e3df62a45d9a964d4df01be4bfb P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260810 19:48:15.903728 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 34b3a855d4bc4670b993b4ceab27b40f (DEFAULT_TABLE table=default.Table_d8e6b3a8ee554914bf34612fe63b3056 [id=954a7b52db5f4ce6aa0ecbf948758f8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.904254 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b3a855d4bc4670b993b4ceab27b40f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.906692 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 3ef34fb73f894fbe8aa1782fe5aae93f (DEFAULT_TABLE table=default.Table_bb9ee8b5a96a42d2be03ff52cf3d6d63 [id=48d9afc5861545a2bb9c66b5879a71ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.907265 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ef34fb73f894fbe8aa1782fe5aae93f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.907477 10367 tablet_bootstrap.cc:492] T 7de27c3442584746b76ea838d38f0b9b P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:15.909153 10367 tablet_bootstrap.cc:654] T 7de27c3442584746b76ea838d38f0b9b P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.911010 10140 tablet_service.cc:1511] Processing CreateTablet for tablet d9fab66c95724cdca35a523a9fc1deba (DEFAULT_TABLE table=default.Table_72a80c06c138411ab77f41d2d076aad0 [id=8ce5b222a3cc4d35b34210427f2315f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.911496 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9fab66c95724cdca35a523a9fc1deba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.919100 9907 tablet_service.cc:1511] Processing CreateTablet for tablet d9fab66c95724cdca35a523a9fc1deba (DEFAULT_TABLE table=default.Table_72a80c06c138411ab77f41d2d076aad0 [id=8ce5b222a3cc4d35b34210427f2315f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.920444 9681 tablet_service.cc:1511] Processing CreateTablet for tablet d9fab66c95724cdca35a523a9fc1deba (DEFAULT_TABLE table=default.Table_72a80c06c138411ab77f41d2d076aad0 [id=8ce5b222a3cc4d35b34210427f2315f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.921249 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9fab66c95724cdca35a523a9fc1deba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.924955 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b3a855d4bc4670b993b4ceab27b40f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.928709 10366 ts_tablet_manager.cc:1434] T b4b6b17ce3354600b2f7450c6e483c69 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.041s user 0.001s sys 0.001s
I20260810 19:48:15.930877 9885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ef34fb73f894fbe8aa1782fe5aae93f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.934386 10366 tablet_bootstrap.cc:492] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:15.936655 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 23bcbfcab4a0409ebdcb75668c80ca54 (DEFAULT_TABLE table=default.Table_d60b140f2ada47759b398feee8725b09 [id=f64c3093cce14b0ab4e258edc2ed6c90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.937148 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23bcbfcab4a0409ebdcb75668c80ca54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.938694 10370 tablet_bootstrap.cc:492] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:15.937129 10377 ts_tablet_manager.cc:1950] T 9a13b0f5b6b14bb9b72740a8521e4ea5 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:15.939169 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1191) took 1402 ms. Trace:
I20260810 19:48:15.939406 10370 ts_tablet_manager.cc:1403] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.132s user 0.006s sys 0.000s
I20260810 19:48:15.939507 10377 rpcz_store.cc:276] 0810 19:48:14.536731 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:14.536835 (+ 104us) service_pool.cc:224] Handling call
0810 19:48:15.775336 (+1238501us) ts_tablet_manager.cc:1151] Deleting tablet 9a13b0f5b6b14bb9b72740a8521e4ea5
0810 19:48:15.775353 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.793976 (+ 18623us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:15.815623 (+ 21647us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:15.939149 (+123526us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1238097}
I20260810 19:48:15.940449 10370 raft_consensus.cc:359] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.939669 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9fab66c95724cdca35a523a9fc1deba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.940961 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 9a13b0f5b6b14bb9b72740a8521e4ea5 (table default.Table_0844c946c41146f38e51790cd8baed2a [id=4830b444314a4bb6a605cb73432e772f]) successfully deleted
I20260810 19:48:15.941346 10377 tablet_replica.cc:333] T 05059ef70a8e440ca2988bfeb610645d P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:15.942644 10377 raft_consensus.cc:2243] T 05059ef70a8e440ca2988bfeb610645d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:15.942868 10377 raft_consensus.cc:2272] T 05059ef70a8e440ca2988bfeb610645d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:15.946406 10370 raft_consensus.cc:385] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.946995 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_5de62e9dcdc04e9ca62c60c1c214bce7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:15.947121 10370 raft_consensus.cc:740] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.947299 9415 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 8e8928f23c284477822d1f6308432dec (table default.Table_5a3f6c9b86e34bb78b562d25e72f43ab [id=b0481cad97294373a02773733421d077]). Expected version 1 got 0
W20260810 19:48:15.947679 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5de62e9dcdc04e9ca62c60c1c214bce7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:15.948467 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_50b4be8902f94126906b08db861107b1" } new_table_name: "default.Table_f27c148428504e64b41675d67a68ddae" modify_external_catalogs: true
I20260810 19:48:15.949275 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e1cc6dd116324bf385dbc82e56283cf7" } new_table_name: "default.Table_8ff9ba1b187e4f8a810e2e408b5384f7" modify_external_catalogs: true
I20260810 19:48:15.949419 10377 ts_tablet_manager.cc:1916] T 05059ef70a8e440ca2988bfeb610645d P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:15.949659 10370 consensus_queue.cc:260] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.942422 10366 tablet_bootstrap.cc:654] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.950263 10370 ts_tablet_manager.cc:1434] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20260810 19:48:15.954041 10370 tablet_bootstrap.cc:492] T 56fa5de3bf7142b2b0978f9190091f33 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:15.955578 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f895bcd21f647f2ab813903d600a31a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:15.955880 10375 tablet_replica.cc:333] T 1f895bcd21f647f2ab813903d600a31a P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:15.955996 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet 3520274768ed41abb010bb109127affa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:15.956105 10375 raft_consensus.cc:2243] T 1f895bcd21f647f2ab813903d600a31a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:15.956290 10375 raft_consensus.cc:2272] T 1f895bcd21f647f2ab813903d600a31a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:15.957183 10375 ts_tablet_manager.cc:1916] T 1f895bcd21f647f2ab813903d600a31a P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:15.958103 10370 tablet_bootstrap.cc:654] T 56fa5de3bf7142b2b0978f9190091f33 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.960817 9408 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 73abedd88ba548bdb5a23f508b77403d (table default.Table_2c70d731dd51405188ec44cbbcffaf57 [id=85908f0b736c4bf9bdbcd67352e2d491]). Expected version 1 got 0
I20260810 19:48:15.961853 13159 raft_consensus.cc:493] T 7d939e3df62a45d9a964d4df01be4bfb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:15.962018 13159 raft_consensus.cc:515] T 7d939e3df62a45d9a964d4df01be4bfb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.964315 13159 leader_election.cc:290] T 7d939e3df62a45d9a964d4df01be4bfb P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:15.965308 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d939e3df62a45d9a964d4df01be4bfb" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:15.963608 10375 ts_tablet_manager.cc:1929] T 1f895bcd21f647f2ab813903d600a31a P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 19:48:15.966454 9611 leader_election.cc:343] T 7d939e3df62a45d9a964d4df01be4bfb P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:15.966549 10375 log.cc:1199] T 1f895bcd21f647f2ab813903d600a31a P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/1f895bcd21f647f2ab813903d600a31a
I20260810 19:48:15.965306 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d939e3df62a45d9a964d4df01be4bfb" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:15.966917 10375 ts_tablet_manager.cc:1950] T 1f895bcd21f647f2ab813903d600a31a P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
W20260810 19:48:15.967236 9611 leader_election.cc:343] T 7d939e3df62a45d9a964d4df01be4bfb P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:15.967360 9611 leader_election.cc:304] T 7d939e3df62a45d9a964d4df01be4bfb P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:15.967784 13159 raft_consensus.cc:2749] T 7d939e3df62a45d9a964d4df01be4bfb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:15.968206 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 1f895bcd21f647f2ab813903d600a31a (table default.Table_c4fa695c16634a2382811d87f8b8224b [id=69aa2ddd2b2d4733a1b0e29676c59330]) successfully deleted
I20260810 19:48:15.973070 10366 tablet_bootstrap.cc:492] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:15.974862 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet b91737c2129e4ca385b4e1c8999c62b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:15.975595 10366 ts_tablet_manager.cc:1403] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.000s
I20260810 19:48:15.976599 10366 raft_consensus.cc:359] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.976886 10366 raft_consensus.cc:385] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:15.977003 10366 raft_consensus.cc:740] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:15.977366 10366 consensus_queue.cc:260] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:15.978051 10366 ts_tablet_manager.cc:1434] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:15.978550 10375 tablet_replica.cc:333] T 3520274768ed41abb010bb109127affa P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
W20260810 19:48:15.980065 9400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.253:37397, user_credentials={real_user=slave}} blocked reactor thread for 135513us
I20260810 19:48:15.980751 10375 raft_consensus.cc:2243] T 3520274768ed41abb010bb109127affa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:15.980978 10375 raft_consensus.cc:2272] T 3520274768ed41abb010bb109127affa P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:15.983837 10377 ts_tablet_manager.cc:1929] T 05059ef70a8e440ca2988bfeb610645d P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:15.986097 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 23bcbfcab4a0409ebdcb75668c80ca54 (DEFAULT_TABLE table=default.Table_d60b140f2ada47759b398feee8725b09 [id=f64c3093cce14b0ab4e258edc2ed6c90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.986604 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23bcbfcab4a0409ebdcb75668c80ca54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.988610 10375 ts_tablet_manager.cc:1916] T 3520274768ed41abb010bb109127affa P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:15.984354 10366 tablet_bootstrap.cc:492] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:15.985874 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 23bcbfcab4a0409ebdcb75668c80ca54 (DEFAULT_TABLE table=default.Table_d60b140f2ada47759b398feee8725b09 [id=f64c3093cce14b0ab4e258edc2ed6c90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:15.996603 10366 tablet_bootstrap.cc:654] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:15.996822 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23bcbfcab4a0409ebdcb75668c80ca54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:15.998588 10377 log.cc:1199] T 05059ef70a8e440ca2988bfeb610645d P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/05059ef70a8e440ca2988bfeb610645d
I20260810 19:48:15.999296 10377 ts_tablet_manager.cc:1950] T 05059ef70a8e440ca2988bfeb610645d P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:16.000481 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1192) took 1387 ms. Trace:
I20260810 19:48:16.001367 10377 rpcz_store.cc:276] 0810 19:48:14.613090 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:14.628971 (+ 15881us) service_pool.cc:224] Handling call
0810 19:48:15.941292 (+1312321us) ts_tablet_manager.cc:1151] Deleting tablet 05059ef70a8e440ca2988bfeb610645d
0810 19:48:15.941303 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:15.973348 (+ 32045us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:15.983753 (+ 10405us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:16.000463 (+ 16710us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1311508}
I20260810 19:48:16.002405 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 05059ef70a8e440ca2988bfeb610645d (table default.Table_39297078d5434aed9d01e90ff26623c8 [id=79f209949d0247619f04d8faa6f4568f]) successfully deleted
I20260810 19:48:16.003026 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1198) took 1338 ms. Trace:
I20260810 19:48:16.003772 10377 rpcz_store.cc:276] 0810 19:48:14.664976 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:14.665056 (+ 80us) service_pool.cc:224] Handling call
0810 19:48:16.002893 (+1337837us) ts_tablet_manager.cc:1151] Deleting tablet 0ff798aa9ef5439bbfc2c1aa3b7eac6d
0810 19:48:16.002904 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:16.003008 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1337622}
W20260810 19:48:16.005131 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f38e0671810f4e81bd2d790852316d54 has no consensus state
W20260810 19:48:16.005173 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 0ff798aa9ef5439bbfc2c1aa3b7eac6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ff798aa9ef5439bbfc2c1aa3b7eac6d already in progress: creating tablet
I20260810 19:48:16.005662 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1200) took 1313 ms. Trace:
I20260810 19:48:16.005752 10377 rpcz_store.cc:276] 0810 19:48:14.692466 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:14.692966 (+ 500us) service_pool.cc:224] Handling call
0810 19:48:16.005536 (+1312570us) ts_tablet_manager.cc:1151] Deleting tablet 4bc41ad892a247848f5d2c1a0d3333ef
0810 19:48:16.005547 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:16.005643 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1312373}
W20260810 19:48:16.006753 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 4bc41ad892a247848f5d2c1a0d3333ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4bc41ad892a247848f5d2c1a0d3333ef already in progress: creating tablet
I20260810 19:48:16.008620 9410 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 8e8928f23c284477822d1f6308432dec (table default.Table_5a3f6c9b86e34bb78b562d25e72f43ab [id=b0481cad97294373a02773733421d077]). Expected version 1 got 0
I20260810 19:48:16.008842 9410 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 7d939e3df62a45d9a964d4df01be4bfb (table default.Table_65f4c2fb3d1c49ae9cdfc041e51bd182 [id=2292ed1c178a4d458f52885e45c76d41]). Expected version 2 got 0
I20260810 19:48:16.009584 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1204) took 1310 ms. Trace:
I20260810 19:48:16.010233 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 3b2f576afb084987be171167a62883bb
I20260810 19:48:16.011055 10144 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b2f576afb084987be171167a62883bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:15 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:16.011298 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b2f576afb084987be171167a62883bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:15 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:16.011269 10377 rpcz_store.cc:276] 0810 19:48:14.699566 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:14.700720 (+ 1154us) service_pool.cc:224] Handling call
0810 19:48:16.009459 (+1308739us) ts_tablet_manager.cc:1151] Deleting tablet c0fc251932454c378f94cbfaa4955232
0810 19:48:16.009470 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:16.009564 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1302816}
I20260810 19:48:16.014482 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b2f576afb084987be171167a62883bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:15 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:16.014760 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 3da297aac2644fcabfcb21769576dca4
I20260810 19:48:16.014930 12266 ts_tablet_manager.cc:1950] T b3754889e4574fc3a936ac31cc6f496a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
W20260810 19:48:16.014895 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet c0fc251932454c378f94cbfaa4955232 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0fc251932454c378f94cbfaa4955232 already in progress: creating tablet
I20260810 19:48:16.015439 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1205) took 1315 ms. Trace:
I20260810 19:48:16.015529 10377 rpcz_store.cc:276] 0810 19:48:14.699732 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:14.700878 (+ 1146us) service_pool.cc:224] Handling call
0810 19:48:16.015306 (+1314428us) ts_tablet_manager.cc:1151] Deleting tablet 4a7ca999f502495fbc56bb6fc4e5c711
0810 19:48:16.015319 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:16.015416 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1308533}
I20260810 19:48:16.016140 13159 raft_consensus.cc:493] T f42e9b00e3da4d73b4beb1b325f09f4a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:16.016289 13159 raft_consensus.cc:515] T f42e9b00e3da4d73b4beb1b325f09f4a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:16.016408 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 4a7ca999f502495fbc56bb6fc4e5c711 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a7ca999f502495fbc56bb6fc4e5c711 already in progress: creating tablet
I20260810 19:48:16.016986 13159 leader_election.cc:290] T f42e9b00e3da4d73b4beb1b325f09f4a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:16.017256 10377 tablet_replica.cc:333] T 444b49a69c8245b6944a76d53041154c P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:16.017702 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet b3754889e4574fc3a936ac31cc6f496a (table default.Table_6f102dcbbfc04cefa60e2601ea7bb372 [id=ab67d2215d85456cb3100985ad22b894]) successfully deleted
I20260810 19:48:16.017939 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 3da297aac2644fcabfcb21769576dca4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:15 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:16.017570 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet 3da297aac2644fcabfcb21769576dca4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:15 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:16.017638 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42e9b00e3da4d73b4beb1b325f09f4a" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:16.018119 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42e9b00e3da4d73b4beb1b325f09f4a" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:16.018623 9611 leader_election.cc:343] T f42e9b00e3da4d73b4beb1b325f09f4a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:16.018587 10144 tablet_service.cc:1558] Processing DeleteTablet for tablet 3da297aac2644fcabfcb21769576dca4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:15 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:16.018846 9611 leader_election.cc:343] T f42e9b00e3da4d73b4beb1b325f09f4a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:16.018926 9611 leader_election.cc:304] T f42e9b00e3da4d73b4beb1b325f09f4a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:16.018919 10377 raft_consensus.cc:2243] T 444b49a69c8245b6944a76d53041154c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:16.019097 10377 raft_consensus.cc:2272] T 444b49a69c8245b6944a76d53041154c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:16.019349 13159 raft_consensus.cc:2749] T f42e9b00e3da4d73b4beb1b325f09f4a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:16.019685 10377 ts_tablet_manager.cc:1916] T 444b49a69c8245b6944a76d53041154c P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:16.020478 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_305add871d244448877b2c9b4dd2e8a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:16.021180 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_305add871d244448877b2c9b4dd2e8a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.022589 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_92e004ad2c72411dacdb1a20f13fe654"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:16.023204 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92e004ad2c72411dacdb1a20f13fe654 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:16.024423 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 95905d5c18b94759893f6caada96e79e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95905d5c18b94759893f6caada96e79e already in progress: creating tablet
W20260810 19:48:16.024724 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet ea9408ecf3784a80ac0c064e1689d25e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea9408ecf3784a80ac0c064e1689d25e already in progress: creating tablet
W20260810 19:48:16.025002 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 18880c0c1717411181a457f1f75e1118 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18880c0c1717411181a457f1f75e1118 already in progress: creating tablet
I20260810 19:48:16.028506 10375 ts_tablet_manager.cc:1929] T 3520274768ed41abb010bb109127affa P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 19:48:16.034351 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet f864e82e2aa843ed867c6b95da2127ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f864e82e2aa843ed867c6b95da2127ed already in progress: creating tablet
I20260810 19:48:16.035491 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 0c6565aebe894508b4cbbcd3cd0a849a
I20260810 19:48:16.035979 9413 catalog_manager.cc:6807] ReplaceTablet: tablet 0c6565aebe894508b4cbbcd3cd0a849a deleted and replaced by tablet 2f636d3a30144449b00b4f9119ba6ab1
I20260810 19:48:16.036232 12266 tablet_replica.cc:333] T 7add2dae2d1b4e8b9b95348e0334ba03 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:16.036477 12266 raft_consensus.cc:2243] T 7add2dae2d1b4e8b9b95348e0334ba03 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:16.036664 12266 raft_consensus.cc:2272] T 7add2dae2d1b4e8b9b95348e0334ba03 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:16.036940 10375 log.cc:1199] T 3520274768ed41abb010bb109127affa P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/3520274768ed41abb010bb109127affa
I20260810 19:48:16.037287 12266 ts_tablet_manager.cc:1916] T 7add2dae2d1b4e8b9b95348e0334ba03 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:16.037328 10375 ts_tablet_manager.cc:1950] T 3520274768ed41abb010bb109127affa P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:16.038249 10144 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c6565aebe894508b4cbbcd3cd0a849a with delete_type TABLET_DATA_DELETED (replaced by tablet 2f636d3a30144449b00b4f9119ba6ab1) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:16.038391 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c6565aebe894508b4cbbcd3cd0a849a with delete_type TABLET_DATA_DELETED (replaced by tablet 2f636d3a30144449b00b4f9119ba6ab1) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:16.040443 9897 tablet_service.cc:1511] Processing CreateTablet for tablet d39fe24340bc49dfa352751108254162 (DEFAULT_TABLE table=default.Table_500a87af3dbc4007864d04aa1f2f7bcd [id=d16fa13458bb4ed2b509585973855e7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.040858 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 3520274768ed41abb010bb109127affa (table default.Table_f9e687e842744de19940ff3ddb74dfa1 [id=541cc0f8fabe41b4a2114eb70c9d5ba4]) successfully deleted
I20260810 19:48:16.040946 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d39fe24340bc49dfa352751108254162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.041725 10140 tablet_service.cc:1511] Processing CreateTablet for tablet 48a2d0d751eb4051a98f52f8889d03f5 (DEFAULT_TABLE table=default.Table_f4f2d054565f42e8843cbff1e2c8cc5a [id=9b8f06303a044fc1ae694b9078b16126]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.042073 10144 tablet_service.cc:1511] Processing CreateTablet for tablet d39fe24340bc49dfa352751108254162 (DEFAULT_TABLE table=default.Table_500a87af3dbc4007864d04aa1f2f7bcd [id=d16fa13458bb4ed2b509585973855e7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.042131 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a2d0d751eb4051a98f52f8889d03f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.042505 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c6565aebe894508b4cbbcd3cd0a849a with delete_type TABLET_DATA_DELETED (replaced by tablet 2f636d3a30144449b00b4f9119ba6ab1) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:16.042801 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d39fe24340bc49dfa352751108254162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.045152 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 48a2d0d751eb4051a98f52f8889d03f5 (DEFAULT_TABLE table=default.Table_f4f2d054565f42e8843cbff1e2c8cc5a [id=9b8f06303a044fc1ae694b9078b16126]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.045547 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a2d0d751eb4051a98f52f8889d03f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.047384 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 264a65bd642648e59998fb55fb3c8de1
I20260810 19:48:16.047679 13041 raft_consensus.cc:493] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:16.047827 13041 raft_consensus.cc:515] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.048467 13041 leader_election.cc:290] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:16.049284 9709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fa5de3bf7142b2b0978f9190091f33" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:16.049526 9709 raft_consensus.cc:2468] T 56fa5de3bf7142b2b0978f9190091f33 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:16.049732 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet 264a65bd642648e59998fb55fb3c8de1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:15 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:16.049767 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fa5de3bf7142b2b0978f9190091f33" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:16.050201 9831 leader_election.cc:304] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:16.050523 9655 tablet_service.cc:1511] Processing CreateTablet for tablet 48a2d0d751eb4051a98f52f8889d03f5 (DEFAULT_TABLE table=default.Table_f4f2d054565f42e8843cbff1e2c8cc5a [id=9b8f06303a044fc1ae694b9078b16126]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.050760 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet 264a65bd642648e59998fb55fb3c8de1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:15 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:16.050786 9830 leader_election.cc:343] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:16.050886 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet 264a65bd642648e59998fb55fb3c8de1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:15 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:16.051005 9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a2d0d751eb4051a98f52f8889d03f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.051136 13041 raft_consensus.cc:2804] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:16.051203 13041 raft_consensus.cc:493] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:16.051258 13041 raft_consensus.cc:3060] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:16.053612 9675 tablet_service.cc:1511] Processing CreateTablet for tablet d39fe24340bc49dfa352751108254162 (DEFAULT_TABLE table=default.Table_500a87af3dbc4007864d04aa1f2f7bcd [id=d16fa13458bb4ed2b509585973855e7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.054028 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d39fe24340bc49dfa352751108254162. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:16.054055 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7189d156844e4c5b83bc2341f81cca5b consensus state has no leader
I20260810 19:48:16.054157 13041 raft_consensus.cc:515] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.055238 9709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fa5de3bf7142b2b0978f9190091f33" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:16.055439 9709 raft_consensus.cc:3060] T 56fa5de3bf7142b2b0978f9190091f33 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:16.055996 13041 leader_election.cc:290] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:16.056416 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fa5de3bf7142b2b0978f9190091f33" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:16.057030 9418 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_1470e58844d94b5ea8dbba9c10ff70d6 [id=2d55615cd797441c8abf6ea5a64f2f9f] alter complete (version 2)
W20260810 19:48:16.057040 9830 leader_election.cc:343] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:16.057854 9418 master_service.cc:960] ReplaceTablet: received request to replace tablet 650ca46244e54bed89e96c4a09fc7a94 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:16.059135 9885 tablet_service.cc:1558] Processing DeleteTablet for tablet 38b0c6a017dc4afc849090cca7ee8b26 with delete_type TABLET_DATA_DELETED (replaced by tablet 47c54793369048fc874522388d08d3da) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:16.061110 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_409905ea96594ba790ce5aad64871146" } new_table_name: "default.Table_ad111742aa3244339758e937715b7f4a" modify_external_catalogs: true
I20260810 19:48:16.061466 9709 raft_consensus.cc:2468] T 56fa5de3bf7142b2b0978f9190091f33 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:16.062028 9831 leader_election.cc:304] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:16.062693 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_365bf6134477414dac360b6d6045f4c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:16.062935 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet 3520274768ed41abb010bb109127affa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:16.062878 13145 consensus_queue.cc:1048] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:16.063135 13041 raft_consensus.cc:2804] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
W20260810 19:48:16.063301 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_365bf6134477414dac360b6d6045f4c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.063907 13041 raft_consensus.cc:697] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:16.064194 13041 consensus_queue.cc:237] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.064518 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3d4960cf68cb4aa5b3ea56c74e06f7c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:16.064973 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2a7aefa4ff8c4818b970f0c8a127f276" } modify_external_catalogs: true
W20260810 19:48:16.065074 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d4960cf68cb4aa5b3ea56c74e06f7c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.065132 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2a7aefa4ff8c4818b970f0c8a127f276" } modify_external_catalogs: true
I20260810 19:48:16.067364 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_da85c56b8ad948aaadc0fb377d5c89ea" } modify_external_catalogs: true
I20260810 19:48:16.067548 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_da85c56b8ad948aaadc0fb377d5c89ea" } modify_external_catalogs: true
I20260810 19:48:16.069280 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_85723f2593004e11acac17f40c9868e0" } new_table_name: "default.Table_826eb7bec7c74d8892c9eec11070cea3" modify_external_catalogs: true
I20260810 19:48:16.070550 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0eee3a62d69c4a90b8b0c45cd7d78dcc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:16.071241 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0eee3a62d69c4a90b8b0c45cd7d78dcc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.076097 13159 raft_consensus.cc:493] T ea557438b7b74944b19e17d7fb8f20cf P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:16.076267 13159 raft_consensus.cc:515] T ea557438b7b74944b19e17d7fb8f20cf P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.077010 13159 leader_election.cc:290] T ea557438b7b74944b19e17d7fb8f20cf P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:16.077672 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea557438b7b74944b19e17d7fb8f20cf" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:16.077890 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea557438b7b74944b19e17d7fb8f20cf" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:16.078361 9611 leader_election.cc:343] T ea557438b7b74944b19e17d7fb8f20cf P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:16.078863 9611 leader_election.cc:343] T ea557438b7b74944b19e17d7fb8f20cf P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:16.078969 9611 leader_election.cc:304] T ea557438b7b74944b19e17d7fb8f20cf P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:16.079361 13159 raft_consensus.cc:2749] T ea557438b7b74944b19e17d7fb8f20cf P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:16.104614 9421 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 8b24b75629ec423b90e4bf287e7cfd38 (table default.Table_ce3ea915b9dd44b3943c4de2b462d48c [id=9f58b113854b4d139e789332dfe00c8c]). Expected version 3 got 0
I20260810 19:48:16.107350 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet b4b6b17ce3354600b2f7450c6e483c69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:16.109951 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_18f2d5449fa84217a7ccbc5321381380"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:16.110675 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18f2d5449fa84217a7ccbc5321381380 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.114967 9407 catalog_manager.cc:5719] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:16.115418 9407 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 56fa5de3bf7142b2b0978f9190091f33 (table default.Table_1881cd552cf54157a0a41766d5b1b259 [id=87220e53176e4254a5238c988b6a7311]). Expected version 2 got 0
W20260810 19:48:16.118067 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 3b2f576afb084987be171167a62883bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b2f576afb084987be171167a62883bb already in progress: creating tablet
W20260810 19:48:16.118505 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 3da297aac2644fcabfcb21769576dca4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3da297aac2644fcabfcb21769576dca4 already in progress: creating tablet
I20260810 19:48:16.119488 10377 ts_tablet_manager.cc:1929] T 444b49a69c8245b6944a76d53041154c P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:16.119688 10377 log.cc:1199] T 444b49a69c8245b6944a76d53041154c P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/444b49a69c8245b6944a76d53041154c
I20260810 19:48:16.120368 10377 ts_tablet_manager.cc:1950] T 444b49a69c8245b6944a76d53041154c P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:16.120885 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1225) took 1033 ms. Trace:
I20260810 19:48:16.121047 10377 rpcz_store.cc:276] 0810 19:48:15.087379 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:15.103709 (+ 16330us) service_pool.cc:224] Handling call
0810 19:48:16.017202 (+913493us) ts_tablet_manager.cc:1151] Deleting tablet 444b49a69c8245b6944a76d53041154c
0810 19:48:16.017213 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:16.026136 (+ 8923us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:16.119408 (+ 93272us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:16.120863 (+ 1455us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":913216}
I20260810 19:48:16.121672 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 444b49a69c8245b6944a76d53041154c (table default.Table_070cfe9bb949439ca652e166a5c0f63e [id=a16bb67de06846c38f490000206e507f]) successfully deleted
W20260810 19:48:16.122093 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 95905d5c18b94759893f6caada96e79e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95905d5c18b94759893f6caada96e79e already in progress: creating tablet
I20260810 19:48:16.122274 13145 raft_consensus.cc:493] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 19:48:16.122406 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 2f3d9408288f47aaaa384428c94a73b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f3d9408288f47aaaa384428c94a73b0 already in progress: creating tablet
I20260810 19:48:16.122530 13145 raft_consensus.cc:515] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:16.122785 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet ea9408ecf3784a80ac0c064e1689d25e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea9408ecf3784a80ac0c064e1689d25e already in progress: creating tablet
I20260810 19:48:16.123435 13145 leader_election.cc:290] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:16.123832 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73abedd88ba548bdb5a23f508b77403d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:16.124261 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 0c6565aebe894508b4cbbcd3cd0a849a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c6565aebe894508b4cbbcd3cd0a849a already in progress: creating tablet
W20260810 19:48:16.124461 10067 leader_election.cc:343] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:16.124761 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 264a65bd642648e59998fb55fb3c8de1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 264a65bd642648e59998fb55fb3c8de1 already in progress: creating tablet
I20260810 19:48:16.125910 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 7dec9f6b698044ae97fa4c480e9e21c1 (DEFAULT_TABLE table=default.Table_a5054a2e3e7c4bcf86bcc34a01d7e807 [id=1879920c8175456bb4c2a7c7129ccace]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.125962 10140 tablet_service.cc:1511] Processing CreateTablet for tablet baacc12f051040f0b380199074097915 (DEFAULT_TABLE table=default.Table_bda2b3d2548648839f545e6909459594 [id=026e1f8a5b6a408cb5372a10cfe6c656]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.126381 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baacc12f051040f0b380199074097915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.126412 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dec9f6b698044ae97fa4c480e9e21c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.127645 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73abedd88ba548bdb5a23f508b77403d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:16.128032 9710 raft_consensus.cc:2468] T 73abedd88ba548bdb5a23f508b77403d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:16.128508 13041 raft_consensus.cc:493] T 3680db3f1a5945a89c1198eb4849e58c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:16.128702 13041 raft_consensus.cc:515] T 3680db3f1a5945a89c1198eb4849e58c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.128927 10068 leader_election.cc:304] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691
W20260810 19:48:16.130450 9831 leader_election.cc:343] T 3680db3f1a5945a89c1198eb4849e58c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 3680db3f1a5945a89c1198eb4849e58c
I20260810 19:48:16.130697 13041 leader_election.cc:290] T 3680db3f1a5945a89c1198eb4849e58c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:16.132014 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 81f0f3f88d26432fbadc5e90aaa5d158 consensus state has no leader
W20260810 19:48:16.132170 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 18880c0c1717411181a457f1f75e1118 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18880c0c1717411181a457f1f75e1118 already in progress: creating tablet
I20260810 19:48:16.133827 13145 raft_consensus.cc:2804] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:16.133947 13145 raft_consensus.cc:493] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:16.134065 13145 raft_consensus.cc:3060] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:16.134536 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet f864e82e2aa843ed867c6b95da2127ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f864e82e2aa843ed867c6b95da2127ed already in progress: creating tablet
I20260810 19:48:16.134895 10377 tablet_replica.cc:333] T 81aabb5656e7472f9223fd7acf10e43c P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:16.137032 13145 raft_consensus.cc:515] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.137542 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_034cb4d8db4f40fa9414357752308b25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:16.138289 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_034cb4d8db4f40fa9414357752308b25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.139366 10377 raft_consensus.cc:2243] T 81aabb5656e7472f9223fd7acf10e43c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:16.139561 10377 raft_consensus.cc:2272] T 81aabb5656e7472f9223fd7acf10e43c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:16.140157 10377 ts_tablet_manager.cc:1916] T 81aabb5656e7472f9223fd7acf10e43c P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:16.139210 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3d1ea6253cfd4262a4df7e7fc413d016"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:16.141083 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d1ea6253cfd4262a4df7e7fc413d016 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.144133 10366 tablet_bootstrap.cc:492] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
W20260810 19:48:16.144182 9830 leader_election.cc:343] T 3680db3f1a5945a89c1198eb4849e58c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Not found: Tablet not found: 3680db3f1a5945a89c1198eb4849e58c
I20260810 19:48:16.144326 9830 leader_election.cc:304] T 3680db3f1a5945a89c1198eb4849e58c P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:16.144335 10366 ts_tablet_manager.cc:1403] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.160s user 0.011s sys 0.006s
I20260810 19:48:16.145522 10366 raft_consensus.cc:359] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.145742 10366 raft_consensus.cc:385] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:16.145844 10366 raft_consensus.cc:740] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:16.146136 10366 consensus_queue.cc:260] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.147867 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet d0976c7855cb49c4ad4a4cf3b1ac1518
I20260810 19:48:16.148524 13104 raft_consensus.cc:2749] T 3680db3f1a5945a89c1198eb4849e58c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:16.149359 10366 ts_tablet_manager.cc:1434] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260810 19:48:16.149654 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet d0976c7855cb49c4ad4a4cf3b1ac1518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:16.151463 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet a099e4cc255c4502b745a1e29cbd4c42
I20260810 19:48:16.151883 10366 tablet_bootstrap.cc:492] T 66acbafdcc8540368693c8f463b41752 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:16.152624 13159 raft_consensus.cc:493] T 8e8928f23c284477822d1f6308432dec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:16.152771 13159 raft_consensus.cc:515] T 8e8928f23c284477822d1f6308432dec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.153445 13159 leader_election.cc:290] T 8e8928f23c284477822d1f6308432dec P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:16.153903 10366 tablet_bootstrap.cc:654] T 66acbafdcc8540368693c8f463b41752 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:16.154160 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8928f23c284477822d1f6308432dec" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:16.154917 9611 leader_election.cc:343] T 8e8928f23c284477822d1f6308432dec P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:16.156590 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet a099e4cc255c4502b745a1e29cbd4c42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:16.157177 9897 tablet_service.cc:1558] Processing DeleteTablet for tablet d0976c7855cb49c4ad4a4cf3b1ac1518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:16.157246 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet a099e4cc255c4502b745a1e29cbd4c42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:16.162834 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3e6181ae99c647b2be5e7b83325e6579"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:16.163491 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e6181ae99c647b2be5e7b83325e6579 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.165581 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 650ca46244e54bed89e96c4a09fc7a94
I20260810 19:48:16.166178 9418 catalog_manager.cc:6807] ReplaceTablet: tablet 650ca46244e54bed89e96c4a09fc7a94 deleted and replaced by tablet f8e1ffaad910441d99aa9d6596d3b17d
I20260810 19:48:16.166685 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 650ca46244e54bed89e96c4a09fc7a94 with delete_type TABLET_DATA_DELETED (replaced by tablet f8e1ffaad910441d99aa9d6596d3b17d) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:16.167528 9897 tablet_service.cc:1558] Processing DeleteTablet for tablet 650ca46244e54bed89e96c4a09fc7a94 with delete_type TABLET_DATA_DELETED (replaced by tablet f8e1ffaad910441d99aa9d6596d3b17d) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:16.142869 10370 tablet_bootstrap.cc:492] T 56fa5de3bf7142b2b0978f9190091f33 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:16.152094 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet d0976c7855cb49c4ad4a4cf3b1ac1518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:16.157104 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet a099e4cc255c4502b745a1e29cbd4c42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:16.167965 10370 ts_tablet_manager.cc:1403] T 56fa5de3bf7142b2b0978f9190091f33 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.215s user 0.014s sys 0.005s
I20260810 19:48:16.157665 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8928f23c284477822d1f6308432dec" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:16.168561 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73abedd88ba548bdb5a23f508b77403d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
W20260810 19:48:16.168649 9611 leader_election.cc:343] T 8e8928f23c284477822d1f6308432dec P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:16.168761 9611 leader_election.cc:304] T 8e8928f23c284477822d1f6308432dec P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:16.169044 10370 raft_consensus.cc:359] T 56fa5de3bf7142b2b0978f9190091f33 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.169211 10370 raft_consensus.cc:385] T 56fa5de3bf7142b2b0978f9190091f33 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:16.169220 13159 raft_consensus.cc:2749] T 8e8928f23c284477822d1f6308432dec P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:16.169253 10370 raft_consensus.cc:740] T 56fa5de3bf7142b2b0978f9190091f33 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:16.168768 9710 raft_consensus.cc:3060] T 73abedd88ba548bdb5a23f508b77403d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:16.169483 10370 consensus_queue.cc:260] T 56fa5de3bf7142b2b0978f9190091f33 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.169989 10370 ts_tablet_manager.cc:1434] T 56fa5de3bf7142b2b0978f9190091f33 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
W20260810 19:48:16.171219 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ba6002f2cfa463882b793f8f5cb5f41 consensus state has no leader
I20260810 19:48:16.172490 9710 raft_consensus.cc:2468] T 73abedd88ba548bdb5a23f508b77403d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
W20260810 19:48:16.175290 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet d0976c7855cb49c4ad4a4cf3b1ac1518 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d0976c7855cb49c4ad4a4cf3b1ac1518 already in progress: creating tablet
I20260810 19:48:16.175449 10068 leader_election.cc:304] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:16.177232 13185 tablet.cc:1724] T 3840b035b88243ecad17865d4716fcfc P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:16.177800 13245 raft_consensus.cc:2804] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:16.178877 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 7dec9f6b698044ae97fa4c480e9e21c1 (DEFAULT_TABLE table=default.Table_a5054a2e3e7c4bcf86bcc34a01d7e807 [id=1879920c8175456bb4c2a7c7129ccace]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.180967 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 95a840488d03439bb825c9b116c0e230 (DEFAULT_TABLE table=default.Table_9f26a3a8a41e43eab54c18c6bba196e3 [id=4635cfb6986d478eba579e3f33cafb06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.187237 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 7dec9f6b698044ae97fa4c480e9e21c1 (DEFAULT_TABLE table=default.Table_a5054a2e3e7c4bcf86bcc34a01d7e807 [id=1879920c8175456bb4c2a7c7129ccace]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.187875 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dec9f6b698044ae97fa4c480e9e21c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.193127 12266 ts_tablet_manager.cc:1929] T 7add2dae2d1b4e8b9b95348e0334ba03 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:16.193354 12266 log.cc:1199] T 7add2dae2d1b4e8b9b95348e0334ba03 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/7add2dae2d1b4e8b9b95348e0334ba03
I20260810 19:48:16.193771 12266 ts_tablet_manager.cc:1950] T 7add2dae2d1b4e8b9b95348e0334ba03 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:16.195175 9897 tablet_service.cc:1511] Processing CreateTablet for tablet 95a840488d03439bb825c9b116c0e230 (DEFAULT_TABLE table=default.Table_9f26a3a8a41e43eab54c18c6bba196e3 [id=4635cfb6986d478eba579e3f33cafb06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.195678 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a840488d03439bb825c9b116c0e230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.199733 10130 tablet_service.cc:1511] Processing CreateTablet for tablet c7409fe62cc149cdb30334c49ed5cce3 (DEFAULT_TABLE table=default.Table_542ae6490ce046f299724c7afb076b83 [id=2f5cfa0297d048a9928c29f3aec47226]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.200023 9885 tablet_service.cc:1511] Processing CreateTablet for tablet cc1fc9a1ce484512a77a26b1be196629 (DEFAULT_TABLE table=default.Table_c339da99a2ef4aaf978f48774cf7197a [id=f412785db13841ffa76b623fe6d457ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.200193 10125 tablet_service.cc:1511] Processing CreateTablet for tablet ecd638dc799348c5b75c6259e09d4c4b (DEFAULT_TABLE table=default.Table_89373162e84f4605be0d2f1f7cca6d6d [id=ffb923c867d845bc8aac666018561035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.200254 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 4e8354623868446991a46486d3834f35 (DEFAULT_TABLE table=default.Table_5c9eb4f561e84e7db222bd31d3ba1952 [id=c90d13ff0a214de69ae089321d2b6f49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.200492 9885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc1fc9a1ce484512a77a26b1be196629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.200459 9655 tablet_service.cc:1511] Processing CreateTablet for tablet c7409fe62cc149cdb30334c49ed5cce3 (DEFAULT_TABLE table=default.Table_542ae6490ce046f299724c7afb076b83 [id=2f5cfa0297d048a9928c29f3aec47226]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.200577 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 1692048aba154f8b99f559eb161e1bfa (DEFAULT_TABLE table=default.Table_25f19f2032a74c4180cc62614260b2fd [id=f432f92dda3c461bab4250eacf396ed2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.200776 9892 tablet_service.cc:1511] Processing CreateTablet for tablet ecd638dc799348c5b75c6259e09d4c4b (DEFAULT_TABLE table=default.Table_89373162e84f4605be0d2f1f7cca6d6d [id=ffb923c867d845bc8aac666018561035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.200888 9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7409fe62cc149cdb30334c49ed5cce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.200941 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1692048aba154f8b99f559eb161e1bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.201160 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecd638dc799348c5b75c6259e09d4c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.199733 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 1692048aba154f8b99f559eb161e1bfa (DEFAULT_TABLE table=default.Table_25f19f2032a74c4180cc62614260b2fd [id=f432f92dda3c461bab4250eacf396ed2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.202641 9657 tablet_service.cc:1511] Processing CreateTablet for tablet ecd638dc799348c5b75c6259e09d4c4b (DEFAULT_TABLE table=default.Table_89373162e84f4605be0d2f1f7cca6d6d [id=ffb923c867d845bc8aac666018561035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.203024 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecd638dc799348c5b75c6259e09d4c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.204113 9664 tablet_service.cc:1511] Processing CreateTablet for tablet cc1fc9a1ce484512a77a26b1be196629 (DEFAULT_TABLE table=default.Table_c339da99a2ef4aaf978f48774cf7197a [id=f412785db13841ffa76b623fe6d457ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.204500 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc1fc9a1ce484512a77a26b1be196629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.206614 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 1692048aba154f8b99f559eb161e1bfa (DEFAULT_TABLE table=default.Table_25f19f2032a74c4180cc62614260b2fd [id=f432f92dda3c461bab4250eacf396ed2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.209559 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 95a840488d03439bb825c9b116c0e230 (DEFAULT_TABLE table=default.Table_9f26a3a8a41e43eab54c18c6bba196e3 [id=4635cfb6986d478eba579e3f33cafb06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.210043 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a840488d03439bb825c9b116c0e230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.210465 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1692048aba154f8b99f559eb161e1bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.200026 9907 tablet_service.cc:1511] Processing CreateTablet for tablet c7409fe62cc149cdb30334c49ed5cce3 (DEFAULT_TABLE table=default.Table_542ae6490ce046f299724c7afb076b83 [id=2f5cfa0297d048a9928c29f3aec47226]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.210840 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7409fe62cc149cdb30334c49ed5cce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.211146 10370 tablet_bootstrap.cc:492] T 8b24b75629ec423b90e4bf287e7cfd38 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:16.214080 10370 tablet_bootstrap.cc:654] T 8b24b75629ec423b90e4bf287e7cfd38 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:16.215189 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a840488d03439bb825c9b116c0e230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.218916 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecd638dc799348c5b75c6259e09d4c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.223645 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7409fe62cc149cdb30334c49ed5cce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.227421 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1692048aba154f8b99f559eb161e1bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.230676 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8354623868446991a46486d3834f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.230775 9675 tablet_service.cc:1511] Processing CreateTablet for tablet baacc12f051040f0b380199074097915 (DEFAULT_TABLE table=default.Table_bda2b3d2548648839f545e6909459594 [id=026e1f8a5b6a408cb5372a10cfe6c656]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.231233 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baacc12f051040f0b380199074097915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.233485 13145 leader_election.cc:290] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:16.233682 13145 consensus_queue.cc:1048] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:16.234298 10367 tablet_bootstrap.cc:492] T 7de27c3442584746b76ea838d38f0b9b P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:16.234496 10367 ts_tablet_manager.cc:1403] T 7de27c3442584746b76ea838d38f0b9b P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.327s user 0.011s sys 0.029s
I20260810 19:48:16.235421 10367 raft_consensus.cc:359] T 7de27c3442584746b76ea838d38f0b9b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.235739 10367 raft_consensus.cc:385] T 7de27c3442584746b76ea838d38f0b9b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:16.235960 10367 raft_consensus.cc:740] T 7de27c3442584746b76ea838d38f0b9b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
W20260810 19:48:16.236093 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet a099e4cc255c4502b745a1e29cbd4c42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a099e4cc255c4502b745a1e29cbd4c42 already in progress: creating tablet
I20260810 19:48:16.236363 10367 consensus_queue.cc:260] T 7de27c3442584746b76ea838d38f0b9b P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.237778 13196 tablet.cc:1724] T 3840b035b88243ecad17865d4716fcfc P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:16.249706 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73abedd88ba548bdb5a23f508b77403d" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:16.250748 9906 tablet_service.cc:1511] Processing CreateTablet for tablet baacc12f051040f0b380199074097915 (DEFAULT_TABLE table=default.Table_bda2b3d2548648839f545e6909459594 [id=026e1f8a5b6a408cb5372a10cfe6c656]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.255503 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baacc12f051040f0b380199074097915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.260167 13041 raft_consensus.cc:493] T 253f302c00cc42ff84076b0c17f7670a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:16.260442 13041 raft_consensus.cc:515] T 253f302c00cc42ff84076b0c17f7670a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.260753 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dec9f6b698044ae97fa4c480e9e21c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.262364 13041 leader_election.cc:290] T 253f302c00cc42ff84076b0c17f7670a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:16.262894 10067 leader_election.cc:343] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:16.264070 10367 ts_tablet_manager.cc:1434] T 7de27c3442584746b76ea838d38f0b9b P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.029s user 0.002s sys 0.000s
I20260810 19:48:16.264959 13245 raft_consensus.cc:697] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:16.265810 13245 consensus_queue.cc:237] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:16.266825 9831 leader_election.cc:343] T 253f302c00cc42ff84076b0c17f7670a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 253f302c00cc42ff84076b0c17f7670a
I20260810 19:48:16.269320 10367 tablet_bootstrap.cc:492] T a776693b6b4943a7b64e13ec10958c16 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:16.271507 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet 650ca46244e54bed89e96c4a09fc7a94 with delete_type TABLET_DATA_DELETED (replaced by tablet f8e1ffaad910441d99aa9d6596d3b17d) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:16.272466 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 650ca46244e54bed89e96c4a09fc7a94 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 650ca46244e54bed89e96c4a09fc7a94 already in progress: creating tablet
I20260810 19:48:16.271257 13192 tablet.cc:1724] T 3840b035b88243ecad17865d4716fcfc P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:16.266103 10144 tablet_service.cc:1511] Processing CreateTablet for tablet cc1fc9a1ce484512a77a26b1be196629 (DEFAULT_TABLE table=default.Table_c339da99a2ef4aaf978f48774cf7197a [id=f412785db13841ffa76b623fe6d457ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.273183 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc1fc9a1ce484512a77a26b1be196629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.276002 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a16400f647e94437932730ebd220e795" } modify_external_catalogs: true
I20260810 19:48:16.276199 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a16400f647e94437932730ebd220e795" } modify_external_catalogs: true
I20260810 19:48:16.278120 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f0efe0b783444415bf0ef90618bf426f" } new_table_name: "default.Table_6093472462c2481da3da73dd33c332ff" modify_external_catalogs: true
I20260810 19:48:16.279727 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_fd5af78e376540b2be18db6a65953a46" } modify_external_catalogs: true
I20260810 19:48:16.279906 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_fd5af78e376540b2be18db6a65953a46" } modify_external_catalogs: true
I20260810 19:48:16.279949 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3606999c99584eadb5b437323d900d9d" } modify_external_catalogs: true
I20260810 19:48:16.280112 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_3606999c99584eadb5b437323d900d9d" } modify_external_catalogs: true
I20260810 19:48:16.279738 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2e1c8f736f574267a5895e990459ed79"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:16.284807 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e1c8f736f574267a5895e990459ed79 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.286561 9655 tablet_service.cc:1558] Processing DeleteTablet for tablet 7de27c3442584746b76ea838d38f0b9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:16.287993 9830 leader_election.cc:343] T 253f302c00cc42ff84076b0c17f7670a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Not found: Tablet not found: 253f302c00cc42ff84076b0c17f7670a
I20260810 19:48:16.288138 9830 leader_election.cc:304] T 253f302c00cc42ff84076b0c17f7670a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:16.288635 13041 raft_consensus.cc:2749] T 253f302c00cc42ff84076b0c17f7670a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:16.290491 10367 tablet_bootstrap.cc:654] T a776693b6b4943a7b64e13ec10958c16 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:16.296762 9831 consensus_peers.cc:597] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d7595dbb46b6441dbb811611da116791. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:16.299268 10367 tablet_bootstrap.cc:492] T a776693b6b4943a7b64e13ec10958c16 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:16.299643 12266 tablet_replica.cc:333] T c9e2dbef6e7a48caa2964ab90fbf9b73 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:16.299868 12266 raft_consensus.cc:2243] T c9e2dbef6e7a48caa2964ab90fbf9b73 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:16.300093 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 7add2dae2d1b4e8b9b95348e0334ba03 (table default.Table_06a146e0e459439cba25bc9eaf210b12 [id=6be2a52358f04826b4fd3f0941693b42]) successfully deleted
I20260810 19:48:16.300529 10367 ts_tablet_manager.cc:1403] T a776693b6b4943a7b64e13ec10958c16 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.003s
I20260810 19:48:16.301411 10367 raft_consensus.cc:359] T a776693b6b4943a7b64e13ec10958c16 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.305334 10377 ts_tablet_manager.cc:1929] T 81aabb5656e7472f9223fd7acf10e43c P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:16.305477 10377 log.cc:1199] T 81aabb5656e7472f9223fd7acf10e43c P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/81aabb5656e7472f9223fd7acf10e43c
I20260810 19:48:16.305846 10377 ts_tablet_manager.cc:1950] T 81aabb5656e7472f9223fd7acf10e43c P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:16.312412 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 81aabb5656e7472f9223fd7acf10e43c (table default.Table_3c331b2bd94d4303a3de78c1369771bc [id=f9a169cfd328466b908bc057a70a9668]) successfully deleted
I20260810 19:48:16.313246 10140 tablet_service.cc:1511] Processing CreateTablet for tablet fa84c64cab9e401c9634e038dbedf9a6 (DEFAULT_TABLE table=default.Table_78f097d877bd4d56980f6bb5eed2e314 [id=728f3eb0333c4174a5aaf070a1e500ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.319375 10366 tablet_bootstrap.cc:492] T 66acbafdcc8540368693c8f463b41752 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:16.319548 10366 ts_tablet_manager.cc:1403] T 66acbafdcc8540368693c8f463b41752 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.168s user 0.003s sys 0.005s
I20260810 19:48:16.320387 10366 raft_consensus.cc:359] T 66acbafdcc8540368693c8f463b41752 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.320581 10366 raft_consensus.cc:385] T 66acbafdcc8540368693c8f463b41752 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:16.320640 10366 raft_consensus.cc:740] T 66acbafdcc8540368693c8f463b41752 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:16.320976 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa84c64cab9e401c9634e038dbedf9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.320924 10366 consensus_queue.cc:260] T 66acbafdcc8540368693c8f463b41752 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.322800 9415 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 56fa5de3bf7142b2b0978f9190091f33 (table default.Table_1881cd552cf54157a0a41766d5b1b259 [id=87220e53176e4254a5238c988b6a7311]). Expected version 2 got 0
I20260810 19:48:16.323041 9415 catalog_manager.cc:5719] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195). New cstate: current_term: 1 leader_uuid: "eadde59fd6504d679e47f03a60c64bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: HEALTHY } } }
I20260810 19:48:16.323447 9415 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 73abedd88ba548bdb5a23f508b77403d (table default.Table_2c70d731dd51405188ec44cbbcffaf57 [id=85908f0b736c4bf9bdbcd67352e2d491]). Expected version 1 got 0
I20260810 19:48:16.324205 10366 ts_tablet_manager.cc:1434] T 66acbafdcc8540368693c8f463b41752 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 19:48:16.324538 10366 tablet_bootstrap.cc:492] T 8d93821ff46a4096a8ebbac83faabed7 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:16.324657 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a91426db4fba4e90a7fba3cf473ed1e5" } new_table_name: "default.Table_c9e39117178848d8901f6c7643262da6" modify_external_catalogs: true
I20260810 19:48:16.325476 10377 tablet_replica.cc:333] T 253f302c00cc42ff84076b0c17f7670a P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:16.325677 10377 raft_consensus.cc:2243] T 253f302c00cc42ff84076b0c17f7670a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:16.325826 10377 raft_consensus.cc:2272] T 253f302c00cc42ff84076b0c17f7670a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:16.326471 10377 ts_tablet_manager.cc:1916] T 253f302c00cc42ff84076b0c17f7670a P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:16.328313 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8ac41ee7ac68449ab4ec0876ce229843" } new_table_name: "default.Table_a5fa260a7a694654a448c0b7645e2e61" modify_external_catalogs: true
I20260810 19:48:16.326536 10366 tablet_bootstrap.cc:654] T 8d93821ff46a4096a8ebbac83faabed7 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:16.329265 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 4e8354623868446991a46486d3834f35 (DEFAULT_TABLE table=default.Table_5c9eb4f561e84e7db222bd31d3ba1952 [id=c90d13ff0a214de69ae089321d2b6f49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.334832 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8354623868446991a46486d3834f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.337580 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 22954e727fb44a24bd382b9caee9996b
I20260810 19:48:16.338374 9418 master_service.cc:960] ReplaceTablet: received request to replace tablet 21041f65462744278244802ef867c2e9 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:16.338439 10367 raft_consensus.cc:385] T a776693b6b4943a7b64e13ec10958c16 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:16.338538 10367 raft_consensus.cc:740] T a776693b6b4943a7b64e13ec10958c16 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:16.300022 12266 raft_consensus.cc:2272] T c9e2dbef6e7a48caa2964ab90fbf9b73 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:16.313424 13159 raft_consensus.cc:493] T 27aca44685be4a0b92767d13bad15daf P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:16.338816 13159 raft_consensus.cc:515] T 27aca44685be4a0b92767d13bad15daf P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.339027 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_30aa215301cf4468a1913b9e05104534"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:16.339479 13159 leader_election.cc:290] T 27aca44685be4a0b92767d13bad15daf P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:16.339587 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30aa215301cf4468a1913b9e05104534 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.340204 13041 raft_consensus.cc:493] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:16.340351 13041 raft_consensus.cc:515] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.333317 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 4e8354623868446991a46486d3834f35 (DEFAULT_TABLE table=default.Table_5c9eb4f561e84e7db222bd31d3ba1952 [id=c90d13ff0a214de69ae089321d2b6f49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.340900 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8354623868446991a46486d3834f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.341014 13041 leader_election.cc:290] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:16.341272 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27aca44685be4a0b92767d13bad15daf" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:16.341712 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27aca44685be4a0b92767d13bad15daf" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:16.342304 9611 leader_election.cc:343] T 27aca44685be4a0b92767d13bad15daf P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:16.342655 9611 leader_election.cc:343] T 27aca44685be4a0b92767d13bad15daf P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:16.342720 9611 leader_election.cc:304] T 27aca44685be4a0b92767d13bad15daf P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:16.342995 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1e4400ca684da7b3b5e6592e19b6e6" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:16.342435 9655 tablet_service.cc:1558] Processing DeleteTablet for tablet 22954e727fb44a24bd382b9caee9996b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:16.343152 9831 leader_election.cc:343] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: bb1e4400ca684da7b3b5e6592e19b6e6
I20260810 19:48:16.343323 13159 raft_consensus.cc:2749] T 27aca44685be4a0b92767d13bad15daf P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:16.343410 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet 22954e727fb44a24bd382b9caee9996b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:48:16.343850 9830 leader_election.cc:343] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:16.343961 9830 leader_election.cc:304] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:16.344198 13041 raft_consensus.cc:2749] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:16.345623 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet cd05a86e7ccd40afbfb10cb8dfe53e78
I20260810 19:48:16.346338 9420 master_service.cc:960] ReplaceTablet: received request to replace tablet aaaeafe4afb8454baf2e141a00da8ee3 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:16.346601 10367 consensus_queue.cc:260] T a776693b6b4943a7b64e13ec10958c16 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.349865 10367 ts_tablet_manager.cc:1434] T a776693b6b4943a7b64e13ec10958c16 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.049s user 0.001s sys 0.001s
W20260810 19:48:16.352108 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a8263a2e8c8b435d85c04f3282b2db4f consensus state has no leader
I20260810 19:48:16.352555 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2051fd14af9e42938ba8066fb2061f03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:16.353200 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2051fd14af9e42938ba8066fb2061f03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.346407 12266 ts_tablet_manager.cc:1916] T c9e2dbef6e7a48caa2964ab90fbf9b73 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:16.355183 9655 tablet_service.cc:1558] Processing DeleteTablet for tablet cd05a86e7ccd40afbfb10cb8dfe53e78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:16.362634 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet cd05a86e7ccd40afbfb10cb8dfe53e78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:16.363562 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet cd05a86e7ccd40afbfb10cb8dfe53e78 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd05a86e7ccd40afbfb10cb8dfe53e78 already in progress: creating tablet
I20260810 19:48:16.364069 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet 22954e727fb44a24bd382b9caee9996b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:16.364457 10366 tablet_bootstrap.cc:492] T 8d93821ff46a4096a8ebbac83faabed7 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:16.364624 10366 ts_tablet_manager.cc:1403] T 8d93821ff46a4096a8ebbac83faabed7 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.040s user 0.000s sys 0.003s
W20260810 19:48:16.364916 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 22954e727fb44a24bd382b9caee9996b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22954e727fb44a24bd382b9caee9996b already in progress: creating tablet
I20260810 19:48:16.365307 10367 tablet_bootstrap.cc:492] T 6f4b5c6d5bd14c59b3cd3f8ee00a3301 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:16.365806 10366 raft_consensus.cc:359] T 8d93821ff46a4096a8ebbac83faabed7 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.366017 10366 raft_consensus.cc:385] T 8d93821ff46a4096a8ebbac83faabed7 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:16.366216 10366 raft_consensus.cc:740] T 8d93821ff46a4096a8ebbac83faabed7 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:16.366503 10366 consensus_queue.cc:260] T 8d93821ff46a4096a8ebbac83faabed7 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.367313 13159 raft_consensus.cc:493] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:16.367453 13159 raft_consensus.cc:515] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.366521 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet cd05a86e7ccd40afbfb10cb8dfe53e78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:16.368093 13159 leader_election.cc:290] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:16.369486 13041 raft_consensus.cc:493] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:16.369652 13041 raft_consensus.cc:515] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.370306 13041 leader_election.cc:290] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:16.370587 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676004738985441985278313d6064530" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:16.371050 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676004738985441985278313d6064530" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:16.371668 9611 leader_election.cc:343] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:16.371943 9611 leader_election.cc:343] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:16.372032 9611 leader_election.cc:304] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:16.372826 9709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e47086440ef4a249f1eed23db655879" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:16.373015 9709 raft_consensus.cc:2468] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:16.374207 9831 leader_election.cc:304] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:16.374185 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e47086440ef4a249f1eed23db655879" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:16.374289 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_80966c76104d4a36af2404b31057c5d1" } new_table_name: "default.Table_c2ec5ae7a4374a8087ba72ba75b7590e" modify_external_catalogs: true
I20260810 19:48:16.374428 10153 raft_consensus.cc:2468] T 5e47086440ef4a249f1eed23db655879 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:16.374526 13104 raft_consensus.cc:2804] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:16.374609 13104 raft_consensus.cc:493] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:16.374668 13104 raft_consensus.cc:3060] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:16.375267 13159 raft_consensus.cc:2749] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:16.377382 13104 raft_consensus.cc:515] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.378072 13104 leader_election.cc:290] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:16.378602 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e47086440ef4a249f1eed23db655879" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:16.378819 10153 raft_consensus.cc:3060] T 5e47086440ef4a249f1eed23db655879 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:16.378844 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e47086440ef4a249f1eed23db655879" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:16.379020 9710 raft_consensus.cc:3060] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:16.381158 10367 tablet_bootstrap.cc:654] T 6f4b5c6d5bd14c59b3cd3f8ee00a3301 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:16.381048 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_17708a4f1cc94b65869c278f1293c503"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:16.381613 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17708a4f1cc94b65869c278f1293c503 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.381634 10153 raft_consensus.cc:2468] T 5e47086440ef4a249f1eed23db655879 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:16.381742 9710 raft_consensus.cc:2468] T 5e47086440ef4a249f1eed23db655879 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:16.382189 9830 leader_election.cc:304] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:16.382898 13104 raft_consensus.cc:2804] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:16.383209 13104 raft_consensus.cc:697] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:16.383546 13104 consensus_queue.cc:237] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.389163 9906 tablet_service.cc:1511] Processing CreateTablet for tablet fa84c64cab9e401c9634e038dbedf9a6 (DEFAULT_TABLE table=default.Table_78f097d877bd4d56980f6bb5eed2e314 [id=728f3eb0333c4174a5aaf070a1e500ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.390569 9892 tablet_service.cc:1511] Processing CreateTablet for tablet ad90777240594193a9b5f7203c302406 (DEFAULT_TABLE table=default.Table_7f42e3c0170c41f6aab544a1d359c022 [id=50b8e0705ac74d76944578ce2d68e066]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.390573 10140 tablet_service.cc:1511] Processing CreateTablet for tablet ad90777240594193a9b5f7203c302406 (DEFAULT_TABLE table=default.Table_7f42e3c0170c41f6aab544a1d359c022 [id=50b8e0705ac74d76944578ce2d68e066]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.391724 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 1ad02bf3b57145fbbaa5596ea5a62906 (DEFAULT_TABLE table=default.Table_64e1f4b9b7e84ac59c8a35c1b44a74bf [id=ab22fa6963c242c6bd0f58f1aba36374]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.391836 9655 tablet_service.cc:1511] Processing CreateTablet for tablet 1ad02bf3b57145fbbaa5596ea5a62906 (DEFAULT_TABLE table=default.Table_64e1f4b9b7e84ac59c8a35c1b44a74bf [id=ab22fa6963c242c6bd0f58f1aba36374]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.392179 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ad02bf3b57145fbbaa5596ea5a62906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.392247 9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ad02bf3b57145fbbaa5596ea5a62906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.392958 9897 tablet_service.cc:1511] Processing CreateTablet for tablet 1ad02bf3b57145fbbaa5596ea5a62906 (DEFAULT_TABLE table=default.Table_64e1f4b9b7e84ac59c8a35c1b44a74bf [id=ab22fa6963c242c6bd0f58f1aba36374]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:16.394639 9395 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 3b2f576afb084987be171167a62883bb (table default.Table_9f15ead49f2144078612a81d1f03b63a [id=7312ca5a38f64257a3a70d5c16f7c8a7], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3b2f576afb084987be171167a62883bb consensus state has no leader
I20260810 19:48:16.395756 13159 raft_consensus.cc:493] T b91737c2129e4ca385b4e1c8999c62b4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:16.395907 13159 raft_consensus.cc:515] T b91737c2129e4ca385b4e1c8999c62b4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.396612 13159 leader_election.cc:290] T b91737c2129e4ca385b4e1c8999c62b4 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:16.397305 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91737c2129e4ca385b4e1c8999c62b4" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:16.397846 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91737c2129e4ca385b4e1c8999c62b4" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:16.397951 9611 leader_election.cc:343] T b91737c2129e4ca385b4e1c8999c62b4 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:16.398384 9611 leader_election.cc:343] T b91737c2129e4ca385b4e1c8999c62b4 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:16.398489 9611 leader_election.cc:304] T b91737c2129e4ca385b4e1c8999c62b4 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:16.398900 13159 raft_consensus.cc:2749] T b91737c2129e4ca385b4e1c8999c62b4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:16.400228 10377 ts_tablet_manager.cc:1929] T 253f302c00cc42ff84076b0c17f7670a P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:16.400521 10377 log.cc:1199] T 253f302c00cc42ff84076b0c17f7670a P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/253f302c00cc42ff84076b0c17f7670a
I20260810 19:48:16.401173 10377 ts_tablet_manager.cc:1950] T 253f302c00cc42ff84076b0c17f7670a P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:16.402175 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 253f302c00cc42ff84076b0c17f7670a (table default.Table_ab79ddcb17e24ce7960c0c41dd451bc2 [id=9a73a382c71249058e61be3b0146826f]) successfully deleted
I20260810 19:48:16.401695 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad90777240594193a9b5f7203c302406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.401937 10370 tablet_bootstrap.cc:492] T 8b24b75629ec423b90e4bf287e7cfd38 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:16.403683 10370 ts_tablet_manager.cc:1403] T 8b24b75629ec423b90e4bf287e7cfd38 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.192s user 0.000s sys 0.005s
I20260810 19:48:16.409708 10370 raft_consensus.cc:359] T 8b24b75629ec423b90e4bf287e7cfd38 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.410297 9675 tablet_service.cc:1511] Processing CreateTablet for tablet ad90777240594193a9b5f7203c302406 (DEFAULT_TABLE table=default.Table_7f42e3c0170c41f6aab544a1d359c022 [id=50b8e0705ac74d76944578ce2d68e066]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.412139 10370 raft_consensus.cc:385] T 8b24b75629ec423b90e4bf287e7cfd38 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:16.412897 10370 raft_consensus.cc:740] T 8b24b75629ec423b90e4bf287e7cfd38 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:16.415321 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet e6ae4df29db74085849d82cf2529ac51
I20260810 19:48:16.416571 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet e6ae4df29db74085849d82cf2529ac51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:16.417042 9655 tablet_service.cc:1558] Processing DeleteTablet for tablet e6ae4df29db74085849d82cf2529ac51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:16.417634 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet e6ae4df29db74085849d82cf2529ac51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6ae4df29db74085849d82cf2529ac51 already in progress: creating tablet
I20260810 19:48:16.417768 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_606cc67677224ea4a2fde51ff7f01e28" } modify_external_catalogs: true
I20260810 19:48:16.417951 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_606cc67677224ea4a2fde51ff7f01e28" } modify_external_catalogs: true
I20260810 19:48:16.418429 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad90777240594193a9b5f7203c302406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.402048 10377 tablet_replica.cc:333] T 3680db3f1a5945a89c1198eb4849e58c P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:16.416508 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet e6ae4df29db74085849d82cf2529ac51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:16.407150 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa84c64cab9e401c9634e038dbedf9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.420331 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ad02bf3b57145fbbaa5596ea5a62906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.420565 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad90777240594193a9b5f7203c302406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.420792 9681 tablet_service.cc:1511] Processing CreateTablet for tablet fa84c64cab9e401c9634e038dbedf9a6 (DEFAULT_TABLE table=default.Table_78f097d877bd4d56980f6bb5eed2e314 [id=728f3eb0333c4174a5aaf070a1e500ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.421357 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa84c64cab9e401c9634e038dbedf9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.426684 10367 tablet_bootstrap.cc:492] T 6f4b5c6d5bd14c59b3cd3f8ee00a3301 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:16.428226 10367 ts_tablet_manager.cc:1403] T 6f4b5c6d5bd14c59b3cd3f8ee00a3301 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.063s user 0.002s sys 0.002s
I20260810 19:48:16.429095 10367 raft_consensus.cc:359] T 6f4b5c6d5bd14c59b3cd3f8ee00a3301 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.429375 10367 raft_consensus.cc:385] T 6f4b5c6d5bd14c59b3cd3f8ee00a3301 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:16.430166 10367 raft_consensus.cc:740] T 6f4b5c6d5bd14c59b3cd3f8ee00a3301 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:16.430568 10367 consensus_queue.cc:260] T 6f4b5c6d5bd14c59b3cd3f8ee00a3301 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:16.430850 9830 consensus_peers.cc:597] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d7595dbb46b6441dbb811611da116791. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:16.437098 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9baf2b3e644171b20e03b4c0704136 (DEFAULT_TABLE table=default.Table_073fe66f42db4d298e2aa03e9ddfb175 [id=1ee17f1e43d64f8c8a1d1e3e0c9562a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.437798 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9baf2b3e644171b20e03b4c0704136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.439492 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9baf2b3e644171b20e03b4c0704136 (DEFAULT_TABLE table=default.Table_073fe66f42db4d298e2aa03e9ddfb175 [id=1ee17f1e43d64f8c8a1d1e3e0c9562a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.439742 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9baf2b3e644171b20e03b4c0704136 (DEFAULT_TABLE table=default.Table_073fe66f42db4d298e2aa03e9ddfb175 [id=1ee17f1e43d64f8c8a1d1e3e0c9562a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:16.440240 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9baf2b3e644171b20e03b4c0704136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:16.442305 13041 raft_consensus.cc:493] T 3520274768ed41abb010bb109127affa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:16.444061 13041 raft_consensus.cc:515] T 3520274768ed41abb010bb109127affa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.444742 13041 leader_election.cc:290] T 3520274768ed41abb010bb109127affa P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:16.442348 10377 raft_consensus.cc:2243] T 3680db3f1a5945a89c1198eb4849e58c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260810 19:48:16.445907 9830 leader_election.cc:343] T 3520274768ed41abb010bb109127affa P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Not found: Tablet not found: 3520274768ed41abb010bb109127affa
I20260810 19:48:16.445952 10377 raft_consensus.cc:2272] T 3680db3f1a5945a89c1198eb4849e58c P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:16.446175 9831 leader_election.cc:343] T 3520274768ed41abb010bb109127affa P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 3520274768ed41abb010bb109127affa
I20260810 19:48:16.446274 9831 leader_election.cc:304] T 3520274768ed41abb010bb109127affa P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:16.446712 13041 raft_consensus.cc:2749] T 3520274768ed41abb010bb109127affa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:16.446861 10377 ts_tablet_manager.cc:1916] T 3680db3f1a5945a89c1198eb4849e58c P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:16.447747 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9baf2b3e644171b20e03b4c0704136. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:16.449503 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d466a47b30874237b3f634afbb529598 consensus state has no leader
I20260810 19:48:16.451337 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f1bfdcf5171d4d2e9269dd94a5c8ace1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:16.451970 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1bfdcf5171d4d2e9269dd94a5c8ace1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.418236 10370 consensus_queue.cc:260] T 8b24b75629ec423b90e4bf287e7cfd38 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:16.469476 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2186b5b292ef4a04b63c1d37f2afc078 consensus state has no leader
I20260810 19:48:16.471771 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_4a4190c1266e4af1b81f0e079408ed17"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:16.472402 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a4190c1266e4af1b81f0e079408ed17 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.447731 10367 ts_tablet_manager.cc:1434] T 6f4b5c6d5bd14c59b3cd3f8ee00a3301 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260810 19:48:16.478904 10370 ts_tablet_manager.cc:1434] T 8b24b75629ec423b90e4bf287e7cfd38 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.075s user 0.000s sys 0.002s
I20260810 19:48:16.481762 10367 tablet_bootstrap.cc:492] T 55fb03a8dd3b40f5ba3de41fa7c01f5d P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:16.483654 10367 tablet_bootstrap.cc:654] T 55fb03a8dd3b40f5ba3de41fa7c01f5d P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:16.485988 10370 tablet_bootstrap.cc:492] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:16.489027 10370 tablet_bootstrap.cc:654] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:16.489118 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_fcc942a53d1b4c05a1a07df15f3d9230" } modify_external_catalogs: true
I20260810 19:48:16.489327 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_fcc942a53d1b4c05a1a07df15f3d9230" } modify_external_catalogs: true
I20260810 19:48:16.494505 13041 raft_consensus.cc:493] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:16.494673 13041 raft_consensus.cc:515] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.495353 13041 leader_election.cc:290] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:16.496796 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24b75629ec423b90e4bf287e7cfd38" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:16.497032 10153 raft_consensus.cc:2468] T 8b24b75629ec423b90e4bf287e7cfd38 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:16.497648 9830 leader_election.cc:304] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:16.498076 13041 raft_consensus.cc:2804] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:16.498167 13041 raft_consensus.cc:493] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:16.500669 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24b75629ec423b90e4bf287e7cfd38" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:16.500787 13041 raft_consensus.cc:3060] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:16.500891 9710 raft_consensus.cc:2468] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:16.501943 12266 ts_tablet_manager.cc:1929] T c9e2dbef6e7a48caa2964ab90fbf9b73 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:16.502055 12266 log.cc:1199] T c9e2dbef6e7a48caa2964ab90fbf9b73 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/c9e2dbef6e7a48caa2964ab90fbf9b73
I20260810 19:48:16.502370 12266 ts_tablet_manager.cc:1950] T c9e2dbef6e7a48caa2964ab90fbf9b73 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:16.503221 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1215) took 1095 ms. Trace:
I20260810 19:48:16.503306 12266 rpcz_store.cc:276] 0810 19:48:15.407597 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:15.407716 (+ 119us) service_pool.cc:224] Handling call
0810 19:48:16.299575 (+891859us) ts_tablet_manager.cc:1151] Deleting tablet c9e2dbef6e7a48caa2964ab90fbf9b73
0810 19:48:16.299587 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:16.385491 (+ 85904us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:16.501862 (+116371us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:16.503197 (+ 1335us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":891636}
I20260810 19:48:16.503808 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet c9e2dbef6e7a48caa2964ab90fbf9b73 (table default.Table_0fa5ed82975d484a938aba25478b3c40 [id=91f4f92ca1804c5f866e3a6cdc8d5d30]) successfully deleted
I20260810 19:48:16.503818 13041 raft_consensus.cc:515] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.504226 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1216) took 1041 ms. Trace:
I20260810 19:48:16.504302 12266 rpcz_store.cc:276] 0810 19:48:15.462692 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:15.462780 (+ 88us) service_pool.cc:224] Handling call
0810 19:48:16.504083 (+1041303us) ts_tablet_manager.cc:1151] Deleting tablet c8311ccef92c48b2a94bbb9e9262ea9d
0810 19:48:16.504096 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:16.504207 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1041053}
I20260810 19:48:16.504937 13041 leader_election.cc:290] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:16.504935 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24b75629ec423b90e4bf287e7cfd38" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:16.505133 9710 raft_consensus.cc:3060] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:16.506479 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_49874ce88a0c4acdaa34f448fe452b06" } new_table_name: "default.Table_e43a254da4604bf7948ff17aca305989" modify_external_catalogs: true
I20260810 19:48:16.508052 9710 raft_consensus.cc:2468] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:16.509980 9831 leader_election.cc:304] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
W20260810 19:48:16.510854 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet c8311ccef92c48b2a94bbb9e9262ea9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c8311ccef92c48b2a94bbb9e9262ea9d already in progress: creating tablet
I20260810 19:48:16.511184 13041 raft_consensus.cc:2804] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:16.511243 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24b75629ec423b90e4bf287e7cfd38" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:16.511442 10153 raft_consensus.cc:3060] T 8b24b75629ec423b90e4bf287e7cfd38 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:16.511475 13041 raft_consensus.cc:697] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:16.512246 13041 consensus_queue.cc:237] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.515146 12266 tablet_replica.cc:333] T ea557438b7b74944b19e17d7fb8f20cf P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:16.515403 12266 raft_consensus.cc:2243] T ea557438b7b74944b19e17d7fb8f20cf P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:16.515589 12266 raft_consensus.cc:2272] T ea557438b7b74944b19e17d7fb8f20cf P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:16.516215 12266 ts_tablet_manager.cc:1916] T ea557438b7b74944b19e17d7fb8f20cf P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:16.517187 10153 raft_consensus.cc:2468] T 8b24b75629ec423b90e4bf287e7cfd38 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:16.518695 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_271df3c038524d63b2e4979d96dd5192"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:16.519290 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_271df3c038524d63b2e4979d96dd5192 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.521549 10367 tablet_bootstrap.cc:492] T 55fb03a8dd3b40f5ba3de41fa7c01f5d P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:16.521698 10367 ts_tablet_manager.cc:1403] T 55fb03a8dd3b40f5ba3de41fa7c01f5d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.000s
W20260810 19:48:16.525339 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 236ab18887dc44caadb63e3b37f8441d has no consensus state
I20260810 19:48:16.526104 10367 raft_consensus.cc:359] T 55fb03a8dd3b40f5ba3de41fa7c01f5d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.526365 10367 raft_consensus.cc:385] T 55fb03a8dd3b40f5ba3de41fa7c01f5d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:16.526469 10367 raft_consensus.cc:740] T 55fb03a8dd3b40f5ba3de41fa7c01f5d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:16.526382 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0ea446f3947f42dba60adb416db9ebb6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:16.527098 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ea446f3947f42dba60adb416db9ebb6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.528031 10367 consensus_queue.cc:260] T 55fb03a8dd3b40f5ba3de41fa7c01f5d P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.533385 10377 ts_tablet_manager.cc:1929] T 3680db3f1a5945a89c1198eb4849e58c P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:16.536363 10367 ts_tablet_manager.cc:1434] T 55fb03a8dd3b40f5ba3de41fa7c01f5d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260810 19:48:16.537001 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 8425f8c3258a41c291f9fa8dbd29fbc6
I20260810 19:48:16.538951 10377 log.cc:1199] T 3680db3f1a5945a89c1198eb4849e58c P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/3680db3f1a5945a89c1198eb4849e58c
I20260810 19:48:16.539397 10377 ts_tablet_manager.cc:1950] T 3680db3f1a5945a89c1198eb4849e58c P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:16.539793 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1243) took 1092 ms. Trace:
I20260810 19:48:16.540954 9655 tablet_service.cc:1558] Processing DeleteTablet for tablet 8425f8c3258a41c291f9fa8dbd29fbc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:16.541049 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_53bddb46400344258ce9e31df115c2a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:16.541800 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53bddb46400344258ce9e31df115c2a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.542104 10377 rpcz_store.cc:276] 0810 19:48:15.447017 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:15.447109 (+ 92us) service_pool.cc:224] Handling call
0810 19:48:16.401977 (+954868us) ts_tablet_manager.cc:1151] Deleting tablet 3680db3f1a5945a89c1198eb4849e58c
0810 19:48:16.401987 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:16.483624 (+ 81637us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:16.533288 (+ 49664us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:16.539769 (+ 6481us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":954626}
I20260810 19:48:16.544974 10367 tablet_bootstrap.cc:492] T 3159795344ae492fb099fca0e52fcf20 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:16.547999 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet 8425f8c3258a41c291f9fa8dbd29fbc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:16.549829 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 8425f8c3258a41c291f9fa8dbd29fbc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8425f8c3258a41c291f9fa8dbd29fbc6 already in progress: creating tablet
I20260810 19:48:16.540038 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 8425f8c3258a41c291f9fa8dbd29fbc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:16.552126 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 3680db3f1a5945a89c1198eb4849e58c (table default.Table_68efca25ddd74752b30341b528693d1f [id=9601a761027047a2bbd739f0a1f86cd0]) successfully deleted
I20260810 19:48:16.552610 10370 tablet_bootstrap.cc:492] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:16.552779 10370 ts_tablet_manager.cc:1403] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.067s user 0.003s sys 0.000s
I20260810 19:48:16.552753 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1244) took 1087 ms. Trace:
I20260810 19:48:16.552973 10377 rpcz_store.cc:276] 0810 19:48:15.465354 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:15.465415 (+ 61us) service_pool.cc:224] Handling call
0810 19:48:16.552510 (+1087095us) ts_tablet_manager.cc:1151] Deleting tablet c8311ccef92c48b2a94bbb9e9262ea9d
0810 19:48:16.552523 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:16.552649 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1086443}
I20260810 19:48:16.553449 10377 tablet_replica.cc:333] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:16.553588 10370 raft_consensus.cc:359] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.553772 10370 raft_consensus.cc:385] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:16.553833 10370 raft_consensus.cc:740] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
W20260810 19:48:16.554042 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet c8311ccef92c48b2a94bbb9e9262ea9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c8311ccef92c48b2a94bbb9e9262ea9d already in progress: creating tablet
I20260810 19:48:16.554500 10367 tablet_bootstrap.cc:654] T 3159795344ae492fb099fca0e52fcf20 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:16.553725 10377 raft_consensus.cc:2243] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:16.555038 10377 pending_rounds.cc:70] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691: Trying to abort 1 pending ops.
I20260810 19:48:16.555158 10377 pending_rounds.cc:77] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058746412789760 op_type: NO_OP noop_request { }
I20260810 19:48:16.555389 10377 raft_consensus.cc:2889] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:16.555560 10377 raft_consensus.cc:2272] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:16.556294 10377 ts_tablet_manager.cc:1916] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:16.556653 9415 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_8ff9ba1b187e4f8a810e2e408b5384f7 [id=6bf4ac94189d476d9ab5778e69d0b14f] alter complete (version 2)
I20260810 19:48:16.557101 13159 raft_consensus.cc:493] T a776693b6b4943a7b64e13ec10958c16 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:16.557256 13159 raft_consensus.cc:515] T a776693b6b4943a7b64e13ec10958c16 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.557351 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1978673641a647d096c688e3c7298029"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:16.557933 13159 leader_election.cc:290] T a776693b6b4943a7b64e13ec10958c16 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:16.558036 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1978673641a647d096c688e3c7298029 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.558817 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a776693b6b4943a7b64e13ec10958c16" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:16.559047 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a776693b6b4943a7b64e13ec10958c16" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:16.559505 9611 leader_election.cc:343] T a776693b6b4943a7b64e13ec10958c16 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:16.559736 9407 master_service.cc:960] ReplaceTablet: received request to replace tablet e18d0da099b749f1bc9d9d276277b68f from {username='slave'} at 127.0.0.1:56048
W20260810 19:48:16.559931 9611 leader_election.cc:343] T a776693b6b4943a7b64e13ec10958c16 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:16.560024 9611 leader_election.cc:304] T a776693b6b4943a7b64e13ec10958c16 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:16.560317 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_fdb9a22aaf1046c7b949a64abb7f2fd5" } modify_external_catalogs: true
I20260810 19:48:16.560456 13159 raft_consensus.cc:2749] T a776693b6b4943a7b64e13ec10958c16 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:16.560513 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_fdb9a22aaf1046c7b949a64abb7f2fd5" } modify_external_catalogs: true
I20260810 19:48:16.565052 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1488511b73d243c6b7384aaf88fb6a15" } new_table_name: "default.Table_14a99457051c4c96943fb9923de47b5d" modify_external_catalogs: true
I20260810 19:48:16.566592 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8fc1feb94cbb484d9a075740f45d658e" } modify_external_catalogs: true
I20260810 19:48:16.566665 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet bb1e4400ca684da7b3b5e6592e19b6e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:16.566783 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8fc1feb94cbb484d9a075740f45d658e" } modify_external_catalogs: true
I20260810 19:48:16.574549 10370 consensus_queue.cc:260] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.574728 13041 raft_consensus.cc:493] T 38b0c6a017dc4afc849090cca7ee8b26 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:16.575068 13041 raft_consensus.cc:515] T 38b0c6a017dc4afc849090cca7ee8b26 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.576308 13041 leader_election.cc:290] T 38b0c6a017dc4afc849090cca7ee8b26 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:16.577775 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b0c6a017dc4afc849090cca7ee8b26" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:16.578723 10370 ts_tablet_manager.cc:1434] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.026s user 0.001s sys 0.001s
W20260810 19:48:16.578882 9831 leader_election.cc:343] T 38b0c6a017dc4afc849090cca7ee8b26 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 38b0c6a017dc4afc849090cca7ee8b26
I20260810 19:48:16.579131 10370 tablet_bootstrap.cc:492] T 38b0c6a017dc4afc849090cca7ee8b26 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:48:16.579623 9830 leader_election.cc:343] T 38b0c6a017dc4afc849090cca7ee8b26 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:16.579738 9830 leader_election.cc:304] T 38b0c6a017dc4afc849090cca7ee8b26 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:16.581913 13041 raft_consensus.cc:2749] T 38b0c6a017dc4afc849090cca7ee8b26 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:16.581792 10370 tablet_bootstrap.cc:654] T 38b0c6a017dc4afc849090cca7ee8b26 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:16.584951 9412 catalog_manager.cc:5719] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:16.585389 9412 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 8b24b75629ec423b90e4bf287e7cfd38 (table default.Table_ce3ea915b9dd44b3943c4de2b462d48c [id=9f58b113854b4d139e789332dfe00c8c]). Expected version 3 got 0
I20260810 19:48:16.585636 9412 catalog_manager.cc:5719] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194). New cstate: current_term: 1 leader_uuid: "6986ed920dcb4af29a5eeeda6f671691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:16.585963 9412 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 5e47086440ef4a249f1eed23db655879 (table default.Table_b38998c1916842f1aa85263f019bde23 [id=a2b6e3d955f3426781465b670f4fa727]). Expected version 1 got 0
I20260810 19:48:16.595899 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 668b3514d9f64d44a8747647194e50be
I20260810 19:48:16.597807 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 668b3514d9f64d44a8747647194e50be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:16.600433 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 668b3514d9f64d44a8747647194e50be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:16.603216 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet 668b3514d9f64d44a8747647194e50be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:16.603585 10375 tablet_replica.cc:333] T 668b3514d9f64d44a8747647194e50be P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:16.603838 10375 raft_consensus.cc:2243] T 668b3514d9f64d44a8747647194e50be P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:16.604080 10375 raft_consensus.cc:2272] T 668b3514d9f64d44a8747647194e50be P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:16.604815 10375 ts_tablet_manager.cc:1916] T 668b3514d9f64d44a8747647194e50be P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:16.605324 10366 ts_tablet_manager.cc:1434] T 8d93821ff46a4096a8ebbac83faabed7 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.241s user 0.022s sys 0.002s
I20260810 19:48:16.607815 10366 tablet_bootstrap.cc:492] T f2606854f9954f2ea10610aeb1e60368 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:16.614645 12266 ts_tablet_manager.cc:1929] T ea557438b7b74944b19e17d7fb8f20cf P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:16.615016 12266 log.cc:1199] T ea557438b7b74944b19e17d7fb8f20cf P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/ea557438b7b74944b19e17d7fb8f20cf
I20260810 19:48:16.619563 10375 ts_tablet_manager.cc:1929] T 668b3514d9f64d44a8747647194e50be P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260810 19:48:16.619871 10375 log.cc:1199] T 668b3514d9f64d44a8747647194e50be P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/668b3514d9f64d44a8747647194e50be
I20260810 19:48:16.620384 10375 ts_tablet_manager.cc:1950] T 668b3514d9f64d44a8747647194e50be P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:16.623672 10366 tablet_bootstrap.cc:654] T f2606854f9954f2ea10610aeb1e60368 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:16.625455 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 668b3514d9f64d44a8747647194e50be (table default.Table_fcc942a53d1b4c05a1a07df15f3d9230 [id=f96d1bbf37954740825d721e6259ce3c]) successfully deleted
I20260810 19:48:16.628923 10377 ts_tablet_manager.cc:1929] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:16.629185 10377 log.cc:1199] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/d7595dbb46b6441dbb811611da116791
I20260810 19:48:16.629648 10377 ts_tablet_manager.cc:1950] T d7595dbb46b6441dbb811611da116791 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:16.630105 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1245) took 1082 ms. Trace:
I20260810 19:48:16.630264 10377 rpcz_store.cc:276] 0810 19:48:15.548032 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:15.548096 (+ 64us) service_pool.cc:224] Handling call
0810 19:48:16.553392 (+1005296us) ts_tablet_manager.cc:1151] Deleting tablet d7595dbb46b6441dbb811611da116791
0810 19:48:16.553403 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:16.596416 (+ 43013us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:16.628841 (+ 32425us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:16.630082 (+ 1241us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1001981}
W20260810 19:48:16.630703 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9f01a22232504d80a827e3d1ea0452a3 consensus state has no leader
I20260810 19:48:16.630764 12266 ts_tablet_manager.cc:1950] T ea557438b7b74944b19e17d7fb8f20cf P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:16.631834 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1217) took 1084 ms. Trace:
I20260810 19:48:16.631955 12266 rpcz_store.cc:276] 0810 19:48:15.547592 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:15.547677 (+ 85us) service_pool.cc:224] Handling call
0810 19:48:16.515071 (+967394us) ts_tablet_manager.cc:1151] Deleting tablet ea557438b7b74944b19e17d7fb8f20cf
0810 19:48:16.515086 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:16.590060 (+ 74974us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:16.595021 (+ 4961us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:16.631799 (+ 36778us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":963050}
I20260810 19:48:16.632350 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet d7595dbb46b6441dbb811611da116791 (table default.Table_d2b8c5a92e3d43b89de4938297a90542 [id=43f4ba98204449f6a0902c584b3e7eb2]) successfully deleted
W20260810 19:48:16.632629 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 5f9535152e6d45fa8ade32631b749678 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f9535152e6d45fa8ade32631b749678 already in progress: creating tablet
W20260810 19:48:16.632858 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 7d84ee2d39a64e7aa2ef066c2cbf30cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d84ee2d39a64e7aa2ef066c2cbf30cf already in progress: creating tablet
W20260810 19:48:16.633100 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet abfa81d2eb2548d0b1688e23240f6d3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet abfa81d2eb2548d0b1688e23240f6d3a already in progress: creating tablet
W20260810 19:48:16.633607 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 3b2f576afb084987be171167a62883bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b2f576afb084987be171167a62883bb already in progress: creating tablet
I20260810 19:48:16.634403 10370 tablet_bootstrap.cc:492] T 38b0c6a017dc4afc849090cca7ee8b26 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:16.634557 10370 ts_tablet_manager.cc:1403] T 38b0c6a017dc4afc849090cca7ee8b26 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.056s user 0.002s sys 0.001s
I20260810 19:48:16.635391 10370 raft_consensus.cc:359] T 38b0c6a017dc4afc849090cca7ee8b26 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.635596 10370 raft_consensus.cc:385] T 38b0c6a017dc4afc849090cca7ee8b26 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:16.635655 10370 raft_consensus.cc:740] T 38b0c6a017dc4afc849090cca7ee8b26 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:16.635823 9408 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 6f4b5c6d5bd14c59b3cd3f8ee00a3301 (table default.Table_2050cbafb9a44f30b46f397b825f7231 [id=4bf40870a0554fb9b04a1f7cc8f87d85]). Expected version 2 got 0
I20260810 19:48:16.635900 10370 consensus_queue.cc:260] T 38b0c6a017dc4afc849090cca7ee8b26 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.639232 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_27ad51955a9e4751b768d1535121449d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:16.639456 10370 ts_tablet_manager.cc:1434] T 38b0c6a017dc4afc849090cca7ee8b26 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
W20260810 19:48:16.640002 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_27ad51955a9e4751b768d1535121449d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.642619 10370 tablet_bootstrap.cc:492] T 48eee4ce10114021855075812e356652 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:16.644850 10370 tablet_bootstrap.cc:654] T 48eee4ce10114021855075812e356652 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:16.647133 9413 master_service.cc:960] ReplaceTablet: received request to replace tablet a3f48f9bb29b4be6ab6ce167159ae793 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:16.652024 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0244c244fd7740cba3105e7c2d527b0d" } modify_external_catalogs: true
I20260810 19:48:16.652230 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0244c244fd7740cba3105e7c2d527b0d" } modify_external_catalogs: true
W20260810 19:48:16.652385 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 3da297aac2644fcabfcb21769576dca4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3da297aac2644fcabfcb21769576dca4 already in progress: creating tablet
I20260810 19:48:16.652499 10377 tablet_replica.cc:333] T 38b0c6a017dc4afc849090cca7ee8b26 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:16.637809 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet a776693b6b4943a7b64e13ec10958c16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:16.640265 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 55fb03a8dd3b40f5ba3de41fa7c01f5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:16.652905 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 0c6565aebe894508b4cbbcd3cd0a849a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c6565aebe894508b4cbbcd3cd0a849a already in progress: creating tablet
W20260810 19:48:16.653134 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 264a65bd642648e59998fb55fb3c8de1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 264a65bd642648e59998fb55fb3c8de1 already in progress: creating tablet
I20260810 19:48:16.653192 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1218) took 1013 ms. Trace:
I20260810 19:48:16.653056 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d838f9cc6228427c9a67fd48d4c2d318" } new_table_name: "default.Table_9da094e5a9d94b2db79ddf9fc58bd0e7" modify_external_catalogs: true
I20260810 19:48:16.653277 12266 rpcz_store.cc:276] 0810 19:48:15.640120 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:15.640191 (+ 71us) service_pool.cc:224] Handling call
0810 19:48:16.653045 (+1012854us) ts_tablet_manager.cc:1151] Deleting tablet 5f9535152e6d45fa8ade32631b749678
0810 19:48:16.653057 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:16.653168 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1012596}
I20260810 19:48:16.654523 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet ea557438b7b74944b19e17d7fb8f20cf (table default.Table_2127777800d84906905aac5e1b9eaf64 [id=310d071d99754287862ab16b28a0b5cf]) successfully deleted
W20260810 19:48:16.654767 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 5f9535152e6d45fa8ade32631b749678 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f9535152e6d45fa8ade32631b749678 already in progress: creating tablet
I20260810 19:48:16.655579 10366 tablet_bootstrap.cc:492] T f2606854f9954f2ea10610aeb1e60368 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:16.655800 10366 ts_tablet_manager.cc:1403] T f2606854f9954f2ea10610aeb1e60368 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.048s user 0.003s sys 0.000s
I20260810 19:48:16.656544 10377 raft_consensus.cc:2243] T 38b0c6a017dc4afc849090cca7ee8b26 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:16.656937 10377 raft_consensus.cc:2272] T 38b0c6a017dc4afc849090cca7ee8b26 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:16.657516 10377 ts_tablet_manager.cc:1916] T 38b0c6a017dc4afc849090cca7ee8b26 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:16.656577 10366 raft_consensus.cc:359] T f2606854f9954f2ea10610aeb1e60368 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:16.657779 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 7d84ee2d39a64e7aa2ef066c2cbf30cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d84ee2d39a64e7aa2ef066c2cbf30cf already in progress: creating tablet
I20260810 19:48:16.657943 10366 raft_consensus.cc:385] T f2606854f9954f2ea10610aeb1e60368 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:16.658461 12266 tablet_replica.cc:333] T 27aca44685be4a0b92767d13bad15daf P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:16.658584 10366 raft_consensus.cc:740] T f2606854f9954f2ea10610aeb1e60368 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:16.658695 12266 raft_consensus.cc:2243] T 27aca44685be4a0b92767d13bad15daf P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:16.658892 12266 raft_consensus.cc:2272] T 27aca44685be4a0b92767d13bad15daf P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:16.659025 10366 consensus_queue.cc:260] T f2606854f9954f2ea10610aeb1e60368 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.659479 12266 ts_tablet_manager.cc:1916] T 27aca44685be4a0b92767d13bad15daf P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:16.661031 10366 ts_tablet_manager.cc:1434] T f2606854f9954f2ea10610aeb1e60368 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 19:48:16.665258 10367 tablet_bootstrap.cc:492] T 3159795344ae492fb099fca0e52fcf20 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:16.665442 10367 ts_tablet_manager.cc:1403] T 3159795344ae492fb099fca0e52fcf20 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.121s user 0.029s sys 0.029s
I20260810 19:48:16.666217 10367 raft_consensus.cc:359] T 3159795344ae492fb099fca0e52fcf20 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.668922 10367 raft_consensus.cc:385] T 3159795344ae492fb099fca0e52fcf20 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:16.669063 10367 raft_consensus.cc:740] T 3159795344ae492fb099fca0e52fcf20 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:16.669116 13245 raft_consensus.cc:493] T 56fa5de3bf7142b2b0978f9190091f33 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:16.669291 13245 raft_consensus.cc:515] T 56fa5de3bf7142b2b0978f9190091f33 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.669996 13245 leader_election.cc:290] T 56fa5de3bf7142b2b0978f9190091f33 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:16.670152 10367 consensus_queue.cc:260] T 3159795344ae492fb099fca0e52fcf20 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.670634 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fa5de3bf7142b2b0978f9190091f33" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:16.670854 9710 raft_consensus.cc:2393] T 56fa5de3bf7142b2b0978f9190091f33 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eadde59fd6504d679e47f03a60c64bb0 in current term 1: Already voted for candidate 6986ed920dcb4af29a5eeeda6f671691 in this term.
I20260810 19:48:16.670898 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fa5de3bf7142b2b0978f9190091f33" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:16.672379 10068 leader_election.cc:304] T 56fa5de3bf7142b2b0978f9190091f33 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:16.673022 13245 raft_consensus.cc:3060] T 56fa5de3bf7142b2b0978f9190091f33 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:16.675966 13245 raft_consensus.cc:2749] T 56fa5de3bf7142b2b0978f9190091f33 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:16.676370 13041 raft_consensus.cc:493] T f2606854f9954f2ea10610aeb1e60368 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:16.676504 13041 raft_consensus.cc:515] T f2606854f9954f2ea10610aeb1e60368 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.676903 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e4aeb59e91c24097bac9517b3c62b75a" } new_table_name: "default.Table_328016a6a8db449784cd581d7e908cfe" modify_external_catalogs: true
I20260810 19:48:16.677174 13041 leader_election.cc:290] T f2606854f9954f2ea10610aeb1e60368 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:16.677452 10377 ts_tablet_manager.cc:1929] T 38b0c6a017dc4afc849090cca7ee8b26 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:16.677561 10377 log.cc:1199] T 38b0c6a017dc4afc849090cca7ee8b26 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/38b0c6a017dc4afc849090cca7ee8b26
I20260810 19:48:16.677848 10377 ts_tablet_manager.cc:1950] T 38b0c6a017dc4afc849090cca7ee8b26 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:16.682154 10367 ts_tablet_manager.cc:1434] T 3159795344ae492fb099fca0e52fcf20 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.017s user 0.003s sys 0.000s
I20260810 19:48:16.683694 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet e785857b6be84721b286398f627dc9a0
I20260810 19:48:16.687564 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet e785857b6be84721b286398f627dc9a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:16.688351 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet e785857b6be84721b286398f627dc9a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e785857b6be84721b286398f627dc9a0 already in progress: creating tablet
I20260810 19:48:16.689107 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet e785857b6be84721b286398f627dc9a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:16.689236 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 3159795344ae492fb099fca0e52fcf20 with delete_type TABLET_DATA_DELETED (replaced by tablet 629cfbd55c0b4a2fbe43f41cdefa85f8) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:16.689831 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_609bec2bcadf419db309d021dc9f9906"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:16.692489 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_609bec2bcadf419db309d021dc9f9906 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.694801 10367 tablet_bootstrap.cc:492] T cb2c9782c034435088f991bef8edf288 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:16.695626 10370 tablet_bootstrap.cc:492] T 48eee4ce10114021855075812e356652 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:16.695850 10370 ts_tablet_manager.cc:1403] T 48eee4ce10114021855075812e356652 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.056s user 0.003s sys 0.001s
I20260810 19:48:16.697136 10370 raft_consensus.cc:359] T 48eee4ce10114021855075812e356652 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.697402 10370 raft_consensus.cc:385] T 48eee4ce10114021855075812e356652 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:16.697512 10370 raft_consensus.cc:740] T 48eee4ce10114021855075812e356652 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:16.697819 10370 consensus_queue.cc:260] T 48eee4ce10114021855075812e356652 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.698697 10370 ts_tablet_manager.cc:1434] T 48eee4ce10114021855075812e356652 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 19:48:16.699705 10370 tablet_bootstrap.cc:492] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:16.701609 10370 tablet_bootstrap.cc:654] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:16.697249 12266 ts_tablet_manager.cc:1929] T 27aca44685be4a0b92767d13bad15daf P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:16.702498 12266 log.cc:1199] T 27aca44685be4a0b92767d13bad15daf P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/27aca44685be4a0b92767d13bad15daf
I20260810 19:48:16.702924 12266 ts_tablet_manager.cc:1950] T 27aca44685be4a0b92767d13bad15daf P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
W20260810 19:48:16.704315 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5a35be79a8924213ab860a9da04a598c consensus state has no leader
I20260810 19:48:16.704708 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 5598878488864bfba663b2edd999e224
I20260810 19:48:16.708012 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet 5598878488864bfba663b2edd999e224 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:16.709929 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 5598878488864bfba663b2edd999e224 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5598878488864bfba663b2edd999e224 already in progress: creating tablet
I20260810 19:48:16.711004 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_96b63be644654b1c9fb59633415031b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:16.711550 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96b63be644654b1c9fb59633415031b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.713052 9418 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 8b24b75629ec423b90e4bf287e7cfd38 (table default.Table_ce3ea915b9dd44b3943c4de2b462d48c [id=9f58b113854b4d139e789332dfe00c8c]). Expected version 3 got 0
I20260810 19:48:16.706034 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 5598878488864bfba663b2edd999e224 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:16.715456 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1220) took 1014 ms. Trace:
I20260810 19:48:16.715559 12266 rpcz_store.cc:276] 0810 19:48:15.701498 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:15.701552 (+ 54us) service_pool.cc:224] Handling call
0810 19:48:16.658401 (+956849us) ts_tablet_manager.cc:1151] Deleting tablet 27aca44685be4a0b92767d13bad15daf
0810 19:48:16.658411 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:16.683929 (+ 25518us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:16.697178 (+ 13249us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:16.715427 (+ 18249us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":956635}
I20260810 19:48:16.716066 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 27aca44685be4a0b92767d13bad15daf (table default.Table_2d55b7a83d4d4faeb63acf0fd1c205b7 [id=b654f41c9aa74d3cb771ec66358c0473]) successfully deleted
I20260810 19:48:16.723469 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet a3f48f9bb29b4be6ab6ce167159ae793
I20260810 19:48:16.723971 9413 catalog_manager.cc:6807] ReplaceTablet: tablet a3f48f9bb29b4be6ab6ce167159ae793 deleted and replaced by tablet 116ec3ab4c5140d5a57a525d2aaa5bb7
W20260810 19:48:16.724433 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ad31c57d589140879a476bb85ee53ef2 consensus state has no leader
I20260810 19:48:16.725591 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet a3f48f9bb29b4be6ab6ce167159ae793 with delete_type TABLET_DATA_DELETED (replaced by tablet 116ec3ab4c5140d5a57a525d2aaa5bb7) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:16.726462 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet abfa81d2eb2548d0b1688e23240f6d3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet abfa81d2eb2548d0b1688e23240f6d3a already in progress: creating tablet
I20260810 19:48:16.726774 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet a3f48f9bb29b4be6ab6ce167159ae793 with delete_type TABLET_DATA_DELETED (replaced by tablet 116ec3ab4c5140d5a57a525d2aaa5bb7) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:16.726858 12266 tablet_replica.cc:333] T f42e9b00e3da4d73b4beb1b325f09f4a P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:16.727087 12266 raft_consensus.cc:2243] T f42e9b00e3da4d73b4beb1b325f09f4a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:16.727253 12266 raft_consensus.cc:2272] T f42e9b00e3da4d73b4beb1b325f09f4a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:16.727864 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet a3f48f9bb29b4be6ab6ce167159ae793 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3f48f9bb29b4be6ab6ce167159ae793 already in progress: creating tablet
I20260810 19:48:16.728008 12266 ts_tablet_manager.cc:1916] T f42e9b00e3da4d73b4beb1b325f09f4a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:16.733923 10370 tablet_bootstrap.cc:492] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:16.734186 10370 ts_tablet_manager.cc:1403] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.035s user 0.012s sys 0.003s
I20260810 19:48:16.735044 10370 raft_consensus.cc:359] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.735257 10370 raft_consensus.cc:385] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:16.735318 10370 raft_consensus.cc:740] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:16.735603 10370 consensus_queue.cc:260] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.736619 10370 ts_tablet_manager.cc:1434] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:16.737275 10370 tablet_bootstrap.cc:492] T b4b6b17ce3354600b2f7450c6e483c69 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:16.739627 10370 tablet_bootstrap.cc:654] T b4b6b17ce3354600b2f7450c6e483c69 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:16.743511 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_981f80e468834b91ba17192d0dea8e60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:16.744221 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_981f80e468834b91ba17192d0dea8e60 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.744736 10377 tablet_replica.cc:333] T 3520274768ed41abb010bb109127affa P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:16.744933 10377 raft_consensus.cc:2243] T 3520274768ed41abb010bb109127affa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:16.745105 10377 raft_consensus.cc:2272] T 3520274768ed41abb010bb109127affa P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:16.679298 9830 leader_election.cc:343] T f2606854f9954f2ea10610aeb1e60368 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Not found: Tablet not found: f2606854f9954f2ea10610aeb1e60368
W20260810 19:48:16.745417 9830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.195:43797, user_credentials={real_user=slave}} blocked reactor thread for 66128.2us
I20260810 19:48:16.745721 10377 ts_tablet_manager.cc:1916] T 3520274768ed41abb010bb109127affa P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:16.746827 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet e785857b6be84721b286398f627dc9a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:16.747020 9897 tablet_service.cc:1558] Processing DeleteTablet for tablet 5598878488864bfba663b2edd999e224 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:38276
W20260810 19:48:16.747123 9831 leader_election.cc:343] T f2606854f9954f2ea10610aeb1e60368 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: f2606854f9954f2ea10610aeb1e60368
I20260810 19:48:16.747310 9831 leader_election.cc:304] T f2606854f9954f2ea10610aeb1e60368 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:48:16.747596 9831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 68129.2us
I20260810 19:48:16.748592 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet a3f48f9bb29b4be6ab6ce167159ae793 with delete_type TABLET_DATA_DELETED (replaced by tablet 116ec3ab4c5140d5a57a525d2aaa5bb7) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:16.749697 13041 raft_consensus.cc:2749] T f2606854f9954f2ea10610aeb1e60368 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:16.749894 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4d107d4bc3e54048b0109bcb4f5cb9f1" } new_table_name: "default.Table_7c4a15fb9a454c01bb9fa99dd4f138c4" modify_external_catalogs: true
I20260810 19:48:16.682086 10366 tablet_bootstrap.cc:492] T 823bcbb987374ab4b9b0fc3d9d79b571 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:16.752180 10366 tablet_bootstrap.cc:654] T 823bcbb987374ab4b9b0fc3d9d79b571 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:16.752993 9795 tablet.cc:2406] T 3159795344ae492fb099fca0e52fcf20 P fcd31b1bbb0340cbacfce652b4ad8da4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 19:48:16.755635 10370 tablet_bootstrap.cc:492] T b4b6b17ce3354600b2f7450c6e483c69 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:16.755786 10370 ts_tablet_manager.cc:1403] T b4b6b17ce3354600b2f7450c6e483c69 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.002s
I20260810 19:48:16.756579 10370 raft_consensus.cc:359] T b4b6b17ce3354600b2f7450c6e483c69 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.756767 10370 raft_consensus.cc:385] T b4b6b17ce3354600b2f7450c6e483c69 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:16.756819 10370 raft_consensus.cc:740] T b4b6b17ce3354600b2f7450c6e483c69 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:16.757043 10370 consensus_queue.cc:260] T b4b6b17ce3354600b2f7450c6e483c69 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.758718 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2050cbafb9a44f30b46f397b825f7231" } modify_external_catalogs: true
I20260810 19:48:16.758925 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2050cbafb9a44f30b46f397b825f7231" } modify_external_catalogs: true
W20260810 19:48:16.760533 10249 tablet.cc:2406] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 19:48:16.761876 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 38b0c6a017dc4afc849090cca7ee8b26 (table default.Table_9c7e78bf368c4d99bca05e9fc4dfcbda [id=df9ef32c15fd46caab42b0a0214afd64]) successfully deleted
I20260810 19:48:16.762027 10370 ts_tablet_manager.cc:1434] T b4b6b17ce3354600b2f7450c6e483c69 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260810 19:48:16.762357 10370 tablet_bootstrap.cc:492] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:16.765136 12266 ts_tablet_manager.cc:1929] T f42e9b00e3da4d73b4beb1b325f09f4a P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:16.765786 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c71e63f4580a439cb7ba4c2f4dd20436"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:16.771625 10366 tablet_bootstrap.cc:492] T 823bcbb987374ab4b9b0fc3d9d79b571 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:16.771785 10366 ts_tablet_manager.cc:1403] T 823bcbb987374ab4b9b0fc3d9d79b571 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.090s user 0.002s sys 0.001s
I20260810 19:48:16.772490 10366 raft_consensus.cc:359] T 823bcbb987374ab4b9b0fc3d9d79b571 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.772680 10366 raft_consensus.cc:385] T 823bcbb987374ab4b9b0fc3d9d79b571 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:16.772724 10366 raft_consensus.cc:740] T 823bcbb987374ab4b9b0fc3d9d79b571 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:16.772929 10366 consensus_queue.cc:260] T 823bcbb987374ab4b9b0fc3d9d79b571 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.773471 10366 ts_tablet_manager.cc:1434] T 823bcbb987374ab4b9b0fc3d9d79b571 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:16.773787 10366 tablet_bootstrap.cc:492] T 1f895bcd21f647f2ab813903d600a31a P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:16.775703 10366 tablet_bootstrap.cc:654] T 1f895bcd21f647f2ab813903d600a31a P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:16.776629 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 34fb654d56f249c8a0353c495802250b consensus state has no leader
I20260810 19:48:16.788456 10366 tablet_bootstrap.cc:492] T 1f895bcd21f647f2ab813903d600a31a P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:16.789170 10366 ts_tablet_manager.cc:1403] T 1f895bcd21f647f2ab813903d600a31a P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.001s
I20260810 19:48:16.792382 10366 raft_consensus.cc:359] T 1f895bcd21f647f2ab813903d600a31a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.792737 10366 raft_consensus.cc:385] T 1f895bcd21f647f2ab813903d600a31a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:16.792846 10366 raft_consensus.cc:740] T 1f895bcd21f647f2ab813903d600a31a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:16.792886 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_cb5d4a067ef84d93b3c5f6182a716580"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:16.797650 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb5d4a067ef84d93b3c5f6182a716580 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:16.799121 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c71e63f4580a439cb7ba4c2f4dd20436 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.800830 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e8f8a641ccd242d79d69a56475e8d33c" } modify_external_catalogs: true
I20260810 19:48:16.801008 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e8f8a641ccd242d79d69a56475e8d33c" } modify_external_catalogs: true
I20260810 19:48:16.770423 13159 raft_consensus.cc:493] T 7de27c3442584746b76ea838d38f0b9b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:16.818789 13159 raft_consensus.cc:515] T 7de27c3442584746b76ea838d38f0b9b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.819363 10367 tablet_bootstrap.cc:654] T cb2c9782c034435088f991bef8edf288 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:16.819895 13159 leader_election.cc:290] T 7de27c3442584746b76ea838d38f0b9b P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:16.821115 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de27c3442584746b76ea838d38f0b9b" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:16.821369 12266 log.cc:1199] T f42e9b00e3da4d73b4beb1b325f09f4a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/f42e9b00e3da4d73b4beb1b325f09f4a
W20260810 19:48:16.821754 9611 leader_election.cc:343] T 7de27c3442584746b76ea838d38f0b9b P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:16.801306 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d93821ff46a4096a8ebbac83faabed7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:16.801306 9897 tablet_service.cc:1558] Processing DeleteTablet for tablet f2606854f9954f2ea10610aeb1e60368 with delete_type TABLET_DATA_DELETED (replaced by tablet 898b70d09c1d410fb75cd4dd32d844c8) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:16.808667 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 823bcbb987374ab4b9b0fc3d9d79b571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:16.823686 10366 consensus_queue.cc:260] T 1f895bcd21f647f2ab813903d600a31a P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.824211 10366 ts_tablet_manager.cc:1434] T 1f895bcd21f647f2ab813903d600a31a P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.035s user 0.001s sys 0.001s
I20260810 19:48:16.824505 10366 tablet_bootstrap.cc:492] T 7459e64bd48449d2a8d4ff835b215d46 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:16.826172 10366 tablet_bootstrap.cc:654] T 7459e64bd48449d2a8d4ff835b215d46 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:16.827451 10367 tablet_bootstrap.cc:492] T cb2c9782c034435088f991bef8edf288 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:16.827602 10367 ts_tablet_manager.cc:1403] T cb2c9782c034435088f991bef8edf288 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.133s user 0.006s sys 0.001s
I20260810 19:48:16.828354 10367 raft_consensus.cc:359] T cb2c9782c034435088f991bef8edf288 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.828537 10367 raft_consensus.cc:385] T cb2c9782c034435088f991bef8edf288 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:16.828598 10367 raft_consensus.cc:740] T cb2c9782c034435088f991bef8edf288 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:16.828887 10367 consensus_queue.cc:260] T cb2c9782c034435088f991bef8edf288 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.833398 10370 tablet_bootstrap.cc:654] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:16.834651 13295 tablet.cc:1724] T 81720b897a674b5380c6469d1600a979 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:16.840085 13245 raft_consensus.cc:493] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:16.840261 13245 raft_consensus.cc:515] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.840246 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c23873a5843340709af27b3886f51b1b" } new_table_name: "default.Table_9967f6e10cab45198260b0a88dd3dd90" modify_external_catalogs: true
I20260810 19:48:16.840984 13245 leader_election.cc:290] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:16.841703 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1e4400ca684da7b3b5e6592e19b6e6" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:16.841934 9931 raft_consensus.cc:2468] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:16.842440 10067 leader_election.cc:304] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:16.842607 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f895bcd21f647f2ab813903d600a31a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:16.852715 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_830fae4b55a24a80977d725471403000"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:16.853370 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_830fae4b55a24a80977d725471403000 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.854985 12266 ts_tablet_manager.cc:1950] T f42e9b00e3da4d73b4beb1b325f09f4a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:16.855608 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f434eae9b387478d93beb21a4f479de3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:16.856010 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1222) took 1049 ms. Trace:
W20260810 19:48:16.856154 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f434eae9b387478d93beb21a4f479de3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.856096 12266 rpcz_store.cc:276] 0810 19:48:15.806750 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:15.806910 (+ 160us) service_pool.cc:224] Handling call
0810 19:48:16.726800 (+919890us) ts_tablet_manager.cc:1151] Deleting tablet f42e9b00e3da4d73b4beb1b325f09f4a
0810 19:48:16.726812 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:16.761736 (+ 34924us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:16.765070 (+ 3334us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:16.855981 (+ 90911us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":919686}
I20260810 19:48:16.856812 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_dcd173e747ce4cd89b52951222967fc4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:16.857307 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dcd173e747ce4cd89b52951222967fc4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.858359 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet f42e9b00e3da4d73b4beb1b325f09f4a (table default.Table_cadbbfe4f5d04095b599c4f15a26eae5 [id=5969227134794b0da0ce049c943e7151]) successfully deleted
I20260810 19:48:16.858646 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet cb2c9782c034435088f991bef8edf288 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:16.810174 10377 ts_tablet_manager.cc:1929] T 3520274768ed41abb010bb109127affa P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 19:48:16.818854 10030 tablet.cc:2406] T 823bcbb987374ab4b9b0fc3d9d79b571 P 6986ed920dcb4af29a5eeeda6f671691: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 19:48:16.820822 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de27c3442584746b76ea838d38f0b9b" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:16.863942 10377 log.cc:1199] T 3520274768ed41abb010bb109127affa P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/3520274768ed41abb010bb109127affa
I20260810 19:48:16.864053 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_41bac9c99b9c403fb298a8ad414099bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:16.864356 10377 ts_tablet_manager.cc:1950] T 3520274768ed41abb010bb109127affa P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
W20260810 19:48:16.864562 9611 leader_election.cc:343] T 7de27c3442584746b76ea838d38f0b9b P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:16.864616 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41bac9c99b9c403fb298a8ad414099bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.864697 9611 leader_election.cc:304] T 7de27c3442584746b76ea838d38f0b9b P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:16.865397 10377 tablet_replica.cc:333] T b4b6b17ce3354600b2f7450c6e483c69 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:16.865535 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 3520274768ed41abb010bb109127affa (table default.Table_f9e687e842744de19940ff3ddb74dfa1 [id=541cc0f8fabe41b4a2114eb70c9d5ba4]) successfully deleted
I20260810 19:48:16.865588 10377 raft_consensus.cc:2243] T b4b6b17ce3354600b2f7450c6e483c69 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:16.865739 10377 raft_consensus.cc:2272] T b4b6b17ce3354600b2f7450c6e483c69 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:16.875113 12266 tablet_replica.cc:333] T b91737c2129e4ca385b4e1c8999c62b4 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
W20260810 19:48:16.875840 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 431c11767fd24c0dac8c3f8dd986cafc has no consensus state
I20260810 19:48:16.875906 10377 ts_tablet_manager.cc:1916] T b4b6b17ce3354600b2f7450c6e483c69 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:16.876665 12266 raft_consensus.cc:2243] T b91737c2129e4ca385b4e1c8999c62b4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:16.878262 12266 raft_consensus.cc:2272] T b91737c2129e4ca385b4e1c8999c62b4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:16.880513 12266 ts_tablet_manager.cc:1916] T b91737c2129e4ca385b4e1c8999c62b4 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:16.877679 13299 tablet.cc:1724] T 81720b897a674b5380c6469d1600a979 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:16.879240 13308 raft_consensus.cc:2749] T 7de27c3442584746b76ea838d38f0b9b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:16.892799 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0a8cc6e2f1d54fff9f1b64a59e7ee6d5" } modify_external_catalogs: true
I20260810 19:48:16.893025 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0a8cc6e2f1d54fff9f1b64a59e7ee6d5" } modify_external_catalogs: true
W20260810 19:48:16.897876 10068 leader_election.cc:343] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: bb1e4400ca684da7b3b5e6592e19b6e6
W20260810 19:48:16.897957 10067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 55540.3us
I20260810 19:48:16.898437 13245 raft_consensus.cc:2804] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:16.898530 13245 raft_consensus.cc:493] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:16.898593 13245 raft_consensus.cc:3060] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:16.900312 10377 ts_tablet_manager.cc:1929] T b4b6b17ce3354600b2f7450c6e483c69 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:16.900449 10377 log.cc:1199] T b4b6b17ce3354600b2f7450c6e483c69 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/b4b6b17ce3354600b2f7450c6e483c69
I20260810 19:48:16.900749 10377 ts_tablet_manager.cc:1950] T b4b6b17ce3354600b2f7450c6e483c69 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:16.901399 13245 raft_consensus.cc:515] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.902124 13245 leader_election.cc:290] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:16.902515 10068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 56003.8us
I20260810 19:48:16.902289 13245 raft_consensus.cc:493] T 38b0c6a017dc4afc849090cca7ee8b26 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:16.903527 13245 raft_consensus.cc:515] T 38b0c6a017dc4afc849090cca7ee8b26 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.903556 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1e4400ca684da7b3b5e6592e19b6e6" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:16.903748 9935 raft_consensus.cc:3060] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:16.904183 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet b4b6b17ce3354600b2f7450c6e483c69 (table default.Table_b94c792bfc8b4c16b86e7127f8082af5 [id=270934e8d981479d9f4b49bc54916f77]) successfully deleted
I20260810 19:48:16.904893 10377 tablet_replica.cc:333] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
W20260810 19:48:16.905020 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet a099e4cc255c4502b745a1e29cbd4c42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a099e4cc255c4502b745a1e29cbd4c42 already in progress: creating tablet
W20260810 19:48:16.905252 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet d0976c7855cb49c4ad4a4cf3b1ac1518 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d0976c7855cb49c4ad4a4cf3b1ac1518 already in progress: creating tablet
W20260810 19:48:16.905442 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 650ca46244e54bed89e96c4a09fc7a94 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 650ca46244e54bed89e96c4a09fc7a94 already in progress: creating tablet
W20260810 19:48:16.905618 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 22954e727fb44a24bd382b9caee9996b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22954e727fb44a24bd382b9caee9996b already in progress: creating tablet
W20260810 19:48:16.905782 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet cd05a86e7ccd40afbfb10cb8dfe53e78 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd05a86e7ccd40afbfb10cb8dfe53e78 already in progress: creating tablet
W20260810 19:48:16.905921 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet e6ae4df29db74085849d82cf2529ac51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6ae4df29db74085849d82cf2529ac51 already in progress: creating tablet
W20260810 19:48:16.906093 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 8425f8c3258a41c291f9fa8dbd29fbc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8425f8c3258a41c291f9fa8dbd29fbc6 already in progress: creating tablet
I20260810 19:48:16.906840 9935 raft_consensus.cc:2468] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:16.907210 13245 leader_election.cc:290] T 38b0c6a017dc4afc849090cca7ee8b26 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:16.907801 10377 raft_consensus.cc:2243] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 19:48:16.907871 10068 leader_election.cc:343] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: bb1e4400ca684da7b3b5e6592e19b6e6
I20260810 19:48:16.908121 13245 raft_consensus.cc:493] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:16.908243 10377 raft_consensus.cc:2272] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:16.908284 13245 raft_consensus.cc:515] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.908915 10377 ts_tablet_manager.cc:1916] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:16.909287 13245 leader_election.cc:290] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:16.908412 10067 leader_election.cc:304] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters: fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:48:16.910280 10067 leader_election.cc:343] T 38b0c6a017dc4afc849090cca7ee8b26 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 38b0c6a017dc4afc849090cca7ee8b26
I20260810 19:48:16.910706 13245 raft_consensus.cc:2804] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:16.910872 13245 raft_consensus.cc:697] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:16.910928 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a77c72f2244a08a65e3779c5895752" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:16.911175 13245 consensus_queue.cc:237] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:16.911573 10067 leader_election.cc:343] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:16.916786 10366 tablet_bootstrap.cc:492] T 7459e64bd48449d2a8d4ff835b215d46 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:16.917692 10370 tablet_bootstrap.cc:492] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:16.918639 10367 ts_tablet_manager.cc:1434] T cb2c9782c034435088f991bef8edf288 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.091s user 0.008s sys 0.004s
W20260810 19:48:16.918794 9400 consensus_peers.cc:597] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a -> Peer f52c40e347e24ab4b3129e7064f4a43e (127.8.235.253:37397): Couldn't send request to peer f52c40e347e24ab4b3129e7064f4a43e. Status: Network error: Client connection negotiation failed: client connection to 127.8.235.253:37397: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260810 19:48:16.918803 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a77c72f2244a08a65e3779c5895752" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:16.918998 10367 tablet_bootstrap.cc:492] T 3109703c51e54af78b58e9bbca50af33 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:16.919067 10370 ts_tablet_manager.cc:1403] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.157s user 0.002s sys 0.003s
I20260810 19:48:16.918995 9710 raft_consensus.cc:2468] T 22a77c72f2244a08a65e3779c5895752 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:16.919668 10068 leader_election.cc:304] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691
I20260810 19:48:16.919986 10370 raft_consensus.cc:359] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.920171 10370 raft_consensus.cc:385] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:16.920209 13245 raft_consensus.cc:2804] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:16.920388 10366 ts_tablet_manager.cc:1403] T 7459e64bd48449d2a8d4ff835b215d46 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.096s user 0.003s sys 0.000s
W20260810 19:48:16.920678 10068 leader_election.cc:343] T 38b0c6a017dc4afc849090cca7ee8b26 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 38b0c6a017dc4afc849090cca7ee8b26
I20260810 19:48:16.920795 10068 leader_election.cc:304] T 38b0c6a017dc4afc849090cca7ee8b26 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:16.921046 13309 raft_consensus.cc:2749] T 38b0c6a017dc4afc849090cca7ee8b26 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:16.921130 10366 raft_consensus.cc:359] T 7459e64bd48449d2a8d4ff835b215d46 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.921298 10366 raft_consensus.cc:385] T 7459e64bd48449d2a8d4ff835b215d46 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:16.921340 10366 raft_consensus.cc:740] T 7459e64bd48449d2a8d4ff835b215d46 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:16.921550 10366 consensus_queue.cc:260] T 7459e64bd48449d2a8d4ff835b215d46 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.922551 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9747046448e44dc4ab648e6759baad73" } modify_external_catalogs: true
I20260810 19:48:16.922734 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_9747046448e44dc4ab648e6759baad73" } modify_external_catalogs: true
I20260810 19:48:16.923128 10367 tablet_bootstrap.cc:654] T 3109703c51e54af78b58e9bbca50af33 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:16.923126 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2845bb7ac75a49d99483ac3cf7d96171" } new_table_name: "default.Table_ae373d0d0422476abe284d192feaa15a" modify_external_catalogs: true
I20260810 19:48:16.920317 13245 raft_consensus.cc:493] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:16.923661 13245 raft_consensus.cc:3060] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:16.927695 13245 raft_consensus.cc:515] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.932987 9709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a77c72f2244a08a65e3779c5895752" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:16.933216 9709 raft_consensus.cc:3060] T 22a77c72f2244a08a65e3779c5895752 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:16.936368 9709 raft_consensus.cc:2468] T 22a77c72f2244a08a65e3779c5895752 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
W20260810 19:48:16.936724 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f146f440c1174d348ed273d29145e815 consensus state has no leader
I20260810 19:48:16.938076 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_11cc4f48379a47908e779ed3c995376a" } new_table_name: "default.Table_723f07e895774e51b004ce069e6ce4f5" modify_external_catalogs: true
I20260810 19:48:16.939508 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1d1421fb907c4d5d9103c350b0557351"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:16.940440 10068 leader_election.cc:304] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:16.940759 13309 raft_consensus.cc:2804] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:16.943116 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b3fe10a412cb4c13851701b963a1d7ae" } new_table_name: "default.Table_ae7cc16a22e34413a8d1ddf892cc7010" modify_external_catalogs: true
W20260810 19:48:16.950963 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d1421fb907c4d5d9103c350b0557351 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.952481 13245 leader_election.cc:290] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:16.920220 10370 raft_consensus.cc:740] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:16.953142 10370 consensus_queue.cc:260] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.953810 10370 ts_tablet_manager.cc:1434] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.035s user 0.001s sys 0.001s
I20260810 19:48:16.955538 10370 tablet_bootstrap.cc:492] T 0292c3214aa84c40ace16760f414d912 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:16.957518 10370 tablet_bootstrap.cc:654] T 0292c3214aa84c40ace16760f414d912 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:16.958809 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a77c72f2244a08a65e3779c5895752" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:16.959004 12266 ts_tablet_manager.cc:1929] T b91737c2129e4ca385b4e1c8999c62b4 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:16.959021 13104 raft_consensus.cc:493] T 7459e64bd48449d2a8d4ff835b215d46 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:16.959124 12266 log.cc:1199] T b91737c2129e4ca385b4e1c8999c62b4 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/b91737c2129e4ca385b4e1c8999c62b4
I20260810 19:48:16.959143 13104 raft_consensus.cc:515] T 7459e64bd48449d2a8d4ff835b215d46 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:16.959539 10067 leader_election.cc:343] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:16.960005 13104 leader_election.cc:290] T 7459e64bd48449d2a8d4ff835b215d46 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:16.960959 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7459e64bd48449d2a8d4ff835b215d46" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:16.961722 9830 leader_election.cc:343] T 7459e64bd48449d2a8d4ff835b215d46 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:16.962239 12266 ts_tablet_manager.cc:1950] T b91737c2129e4ca385b4e1c8999c62b4 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
W20260810 19:48:16.963300 9831 leader_election.cc:343] T 7459e64bd48449d2a8d4ff835b215d46 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 7459e64bd48449d2a8d4ff835b215d46
I20260810 19:48:16.963418 9831 leader_election.cc:304] T 7459e64bd48449d2a8d4ff835b215d46 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:16.963848 13041 raft_consensus.cc:2749] T 7459e64bd48449d2a8d4ff835b215d46 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:16.916802 10377 ts_tablet_manager.cc:1929] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:16.969097 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet b91737c2129e4ca385b4e1c8999c62b4 (table default.Table_b1dee343716e4e969055ae6ed5d93b60 [id=9a1f9fb7aee041a2a8b5cc736d74eaa7]) successfully deleted
I20260810 19:48:16.970158 10377 log.cc:1199] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/bb1e4400ca684da7b3b5e6592e19b6e6
I20260810 19:48:16.970589 10366 ts_tablet_manager.cc:1434] T 7459e64bd48449d2a8d4ff835b215d46 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.050s user 0.001s sys 0.000s
W20260810 19:48:16.971060 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 3b2f576afb084987be171167a62883bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b2f576afb084987be171167a62883bb already in progress: creating tablet
I20260810 19:48:16.970765 10377 ts_tablet_manager.cc:1950] T bb1e4400ca684da7b3b5e6592e19b6e6 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:16.971486 12266 tablet_replica.cc:333] T 3da297aac2644fcabfcb21769576dca4 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:16.971736 12266 raft_consensus.cc:2243] T 3da297aac2644fcabfcb21769576dca4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:16.973234 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet bb1e4400ca684da7b3b5e6592e19b6e6 (table default.Table_a1fa6532e8104ca59b2dca19999e2e61 [id=857eb3f1b89c41a6b2e3b30b375a585c]) successfully deleted
I20260810 19:48:16.974267 10367 tablet_bootstrap.cc:492] T 3109703c51e54af78b58e9bbca50af33 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:16.974510 10367 ts_tablet_manager.cc:1403] T 3109703c51e54af78b58e9bbca50af33 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.056s user 0.008s sys 0.001s
I20260810 19:48:16.976856 9415 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_328016a6a8db449784cd581d7e908cfe [id=8d7f043045ff44cd886367b5860f8433] alter complete (version 2)
I20260810 19:48:16.977063 10367 raft_consensus.cc:359] T 3109703c51e54af78b58e9bbca50af33 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.977267 10367 raft_consensus.cc:385] T 3109703c51e54af78b58e9bbca50af33 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:16.977344 10367 raft_consensus.cc:740] T 3109703c51e54af78b58e9bbca50af33 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:16.977584 10367 consensus_queue.cc:260] T 3109703c51e54af78b58e9bbca50af33 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.978170 10367 ts_tablet_manager.cc:1434] T 3109703c51e54af78b58e9bbca50af33 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260810 19:48:16.979182 10366 tablet_bootstrap.cc:492] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:16.979782 10367 tablet_bootstrap.cc:492] T e87fd882e6b6413480a0cb06aee74722 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:16.982358 9415 master_service.cc:960] ReplaceTablet: received request to replace tablet 53bfac43413347cc8d596169e6daa274 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:16.983980 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_7c4fc88cb6b74b37be38348e717f1280"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:16.985383 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c4fc88cb6b74b37be38348e717f1280 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:16.986688 12266 raft_consensus.cc:2272] T 3da297aac2644fcabfcb21769576dca4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:16.989540 12266 ts_tablet_manager.cc:1916] T 3da297aac2644fcabfcb21769576dca4 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:16.995193 13309 raft_consensus.cc:697] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:16.995446 10367 tablet_bootstrap.cc:654] T e87fd882e6b6413480a0cb06aee74722 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:16.995601 13309 consensus_queue.cc:237] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:16.981360 9906 tablet_service.cc:1558] Processing DeleteTablet for tablet 7459e64bd48449d2a8d4ff835b215d46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:10 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:16.984452 10377 tablet_replica.cc:333] T 668b3514d9f64d44a8747647194e50be P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:16.998658 10377 raft_consensus.cc:2243] T 668b3514d9f64d44a8747647194e50be P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:16.998939 10377 raft_consensus.cc:2272] T 668b3514d9f64d44a8747647194e50be P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:16.999583 10370 tablet_bootstrap.cc:492] T 0292c3214aa84c40ace16760f414d912 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:16.999634 10377 ts_tablet_manager.cc:1916] T 668b3514d9f64d44a8747647194e50be P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:17.000069 10366 tablet_bootstrap.cc:654] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:17.000049 10370 ts_tablet_manager.cc:1403] T 0292c3214aa84c40ace16760f414d912 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.001s
I20260810 19:48:17.000831 10370 raft_consensus.cc:359] T 0292c3214aa84c40ace16760f414d912 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.001051 10370 raft_consensus.cc:385] T 0292c3214aa84c40ace16760f414d912 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:17.001120 10370 raft_consensus.cc:740] T 0292c3214aa84c40ace16760f414d912 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:17.001376 10370 consensus_queue.cc:260] T 0292c3214aa84c40ace16760f414d912 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.002368 10370 ts_tablet_manager.cc:1434] T 0292c3214aa84c40ace16760f414d912 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:17.002720 10370 tablet_bootstrap.cc:492] T 5f4e2adee0264e418ff8c54912973e60 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:48:17.006549 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f8cfda17c3434e73b8c37b8e6fd73bf7 consensus state has no leader
I20260810 19:48:17.008469 10370 tablet_bootstrap.cc:654] T 5f4e2adee0264e418ff8c54912973e60 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:17.009152 10377 ts_tablet_manager.cc:1929] T 668b3514d9f64d44a8747647194e50be P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260810 19:48:17.014001 13302 raft_consensus.cc:493] T 3109703c51e54af78b58e9bbca50af33 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.014261 13302 raft_consensus.cc:515] T 3109703c51e54af78b58e9bbca50af33 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.018908 10377 log.cc:1199] T 668b3514d9f64d44a8747647194e50be P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/668b3514d9f64d44a8747647194e50be
I20260810 19:48:17.019409 10377 ts_tablet_manager.cc:1950] T 668b3514d9f64d44a8747647194e50be P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
W20260810 19:48:17.020452 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2067e0b1bf2841a2920b0e57ebd1780d consensus state has no leader
I20260810 19:48:17.018733 10367 tablet_bootstrap.cc:492] T e87fd882e6b6413480a0cb06aee74722 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:17.022166 10367 ts_tablet_manager.cc:1403] T e87fd882e6b6413480a0cb06aee74722 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.042s user 0.001s sys 0.004s
I20260810 19:48:17.023102 10367 raft_consensus.cc:359] T e87fd882e6b6413480a0cb06aee74722 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.023353 10367 raft_consensus.cc:385] T e87fd882e6b6413480a0cb06aee74722 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:17.023474 10367 raft_consensus.cc:740] T e87fd882e6b6413480a0cb06aee74722 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:17.023773 10367 consensus_queue.cc:260] T e87fd882e6b6413480a0cb06aee74722 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.024082 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3109703c51e54af78b58e9bbca50af33" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:17.024195 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3109703c51e54af78b58e9bbca50af33" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:17.024822 9611 leader_election.cc:343] T 3109703c51e54af78b58e9bbca50af33 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.024881 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0ee3eba17cf2454e9dd394cd7470a671"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:17.025048 9611 leader_election.cc:343] T 3109703c51e54af78b58e9bbca50af33 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.025137 9611 leader_election.cc:304] T 3109703c51e54af78b58e9bbca50af33 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
W20260810 19:48:17.025458 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ee3eba17cf2454e9dd394cd7470a671 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:17.026482 13159 raft_consensus.cc:2749] T 3109703c51e54af78b58e9bbca50af33 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:17.027676 13302 leader_election.cc:290] T 3109703c51e54af78b58e9bbca50af33 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:17.027993 13041 consensus_queue.cc:1048] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:17.028832 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 3109703c51e54af78b58e9bbca50af33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:58 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:17.032106 10367 ts_tablet_manager.cc:1434] T e87fd882e6b6413480a0cb06aee74722 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260810 19:48:17.032536 10367 tablet_bootstrap.cc:492] T 5a35be79a8924213ab860a9da04a598c P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:17.034864 10367 tablet_bootstrap.cc:654] T 5a35be79a8924213ab860a9da04a598c P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:17.035836 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 668b3514d9f64d44a8747647194e50be (table default.Table_fcc942a53d1b4c05a1a07df15f3d9230 [id=f96d1bbf37954740825d721e6259ce3c]) successfully deleted
I20260810 19:48:17.037124 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_59dd0d940c174b9f9998bec1b5c54a68" } new_table_name: "default.Table_3796e03f85cf4074a369ef226f554cd7" modify_external_catalogs: true
W20260810 19:48:17.037640 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet e785857b6be84721b286398f627dc9a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e785857b6be84721b286398f627dc9a0 already in progress: creating tablet
W20260810 19:48:17.038396 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 5598878488864bfba663b2edd999e224 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5598878488864bfba663b2edd999e224 already in progress: creating tablet
W20260810 19:48:17.039041 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet a3f48f9bb29b4be6ab6ce167159ae793 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3f48f9bb29b4be6ab6ce167159ae793 already in progress: creating tablet
I20260810 19:48:17.039400 10377 tablet_replica.cc:333] T 8d93821ff46a4096a8ebbac83faabed7 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:17.039664 10377 raft_consensus.cc:2243] T 8d93821ff46a4096a8ebbac83faabed7 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:17.042204 13302 raft_consensus.cc:493] T 6f4b5c6d5bd14c59b3cd3f8ee00a3301 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.043609 10377 raft_consensus.cc:2272] T 8d93821ff46a4096a8ebbac83faabed7 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:17.044415 10377 ts_tablet_manager.cc:1916] T 8d93821ff46a4096a8ebbac83faabed7 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:17.044984 9412 master_service.cc:960] ReplaceTablet: received request to replace tablet b5ec15d8a0d241e3b6238c408d2fb436 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:17.045573 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_30732d5b4723469da64545f8603f37f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:17.046178 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30732d5b4723469da64545f8603f37f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:17.047960 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet e87fd882e6b6413480a0cb06aee74722 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:17.048553 13302 raft_consensus.cc:515] T 6f4b5c6d5bd14c59b3cd3f8ee00a3301 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.049798 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4b5c6d5bd14c59b3cd3f8ee00a3301" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:17.050041 13302 leader_election.cc:290] T 6f4b5c6d5bd14c59b3cd3f8ee00a3301 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:17.050612 9611 leader_election.cc:343] T 6f4b5c6d5bd14c59b3cd3f8ee00a3301 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.052065 10367 tablet_bootstrap.cc:492] T 5a35be79a8924213ab860a9da04a598c P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:17.052271 10367 ts_tablet_manager.cc:1403] T 5a35be79a8924213ab860a9da04a598c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.002s
I20260810 19:48:17.053148 13041 raft_consensus.cc:493] T 823bcbb987374ab4b9b0fc3d9d79b571 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.053299 13041 raft_consensus.cc:515] T 823bcbb987374ab4b9b0fc3d9d79b571 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.053993 13041 leader_election.cc:290] T 823bcbb987374ab4b9b0fc3d9d79b571 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:17.055368 9831 leader_election.cc:343] T 823bcbb987374ab4b9b0fc3d9d79b571 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 823bcbb987374ab4b9b0fc3d9d79b571
I20260810 19:48:17.056115 10367 raft_consensus.cc:359] T 5a35be79a8924213ab860a9da04a598c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.056385 10367 raft_consensus.cc:385] T 5a35be79a8924213ab860a9da04a598c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:17.056492 10367 raft_consensus.cc:740] T 5a35be79a8924213ab860a9da04a598c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:17.056825 10367 consensus_queue.cc:260] T 5a35be79a8924213ab860a9da04a598c P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.057446 10367 ts_tablet_manager.cc:1434] T 5a35be79a8924213ab860a9da04a598c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 19:48:17.057946 10367 tablet_bootstrap.cc:492] T 269adfeb1efe46d3944f33b245126665 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:17.060554 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f916c7c5ea66493aa9377d0bde28cf58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:17.061190 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f916c7c5ea66493aa9377d0bde28cf58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:17.061268 12266 ts_tablet_manager.cc:1929] T 3da297aac2644fcabfcb21769576dca4 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:17.061398 12266 log.cc:1199] T 3da297aac2644fcabfcb21769576dca4 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/3da297aac2644fcabfcb21769576dca4
I20260810 19:48:17.061798 12266 ts_tablet_manager.cc:1950] T 3da297aac2644fcabfcb21769576dca4 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:17.065279 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4b5c6d5bd14c59b3cd3f8ee00a3301" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:17.065778 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823bcbb987374ab4b9b0fc3d9d79b571" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:17.066084 9611 leader_election.cc:343] T 6f4b5c6d5bd14c59b3cd3f8ee00a3301 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.066248 9611 leader_election.cc:304] T 6f4b5c6d5bd14c59b3cd3f8ee00a3301 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
W20260810 19:48:17.067126 9830 leader_election.cc:343] T 823bcbb987374ab4b9b0fc3d9d79b571 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.067291 9830 leader_election.cc:304] T 823bcbb987374ab4b9b0fc3d9d79b571 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:17.067782 13041 raft_consensus.cc:2749] T 823bcbb987374ab4b9b0fc3d9d79b571 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:17.068133 13302 raft_consensus.cc:2749] T 6f4b5c6d5bd14c59b3cd3f8ee00a3301 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:17.074288 10377 ts_tablet_manager.cc:1929] T 8d93821ff46a4096a8ebbac83faabed7 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:17.077817 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1231) took 1060 ms. Trace:
I20260810 19:48:17.077934 12266 rpcz_store.cc:276] 0810 19:48:16.017823 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:16.017881 (+ 58us) service_pool.cc:224] Handling call
0810 19:48:16.971427 (+953546us) ts_tablet_manager.cc:1151] Deleting tablet 3da297aac2644fcabfcb21769576dca4
0810 19:48:16.971438 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:17.010224 (+ 38786us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:17.061170 (+ 50946us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:17.077771 (+ 16601us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":953332}
I20260810 19:48:17.081331 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 3da297aac2644fcabfcb21769576dca4 (table default.Table_f6f4b21d44ba45339d95ca1933e92cd9 [id=67f177aa933f4f00a3dcab7e11f61624]) successfully deleted
I20260810 19:48:17.081764 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1232) took 1043 ms. Trace:
I20260810 19:48:17.084259 10370 tablet_bootstrap.cc:492] T 5f4e2adee0264e418ff8c54912973e60 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:17.084501 10370 ts_tablet_manager.cc:1403] T 5f4e2adee0264e418ff8c54912973e60 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.082s user 0.003s sys 0.003s
I20260810 19:48:17.085343 10370 raft_consensus.cc:359] T 5f4e2adee0264e418ff8c54912973e60 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.085598 10370 raft_consensus.cc:385] T 5f4e2adee0264e418ff8c54912973e60 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:17.085708 10370 raft_consensus.cc:740] T 5f4e2adee0264e418ff8c54912973e60 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:17.086043 10370 consensus_queue.cc:260] T 5f4e2adee0264e418ff8c54912973e60 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.086709 10370 ts_tablet_manager.cc:1434] T 5f4e2adee0264e418ff8c54912973e60 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 19:48:17.086912 12266 rpcz_store.cc:276] 0810 19:48:16.038257 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:16.038337 (+ 80us) service_pool.cc:224] Handling call
0810 19:48:17.081268 (+1042931us) ts_tablet_manager.cc:1151] Deleting tablet 0c6565aebe894508b4cbbcd3cd0a849a
0810 19:48:17.081279 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:17.081698 (+ 419us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1042739}
I20260810 19:48:17.076248 13041 consensus_queue.cc:1048] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:17.088235 10370 tablet_bootstrap.cc:492] T 823bcbb987374ab4b9b0fc3d9d79b571 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:17.088851 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1235) took 1038 ms. Trace:
W20260810 19:48:17.089448 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 0c6565aebe894508b4cbbcd3cd0a849a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c6565aebe894508b4cbbcd3cd0a849a already in progress: creating tablet
I20260810 19:48:17.089608 9416 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 56fa5de3bf7142b2b0978f9190091f33 (table default.Table_1881cd552cf54157a0a41766d5b1b259 [id=87220e53176e4254a5238c988b6a7311]). Expected version 2 got 0
I20260810 19:48:17.089680 12266 rpcz_store.cc:276] 0810 19:48:16.050777 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:16.050836 (+ 59us) service_pool.cc:224] Handling call
0810 19:48:17.088661 (+1037825us) ts_tablet_manager.cc:1151] Deleting tablet 264a65bd642648e59998fb55fb3c8de1
0810 19:48:17.088674 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:17.088807 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1037646}
I20260810 19:48:17.083333 10367 tablet_bootstrap.cc:654] T 269adfeb1efe46d3944f33b245126665 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:17.090238 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 264a65bd642648e59998fb55fb3c8de1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 264a65bd642648e59998fb55fb3c8de1 already in progress: creating tablet
I20260810 19:48:17.087491 13329 tablet.cc:1724] T 81720b897a674b5380c6469d1600a979 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:17.093461 10370 tablet_bootstrap.cc:654] T 823bcbb987374ab4b9b0fc3d9d79b571 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:17.094204 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet d0976c7855cb49c4ad4a4cf3b1ac1518 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d0976c7855cb49c4ad4a4cf3b1ac1518 already in progress: creating tablet
I20260810 19:48:17.094635 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_072335e923324709a99255e9f3fdadfa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:17.095331 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_072335e923324709a99255e9f3fdadfa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:17.095424 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet a099e4cc255c4502b745a1e29cbd4c42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a099e4cc255c4502b745a1e29cbd4c42 already in progress: creating tablet
I20260810 19:48:17.097784 10377 log.cc:1199] T 8d93821ff46a4096a8ebbac83faabed7 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/8d93821ff46a4096a8ebbac83faabed7
I20260810 19:48:17.098398 10377 ts_tablet_manager.cc:1950] T 8d93821ff46a4096a8ebbac83faabed7 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
W20260810 19:48:17.098558 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 650ca46244e54bed89e96c4a09fc7a94 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 650ca46244e54bed89e96c4a09fc7a94 already in progress: creating tablet
I20260810 19:48:17.099742 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 8d93821ff46a4096a8ebbac83faabed7 (table default.Table_422e53637be84964a1cd4bb082fec236 [id=79d6de9ae42e416fba0595834b38ce40]) successfully deleted
I20260810 19:48:17.100135 10377 tablet_replica.cc:333] T f2606854f9954f2ea10610aeb1e60368 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:17.100625 10367 tablet_bootstrap.cc:492] T 269adfeb1efe46d3944f33b245126665 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:17.101161 10367 ts_tablet_manager.cc:1403] T 269adfeb1efe46d3944f33b245126665 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.000s
I20260810 19:48:17.103482 10367 raft_consensus.cc:359] T 269adfeb1efe46d3944f33b245126665 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.107067 10367 raft_consensus.cc:385] T 269adfeb1efe46d3944f33b245126665 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:17.109203 10367 raft_consensus.cc:740] T 269adfeb1efe46d3944f33b245126665 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:17.100966 12266 tablet_replica.cc:333] T 7de27c3442584746b76ea838d38f0b9b P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:17.109779 12266 raft_consensus.cc:2243] T 7de27c3442584746b76ea838d38f0b9b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:17.110049 12266 raft_consensus.cc:2272] T 7de27c3442584746b76ea838d38f0b9b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:17.110761 12266 ts_tablet_manager.cc:1916] T 7de27c3442584746b76ea838d38f0b9b P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:17.112576 10367 consensus_queue.cc:260] T 269adfeb1efe46d3944f33b245126665 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.114974 10367 ts_tablet_manager.cc:1434] T 269adfeb1efe46d3944f33b245126665 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
W20260810 19:48:17.120236 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1f286be362c745f1964fe2401832c6c1 consensus state has no leader
I20260810 19:48:17.123828 10377 raft_consensus.cc:2243] T f2606854f9954f2ea10610aeb1e60368 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:17.124150 10377 raft_consensus.cc:2272] T f2606854f9954f2ea10610aeb1e60368 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:17.104051 10366 tablet_bootstrap.cc:492] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:17.124557 10366 ts_tablet_manager.cc:1403] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.145s user 0.003s sys 0.000s
I20260810 19:48:17.125072 10377 ts_tablet_manager.cc:1916] T f2606854f9954f2ea10610aeb1e60368 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:17.125366 12266 ts_tablet_manager.cc:1929] T 7de27c3442584746b76ea838d38f0b9b P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:17.125525 12266 log.cc:1199] T 7de27c3442584746b76ea838d38f0b9b P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/7de27c3442584746b76ea838d38f0b9b
I20260810 19:48:17.125967 12266 ts_tablet_manager.cc:1950] T 7de27c3442584746b76ea838d38f0b9b P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:17.125394 10366 raft_consensus.cc:359] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.126117 10366 raft_consensus.cc:385] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:17.126190 10366 raft_consensus.cc:740] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:17.126483 10366 consensus_queue.cc:260] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.127316 10370 tablet_bootstrap.cc:492] T 823bcbb987374ab4b9b0fc3d9d79b571 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:17.127483 10370 ts_tablet_manager.cc:1403] T 823bcbb987374ab4b9b0fc3d9d79b571 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.000s
I20260810 19:48:17.128302 10370 raft_consensus.cc:359] T 823bcbb987374ab4b9b0fc3d9d79b571 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.128497 10370 raft_consensus.cc:385] T 823bcbb987374ab4b9b0fc3d9d79b571 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:17.128561 10370 raft_consensus.cc:740] T 823bcbb987374ab4b9b0fc3d9d79b571 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:17.129081 10370 consensus_queue.cc:260] T 823bcbb987374ab4b9b0fc3d9d79b571 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.129650 10370 ts_tablet_manager.cc:1434] T 823bcbb987374ab4b9b0fc3d9d79b571 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:17.129739 10366 ts_tablet_manager.cc:1434] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260810 19:48:17.131000 10370 tablet_bootstrap.cc:492] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:17.132018 10366 tablet_bootstrap.cc:492] T b9b567b3338845e4a37cff2a955056ae P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:17.136646 10370 tablet_bootstrap.cc:654] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:17.138025 10366 tablet_bootstrap.cc:654] T b9b567b3338845e4a37cff2a955056ae P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:17.148001 10367 tablet_bootstrap.cc:492] T f5fa6060b9ef48cea6830cd9d19424ea P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
W20260810 19:48:17.149775 9611 consensus_peers.cc:597] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 668b3514d9f64d44a8747647194e50be. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:17.151775 10377 ts_tablet_manager.cc:1929] T f2606854f9954f2ea10610aeb1e60368 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:17.152050 10377 log.cc:1199] T f2606854f9954f2ea10610aeb1e60368 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/f2606854f9954f2ea10610aeb1e60368
I20260810 19:48:17.152490 10377 ts_tablet_manager.cc:1950] T f2606854f9954f2ea10610aeb1e60368 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:17.153923 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet f2606854f9954f2ea10610aeb1e60368 (table default.Table_33ab9a72c1d543beb6a25830c7f1aa23 [id=4fe62c29683b4e5ca802b5cf74ae195e]) successfully deleted
I20260810 19:48:17.154959 10377 tablet_replica.cc:333] T 823bcbb987374ab4b9b0fc3d9d79b571 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:17.155225 10377 raft_consensus.cc:2243] T 823bcbb987374ab4b9b0fc3d9d79b571 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:17.155478 10377 raft_consensus.cc:2272] T 823bcbb987374ab4b9b0fc3d9d79b571 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:17.156280 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 7de27c3442584746b76ea838d38f0b9b (table default.Table_9eeefa885ca24021833ff2fc5016de3e [id=f76de132787a49c6af75b9fe63be9d09]) successfully deleted
I20260810 19:48:17.156347 10377 ts_tablet_manager.cc:1916] T 823bcbb987374ab4b9b0fc3d9d79b571 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:17.159102 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 22954e727fb44a24bd382b9caee9996b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22954e727fb44a24bd382b9caee9996b already in progress: creating tablet
W20260810 19:48:17.159578 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet cd05a86e7ccd40afbfb10cb8dfe53e78 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd05a86e7ccd40afbfb10cb8dfe53e78 already in progress: creating tablet
W20260810 19:48:17.159857 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet e6ae4df29db74085849d82cf2529ac51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6ae4df29db74085849d82cf2529ac51 already in progress: creating tablet
W20260810 19:48:17.160095 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 8425f8c3258a41c291f9fa8dbd29fbc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8425f8c3258a41c291f9fa8dbd29fbc6 already in progress: creating tablet
I20260810 19:48:17.162530 12266 tablet_replica.cc:333] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:17.162809 12266 raft_consensus.cc:2243] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:17.163177 12266 raft_consensus.cc:2272] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:17.165809 9410 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 56fa5de3bf7142b2b0978f9190091f33 (table default.Table_1881cd552cf54157a0a41766d5b1b259 [id=87220e53176e4254a5238c988b6a7311]). Expected version 2 got 0
I20260810 19:48:17.165987 9410 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 5a35be79a8924213ab860a9da04a598c (table default.Table_14a99457051c4c96943fb9923de47b5d [id=4bce0610a04641ff86ab3af94e12e31d]). Expected version 2 got 0
I20260810 19:48:17.166724 9412 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 56fa5de3bf7142b2b0978f9190091f33 (table default.Table_1881cd552cf54157a0a41766d5b1b259 [id=87220e53176e4254a5238c988b6a7311]). Expected version 2 got 0
I20260810 19:48:17.167802 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 38b0c6a017dc4afc849090cca7ee8b26 with delete_type TABLET_DATA_DELETED (replaced by tablet 47c54793369048fc874522388d08d3da) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:17.170423 10370 tablet_bootstrap.cc:492] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:17.170542 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet 48eee4ce10114021855075812e356652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:17.170583 10370 ts_tablet_manager.cc:1403] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.001s
I20260810 19:48:17.170897 10375 tablet_replica.cc:333] T 38b0c6a017dc4afc849090cca7ee8b26 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:17.171113 10375 raft_consensus.cc:2243] T 38b0c6a017dc4afc849090cca7ee8b26 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:17.171293 10375 raft_consensus.cc:2272] T 38b0c6a017dc4afc849090cca7ee8b26 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:17.171933 10375 ts_tablet_manager.cc:1916] T 38b0c6a017dc4afc849090cca7ee8b26 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:17.176640 13302 raft_consensus.cc:493] T 55fb03a8dd3b40f5ba3de41fa7c01f5d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.176813 13302 raft_consensus.cc:515] T 55fb03a8dd3b40f5ba3de41fa7c01f5d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.177470 13302 leader_election.cc:290] T 55fb03a8dd3b40f5ba3de41fa7c01f5d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:17.178391 12266 ts_tablet_manager.cc:1916] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:17.178735 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55fb03a8dd3b40f5ba3de41fa7c01f5d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:17.179500 9611 leader_election.cc:343] T 55fb03a8dd3b40f5ba3de41fa7c01f5d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.179936 13309 raft_consensus.cc:493] T 5f4e2adee0264e418ff8c54912973e60 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.180087 13309 raft_consensus.cc:515] T 5f4e2adee0264e418ff8c54912973e60 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.180833 13309 leader_election.cc:290] T 5f4e2adee0264e418ff8c54912973e60 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:17.181164 10140 tablet_service.cc:1511] Processing CreateTablet for tablet 958525dccd734ad0822e454008647612 (DEFAULT_TABLE table=default.Table_18f2d5449fa84217a7ccbc5321381380 [id=54fd872bae0c4bdab2e0f35b1890f235]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.181631 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 958525dccd734ad0822e454008647612. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:17.182446 10068 leader_election.cc:343] T 5f4e2adee0264e418ff8c54912973e60 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 5f4e2adee0264e418ff8c54912973e60
I20260810 19:48:17.182778 13320 consensus_queue.cc:1048] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:17.182863 10370 raft_consensus.cc:359] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.183027 10370 raft_consensus.cc:385] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:17.183071 10370 raft_consensus.cc:740] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:17.183260 10370 consensus_queue.cc:260] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.183961 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4e2adee0264e418ff8c54912973e60" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:17.185357 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55fb03a8dd3b40f5ba3de41fa7c01f5d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:17.186473 9611 leader_election.cc:343] T 55fb03a8dd3b40f5ba3de41fa7c01f5d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.186606 9611 leader_election.cc:304] T 55fb03a8dd3b40f5ba3de41fa7c01f5d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:17.187397 13302 raft_consensus.cc:2749] T 55fb03a8dd3b40f5ba3de41fa7c01f5d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:17.190832 10067 leader_election.cc:343] T 5f4e2adee0264e418ff8c54912973e60 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.190969 10067 leader_election.cc:304] T 5f4e2adee0264e418ff8c54912973e60 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:17.191239 10375 ts_tablet_manager.cc:1929] T 38b0c6a017dc4afc849090cca7ee8b26 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:17.191359 10375 log.cc:1199] T 38b0c6a017dc4afc849090cca7ee8b26 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/38b0c6a017dc4afc849090cca7ee8b26
I20260810 19:48:17.191484 13320 raft_consensus.cc:2749] T 5f4e2adee0264e418ff8c54912973e60 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:17.191677 10375 ts_tablet_manager.cc:1950] T 38b0c6a017dc4afc849090cca7ee8b26 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:17.192785 10375 tablet_replica.cc:333] T 48eee4ce10114021855075812e356652 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:17.192929 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 38b0c6a017dc4afc849090cca7ee8b26 (table default.Table_9c7e78bf368c4d99bca05e9fc4dfcbda [id=df9ef32c15fd46caab42b0a0214afd64]) successfully deleted
I20260810 19:48:17.193025 10375 raft_consensus.cc:2243] T 48eee4ce10114021855075812e356652 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:17.193173 10375 raft_consensus.cc:2272] T 48eee4ce10114021855075812e356652 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:17.193608 10370 ts_tablet_manager.cc:1434] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20260810 19:48:17.194151 10370 tablet_bootstrap.cc:492] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:17.198238 10370 tablet_bootstrap.cc:654] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:17.202620 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 958525dccd734ad0822e454008647612 (DEFAULT_TABLE table=default.Table_18f2d5449fa84217a7ccbc5321381380 [id=54fd872bae0c4bdab2e0f35b1890f235]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.204159 9684 tablet_service.cc:1511] Processing CreateTablet for tablet cd493bc85edf46c484ecb6f9f2ea7338 (DEFAULT_TABLE table=default.Table_305add871d244448877b2c9b4dd2e8a5 [id=3618a1ab83964fffb829a36f1cd0537e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.204813 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 3af8428d456841849d4c6cd2c402585e (DEFAULT_TABLE table=default.Table_2ae916a777334f9a9265e324290edb60 [id=98553057cb374b9fb23fda0d9ee3e8c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.205248 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3af8428d456841849d4c6cd2c402585e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.205856 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 3af8428d456841849d4c6cd2c402585e (DEFAULT_TABLE table=default.Table_2ae916a777334f9a9265e324290edb60 [id=98553057cb374b9fb23fda0d9ee3e8c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.206338 10135 tablet_service.cc:1511] Processing CreateTablet for tablet ec47a78641a548cfb0ccb5aab1f6ac64 (DEFAULT_TABLE table=default.Table_968d4ecf85ff4060bb01bddd4d994029 [id=7705d9fbb614462885fa2f256270a107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.206557 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 958525dccd734ad0822e454008647612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.206699 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec47a78641a548cfb0ccb5aab1f6ac64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.207131 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3af8428d456841849d4c6cd2c402585e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.207736 12266 ts_tablet_manager.cc:1929] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260810 19:48:17.208462 12266 log.cc:1199] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/668b3514d9f64d44a8747647194e50be
I20260810 19:48:17.208861 12266 ts_tablet_manager.cc:1950] T 668b3514d9f64d44a8747647194e50be P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:17.211030 10367 tablet_bootstrap.cc:654] T f5fa6060b9ef48cea6830cd9d19424ea P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:17.213522 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd493bc85edf46c484ecb6f9f2ea7338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.214149 10140 tablet_service.cc:1511] Processing CreateTablet for tablet cd493bc85edf46c484ecb6f9f2ea7338 (DEFAULT_TABLE table=default.Table_305add871d244448877b2c9b4dd2e8a5 [id=3618a1ab83964fffb829a36f1cd0537e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.214572 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd493bc85edf46c484ecb6f9f2ea7338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.215176 10370 tablet_bootstrap.cc:492] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:17.215305 10370 ts_tablet_manager.cc:1403] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.000s
I20260810 19:48:17.216101 10370 raft_consensus.cc:359] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.216264 10370 raft_consensus.cc:385] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:17.216306 10370 raft_consensus.cc:740] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:17.216566 10370 consensus_queue.cc:260] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.216684 13302 raft_consensus.cc:493] T 3159795344ae492fb099fca0e52fcf20 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.216809 13302 raft_consensus.cc:515] T 3159795344ae492fb099fca0e52fcf20 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.217221 10370 ts_tablet_manager.cc:1434] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:17.217516 10370 tablet_bootstrap.cc:492] T 9ed73161398f4f54a20a9173c18b4d3c P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:17.217538 13302 leader_election.cc:290] T 3159795344ae492fb099fca0e52fcf20 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:17.218461 13338 raft_consensus.cc:493] T 1f895bcd21f647f2ab813903d600a31a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.218619 13338 raft_consensus.cc:515] T 1f895bcd21f647f2ab813903d600a31a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.218704 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3159795344ae492fb099fca0e52fcf20" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:17.219242 13338 leader_election.cc:290] T 1f895bcd21f647f2ab813903d600a31a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:17.219300 10370 tablet_bootstrap.cc:654] T 9ed73161398f4f54a20a9173c18b4d3c P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:17.220887 9831 leader_election.cc:343] T 1f895bcd21f647f2ab813903d600a31a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 1f895bcd21f647f2ab813903d600a31a
I20260810 19:48:17.223091 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_8504e02662614f29a684e21a52f8f17b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:17.223197 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a5054a2e3e7c4bcf86bcc34a01d7e807" } new_table_name: "default.Table_db87d047057f457097f6db0c2416af0e" modify_external_catalogs: true
W20260810 19:48:17.223732 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8504e02662614f29a684e21a52f8f17b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:17.224047 9611 leader_election.cc:343] T 3159795344ae492fb099fca0e52fcf20 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.225274 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1f3c66cf43f34e418f4baea736bc9669"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:17.225675 13245 raft_consensus.cc:493] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 19:48:17.225843 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f3c66cf43f34e418f4baea736bc9669 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:17.225831 13245 raft_consensus.cc:515] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.225858 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3159795344ae492fb099fca0e52fcf20" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:17.226506 13245 leader_election.cc:290] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:17.227510 9611 leader_election.cc:343] T 3159795344ae492fb099fca0e52fcf20 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.227488 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ed05a1eb4a4f6e9a7284caaa0bba05" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:17.227622 9611 leader_election.cc:304] T 3159795344ae492fb099fca0e52fcf20 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:17.227716 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ed05a1eb4a4f6e9a7284caaa0bba05" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:17.227918 9710 raft_consensus.cc:2468] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:17.228065 13302 raft_consensus.cc:2749] T 3159795344ae492fb099fca0e52fcf20 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:17.228112 10067 leader_election.cc:343] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.228399 10068 leader_election.cc:304] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691
I20260810 19:48:17.229445 13245 raft_consensus.cc:2804] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:17.229527 13245 raft_consensus.cc:493] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:17.229590 13245 raft_consensus.cc:3060] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:17.238637 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 2acdafe2cb7840c693cdc8446a2f71d2 (DEFAULT_TABLE table=default.Table_97732b9bdb164afca8b82bedc2afb5b2 [id=d3a7dc0f31d340a0bd27beb9b7882e92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.239153 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2acdafe2cb7840c693cdc8446a2f71d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.240664 13245 raft_consensus.cc:515] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.240850 10375 ts_tablet_manager.cc:1916] T 48eee4ce10114021855075812e356652 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:17.242017 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ed05a1eb4a4f6e9a7284caaa0bba05" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:17.243194 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ed05a1eb4a4f6e9a7284caaa0bba05" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:17.243446 9710 raft_consensus.cc:3060] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:17.243952 10067 leader_election.cc:343] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.245941 13245 leader_election.cc:290] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:17.247200 10370 tablet_bootstrap.cc:492] T 9ed73161398f4f54a20a9173c18b4d3c P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:17.247201 12266 tablet_replica.cc:333] T a776693b6b4943a7b64e13ec10958c16 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:17.247356 10370 ts_tablet_manager.cc:1403] T 9ed73161398f4f54a20a9173c18b4d3c P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.007s
I20260810 19:48:17.247424 12266 raft_consensus.cc:2243] T a776693b6b4943a7b64e13ec10958c16 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:17.247605 12266 raft_consensus.cc:2272] T a776693b6b4943a7b64e13ec10958c16 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:17.248152 10370 raft_consensus.cc:359] T 9ed73161398f4f54a20a9173c18b4d3c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.248288 12266 ts_tablet_manager.cc:1916] T a776693b6b4943a7b64e13ec10958c16 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:17.248328 10370 raft_consensus.cc:385] T 9ed73161398f4f54a20a9173c18b4d3c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:17.248375 10370 raft_consensus.cc:740] T 9ed73161398f4f54a20a9173c18b4d3c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:17.251300 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 668b3514d9f64d44a8747647194e50be (table default.Table_fcc942a53d1b4c05a1a07df15f3d9230 [id=f96d1bbf37954740825d721e6259ce3c]) successfully deleted
I20260810 19:48:17.251514 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 2acdafe2cb7840c693cdc8446a2f71d2 (DEFAULT_TABLE table=default.Table_97732b9bdb164afca8b82bedc2afb5b2 [id=d3a7dc0f31d340a0bd27beb9b7882e92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.251915 9710 raft_consensus.cc:2468] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:17.252290 9657 tablet_service.cc:1511] Processing CreateTablet for tablet ff4091dee89640eebfd97861e52f538a (DEFAULT_TABLE table=default.Table_733643d1126149498dc7b97d8549fc5c [id=35ac14265e964a7a8a302733c641b90b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.252405 9655 tablet_service.cc:1511] Processing CreateTablet for tablet 38ebc3b194a14808b630499031be4da2 (DEFAULT_TABLE table=default.Table_6d633a72880e44b6a591eeeb52f63d79 [id=6d9fc81a8df940d4b8f911e7a6d707e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.251986 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2acdafe2cb7840c693cdc8446a2f71d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.252507 10068 leader_election.cc:304] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691
I20260810 19:48:17.252781 9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38ebc3b194a14808b630499031be4da2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.252986 13309 raft_consensus.cc:493] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.253114 13309 raft_consensus.cc:515] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.253587 13302 raft_consensus.cc:493] T cb2c9782c034435088f991bef8edf288 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.253727 13309 leader_election.cc:290] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:17.253702 13302 raft_consensus.cc:515] T cb2c9782c034435088f991bef8edf288 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.253866 13309 raft_consensus.cc:2804] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:17.253962 13309 raft_consensus.cc:697] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:17.254196 13309 consensus_queue.cc:237] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.254273 13302 leader_election.cc:290] T cb2c9782c034435088f991bef8edf288 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:17.255373 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66acbafdcc8540368693c8f463b41752" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:17.255589 9935 raft_consensus.cc:2468] T 66acbafdcc8540368693c8f463b41752 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:17.256242 10124 tablet_service.cc:1511] Processing CreateTablet for tablet ff4091dee89640eebfd97861e52f538a (DEFAULT_TABLE table=default.Table_733643d1126149498dc7b97d8549fc5c [id=35ac14265e964a7a8a302733c641b90b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.256328 10067 leader_election.cc:304] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:17.256597 13320 raft_consensus.cc:2804] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:17.256639 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4091dee89640eebfd97861e52f538a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.256661 13320 raft_consensus.cc:493] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:17.256718 13320 raft_consensus.cc:3060] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:17.258080 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 4437564045784f36a320181da8387397 (DEFAULT_TABLE table=default.Table_0eee3a62d69c4a90b8b0c45cd7d78dcc [id=3a27a2aaea7e4b2b8cfbb6c0d50af446]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.258605 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 4437564045784f36a320181da8387397 (DEFAULT_TABLE table=default.Table_0eee3a62d69c4a90b8b0c45cd7d78dcc [id=3a27a2aaea7e4b2b8cfbb6c0d50af446]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.258904 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4091dee89640eebfd97861e52f538a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.258951 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4437564045784f36a320181da8387397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.259517 13320 raft_consensus.cc:515] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.260193 13320 leader_election.cc:290] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:17.260390 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4437564045784f36a320181da8387397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.261237 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66acbafdcc8540368693c8f463b41752" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:17.261428 9935 raft_consensus.cc:3060] T 66acbafdcc8540368693c8f463b41752 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:17.262871 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2c9782c034435088f991bef8edf288" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:17.263710 9611 leader_election.cc:343] T cb2c9782c034435088f991bef8edf288 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.264961 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66acbafdcc8540368693c8f463b41752" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:17.265161 9717 raft_consensus.cc:2468] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:17.265769 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2c9782c034435088f991bef8edf288" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:17.266202 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66acbafdcc8540368693c8f463b41752" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:17.266412 9715 raft_consensus.cc:3060] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:17.267329 10067 consensus_peers.cc:597] T 73abedd88ba548bdb5a23f508b77403d P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260810 19:48:17.268306 9611 leader_election.cc:343] T cb2c9782c034435088f991bef8edf288 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.268433 9611 leader_election.cc:304] T cb2c9782c034435088f991bef8edf288 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:17.268821 13302 raft_consensus.cc:2749] T cb2c9782c034435088f991bef8edf288 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:17.269058 9715 raft_consensus.cc:2468] T 66acbafdcc8540368693c8f463b41752 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:17.269479 10068 leader_election.cc:304] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:17.269832 10370 consensus_queue.cc:260] T 9ed73161398f4f54a20a9173c18b4d3c P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.270382 10370 ts_tablet_manager.cc:1434] T 9ed73161398f4f54a20a9173c18b4d3c P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.023s user 0.002s sys 0.001s
I20260810 19:48:17.272248 13320 raft_consensus.cc:2804] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:17.276769 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 38ebc3b194a14808b630499031be4da2 (DEFAULT_TABLE table=default.Table_6d633a72880e44b6a591eeeb52f63d79 [id=6d9fc81a8df940d4b8f911e7a6d707e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.277240 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38ebc3b194a14808b630499031be4da2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.278602 10370 tablet_bootstrap.cc:492] T b3754889e4574fc3a936ac31cc6f496a P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:17.285962 9675 tablet_service.cc:1511] Processing CreateTablet for tablet ec47a78641a548cfb0ccb5aab1f6ac64 (DEFAULT_TABLE table=default.Table_968d4ecf85ff4060bb01bddd4d994029 [id=7705d9fbb614462885fa2f256270a107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.286487 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec47a78641a548cfb0ccb5aab1f6ac64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.287420 10370 tablet_bootstrap.cc:654] T b3754889e4574fc3a936ac31cc6f496a P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:17.287680 9655 tablet_service.cc:1511] Processing CreateTablet for tablet 4a66974e83f8431484e5ecd1d3dd9224 (DEFAULT_TABLE table=default.Table_2e1c8f736f574267a5895e990459ed79 [id=d38db2a981ff4703b6ee936407f1e79e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.288208 9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a66974e83f8431484e5ecd1d3dd9224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.292356 10367 tablet_bootstrap.cc:492] T f5fa6060b9ef48cea6830cd9d19424ea P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:17.292523 10367 ts_tablet_manager.cc:1403] T f5fa6060b9ef48cea6830cd9d19424ea P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.145s user 0.020s sys 0.001s
I20260810 19:48:17.292932 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 4a66974e83f8431484e5ecd1d3dd9224 (DEFAULT_TABLE table=default.Table_2e1c8f736f574267a5895e990459ed79 [id=d38db2a981ff4703b6ee936407f1e79e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.293233 10367 raft_consensus.cc:359] T f5fa6060b9ef48cea6830cd9d19424ea P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.293386 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a66974e83f8431484e5ecd1d3dd9224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.293416 10367 raft_consensus.cc:385] T f5fa6060b9ef48cea6830cd9d19424ea P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:17.293469 10367 raft_consensus.cc:740] T f5fa6060b9ef48cea6830cd9d19424ea P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:17.293730 10367 consensus_queue.cc:260] T f5fa6060b9ef48cea6830cd9d19424ea P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.294664 10367 ts_tablet_manager.cc:1434] T f5fa6060b9ef48cea6830cd9d19424ea P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 19:48:17.295691 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 2f636d3a30144449b00b4f9119ba6ab1 (DEFAULT_TABLE table=default.Table_2c9aa482e51c48f6bd512effb1144fa9 [id=e875cf37caf448b8b21d8c419f01d921]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.296617 10370 tablet_bootstrap.cc:492] T b3754889e4574fc3a936ac31cc6f496a P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:17.296780 10370 ts_tablet_manager.cc:1403] T b3754889e4574fc3a936ac31cc6f496a P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.002s
I20260810 19:48:17.297453 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 2f636d3a30144449b00b4f9119ba6ab1 (DEFAULT_TABLE table=default.Table_2c9aa482e51c48f6bd512effb1144fa9 [id=e875cf37caf448b8b21d8c419f01d921]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.297577 10370 raft_consensus.cc:359] T b3754889e4574fc3a936ac31cc6f496a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.297751 10370 raft_consensus.cc:385] T b3754889e4574fc3a936ac31cc6f496a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:17.297822 10370 raft_consensus.cc:740] T b3754889e4574fc3a936ac31cc6f496a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:17.297868 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f636d3a30144449b00b4f9119ba6ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.299255 10375 ts_tablet_manager.cc:1929] T 48eee4ce10114021855075812e356652 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:17.302876 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f636d3a30144449b00b4f9119ba6ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.303963 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 25da36714b1d4e89a2c4af713331f4ec
I20260810 19:48:17.306633 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet 25da36714b1d4e89a2c4af713331f4ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:17.311014 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 1d27261183b4478cbcf0e8a89fc42f03 (DEFAULT_TABLE table=default.Table_3653184e2aa24b82b6fc81998fd83734 [id=9a1b72d5c4474a9981add393ce463bb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.320976 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d27261183b4478cbcf0e8a89fc42f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.323313 10367 tablet_bootstrap.cc:492] T 22954e727fb44a24bd382b9caee9996b P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:17.323349 10377 ts_tablet_manager.cc:1929] T 823bcbb987374ab4b9b0fc3d9d79b571 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:17.323493 10377 log.cc:1199] T 823bcbb987374ab4b9b0fc3d9d79b571 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/823bcbb987374ab4b9b0fc3d9d79b571
I20260810 19:48:17.323848 10377 ts_tablet_manager.cc:1950] T 823bcbb987374ab4b9b0fc3d9d79b571 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:17.320971 13302 raft_consensus.cc:493] T e87fd882e6b6413480a0cb06aee74722 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.324331 10377 tablet_replica.cc:333] T 1f895bcd21f647f2ab813903d600a31a P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:17.324335 13302 raft_consensus.cc:515] T e87fd882e6b6413480a0cb06aee74722 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.324533 10377 raft_consensus.cc:2243] T 1f895bcd21f647f2ab813903d600a31a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:17.324685 10377 raft_consensus.cc:2272] T 1f895bcd21f647f2ab813903d600a31a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:17.324882 10367 tablet_bootstrap.cc:654] T 22954e727fb44a24bd382b9caee9996b P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:17.325054 13302 leader_election.cc:290] T e87fd882e6b6413480a0cb06aee74722 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:17.325794 10366 tablet_bootstrap.cc:492] T b9b567b3338845e4a37cff2a955056ae P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:17.325940 10366 ts_tablet_manager.cc:1403] T b9b567b3338845e4a37cff2a955056ae P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.194s user 0.007s sys 0.014s
I20260810 19:48:17.326624 10366 raft_consensus.cc:359] T b9b567b3338845e4a37cff2a955056ae P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.326784 10366 raft_consensus.cc:385] T b9b567b3338845e4a37cff2a955056ae P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:17.326841 10366 raft_consensus.cc:740] T b9b567b3338845e4a37cff2a955056ae P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:17.326902 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 958525dccd734ad0822e454008647612 (DEFAULT_TABLE table=default.Table_18f2d5449fa84217a7ccbc5321381380 [id=54fd872bae0c4bdab2e0f35b1890f235]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.327025 10366 consensus_queue.cc:260] T b9b567b3338845e4a37cff2a955056ae P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.327533 10366 ts_tablet_manager.cc:1434] T b9b567b3338845e4a37cff2a955056ae P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 19:48:17.329072 9897 tablet_service.cc:1511] Processing CreateTablet for tablet cd493bc85edf46c484ecb6f9f2ea7338 (DEFAULT_TABLE table=default.Table_305add871d244448877b2c9b4dd2e8a5 [id=3618a1ab83964fffb829a36f1cd0537e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.331900 10366 tablet_bootstrap.cc:492] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:17.332011 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 958525dccd734ad0822e454008647612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.333878 9935 raft_consensus.cc:2468] T 66acbafdcc8540368693c8f463b41752 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:17.334896 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd493bc85edf46c484ecb6f9f2ea7338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.336256 10366 tablet_bootstrap.cc:654] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:17.337381 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 3af8428d456841849d4c6cd2c402585e (DEFAULT_TABLE table=default.Table_2ae916a777334f9a9265e324290edb60 [id=98553057cb374b9fb23fda0d9ee3e8c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.337478 9907 tablet_service.cc:1511] Processing CreateTablet for tablet ec47a78641a548cfb0ccb5aab1f6ac64 (DEFAULT_TABLE table=default.Table_968d4ecf85ff4060bb01bddd4d994029 [id=7705d9fbb614462885fa2f256270a107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.337610 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 2acdafe2cb7840c693cdc8446a2f71d2 (DEFAULT_TABLE table=default.Table_97732b9bdb164afca8b82bedc2afb5b2 [id=d3a7dc0f31d340a0bd27beb9b7882e92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.337854 9885 tablet_service.cc:1511] Processing CreateTablet for tablet 38ebc3b194a14808b630499031be4da2 (DEFAULT_TABLE table=default.Table_6d633a72880e44b6a591eeeb52f63d79 [id=6d9fc81a8df940d4b8f911e7a6d707e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.337913 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 4a66974e83f8431484e5ecd1d3dd9224 (DEFAULT_TABLE table=default.Table_2e1c8f736f574267a5895e990459ed79 [id=d38db2a981ff4703b6ee936407f1e79e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.338024 9902 tablet_service.cc:1511] Processing CreateTablet for tablet ff4091dee89640eebfd97861e52f538a (DEFAULT_TABLE table=default.Table_733643d1126149498dc7b97d8549fc5c [id=35ac14265e964a7a8a302733c641b90b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.338407 9894 tablet_service.cc:1511] Processing CreateTablet for tablet 4437564045784f36a320181da8387397 (DEFAULT_TABLE table=default.Table_0eee3a62d69c4a90b8b0c45cd7d78dcc [id=3a27a2aaea7e4b2b8cfbb6c0d50af446]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:17.338471 9830 leader_election.cc:343] T 1f895bcd21f647f2ab813903d600a31a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Not found: Tablet not found: 1f895bcd21f647f2ab813903d600a31a
I20260810 19:48:17.338573 9830 leader_election.cc:304] T 1f895bcd21f647f2ab813903d600a31a P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:17.338596 9908 tablet_service.cc:1511] Processing CreateTablet for tablet be90bb3ded454172aef6578669dfa908 (DEFAULT_TABLE table=default.Table_c66a98aa6e1f4ef5a7fcc4d8a5f6ed4e [id=bdebbc256a5d4918bafe8d110ec49327]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:17.338742 9830 raft_consensus.cc:2686] T 1f895bcd21f647f2ab813903d600a31a P 6986ed920dcb4af29a5eeeda6f671691: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 19:48:17.338425 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 25da36714b1d4e89a2c4af713331f4ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:17.339090 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3af8428d456841849d4c6cd2c402585e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.339195 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 2f636d3a30144449b00b4f9119ba6ab1 (DEFAULT_TABLE table=default.Table_2c9aa482e51c48f6bd512effb1144fa9 [id=e875cf37caf448b8b21d8c419f01d921]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.339504 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f636d3a30144449b00b4f9119ba6ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.342430 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2acdafe2cb7840c693cdc8446a2f71d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.338263 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 1d27261183b4478cbcf0e8a89fc42f03 (DEFAULT_TABLE table=default.Table_3653184e2aa24b82b6fc81998fd83734 [id=9a1b72d5c4474a9981add393ce463bb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.343444 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d27261183b4478cbcf0e8a89fc42f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.346451 9885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38ebc3b194a14808b630499031be4da2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.350503 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a66974e83f8431484e5ecd1d3dd9224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.354822 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be90bb3ded454172aef6578669dfa908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.355011 10366 tablet_bootstrap.cc:492] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:17.355134 10366 ts_tablet_manager.cc:1403] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.001s
I20260810 19:48:17.355785 10366 raft_consensus.cc:359] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.355953 10366 raft_consensus.cc:385] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:17.356019 10366 raft_consensus.cc:740] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:17.355964 13335 consensus_queue.cc:1048] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:17.356122 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87fd882e6b6413480a0cb06aee74722" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:17.356251 10366 consensus_queue.cc:260] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.356987 10366 ts_tablet_manager.cc:1434] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:17.357254 10366 tablet_bootstrap.cc:492] T 99aa001db52149dd90ce86e7261f7424 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
W20260810 19:48:17.357669 9611 leader_election.cc:343] T e87fd882e6b6413480a0cb06aee74722 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.358440 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4437564045784f36a320181da8387397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.358949 10366 tablet_bootstrap.cc:654] T 99aa001db52149dd90ce86e7261f7424 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:17.360306 12266 ts_tablet_manager.cc:1929] T a776693b6b4943a7b64e13ec10958c16 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:17.360427 12266 log.cc:1199] T a776693b6b4943a7b64e13ec10958c16 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/a776693b6b4943a7b64e13ec10958c16
I20260810 19:48:17.362825 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec47a78641a548cfb0ccb5aab1f6ac64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.363178 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4091dee89640eebfd97861e52f538a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.363785 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 823bcbb987374ab4b9b0fc3d9d79b571 (table default.Table_c53d9c7f87054a568e99b3f08135ff87 [id=55a3c423691d48feb82508b11c04ca4e]) successfully deleted
I20260810 19:48:17.370043 10377 ts_tablet_manager.cc:1916] T 1f895bcd21f647f2ab813903d600a31a P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:17.373950 10366 tablet_bootstrap.cc:492] T 99aa001db52149dd90ce86e7261f7424 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:17.378221 10366 ts_tablet_manager.cc:1403] T 99aa001db52149dd90ce86e7261f7424 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.000s
I20260810 19:48:17.384162 10366 raft_consensus.cc:359] T 99aa001db52149dd90ce86e7261f7424 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.302386 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 1d27261183b4478cbcf0e8a89fc42f03 (DEFAULT_TABLE table=default.Table_3653184e2aa24b82b6fc81998fd83734 [id=9a1b72d5c4474a9981add393ce463bb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.390470 10375 log.cc:1199] T 48eee4ce10114021855075812e356652 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/48eee4ce10114021855075812e356652
I20260810 19:48:17.390765 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d27261183b4478cbcf0e8a89fc42f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.390868 10375 ts_tablet_manager.cc:1950] T 48eee4ce10114021855075812e356652 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:17.393467 10366 raft_consensus.cc:385] T 99aa001db52149dd90ce86e7261f7424 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:17.393549 10366 raft_consensus.cc:740] T 99aa001db52149dd90ce86e7261f7424 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:17.398488 10366 consensus_queue.cc:260] T 99aa001db52149dd90ce86e7261f7424 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.399075 10366 ts_tablet_manager.cc:1434] T 99aa001db52149dd90ce86e7261f7424 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.018s user 0.001s sys 0.000s
I20260810 19:48:17.399402 10366 tablet_bootstrap.cc:492] T 48eee4ce10114021855075812e356652 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:17.304847 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 25da36714b1d4e89a2c4af713331f4ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:17.401108 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 59826cbe61054ac8aec82c6be683defd (DEFAULT_TABLE table=default.Table_f458a2f7a78d4870b5f489afdcd4eef6 [id=815aba326e24410cadef0e060b427979]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.307400 10370 consensus_queue.cc:260] T b3754889e4574fc3a936ac31cc6f496a P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.308287 10139 tablet_service.cc:1511] Processing CreateTablet for tablet be90bb3ded454172aef6578669dfa908 (DEFAULT_TABLE table=default.Table_c66a98aa6e1f4ef5a7fcc4d8a5f6ed4e [id=bdebbc256a5d4918bafe8d110ec49327]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.401859 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be90bb3ded454172aef6578669dfa908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.401940 10370 ts_tablet_manager.cc:1434] T b3754889e4574fc3a936ac31cc6f496a P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.105s user 0.001s sys 0.001s
I20260810 19:48:17.321867 13320 raft_consensus.cc:697] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:17.347282 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87fd882e6b6413480a0cb06aee74722" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:17.402290 10370 tablet_bootstrap.cc:492] T eb3e7d34b5314bc7a7c5ed53792728ca P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:17.358457 13357 raft_consensus.cc:493] T 9ed73161398f4f54a20a9173c18b4d3c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.403128 13357 raft_consensus.cc:515] T 9ed73161398f4f54a20a9173c18b4d3c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.404152 13357 leader_election.cc:290] T 9ed73161398f4f54a20a9173c18b4d3c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:17.404475 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ed73161398f4f54a20a9173c18b4d3c" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:17.404584 10370 tablet_bootstrap.cc:654] T eb3e7d34b5314bc7a7c5ed53792728ca P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:17.404986 10067 leader_election.cc:343] T 9ed73161398f4f54a20a9173c18b4d3c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.406980 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 47bbe10c2ac0465caa86125babf12277
W20260810 19:48:17.407464 9611 leader_election.cc:343] T e87fd882e6b6413480a0cb06aee74722 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.407593 9611 leader_election.cc:304] T e87fd882e6b6413480a0cb06aee74722 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:17.407778 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 6f4b5c6d5bd14c59b3cd3f8ee00a3301
I20260810 19:48:17.408030 13302 raft_consensus.cc:2749] T e87fd882e6b6413480a0cb06aee74722 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:17.402491 13320 consensus_queue.cc:237] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.409294 9908 tablet_service.cc:1511] Processing CreateTablet for tablet c664841cfc364f40b2f04df7b165896f (DEFAULT_TABLE table=default.Table_2b1699b3911947319e52307f4451f572 [id=c67432fec6584aa38ab2a34a05afd288]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.409727 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c664841cfc364f40b2f04df7b165896f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:17.410110 10068 leader_election.cc:343] T 9ed73161398f4f54a20a9173c18b4d3c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 9ed73161398f4f54a20a9173c18b4d3c
I20260810 19:48:17.410215 10068 leader_election.cc:304] T 9ed73161398f4f54a20a9173c18b4d3c P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:17.411186 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet e341b104f53c4b6bb87ca3274845e58f
I20260810 19:48:17.411808 9421 master_service.cc:960] ReplaceTablet: received request to replace tablet deeb390ae00646089e9f1d453ddb54a1 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:17.412302 13309 raft_consensus.cc:2749] T 9ed73161398f4f54a20a9173c18b4d3c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:17.414489 9415 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 269adfeb1efe46d3944f33b245126665 (table default.Table_696557d30f2f4005b23f9da6ad1f38c4 [id=b7a9d407c9d74d0c8fd85c1d8498c3f9]). Expected version 1 got 0
I20260810 19:48:17.414633 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_079c56f5b23049f0bfd2ec3217105ab9" } new_table_name: "default.Table_21fcacdc6600475f94cfb970d662c931" modify_external_catalogs: true
I20260810 19:48:17.415501 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2b30f2552558478aa3e232e68390c193"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:17.416894 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b30f2552558478aa3e232e68390c193 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:17.417229 9398 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet e56d9c164d2b47abb004d13b7f2488d9 (table default.Table_e0cbf5c3255a4df480038df674f812b6 [id=a1b8d2e7a88a423296bc7337fa9392d9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e56d9c164d2b47abb004d13b7f2488d9 consensus state has no leader
I20260810 19:48:17.418583 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_18b5d7c2de7c4a87bb24f7a67bc0b721"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:17.418870 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ad4c8111945d44589f5608226af55c5b" } new_table_name: "default.Table_5ac565e827d240f4a65f11bbf973f3a2" modify_external_catalogs: true
W20260810 19:48:17.419092 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18b5d7c2de7c4a87bb24f7a67bc0b721 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:17.419081 9897 tablet_service.cc:1511] Processing CreateTablet for tablet 59826cbe61054ac8aec82c6be683defd (DEFAULT_TABLE table=default.Table_f458a2f7a78d4870b5f489afdcd4eef6 [id=815aba326e24410cadef0e060b427979]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.422230 10139 tablet_service.cc:1558] Processing DeleteTablet for tablet 47bbe10c2ac0465caa86125babf12277 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:17.423156 9416 catalog_manager.cc:5719] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195). New cstate: current_term: 1 leader_uuid: "eadde59fd6504d679e47f03a60c64bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: HEALTHY } } }
I20260810 19:48:17.423748 9416 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 56fa5de3bf7142b2b0978f9190091f33 (table default.Table_1881cd552cf54157a0a41766d5b1b259 [id=87220e53176e4254a5238c988b6a7311]). Expected version 2 got 0
I20260810 19:48:17.423914 9416 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 0292c3214aa84c40ace16760f414d912 (table default.Table_3ca7c069a1d34227aca0af884fac1b5b [id=b3ab2ecf4f4247369ce62adeb445c834]). Expected version 1 got 0
I20260810 19:48:17.428517 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet 263a5695e7754b44a64edbda27b42135 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:04 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:17.429152 9894 tablet_service.cc:1558] Processing DeleteTablet for tablet e341b104f53c4b6bb87ca3274845e58f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:17.429491 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet e341b104f53c4b6bb87ca3274845e58f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:17.429522 13041 consensus_queue.cc:1048] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:17.430351 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 5ec87a09fe7e4ebc9a8179f51af69af5 (DEFAULT_TABLE table=default.Table_75d30ea8a4b04e43831658c263cbc3f9 [id=a4a5412ad0614cbd9323f1997b77dcd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.430866 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ec87a09fe7e4ebc9a8179f51af69af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.430786 9894 tablet_service.cc:1511] Processing CreateTablet for tablet 5ec87a09fe7e4ebc9a8179f51af69af5 (DEFAULT_TABLE table=default.Table_75d30ea8a4b04e43831658c263cbc3f9 [id=a4a5412ad0614cbd9323f1997b77dcd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.431928 10137 tablet_service.cc:1511] Processing CreateTablet for tablet c664841cfc364f40b2f04df7b165896f (DEFAULT_TABLE table=default.Table_2b1699b3911947319e52307f4451f572 [id=c67432fec6584aa38ab2a34a05afd288]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.432387 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c664841cfc364f40b2f04df7b165896f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.433475 10370 tablet_bootstrap.cc:492] T eb3e7d34b5314bc7a7c5ed53792728ca P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:17.433616 10370 ts_tablet_manager.cc:1403] T eb3e7d34b5314bc7a7c5ed53792728ca P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.031s user 0.000s sys 0.010s
I20260810 19:48:17.434397 10370 raft_consensus.cc:359] T eb3e7d34b5314bc7a7c5ed53792728ca P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.434574 10370 raft_consensus.cc:385] T eb3e7d34b5314bc7a7c5ed53792728ca P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:17.434656 10370 raft_consensus.cc:740] T eb3e7d34b5314bc7a7c5ed53792728ca P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:17.435331 10370 consensus_queue.cc:260] T eb3e7d34b5314bc7a7c5ed53792728ca P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.436326 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f4b5c6d5bd14c59b3cd3f8ee00a3301 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:17.436597 9902 tablet_service.cc:1558] Processing DeleteTablet for tablet 47bbe10c2ac0465caa86125babf12277 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:17.437080 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 59826cbe61054ac8aec82c6be683defd (DEFAULT_TABLE table=default.Table_f458a2f7a78d4870b5f489afdcd4eef6 [id=815aba326e24410cadef0e060b427979]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.437517 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59826cbe61054ac8aec82c6be683defd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.437331 9664 tablet_service.cc:1511] Processing CreateTablet for tablet be90bb3ded454172aef6578669dfa908 (DEFAULT_TABLE table=default.Table_c66a98aa6e1f4ef5a7fcc4d8a5f6ed4e [id=bdebbc256a5d4918bafe8d110ec49327]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.437937 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be90bb3ded454172aef6578669dfa908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.439397 10370 ts_tablet_manager.cc:1434] T eb3e7d34b5314bc7a7c5ed53792728ca P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260810 19:48:17.440932 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f4b5c6d5bd14c59b3cd3f8ee00a3301 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:17.441712 10370 tablet_bootstrap.cc:492] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:17.444100 10124 tablet_service.cc:1511] Processing CreateTablet for tablet b16d7333f3dd481bb242dee2564d2051 (DEFAULT_TABLE table=default.Table_92e004ad2c72411dacdb1a20f13fe654 [id=2c058f47ba3b4e928be8a654839484c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.444584 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b16d7333f3dd481bb242dee2564d2051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.445545 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet ed5ae28144b2488fb06e436920b3ca6a
I20260810 19:48:17.447726 9407 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 18ed05a1eb4a4f6e9a7284caaa0bba05 (table default.Table_5f86aedb4db8406090f1dd83566d57f8 [id=04cfb59bcc4e460f9063fe742900ba92]). Expected version 1 got 0
I20260810 19:48:17.448678 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 431c11767fd24c0dac8c3f8dd986cafc (DEFAULT_TABLE table=default.Table_9967f6e10cab45198260b0a88dd3dd90 [id=7b71eaa9104e46859f0d415fa6a687c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.448980 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_72a80c06c138411ab77f41d2d076aad0" } new_table_name: "default.Table_0729d89897294613837b225dbc2b7809" modify_external_catalogs: true
I20260810 19:48:17.449386 9898 tablet_service.cc:1511] Processing CreateTablet for tablet b16d7333f3dd481bb242dee2564d2051 (DEFAULT_TABLE table=default.Table_92e004ad2c72411dacdb1a20f13fe654 [id=2c058f47ba3b4e928be8a654839484c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.452033 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet ed5ae28144b2488fb06e436920b3ca6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:17.455201 9885 tablet_service.cc:1558] Processing DeleteTablet for tablet b9b567b3338845e4a37cff2a955056ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:17.455533 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet ed5ae28144b2488fb06e436920b3ca6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:17.455600 10118 tablet_service.cc:1511] Processing CreateTablet for tablet f38e0671810f4e81bd2d790852316d54 (DEFAULT_TABLE table=default.Table_47c62dfd4e2f44d1994d2af7218e8862 [id=bdcd1b8310aa4e31b9940e87d8b9c1e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.455801 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet 99aa001db52149dd90ce86e7261f7424 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:05 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:17.456049 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f38e0671810f4e81bd2d790852316d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.456223 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 431c11767fd24c0dac8c3f8dd986cafc (DEFAULT_TABLE table=default.Table_9967f6e10cab45198260b0a88dd3dd90 [id=7b71eaa9104e46859f0d415fa6a687c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.456609 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 431c11767fd24c0dac8c3f8dd986cafc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.457261 10370 tablet_bootstrap.cc:654] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:17.458621 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7dec9f6b698044ae97fa4c480e9e21c1 consensus state has no leader
I20260810 19:48:17.460330 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet deeb390ae00646089e9f1d453ddb54a1
I20260810 19:48:17.460793 9421 catalog_manager.cc:6807] ReplaceTablet: tablet deeb390ae00646089e9f1d453ddb54a1 deleted and replaced by tablet 50e3bcae1da6442aa57a4c8a46ee9493
I20260810 19:48:17.463065 13357 raft_consensus.cc:493] T b3754889e4574fc3a936ac31cc6f496a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.463201 13357 raft_consensus.cc:515] T b3754889e4574fc3a936ac31cc6f496a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.463881 13357 leader_election.cc:290] T b3754889e4574fc3a936ac31cc6f496a P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:17.464622 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3754889e4574fc3a936ac31cc6f496a" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:17.465306 10067 leader_election.cc:343] T b3754889e4574fc3a936ac31cc6f496a P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.472930 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59826cbe61054ac8aec82c6be683defd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.473532 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 48eee4ce10114021855075812e356652 (table default.Table_11f7a8e6101542a5935af66211bd2469 [id=a8bcb3d29fb749c5ab9fa745718d0fac]) successfully deleted
I20260810 19:48:17.473899 9658 tablet_service.cc:1511] Processing CreateTablet for tablet c664841cfc364f40b2f04df7b165896f (DEFAULT_TABLE table=default.Table_2b1699b3911947319e52307f4451f572 [id=c67432fec6584aa38ab2a34a05afd288]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.474295 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c664841cfc364f40b2f04df7b165896f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:17.474627 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 25da36714b1d4e89a2c4af713331f4ec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25da36714b1d4e89a2c4af713331f4ec already in progress: creating tablet
W20260810 19:48:17.474839 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 47bbe10c2ac0465caa86125babf12277 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47bbe10c2ac0465caa86125babf12277 already in progress: creating tablet
I20260810 19:48:17.475934 9657 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f4b5c6d5bd14c59b3cd3f8ee00a3301 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:17.476044 9668 tablet_service.cc:1511] Processing CreateTablet for tablet 5ec87a09fe7e4ebc9a8179f51af69af5 (DEFAULT_TABLE table=default.Table_75d30ea8a4b04e43831658c263cbc3f9 [id=a4a5412ad0614cbd9323f1997b77dcd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.476434 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ec87a09fe7e4ebc9a8179f51af69af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.476794 9665 tablet_service.cc:1511] Processing CreateTablet for tablet 431c11767fd24c0dac8c3f8dd986cafc (DEFAULT_TABLE table=default.Table_9967f6e10cab45198260b0a88dd3dd90 [id=7b71eaa9104e46859f0d415fa6a687c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.477152 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 431c11767fd24c0dac8c3f8dd986cafc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.477567 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet e341b104f53c4b6bb87ca3274845e58f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:17.478147 10370 tablet_bootstrap.cc:492] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:17.479363 10370 ts_tablet_manager.cc:1403] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.038s user 0.007s sys 0.000s
I20260810 19:48:17.483537 9655 tablet_service.cc:1558] Processing DeleteTablet for tablet 47bbe10c2ac0465caa86125babf12277 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:17.484288 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet deeb390ae00646089e9f1d453ddb54a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 50e3bcae1da6442aa57a4c8a46ee9493) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:17.486541 9895 tablet_service.cc:1511] Processing CreateTablet for tablet f38e0671810f4e81bd2d790852316d54 (DEFAULT_TABLE table=default.Table_47c62dfd4e2f44d1994d2af7218e8862 [id=bdcd1b8310aa4e31b9940e87d8b9c1e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.486101 10370 raft_consensus.cc:359] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.487233 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet deeb390ae00646089e9f1d453ddb54a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 50e3bcae1da6442aa57a4c8a46ee9493) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:17.487382 10370 raft_consensus.cc:385] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:17.487787 10370 raft_consensus.cc:740] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:17.489153 10370 consensus_queue.cc:260] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.492283 9665 tablet_service.cc:1558] Processing DeleteTablet for tablet ed5ae28144b2488fb06e436920b3ca6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:17.492988 9655 tablet_service.cc:1511] Processing CreateTablet for tablet b16d7333f3dd481bb242dee2564d2051 (DEFAULT_TABLE table=default.Table_92e004ad2c72411dacdb1a20f13fe654 [id=2c058f47ba3b4e928be8a654839484c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.493443 9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b16d7333f3dd481bb242dee2564d2051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.496578 12266 ts_tablet_manager.cc:1950] T a776693b6b4943a7b64e13ec10958c16 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
W20260810 19:48:17.496661 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet e341b104f53c4b6bb87ca3274845e58f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e341b104f53c4b6bb87ca3274845e58f already in progress: creating tablet
I20260810 19:48:17.498536 9667 tablet_service.cc:1558] Processing DeleteTablet for tablet deeb390ae00646089e9f1d453ddb54a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 50e3bcae1da6442aa57a4c8a46ee9493) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:17.498536 13302 raft_consensus.cc:493] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.498734 13302 raft_consensus.cc:515] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.501933 10370 ts_tablet_manager.cc:1434] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.022s user 0.003s sys 0.000s
I20260810 19:48:17.499541 13159 raft_consensus.cc:493] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.503479 13159 raft_consensus.cc:515] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.504194 13159 leader_election.cc:290] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:17.505201 10370 tablet_bootstrap.cc:492] T 263a5695e7754b44a64edbda27b42135 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:17.505869 13159 raft_consensus.cc:493] T 5a35be79a8924213ab860a9da04a598c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.506009 13159 raft_consensus.cc:515] T 5a35be79a8924213ab860a9da04a598c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.508484 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b19479978c46bf8a425ccf1225ef45" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:17.509191 9611 leader_election.cc:343] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.509855 13159 leader_election.cc:290] T 5a35be79a8924213ab860a9da04a598c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:17.511519 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b19479978c46bf8a425ccf1225ef45" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:17.512027 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35be79a8924213ab860a9da04a598c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:17.512650 9611 leader_election.cc:343] T 5a35be79a8924213ab860a9da04a598c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:17.513104 9611 leader_election.cc:343] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.513203 9611 leader_election.cc:304] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:17.513391 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35be79a8924213ab860a9da04a598c" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:17.513777 13159 raft_consensus.cc:2749] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:17.514201 9611 leader_election.cc:343] T 5a35be79a8924213ab860a9da04a598c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.514344 9611 leader_election.cc:304] T 5a35be79a8924213ab860a9da04a598c P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:17.514353 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0292c3214aa84c40ace16760f414d912" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:17.514787 13159 raft_consensus.cc:2749] T 5a35be79a8924213ab860a9da04a598c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:17.518301 9611 leader_election.cc:343] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.518754 10370 tablet_bootstrap.cc:654] T 263a5695e7754b44a64edbda27b42135 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:17.498298 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 6f4b5c6d5bd14c59b3cd3f8ee00a3301 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f4b5c6d5bd14c59b3cd3f8ee00a3301 already in progress: creating tablet
I20260810 19:48:17.519217 13302 leader_election.cc:290] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:17.520288 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet ed5ae28144b2488fb06e436920b3ca6a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed5ae28144b2488fb06e436920b3ca6a already in progress: creating tablet
W20260810 19:48:17.521503 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet deeb390ae00646089e9f1d453ddb54a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet deeb390ae00646089e9f1d453ddb54a1 already in progress: creating tablet
W20260810 19:48:17.523895 10068 leader_election.cc:343] T b3754889e4574fc3a936ac31cc6f496a P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: b3754889e4574fc3a936ac31cc6f496a
I20260810 19:48:17.524037 10068 leader_election.cc:304] T b3754889e4574fc3a936ac31cc6f496a P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:17.524315 13320 raft_consensus.cc:2749] T b3754889e4574fc3a936ac31cc6f496a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:17.525101 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0292c3214aa84c40ace16760f414d912" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:17.525305 10153 raft_consensus.cc:2468] T 0292c3214aa84c40ace16760f414d912 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:48:17.525862 9611 leader_election.cc:304] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691
I20260810 19:48:17.526149 13302 raft_consensus.cc:2804] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:17.526213 13302 raft_consensus.cc:493] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:17.526286 13302 raft_consensus.cc:3060] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:17.529208 13302 raft_consensus.cc:515] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.529872 13302 leader_election.cc:290] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:17.532023 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0292c3214aa84c40ace16760f414d912" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:17.532029 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0292c3214aa84c40ace16760f414d912" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:17.532235 10153 raft_consensus.cc:3060] T 0292c3214aa84c40ace16760f414d912 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:17.535694 10153 raft_consensus.cc:2468] T 0292c3214aa84c40ace16760f414d912 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:48:17.536567 9611 leader_election.cc:304] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
W20260810 19:48:17.537029 9611 leader_election.cc:343] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.537557 13302 raft_consensus.cc:2804] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:17.537863 13302 raft_consensus.cc:697] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:48:17.538199 13302 consensus_queue.cc:237] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.541862 10370 tablet_bootstrap.cc:492] T 263a5695e7754b44a64edbda27b42135 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:17.542147 10370 ts_tablet_manager.cc:1403] T 263a5695e7754b44a64edbda27b42135 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.038s user 0.007s sys 0.000s
I20260810 19:48:17.551292 10370 raft_consensus.cc:359] T 263a5695e7754b44a64edbda27b42135 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.552196 10370 raft_consensus.cc:385] T 263a5695e7754b44a64edbda27b42135 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:17.552587 10370 raft_consensus.cc:740] T 263a5695e7754b44a64edbda27b42135 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:17.553603 10370 consensus_queue.cc:260] T 263a5695e7754b44a64edbda27b42135 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.560313 13041 consensus_queue.cc:1048] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:17.560940 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet a776693b6b4943a7b64e13ec10958c16 (table default.Table_ad4523adf6cb4df7948a357515ec4b9a [id=632c2c289ff24ddcbf9d13ffe1fcda15]) successfully deleted
I20260810 19:48:17.561281 10370 ts_tablet_manager.cc:1434] T 263a5695e7754b44a64edbda27b42135 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.019s user 0.003s sys 0.000s
I20260810 19:48:17.563024 12266 tablet_replica.cc:333] T 55fb03a8dd3b40f5ba3de41fa7c01f5d P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:17.563993 10367 tablet_bootstrap.cc:492] T 22954e727fb44a24bd382b9caee9996b P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:17.564597 10367 ts_tablet_manager.cc:1403] T 22954e727fb44a24bd382b9caee9996b P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.241s user 0.007s sys 0.004s
I20260810 19:48:17.565869 10370 tablet_bootstrap.cc:492] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:17.568215 9907 tablet_service.cc:1511] Processing CreateTablet for tablet 236ab18887dc44caadb63e3b37f8441d (DEFAULT_TABLE table=default.Table_c2ec5ae7a4374a8087ba72ba75b7590e [id=35d28bcf7c1c46c6ab1800f622ea093a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.569972 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 5bde46eae2364133a499198d9187b2a5 (DEFAULT_TABLE table=default.Table_a815f0b98f384b3c89974f65a73ed73f [id=ee26d09800984fd18ee040e0ae24bb76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.570438 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bde46eae2364133a499198d9187b2a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.570473 9885 tablet_service.cc:1511] Processing CreateTablet for tablet 5bde46eae2364133a499198d9187b2a5 (DEFAULT_TABLE table=default.Table_a815f0b98f384b3c89974f65a73ed73f [id=ee26d09800984fd18ee040e0ae24bb76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.571975 9906 tablet_service.cc:1511] Processing CreateTablet for tablet f8e1ffaad910441d99aa9d6596d3b17d (DEFAULT_TABLE table=default.Table_d29e9a9dd94f48d5bae5e17c3e706428 [id=e4841688e32c4ad9807d0e7aadb1ef7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.575086 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 236ab18887dc44caadb63e3b37f8441d (DEFAULT_TABLE table=default.Table_c2ec5ae7a4374a8087ba72ba75b7590e [id=35d28bcf7c1c46c6ab1800f622ea093a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:17.576901 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 01f778560eb9475da082dec2e2892e9c consensus state has no leader
W20260810 19:48:17.577019 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3c6996f880e847c39a3a4e173d28ed9f consensus state has no leader
I20260810 19:48:17.579082 9415 master_service.cc:960] ReplaceTablet: received request to replace tablet 8569d63bbd8e4753b376ee6a5127fd3d from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:17.580818 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b14a1b59ea5e43e68958b8202562182e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:17.581454 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b14a1b59ea5e43e68958b8202562182e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:17.582304 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ff08ac2a902148c29690a097858fa0d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:17.582540 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_364f284b970d409bbd9cd3c59e6da18e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:17.582826 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ff08ac2a902148c29690a097858fa0d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:17.582974 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_364f284b970d409bbd9cd3c59e6da18e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:17.565251 12266 raft_consensus.cc:2243] T 55fb03a8dd3b40f5ba3de41fa7c01f5d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:17.585114 9418 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 8b24b75629ec423b90e4bf287e7cfd38 (table default.Table_ce3ea915b9dd44b3943c4de2b462d48c [id=9f58b113854b4d139e789332dfe00c8c]). Expected version 3 got 0
I20260810 19:48:17.585256 12266 raft_consensus.cc:2272] T 55fb03a8dd3b40f5ba3de41fa7c01f5d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:17.585882 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_d80279bdee9144d9b36f89aad71ca8aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:17.568059 9655 tablet_service.cc:1511] Processing CreateTablet for tablet 5bde46eae2364133a499198d9187b2a5 (DEFAULT_TABLE table=default.Table_a815f0b98f384b3c89974f65a73ed73f [id=ee26d09800984fd18ee040e0ae24bb76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.586735 9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bde46eae2364133a499198d9187b2a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.586777 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b39b7dbc0b6e4f398a8cb0bc8b76666b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:17.587213 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b39b7dbc0b6e4f398a8cb0bc8b76666b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:17.589632 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a018c57628c543db9a258f393c98f931" } new_table_name: "default.Table_39ead7604ec44a62875e92104a9bc306" modify_external_catalogs: true
I20260810 19:48:17.569027 9668 tablet_service.cc:1511] Processing CreateTablet for tablet f8e1ffaad910441d99aa9d6596d3b17d (DEFAULT_TABLE table=default.Table_d29e9a9dd94f48d5bae5e17c3e706428 [id=e4841688e32c4ad9807d0e7aadb1ef7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.590956 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e1ffaad910441d99aa9d6596d3b17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.591840 9413 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 73abedd88ba548bdb5a23f508b77403d (table default.Table_2c70d731dd51405188ec44cbbcffaf57 [id=85908f0b736c4bf9bdbcd67352e2d491]). Expected version 1 got 0
I20260810 19:48:17.591917 10370 tablet_bootstrap.cc:654] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:17.592897 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b0fbac9c2b634c38aad056086165f4ec" } modify_external_catalogs: true
I20260810 19:48:17.593050 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b0fbac9c2b634c38aad056086165f4ec" } modify_external_catalogs: true
I20260810 19:48:17.593104 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet f5fa6060b9ef48cea6830cd9d19424ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:17.595129 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d80279bdee9144d9b36f89aad71ca8aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:17.596345 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b3424333fe664b7a8bbd68768e31c59d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:17.596912 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3424333fe664b7a8bbd68768e31c59d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:17.599367 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d9fab66c95724cdca35a523a9fc1deba consensus state has no leader
I20260810 19:48:17.565411 10367 raft_consensus.cc:359] T 22954e727fb44a24bd382b9caee9996b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.600311 10367 raft_consensus.cc:385] T 22954e727fb44a24bd382b9caee9996b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:17.600546 10367 raft_consensus.cc:740] T 22954e727fb44a24bd382b9caee9996b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:17.601228 10367 consensus_queue.cc:260] T 22954e727fb44a24bd382b9caee9996b P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.603869 10367 ts_tablet_manager.cc:1434] T 22954e727fb44a24bd382b9caee9996b P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.039s user 0.001s sys 0.002s
I20260810 19:48:17.573691 9675 tablet_service.cc:1511] Processing CreateTablet for tablet f38e0671810f4e81bd2d790852316d54 (DEFAULT_TABLE table=default.Table_47c62dfd4e2f44d1994d2af7218e8862 [id=bdcd1b8310aa4e31b9940e87d8b9c1e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.606578 13338 consensus_queue.cc:1048] T 5e47086440ef4a249f1eed23db655879 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:17.609207 9407 catalog_manager.cc:5719] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193). New cstate: current_term: 1 leader_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:17.609634 9407 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 0292c3214aa84c40ace16760f414d912 (table default.Table_3ca7c069a1d34227aca0af884fac1b5b [id=b3ab2ecf4f4247369ce62adeb445c834]). Expected version 1 got 0
I20260810 19:48:17.609862 9407 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 73abedd88ba548bdb5a23f508b77403d (table default.Table_2c70d731dd51405188ec44cbbcffaf57 [id=85908f0b736c4bf9bdbcd67352e2d491]). Expected version 1 got 0
I20260810 19:48:17.609995 9407 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 8b24b75629ec423b90e4bf287e7cfd38 (table default.Table_ce3ea915b9dd44b3943c4de2b462d48c [id=9f58b113854b4d139e789332dfe00c8c]). Expected version 3 got 0
I20260810 19:48:17.617491 10137 tablet_service.cc:1511] Processing CreateTablet for tablet f8e1ffaad910441d99aa9d6596d3b17d (DEFAULT_TABLE table=default.Table_d29e9a9dd94f48d5bae5e17c3e706428 [id=e4841688e32c4ad9807d0e7aadb1ef7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.620404 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 48e13adfdfe54c4b9e746b702683b451 (DEFAULT_TABLE table=default.Table_3d1ea6253cfd4262a4df7e7fc413d016 [id=ab7aac7161c94ee5a51dd905def885be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.622499 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 48e13adfdfe54c4b9e746b702683b451 (DEFAULT_TABLE table=default.Table_3d1ea6253cfd4262a4df7e7fc413d016 [id=ab7aac7161c94ee5a51dd905def885be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.623281 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 8569d63bbd8e4753b376ee6a5127fd3d
I20260810 19:48:17.623292 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet bb1e4400ca684da7b3b5e6592e19b6e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:00 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:17.623762 9415 catalog_manager.cc:6807] ReplaceTablet: tablet 8569d63bbd8e4753b376ee6a5127fd3d deleted and replaced by tablet 1aa91baf608d46a495847dc4cfc8bd49
I20260810 19:48:17.625208 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet 823bcbb987374ab4b9b0fc3d9d79b571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:54 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:17.626610 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f4e2adee0264e418ff8c54912973e60 with delete_type TABLET_DATA_DELETED (replaced by tablet 883bf419763f4dcfab870fea49137eff) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:17.627869 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet b4b6b17ce3354600b2f7450c6e483c69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:17.629362 9655 tablet_service.cc:1558] Processing DeleteTablet for tablet 8569d63bbd8e4753b376ee6a5127fd3d with delete_type TABLET_DATA_DELETED (replaced by tablet 1aa91baf608d46a495847dc4cfc8bd49) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:17.655269 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 236ab18887dc44caadb63e3b37f8441d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.657444 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48e13adfdfe54c4b9e746b702683b451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.659755 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e1ffaad910441d99aa9d6596d3b17d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:17.663005 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 97c78c188c024b0f9da45cd99d2cb80c consensus state has no leader
I20260810 19:48:17.664731 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_da45ba37a0804616b521723bc724e0f0" } modify_external_catalogs: true
I20260810 19:48:17.642289 10367 tablet_bootstrap.cc:492] T 0849ea9c04104a8184f8a8cd40e06fc2 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:17.664913 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_da45ba37a0804616b521723bc724e0f0" } modify_external_catalogs: true
I20260810 19:48:17.644088 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 236ab18887dc44caadb63e3b37f8441d (DEFAULT_TABLE table=default.Table_c2ec5ae7a4374a8087ba72ba75b7590e [id=35d28bcf7c1c46c6ab1800f622ea093a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.645222 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f38e0671810f4e81bd2d790852316d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.665975 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_073fe66f42db4d298e2aa03e9ddfb175" } modify_external_catalogs: true
I20260810 19:48:17.658041 9655 tablet_service.cc:1511] Processing CreateTablet for tablet 48e13adfdfe54c4b9e746b702683b451 (DEFAULT_TABLE table=default.Table_3d1ea6253cfd4262a4df7e7fc413d016 [id=ab7aac7161c94ee5a51dd905def885be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.666132 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_073fe66f42db4d298e2aa03e9ddfb175" } modify_external_catalogs: true
I20260810 19:48:17.666504 9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48e13adfdfe54c4b9e746b702683b451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.666776 9410 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f98594bccdb54d598dbba0d33856edc8" } modify_external_catalogs: true
I20260810 19:48:17.667032 9410 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f98594bccdb54d598dbba0d33856edc8" } modify_external_catalogs: true
I20260810 19:48:17.671005 13357 raft_consensus.cc:493] T b4b6b17ce3354600b2f7450c6e483c69 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.671151 13357 raft_consensus.cc:515] T b4b6b17ce3354600b2f7450c6e483c69 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.671845 13357 leader_election.cc:290] T b4b6b17ce3354600b2f7450c6e483c69 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:17.673094 10067 leader_election.cc:343] T b4b6b17ce3354600b2f7450c6e483c69 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: b4b6b17ce3354600b2f7450c6e483c69
I20260810 19:48:17.673749 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_97732b9bdb164afca8b82bedc2afb5b2" } modify_external_catalogs: true
I20260810 19:48:17.673924 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_97732b9bdb164afca8b82bedc2afb5b2" } modify_external_catalogs: true
I20260810 19:48:17.674547 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 236ab18887dc44caadb63e3b37f8441d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.675134 10375 tablet_replica.cc:333] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
W20260810 19:48:17.675930 10068 leader_election.cc:343] T b4b6b17ce3354600b2f7450c6e483c69 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: b4b6b17ce3354600b2f7450c6e483c69
I20260810 19:48:17.676052 10068 leader_election.cc:304] T b4b6b17ce3354600b2f7450c6e483c69 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:17.676007 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_6b8863bd284444ed80fde8b5131ba710"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:17.676082 10375 raft_consensus.cc:2243] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:17.676548 13357 raft_consensus.cc:2749] T b4b6b17ce3354600b2f7450c6e483c69 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:17.676574 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b8863bd284444ed80fde8b5131ba710 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:17.677392 10375 pending_rounds.cc:70] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:17.677541 10375 pending_rounds.cc:77] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058752152121344 op_type: NO_OP noop_request { }
I20260810 19:48:17.677776 10375 raft_consensus.cc:2889] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:17.678028 10375 raft_consensus.cc:2272] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:17.678535 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a96082c210af46e4acbf221a98d946eb" } new_table_name: "default.Table_f5301fb232b245139e9444210309ce06" modify_external_catalogs: true
I20260810 19:48:17.679287 10375 ts_tablet_manager.cc:1916] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:17.679801 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet f2d00c669285436bbafb4b657532f222
I20260810 19:48:17.664285 12266 ts_tablet_manager.cc:1916] T 55fb03a8dd3b40f5ba3de41fa7c01f5d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:17.680647 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e437c0e9512842d3977b1963a2a0435c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:17.680756 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet f2d00c669285436bbafb4b657532f222 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:17 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:17.681309 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e437c0e9512842d3977b1963a2a0435c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:17.682610 13302 raft_consensus.cc:493] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.682811 13302 raft_consensus.cc:515] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.684188 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fe67e8bd014acaa202c022c193cdc6" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:17.685056 9611 leader_election.cc:343] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.686101 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fe67e8bd014acaa202c022c193cdc6" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:17.686794 9611 leader_election.cc:343] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.686906 9611 leader_election.cc:304] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:17.687155 13159 raft_consensus.cc:2749] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:17.687510 13302 leader_election.cc:290] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:17.692179 10370 tablet_bootstrap.cc:492] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:17.692497 10370 ts_tablet_manager.cc:1403] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.128s user 0.002s sys 0.026s
I20260810 19:48:17.694064 10370 raft_consensus.cc:359] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.694470 10370 raft_consensus.cc:385] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:17.694645 10370 raft_consensus.cc:740] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:17.695083 10370 consensus_queue.cc:260] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.697479 10370 ts_tablet_manager.cc:1434] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260810 19:48:17.697613 13104 raft_consensus.cc:493] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.697803 13104 raft_consensus.cc:515] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.698546 13104 leader_election.cc:290] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:17.699162 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263a5695e7754b44a64edbda27b42135" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:17.699362 10151 raft_consensus.cc:2468] T 263a5695e7754b44a64edbda27b42135 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 0.
I20260810 19:48:17.699781 9830 leader_election.cc:304] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:17.700182 13104 raft_consensus.cc:2804] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:17.700269 13104 raft_consensus.cc:493] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:17.700330 13104 raft_consensus.cc:3060] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:17.700757 10370 tablet_bootstrap.cc:492] T 749cea5cd8f842b891f4e2cab07c054e P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:17.703953 13104 raft_consensus.cc:515] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.705101 13104 leader_election.cc:290] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:17.706229 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263a5695e7754b44a64edbda27b42135" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:17.706450 10151 raft_consensus.cc:3060] T 263a5695e7754b44a64edbda27b42135 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:17.709313 10151 raft_consensus.cc:2468] T 263a5695e7754b44a64edbda27b42135 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6986ed920dcb4af29a5eeeda6f671691 in term 1.
I20260810 19:48:17.709873 9830 leader_election.cc:304] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
W20260810 19:48:17.710026 9831 leader_election.cc:343] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 263a5695e7754b44a64edbda27b42135
W20260810 19:48:17.711140 9831 leader_election.cc:343] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 263a5695e7754b44a64edbda27b42135
I20260810 19:48:17.711591 13104 raft_consensus.cc:2804] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:17.712873 13104 raft_consensus.cc:697] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Becoming Leader. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Running, Role: LEADER
I20260810 19:48:17.713639 13104 consensus_queue.cc:237] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.719666 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet f2d00c669285436bbafb4b657532f222 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:17 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:17.719671 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet 8569d63bbd8e4753b376ee6a5127fd3d with delete_type TABLET_DATA_DELETED (replaced by tablet 1aa91baf608d46a495847dc4cfc8bd49) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:17.720677 9892 tablet_service.cc:1558] Processing DeleteTablet for tablet f2d00c669285436bbafb4b657532f222 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:17 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:17.721081 10137 tablet_service.cc:1511] Processing CreateTablet for tablet a350fa55929947e997e2ff763afe6a01 (DEFAULT_TABLE table=default.Table_365bf6134477414dac360b6d6045f4c0 [id=b3606f94b1fd4f1488202d385cc5b298]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.721491 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a350fa55929947e997e2ff763afe6a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.722653 10370 tablet_bootstrap.cc:654] T 749cea5cd8f842b891f4e2cab07c054e P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:17.724961 9408 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 7d939e3df62a45d9a964d4df01be4bfb (table default.Table_65f4c2fb3d1c49ae9cdfc041e51bd182 [id=2292ed1c178a4d458f52885e45c76d41]). Expected version 2 got 0
I20260810 19:48:17.725171 9408 catalog_manager.cc:5719] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195). New cstate: current_term: 1 leader_uuid: "eadde59fd6504d679e47f03a60c64bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: HEALTHY } } }
I20260810 19:48:17.725530 9408 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 18ed05a1eb4a4f6e9a7284caaa0bba05 (table default.Table_5f86aedb4db8406090f1dd83566d57f8 [id=04cfb59bcc4e460f9063fe742900ba92]). Expected version 1 got 0
I20260810 19:48:17.725760 9408 catalog_manager.cc:5719] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195). New cstate: current_term: 1 leader_uuid: "eadde59fd6504d679e47f03a60c64bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: HEALTHY } } }
I20260810 19:48:17.726214 9408 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 8b24b75629ec423b90e4bf287e7cfd38 (table default.Table_ce3ea915b9dd44b3943c4de2b462d48c [id=9f58b113854b4d139e789332dfe00c8c]). Expected version 3 got 0
I20260810 19:48:17.727824 9408 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 73abedd88ba548bdb5a23f508b77403d (table default.Table_2c70d731dd51405188ec44cbbcffaf57 [id=85908f0b736c4bf9bdbcd67352e2d491]). Expected version 1 got 0
I20260810 19:48:17.728060 9408 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 5e47086440ef4a249f1eed23db655879 (table default.Table_b38998c1916842f1aa85263f019bde23 [id=a2b6e3d955f3426781465b670f4fa727]). Expected version 1 got 0
I20260810 19:48:17.730710 9410 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet ec11528c81d24cbc851a4c31cf9257a2
I20260810 19:48:17.733824 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet ec11528c81d24cbc851a4c31cf9257a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:17 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:17.733906 9658 tablet_service.cc:1511] Processing CreateTablet for tablet a350fa55929947e997e2ff763afe6a01 (DEFAULT_TABLE table=default.Table_365bf6134477414dac360b6d6045f4c0 [id=b3606f94b1fd4f1488202d385cc5b298]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.734391 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a350fa55929947e997e2ff763afe6a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.748020 9892 tablet_service.cc:1511] Processing CreateTablet for tablet a350fa55929947e997e2ff763afe6a01 (DEFAULT_TABLE table=default.Table_365bf6134477414dac360b6d6045f4c0 [id=b3606f94b1fd4f1488202d385cc5b298]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.750773 10137 tablet_service.cc:1558] Processing DeleteTablet for tablet ec11528c81d24cbc851a4c31cf9257a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:17 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:17.756448 10367 tablet_bootstrap.cc:654] T 0849ea9c04104a8184f8a8cd40e06fc2 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:17.758806 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 8569d63bbd8e4753b376ee6a5127fd3d with delete_type TABLET_DATA_DELETED (replaced by tablet 1aa91baf608d46a495847dc4cfc8bd49) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:17.758808 10067 consensus_peers.cc:597] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:17.761309 10370 tablet_bootstrap.cc:492] T 749cea5cd8f842b891f4e2cab07c054e P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:17.761770 10370 ts_tablet_manager.cc:1403] T 749cea5cd8f842b891f4e2cab07c054e P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.061s user 0.007s sys 0.003s
I20260810 19:48:17.764590 10370 raft_consensus.cc:359] T 749cea5cd8f842b891f4e2cab07c054e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.766358 10370 raft_consensus.cc:385] T 749cea5cd8f842b891f4e2cab07c054e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:17.766995 10370 raft_consensus.cc:740] T 749cea5cd8f842b891f4e2cab07c054e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:17.769688 10370 consensus_queue.cc:260] T 749cea5cd8f842b891f4e2cab07c054e P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.773528 10375 ts_tablet_manager.cc:1929] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:17.774725 10375 log.cc:1199] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/bb1e4400ca684da7b3b5e6592e19b6e6
I20260810 19:48:17.775913 13104 raft_consensus.cc:493] T 99aa001db52149dd90ce86e7261f7424 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.776075 13104 raft_consensus.cc:515] T 99aa001db52149dd90ce86e7261f7424 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.776818 13104 leader_election.cc:290] T 99aa001db52149dd90ce86e7261f7424 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:17.777987 9830 leader_election.cc:343] T 99aa001db52149dd90ce86e7261f7424 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Not found: Tablet not found: 99aa001db52149dd90ce86e7261f7424
W20260810 19:48:17.778334 9831 leader_election.cc:343] T 99aa001db52149dd90ce86e7261f7424 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 99aa001db52149dd90ce86e7261f7424
I20260810 19:48:17.778461 9831 leader_election.cc:304] T 99aa001db52149dd90ce86e7261f7424 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:17.778976 13104 raft_consensus.cc:2749] T 99aa001db52149dd90ce86e7261f7424 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:17.779384 10370 ts_tablet_manager.cc:1434] T 749cea5cd8f842b891f4e2cab07c054e P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.017s user 0.003s sys 0.001s
I20260810 19:48:17.782334 13357 raft_consensus.cc:493] T 823bcbb987374ab4b9b0fc3d9d79b571 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.782476 13357 raft_consensus.cc:515] T 823bcbb987374ab4b9b0fc3d9d79b571 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.782289 9407 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c3b6fdaa9f2442f59e4dddf40bc53733" } new_table_name: "default.Table_2a967813ddb34c2bb4cb80d6d1990f9f" modify_external_catalogs: true
I20260810 19:48:17.783107 13357 leader_election.cc:290] T 823bcbb987374ab4b9b0fc3d9d79b571 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:17.784279 9901 tablet_service.cc:1558] Processing DeleteTablet for tablet ec11528c81d24cbc851a4c31cf9257a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:17 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:17.784538 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 97a303564aae4afda08f4ea699a176cf (DEFAULT_TABLE table=default.Table_5de62e9dcdc04e9ca62c60c1c214bce7 [id=b00ed0c7004346b395ffa23e78642667]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:17.785247 10067 leader_election.cc:343] T 823bcbb987374ab4b9b0fc3d9d79b571 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 823bcbb987374ab4b9b0fc3d9d79b571
I20260810 19:48:17.785367 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 97a303564aae4afda08f4ea699a176cf (DEFAULT_TABLE table=default.Table_5de62e9dcdc04e9ca62c60c1c214bce7 [id=b00ed0c7004346b395ffa23e78642667]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.786425 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97a303564aae4afda08f4ea699a176cf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:17.786715 10068 leader_election.cc:343] T 823bcbb987374ab4b9b0fc3d9d79b571 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 823bcbb987374ab4b9b0fc3d9d79b571
I20260810 19:48:17.786825 10068 leader_election.cc:304] T 823bcbb987374ab4b9b0fc3d9d79b571 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:17.782452 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_64e5558a29af405b85912f54bebdf3be" } new_table_name: "default.Table_b83a5a6085b44b818679b1fd973071e1" modify_external_catalogs: true
I20260810 19:48:17.787426 13357 raft_consensus.cc:2749] T 823bcbb987374ab4b9b0fc3d9d79b571 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:17.788301 10375 ts_tablet_manager.cc:1950] T bb1e4400ca684da7b3b5e6592e19b6e6 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:17.789728 10370 tablet_bootstrap.cc:492] T deeb390ae00646089e9f1d453ddb54a1 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:17.790436 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 6b9baf2b3e644171b20e03b4c0704136
I20260810 19:48:17.793282 9655 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b9baf2b3e644171b20e03b4c0704136 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:17 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:17.796232 9655 tablet_service.cc:1511] Processing CreateTablet for tablet 97a303564aae4afda08f4ea699a176cf (DEFAULT_TABLE table=default.Table_5de62e9dcdc04e9ca62c60c1c214bce7 [id=b00ed0c7004346b395ffa23e78642667]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.798957 9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97a303564aae4afda08f4ea699a176cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.803073 10367 tablet_bootstrap.cc:492] T 0849ea9c04104a8184f8a8cd40e06fc2 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:17.803239 10367 ts_tablet_manager.cc:1403] T 0849ea9c04104a8184f8a8cd40e06fc2 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.162s user 0.002s sys 0.004s
I20260810 19:48:17.803335 10375 tablet_replica.cc:333] T 823bcbb987374ab4b9b0fc3d9d79b571 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:17.804044 10367 raft_consensus.cc:359] T 0849ea9c04104a8184f8a8cd40e06fc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.804236 10367 raft_consensus.cc:385] T 0849ea9c04104a8184f8a8cd40e06fc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:17.804296 10367 raft_consensus.cc:740] T 0849ea9c04104a8184f8a8cd40e06fc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:17.804520 10367 consensus_queue.cc:260] T 0849ea9c04104a8184f8a8cd40e06fc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.805079 10375 raft_consensus.cc:2243] T 823bcbb987374ab4b9b0fc3d9d79b571 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:17.806020 10367 ts_tablet_manager.cc:1434] T 0849ea9c04104a8184f8a8cd40e06fc2 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 19:48:17.806823 10375 raft_consensus.cc:2272] T 823bcbb987374ab4b9b0fc3d9d79b571 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:17.807411 9901 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b9baf2b3e644171b20e03b4c0704136 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:17 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:17.807583 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b9baf2b3e644171b20e03b4c0704136 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:17 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:17.807945 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet bb1e4400ca684da7b3b5e6592e19b6e6 (table default.Table_a1fa6532e8104ca59b2dca19999e2e61 [id=857eb3f1b89c41a6b2e3b30b375a585c]) successfully deleted
I20260810 19:48:17.812045 10375 ts_tablet_manager.cc:1916] T 823bcbb987374ab4b9b0fc3d9d79b571 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:17.824098 13357 consensus_queue.cc:1048] T 22a77c72f2244a08a65e3779c5895752 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:17.837899 13159 raft_consensus.cc:493] T f5fa6060b9ef48cea6830cd9d19424ea P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.838105 13159 raft_consensus.cc:515] T f5fa6060b9ef48cea6830cd9d19424ea P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.838829 10370 tablet_bootstrap.cc:654] T deeb390ae00646089e9f1d453ddb54a1 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:17.843772 10367 tablet_bootstrap.cc:492] T c8311ccef92c48b2a94bbb9e9262ea9d P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:17.842644 12266 ts_tablet_manager.cc:1929] T 55fb03a8dd3b40f5ba3de41fa7c01f5d P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:17.846516 13159 leader_election.cc:290] T f5fa6060b9ef48cea6830cd9d19424ea P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:17.845088 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 36d031e15a954a5dbb7391ca3e8c438b (DEFAULT_TABLE table=default.Table_3e6181ae99c647b2be5e7b83325e6579 [id=95d6d3664c264cba810da3e0ae24d212]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.847281 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fa6060b9ef48cea6830cd9d19424ea" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:17.847477 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fa6060b9ef48cea6830cd9d19424ea" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:17.847239 12266 log.cc:1199] T 55fb03a8dd3b40f5ba3de41fa7c01f5d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/55fb03a8dd3b40f5ba3de41fa7c01f5d
W20260810 19:48:17.848145 9611 leader_election.cc:343] T f5fa6060b9ef48cea6830cd9d19424ea P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:17.848855 9611 leader_election.cc:343] T f5fa6060b9ef48cea6830cd9d19424ea P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.848964 9611 leader_election.cc:304] T f5fa6060b9ef48cea6830cd9d19424ea P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:17.849323 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 36d031e15a954a5dbb7391ca3e8c438b (DEFAULT_TABLE table=default.Table_3e6181ae99c647b2be5e7b83325e6579 [id=95d6d3664c264cba810da3e0ae24d212]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.849491 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 5d5c98fae3a14e91af2be09dfb9a05ea (DEFAULT_TABLE table=default.Table_3d4960cf68cb4aa5b3ea56c74e06f7c6 [id=767b9b655e9f4de385982596a3aacfb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.849912 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d5c98fae3a14e91af2be09dfb9a05ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.850817 13159 raft_consensus.cc:2749] T f5fa6060b9ef48cea6830cd9d19424ea P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:17.853053 10367 tablet_bootstrap.cc:654] T c8311ccef92c48b2a94bbb9e9262ea9d P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:17.868484 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d031e15a954a5dbb7391ca3e8c438b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.869578 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet f3e3dde1c29e4275bafb27df63b117be
I20260810 19:48:17.868263 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 36d031e15a954a5dbb7391ca3e8c438b (DEFAULT_TABLE table=default.Table_3e6181ae99c647b2be5e7b83325e6579 [id=95d6d3664c264cba810da3e0ae24d212]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.872295 12266 ts_tablet_manager.cc:1950] T 55fb03a8dd3b40f5ba3de41fa7c01f5d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:17.874723 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet f3e3dde1c29e4275bafb27df63b117be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:17 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:17.875537 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_837db8eddbb8449eb276b9a74d12b160"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:17.876224 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_837db8eddbb8449eb276b9a74d12b160 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:17.876715 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 2acdafe2cb7840c693cdc8446a2f71d2
I20260810 19:48:17.877457 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_0facd7b775174e8ab5239ab75b8f0a01"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:17.878018 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0facd7b775174e8ab5239ab75b8f0a01 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:17.878134 9675 tablet_service.cc:1558] Processing DeleteTablet for tablet 2acdafe2cb7840c693cdc8446a2f71d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:17 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:17.890617 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet f3e3dde1c29e4275bafb27df63b117be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:17 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:17.890964 13159 raft_consensus.cc:493] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.891124 13159 raft_consensus.cc:515] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.891775 13159 leader_election.cc:290] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:17.892242 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet f3e3dde1c29e4275bafb27df63b117be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:17 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:17.892947 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_961700636a7b4d19b41a7e26230b64a7" } new_table_name: "default.Table_9bc7f132000a402e92c9764ad2b2fdaf" modify_external_catalogs: true
I20260810 19:48:17.893081 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59942eba1014659b6f601e74d53d880" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:17.893261 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59942eba1014659b6f601e74d53d880" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:17.894011 9611 leader_election.cc:343] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:17.894528 9611 leader_election.cc:343] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:17.894634 9611 leader_election.cc:304] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:17.895110 13159 raft_consensus.cc:2749] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:17.895754 10370 tablet_bootstrap.cc:492] T deeb390ae00646089e9f1d453ddb54a1 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:17.896617 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet 2acdafe2cb7840c693cdc8446a2f71d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:17 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:17.896778 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 2acdafe2cb7840c693cdc8446a2f71d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:17 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:17.896987 10370 ts_tablet_manager.cc:1403] T deeb390ae00646089e9f1d453ddb54a1 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.109s user 0.008s sys 0.004s
I20260810 19:48:17.897374 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d031e15a954a5dbb7391ca3e8c438b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.907410 10370 raft_consensus.cc:359] T deeb390ae00646089e9f1d453ddb54a1 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.910576 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 5d5c98fae3a14e91af2be09dfb9a05ea (DEFAULT_TABLE table=default.Table_3d4960cf68cb4aa5b3ea56c74e06f7c6 [id=767b9b655e9f4de385982596a3aacfb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.911072 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d5c98fae3a14e91af2be09dfb9a05ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.910367 10370 raft_consensus.cc:385] T deeb390ae00646089e9f1d453ddb54a1 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:17.911803 10370 raft_consensus.cc:740] T deeb390ae00646089e9f1d453ddb54a1 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:17.915450 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 5d5c98fae3a14e91af2be09dfb9a05ea (DEFAULT_TABLE table=default.Table_3d4960cf68cb4aa5b3ea56c74e06f7c6 [id=767b9b655e9f4de385982596a3aacfb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.916690 9905 tablet_service.cc:1511] Processing CreateTablet for tablet d6f96b4d353c4c59bd965dca7b12be90 (DEFAULT_TABLE table=default.Table_034cb4d8db4f40fa9414357752308b25 [id=1cc0919af8cf4ccab00a1a7c30e06b1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.917446 10370 consensus_queue.cc:260] T deeb390ae00646089e9f1d453ddb54a1 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.926959 10370 ts_tablet_manager.cc:1434] T deeb390ae00646089e9f1d453ddb54a1 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.029s user 0.005s sys 0.000s
I20260810 19:48:17.929782 10145 tablet_service.cc:1511] Processing CreateTablet for tablet d6f96b4d353c4c59bd965dca7b12be90 (DEFAULT_TABLE table=default.Table_034cb4d8db4f40fa9414357752308b25 [id=1cc0919af8cf4ccab00a1a7c30e06b1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.932293 10370 tablet_bootstrap.cc:492] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:17.934031 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f96b4d353c4c59bd965dca7b12be90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.937635 10367 tablet_bootstrap.cc:492] T c8311ccef92c48b2a94bbb9e9262ea9d P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:17.938252 10367 ts_tablet_manager.cc:1403] T c8311ccef92c48b2a94bbb9e9262ea9d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.095s user 0.006s sys 0.002s
I20260810 19:48:17.941829 10367 raft_consensus.cc:359] T c8311ccef92c48b2a94bbb9e9262ea9d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.942672 10367 raft_consensus.cc:385] T c8311ccef92c48b2a94bbb9e9262ea9d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:17.942911 10367 raft_consensus.cc:740] T c8311ccef92c48b2a94bbb9e9262ea9d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:17.944015 10367 consensus_queue.cc:260] T c8311ccef92c48b2a94bbb9e9262ea9d P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.947556 9664 tablet_service.cc:1511] Processing CreateTablet for tablet d6f96b4d353c4c59bd965dca7b12be90 (DEFAULT_TABLE table=default.Table_034cb4d8db4f40fa9414357752308b25 [id=1cc0919af8cf4ccab00a1a7c30e06b1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.948045 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f96b4d353c4c59bd965dca7b12be90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.948951 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1258) took 1311 ms. Trace:
I20260810 19:48:17.949344 12266 rpcz_store.cc:276] 0810 19:48:16.637693 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:16.640183 (+ 2490us) service_pool.cc:224] Handling call
0810 19:48:17.562387 (+922204us) ts_tablet_manager.cc:1151] Deleting tablet 55fb03a8dd3b40f5ba3de41fa7c01f5d
0810 19:48:17.562591 (+ 204us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:17.710221 (+147630us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:17.841507 (+131286us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:17.948863 (+107356us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22,"tablet-delete.queue_time_us":909427}
I20260810 19:48:17.951371 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 55fb03a8dd3b40f5ba3de41fa7c01f5d (table default.Table_1c98bf082e38462a83cbf3d6850868b3 [id=b915a5fccb7c46a68ea7f5df2b5cf5ec]) successfully deleted
I20260810 19:48:17.952205 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1259) took 1263 ms. Trace:
I20260810 19:48:17.952661 12266 rpcz_store.cc:276] 0810 19:48:16.688976 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:16.689042 (+ 66us) service_pool.cc:224] Handling call
0810 19:48:17.951283 (+1262241us) ts_tablet_manager.cc:1151] Deleting tablet e785857b6be84721b286398f627dc9a0
0810 19:48:17.951362 (+ 79us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:17.952120 (+ 758us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1261898}
I20260810 19:48:17.954169 10375 ts_tablet_manager.cc:1929] T 823bcbb987374ab4b9b0fc3d9d79b571 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 19:48:17.955936 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet e785857b6be84721b286398f627dc9a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e785857b6be84721b286398f627dc9a0 already in progress: creating tablet
I20260810 19:48:17.956723 10375 log.cc:1199] T 823bcbb987374ab4b9b0fc3d9d79b571 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/823bcbb987374ab4b9b0fc3d9d79b571
I20260810 19:48:17.960614 13320 raft_consensus.cc:493] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.960785 13320 raft_consensus.cc:515] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.962791 13320 leader_election.cc:290] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:17.963274 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ef71075eb2cc4dcaa310786b3333f070 consensus state has no leader
I20260810 19:48:17.963665 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b567b3338845e4a37cff2a955056ae" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:17.963732 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_61622d0039ff4e02bd197850b26ed5dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:17.963904 9944 raft_consensus.cc:2468] T b9b567b3338845e4a37cff2a955056ae P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
W20260810 19:48:17.964377 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61622d0039ff4e02bd197850b26ed5dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:17.964432 10067 leader_election.cc:304] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:17.964645 10370 tablet_bootstrap.cc:654] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:17.964723 13320 raft_consensus.cc:2804] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:17.965660 13320 raft_consensus.cc:493] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:17.965767 13320 raft_consensus.cc:3060] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:17.966178 10375 ts_tablet_manager.cc:1950] T 823bcbb987374ab4b9b0fc3d9d79b571 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
W20260810 19:48:17.966522 10068 leader_election.cc:343] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: b9b567b3338845e4a37cff2a955056ae
I20260810 19:48:17.968605 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_34d55298fe734e128bf7cc506c956a94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:17.969219 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34d55298fe734e128bf7cc506c956a94 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:17.972044 13320 raft_consensus.cc:515] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.973606 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 823bcbb987374ab4b9b0fc3d9d79b571 (table default.Table_c53d9c7f87054a568e99b3f08135ff87 [id=55a3c423691d48feb82508b11c04ca4e]) successfully deleted
I20260810 19:48:17.973436 10375 tablet_replica.cc:333] T 5f4e2adee0264e418ff8c54912973e60 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:17.973619 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b567b3338845e4a37cff2a955056ae" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:17.973836 9944 raft_consensus.cc:3060] T b9b567b3338845e4a37cff2a955056ae P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:17.976826 9944 raft_consensus.cc:2468] T b9b567b3338845e4a37cff2a955056ae P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:17.977535 10067 leader_election.cc:304] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0; no voters:
I20260810 19:48:17.977870 13309 raft_consensus.cc:2804] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:17.978273 13309 raft_consensus.cc:697] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:17.977819 10375 raft_consensus.cc:2243] T 5f4e2adee0264e418ff8c54912973e60 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:17.978564 13309 consensus_queue.cc:237] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.954260 12266 tablet_replica.cc:333] T 3159795344ae492fb099fca0e52fcf20 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:17.982023 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 8115ec0dae54478ebbb736e80231492a (DEFAULT_TABLE table=default.Table_d7f1b950b9084c219bf757e23cef21e3 [id=796b1c9fbcb34bbe8f7931a0c11d6cd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.983178 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 8115ec0dae54478ebbb736e80231492a (DEFAULT_TABLE table=default.Table_d7f1b950b9084c219bf757e23cef21e3 [id=796b1c9fbcb34bbe8f7931a0c11d6cd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.983793 13104 raft_consensus.cc:493] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.982290 10375 raft_consensus.cc:2272] T 5f4e2adee0264e418ff8c54912973e60 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:17.983944 13104 raft_consensus.cc:515] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.984618 13104 leader_election.cc:290] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:17.985426 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ed05a1eb4a4f6e9a7284caaa0bba05" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:17.985675 9710 raft_consensus.cc:2393] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6986ed920dcb4af29a5eeeda6f671691 in current term 1: Already voted for candidate eadde59fd6504d679e47f03a60c64bb0 in this term.
I20260810 19:48:17.985713 10367 ts_tablet_manager.cc:1434] T c8311ccef92c48b2a94bbb9e9262ea9d P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.047s user 0.004s sys 0.000s
I20260810 19:48:17.986984 13357 raft_consensus.cc:493] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:17.987126 13357 raft_consensus.cc:515] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:17.987738 13357 leader_election.cc:290] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:17.987882 12266 raft_consensus.cc:2243] T 3159795344ae492fb099fca0e52fcf20 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:17.982499 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8115ec0dae54478ebbb736e80231492a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:17.989871 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ed05a1eb4a4f6e9a7284caaa0bba05" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:17.989871 12266 raft_consensus.cc:2272] T 3159795344ae492fb099fca0e52fcf20 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:17.993211 9887 tablet_service.cc:1511] Processing CreateTablet for tablet 6aca62e4566648cabfdae1c84246f230 (DEFAULT_TABLE table=default.Table_5e59db5efe264421a5f3455e9aa63c62 [id=4b52435931f6482a8c3bca2d0c05bd53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.994298 9830 leader_election.cc:304] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:17.994882 13041 raft_consensus.cc:3060] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:17.996289 10375 ts_tablet_manager.cc:1916] T 5f4e2adee0264e418ff8c54912973e60 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:17.996346 12266 ts_tablet_manager.cc:1916] T 3159795344ae492fb099fca0e52fcf20 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:17.997716 13041 raft_consensus.cc:2749] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:17.998278 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 6aca62e4566648cabfdae1c84246f230 (DEFAULT_TABLE table=default.Table_5e59db5efe264421a5f3455e9aa63c62 [id=4b52435931f6482a8c3bca2d0c05bd53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:17.998756 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aca62e4566648cabfdae1c84246f230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.002197 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 8115ec0dae54478ebbb736e80231492a (DEFAULT_TABLE table=default.Table_d7f1b950b9084c219bf757e23cef21e3 [id=796b1c9fbcb34bbe8f7931a0c11d6cd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.002715 9668 tablet_service.cc:1511] Processing CreateTablet for tablet 6aca62e4566648cabfdae1c84246f230 (DEFAULT_TABLE table=default.Table_5e59db5efe264421a5f3455e9aa63c62 [id=4b52435931f6482a8c3bca2d0c05bd53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.003158 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d939e3df62a45d9a964d4df01be4bfb" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:18.003373 9710 raft_consensus.cc:2468] T 7d939e3df62a45d9a964d4df01be4bfb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
W20260810 19:48:18.003964 10068 leader_election.cc:343] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: b9b567b3338845e4a37cff2a955056ae
I20260810 19:48:18.004434 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8115ec0dae54478ebbb736e80231492a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.004756 10367 tablet_bootstrap.cc:492] T 60e99cd75ada470380ab69da60ddac77 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:18.010910 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aca62e4566648cabfdae1c84246f230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.011191 10367 tablet_bootstrap.cc:654] T 60e99cd75ada470380ab69da60ddac77 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:18.023510 10068 leader_election.cc:304] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:18.023959 13357 raft_consensus.cc:2804] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:18.024045 13357 raft_consensus.cc:493] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:18.024104 13357 raft_consensus.cc:3060] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:18.027351 13357 raft_consensus.cc:515] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.028889 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d939e3df62a45d9a964d4df01be4bfb" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:18.029649 10067 leader_election.cc:343] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:18.030854 13320 leader_election.cc:290] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:18.033275 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d939e3df62a45d9a964d4df01be4bfb" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:18.033499 9710 raft_consensus.cc:3060] T 7d939e3df62a45d9a964d4df01be4bfb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:18.036533 9710 raft_consensus.cc:2468] T 7d939e3df62a45d9a964d4df01be4bfb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:18.037518 10068 leader_election.cc:304] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:18.043541 13320 raft_consensus.cc:2804] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:18.043877 13320 raft_consensus.cc:697] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:18.044530 13320 consensus_queue.cc:237] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.050951 13357 leader_election.cc:290] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:18.052666 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d939e3df62a45d9a964d4df01be4bfb" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
W20260810 19:48:18.053330 10067 leader_election.cc:343] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:18.069778 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_74c5066c29584dfca364436dd02a84b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:18.070331 10118 tablet_service.cc:1558] Processing DeleteTablet for tablet b3754889e4574fc3a936ac31cc6f496a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:18.070410 10130 tablet_service.cc:1558] Processing DeleteTablet for tablet 263a5695e7754b44a64edbda27b42135 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:04 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:18.070175 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet eb3e7d34b5314bc7a7c5ed53792728ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:18.070641 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet b9b567b3338845e4a37cff2a955056ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:18.070410 10139 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ed73161398f4f54a20a9173c18b4d3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:04 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:18.070926 9415 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 5e47086440ef4a249f1eed23db655879 (table default.Table_b38998c1916842f1aa85263f019bde23 [id=a2b6e3d955f3426781465b670f4fa727]). Expected version 1 got 0
I20260810 19:48:18.071935 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_348f96b1205b40888cfeacca983e5d0f" } new_table_name: "default.Table_ebaaacb1ee494f17b316a0d10605a73e" modify_external_catalogs: true
I20260810 19:48:18.072789 9410 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 5e47086440ef4a249f1eed23db655879 (table default.Table_b38998c1916842f1aa85263f019bde23 [id=a2b6e3d955f3426781465b670f4fa727]). Expected version 1 got 0
I20260810 19:48:18.073911 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_d4b2c9fd4f414031b98f4fe3c8d0ff5e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:18.077220 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74c5066c29584dfca364436dd02a84b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:18.078118 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4b2c9fd4f414031b98f4fe3c8d0ff5e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:18.082108 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet 22954e727fb44a24bd382b9caee9996b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:16 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:18.086050 13159 raft_consensus.cc:493] T 269adfeb1efe46d3944f33b245126665 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:18.086221 13159 raft_consensus.cc:515] T 269adfeb1efe46d3944f33b245126665 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.086987 13159 leader_election.cc:290] T 269adfeb1efe46d3944f33b245126665 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:18.088040 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269adfeb1efe46d3944f33b245126665" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:18.088774 9611 leader_election.cc:343] T 269adfeb1efe46d3944f33b245126665 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:18.090898 10367 tablet_bootstrap.cc:492] T 60e99cd75ada470380ab69da60ddac77 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:18.091779 10367 ts_tablet_manager.cc:1403] T 60e99cd75ada470380ab69da60ddac77 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.087s user 0.000s sys 0.010s
I20260810 19:48:18.106748 10367 raft_consensus.cc:359] T 60e99cd75ada470380ab69da60ddac77 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.144256 10370 tablet_bootstrap.cc:492] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
W20260810 19:48:18.144824 10068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 107339us
I20260810 19:48:18.144858 10370 ts_tablet_manager.cc:1403] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.214s user 0.016s sys 0.002s
I20260810 19:48:18.139639 10367 raft_consensus.cc:385] T 60e99cd75ada470380ab69da60ddac77 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:18.146981 13159 raft_consensus.cc:493] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:18.147156 13159 raft_consensus.cc:515] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.147907 13159 leader_election.cc:290] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:18.149461 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deeb390ae00646089e9f1d453ddb54a1" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:18.150203 9611 leader_election.cc:343] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:18.147502 10367 raft_consensus.cc:740] T 60e99cd75ada470380ab69da60ddac77 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:18.152554 10370 raft_consensus.cc:359] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.157568 10370 raft_consensus.cc:385] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:18.160064 10370 raft_consensus.cc:740] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:18.161590 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269adfeb1efe46d3944f33b245126665" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:18.165357 10370 consensus_queue.cc:260] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.176293 13357 consensus_queue.cc:1048] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:18.171473 10367 consensus_queue.cc:260] T 60e99cd75ada470380ab69da60ddac77 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.183035 10370 ts_tablet_manager.cc:1434] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.037s user 0.004s sys 0.001s
I20260810 19:48:18.190100 10370 tablet_bootstrap.cc:492] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:18.206899 13159 raft_consensus.cc:493] T 22954e727fb44a24bd382b9caee9996b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:18.207090 13159 raft_consensus.cc:515] T 22954e727fb44a24bd382b9caee9996b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.207871 13159 leader_election.cc:290] T 22954e727fb44a24bd382b9caee9996b P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:18.209271 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22954e727fb44a24bd382b9caee9996b" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:18.210017 9611 leader_election.cc:343] T 22954e727fb44a24bd382b9caee9996b P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:18.208707 10367 ts_tablet_manager.cc:1434] T 60e99cd75ada470380ab69da60ddac77 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.116s user 0.001s sys 0.010s
I20260810 19:48:18.217941 10375 ts_tablet_manager.cc:1929] T 5f4e2adee0264e418ff8c54912973e60 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:18.220733 10375 log.cc:1199] T 5f4e2adee0264e418ff8c54912973e60 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/5f4e2adee0264e418ff8c54912973e60
I20260810 19:48:18.222142 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f38e0671810f4e81bd2d790852316d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.222529 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48e13adfdfe54c4b9e746b702683b451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.222738 9885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bde46eae2364133a499198d9187b2a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.223004 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ec87a09fe7e4ebc9a8179f51af69af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.223235 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 431c11767fd24c0dac8c3f8dd986cafc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.223402 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f96b4d353c4c59bd965dca7b12be90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.226548 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e1ffaad910441d99aa9d6596d3b17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.226792 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97a303564aae4afda08f4ea699a176cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.230427 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d031e15a954a5dbb7391ca3e8c438b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.230911 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 236ab18887dc44caadb63e3b37f8441d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.231854 9887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aca62e4566648cabfdae1c84246f230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.234602 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59826cbe61054ac8aec82c6be683defd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.235229 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8115ec0dae54478ebbb736e80231492a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.235416 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a350fa55929947e997e2ff763afe6a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.235608 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d5c98fae3a14e91af2be09dfb9a05ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.238729 10377 ts_tablet_manager.cc:1929] T 1f895bcd21f647f2ab813903d600a31a P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:18.238997 10377 log.cc:1199] T 1f895bcd21f647f2ab813903d600a31a P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/1f895bcd21f647f2ab813903d600a31a
I20260810 19:48:18.242164 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b16d7333f3dd481bb242dee2564d2051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.242350 10377 ts_tablet_manager.cc:1950] T 1f895bcd21f647f2ab813903d600a31a P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:18.243105 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1293) took 1400 ms. Trace:
I20260810 19:48:18.243902 10366 tablet_bootstrap.cc:654] T 48eee4ce10114021855075812e356652 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:18.243408 10377 rpcz_store.cc:276] 0810 19:48:16.842485 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:16.842539 (+ 54us) service_pool.cc:224] Handling call
0810 19:48:17.324282 (+481743us) ts_tablet_manager.cc:1151] Deleting tablet 1f895bcd21f647f2ab813903d600a31a
0810 19:48:17.324290 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:17.424668 (+100378us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:18.238672 (+814004us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:18.243083 (+ 4411us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":481542}
I20260810 19:48:18.250418 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 1f895bcd21f647f2ab813903d600a31a (table default.Table_c4fa695c16634a2382811d87f8b8224b [id=69aa2ddd2b2d4733a1b0e29676c59330]) successfully deleted
I20260810 19:48:18.250762 10377 tablet_replica.cc:333] T 7459e64bd48449d2a8d4ff835b215d46 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:18.251305 10377 raft_consensus.cc:2243] T 7459e64bd48449d2a8d4ff835b215d46 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:18.254210 10375 ts_tablet_manager.cc:1950] T 5f4e2adee0264e418ff8c54912973e60 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:18.254880 10370 tablet_bootstrap.cc:654] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:18.255538 10377 raft_consensus.cc:2272] T 7459e64bd48449d2a8d4ff835b215d46 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:18.263118 10375 tablet_replica.cc:333] T b4b6b17ce3354600b2f7450c6e483c69 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:18.263321 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 5f4e2adee0264e418ff8c54912973e60 (table default.Table_4b3474ab5fac40a28a050d69fc60bfe5 [id=495386acd3524a388b83e38f07bf9967]) successfully deleted
I20260810 19:48:18.263373 10375 raft_consensus.cc:2243] T b4b6b17ce3354600b2f7450c6e483c69 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:18.263537 10375 raft_consensus.cc:2272] T b4b6b17ce3354600b2f7450c6e483c69 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:18.264103 10375 ts_tablet_manager.cc:1916] T b4b6b17ce3354600b2f7450c6e483c69 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:18.263391 10377 ts_tablet_manager.cc:1916] T 7459e64bd48449d2a8d4ff835b215d46 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:18.266011 9611 leader_election.cc:343] T 269adfeb1efe46d3944f33b245126665 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:18.266165 9611 leader_election.cc:304] T 269adfeb1efe46d3944f33b245126665 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:18.266638 13159 raft_consensus.cc:2749] T 269adfeb1efe46d3944f33b245126665 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:18.268712 13404 raft_consensus.cc:493] T eb3e7d34b5314bc7a7c5ed53792728ca P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:18.268954 13404 raft_consensus.cc:515] T eb3e7d34b5314bc7a7c5ed53792728ca P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.270210 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e7d34b5314bc7a7c5ed53792728ca" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:18.270876 10067 leader_election.cc:343] T eb3e7d34b5314bc7a7c5ed53792728ca P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:18.271227 13404 leader_election.cc:290] T eb3e7d34b5314bc7a7c5ed53792728ca P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:18.279605 9611 consensus_peers.cc:597] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:18.284276 10375 ts_tablet_manager.cc:1929] T b4b6b17ce3354600b2f7450c6e483c69 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:18.284425 10375 log.cc:1199] T b4b6b17ce3354600b2f7450c6e483c69 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/b4b6b17ce3354600b2f7450c6e483c69
I20260810 19:48:18.284711 10375 ts_tablet_manager.cc:1950] T b4b6b17ce3354600b2f7450c6e483c69 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:18.285257 13404 raft_consensus.cc:493] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:18.285490 13404 raft_consensus.cc:515] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.286945 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b19479978c46bf8a425ccf1225ef45" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:18.287607 10067 leader_election.cc:343] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:18.289290 13404 leader_election.cc:290] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:18.290513 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deeb390ae00646089e9f1d453ddb54a1" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:18.290643 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22954e727fb44a24bd382b9caee9996b" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:18.290717 10151 raft_consensus.cc:2468] T deeb390ae00646089e9f1d453ddb54a1 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:48:18.291409 10151 raft_consensus.cc:1275] T 0292c3214aa84c40ace16760f414d912 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Refusing update from remote peer fcd31b1bbb0340cbacfce652b4ad8da4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 19:48:18.298882 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet b4b6b17ce3354600b2f7450c6e483c69 (table default.Table_b94c792bfc8b4c16b86e7127f8082af5 [id=270934e8d981479d9f4b49bc54916f77]) successfully deleted
I20260810 19:48:18.299377 10375 tablet_replica.cc:333] T f3e3dde1c29e4275bafb27df63b117be P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
W20260810 19:48:18.299743 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet f2d00c669285436bbafb4b657532f222 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2d00c669285436bbafb4b657532f222 already in progress: creating tablet
W20260810 19:48:18.300012 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet ec11528c81d24cbc851a4c31cf9257a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec11528c81d24cbc851a4c31cf9257a2 already in progress: creating tablet
W20260810 19:48:18.300165 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 8569d63bbd8e4753b376ee6a5127fd3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8569d63bbd8e4753b376ee6a5127fd3d already in progress: creating tablet
W20260810 19:48:18.300328 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 6b9baf2b3e644171b20e03b4c0704136 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b9baf2b3e644171b20e03b4c0704136 already in progress: creating tablet
W20260810 19:48:18.301546 9611 leader_election.cc:343] T 22954e727fb44a24bd382b9caee9996b P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:18.301692 9611 leader_election.cc:304] T 22954e727fb44a24bd382b9caee9996b P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:18.302120 9611 leader_election.cc:304] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691
I20260810 19:48:18.302651 13159 raft_consensus.cc:2749] T 22954e727fb44a24bd382b9caee9996b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:18.302830 13159 raft_consensus.cc:2804] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:18.302901 13159 raft_consensus.cc:493] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:18.302975 13159 raft_consensus.cc:3060] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:18.303566 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b19479978c46bf8a425ccf1225ef45" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:18.303751 9715 raft_consensus.cc:2468] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
W20260810 19:48:18.308964 10068 leader_election.cc:343] T eb3e7d34b5314bc7a7c5ed53792728ca P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: eb3e7d34b5314bc7a7c5ed53792728ca
I20260810 19:48:18.310526 10068 leader_election.cc:304] T eb3e7d34b5314bc7a7c5ed53792728ca P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:18.311057 13404 raft_consensus.cc:2749] T eb3e7d34b5314bc7a7c5ed53792728ca P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:18.312407 10068 leader_election.cc:304] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691
I20260810 19:48:18.313949 13404 raft_consensus.cc:2804] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:18.314450 13404 raft_consensus.cc:493] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:18.314594 13404 raft_consensus.cc:3060] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:18.317648 13404 raft_consensus.cc:515] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.318928 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b19479978c46bf8a425ccf1225ef45" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
W20260810 19:48:18.319505 10067 leader_election.cc:343] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:18.323136 10370 tablet_bootstrap.cc:492] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:18.323292 10370 ts_tablet_manager.cc:1403] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.135s user 0.013s sys 0.005s
I20260810 19:48:18.324050 10370 raft_consensus.cc:359] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.324225 10370 raft_consensus.cc:385] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:18.324293 10370 raft_consensus.cc:740] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:18.324342 13404 leader_election.cc:290] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:18.324513 10370 consensus_queue.cc:260] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.325017 10370 ts_tablet_manager.cc:1434] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:18.325100 9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b19479978c46bf8a425ccf1225ef45" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:18.325271 10370 tablet_bootstrap.cc:492] T 8d93821ff46a4096a8ebbac83faabed7 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:18.325301 9715 raft_consensus.cc:3060] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:18.326835 10370 tablet_bootstrap.cc:654] T 8d93821ff46a4096a8ebbac83faabed7 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:18.327560 10375 raft_consensus.cc:2243] T f3e3dde1c29e4275bafb27df63b117be P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:18.327839 10375 pending_rounds.cc:70] T f3e3dde1c29e4275bafb27df63b117be P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:18.327891 10375 pending_rounds.cc:77] T f3e3dde1c29e4275bafb27df63b117be P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7317058757338923008 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "f3e3dde1c29e4275bafb27df63b117be" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_da45ba37a0804616b521723bc724e0f0" dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" new_extra_config { } }
I20260810 19:48:18.328189 10375 raft_consensus.cc:2272] T f3e3dde1c29e4275bafb27df63b117be P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:18.329843 10375 ts_tablet_manager.cc:1916] T f3e3dde1c29e4275bafb27df63b117be P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:18.335963 10375 ts_tablet_manager.cc:1929] T f3e3dde1c29e4275bafb27df63b117be P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:18.336081 10375 log.cc:1199] T f3e3dde1c29e4275bafb27df63b117be P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/f3e3dde1c29e4275bafb27df63b117be
I20260810 19:48:18.336404 10375 ts_tablet_manager.cc:1950] T f3e3dde1c29e4275bafb27df63b117be P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:18.337544 10375 tablet_replica.cc:333] T b3754889e4574fc3a936ac31cc6f496a P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:18.337508 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet f3e3dde1c29e4275bafb27df63b117be (table default.Table_da45ba37a0804616b521723bc724e0f0 [id=d5afb5c8b2d042e5aec4a0721e2cae1d]) successfully deleted
I20260810 19:48:18.337728 10375 raft_consensus.cc:2243] T b3754889e4574fc3a936ac31cc6f496a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:18.337868 10375 raft_consensus.cc:2272] T b3754889e4574fc3a936ac31cc6f496a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:18.338363 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 2acdafe2cb7840c693cdc8446a2f71d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2acdafe2cb7840c693cdc8446a2f71d2 already in progress: creating tablet
I20260810 19:48:18.342934 10375 ts_tablet_manager.cc:1916] T b3754889e4574fc3a936ac31cc6f496a P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:18.346959 9715 raft_consensus.cc:2468] T 83b19479978c46bf8a425ccf1225ef45 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:18.348053 13159 raft_consensus.cc:515] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.348556 10068 leader_election.cc:304] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691
I20260810 19:48:18.348726 13159 leader_election.cc:290] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:18.349854 10375 ts_tablet_manager.cc:1929] T b3754889e4574fc3a936ac31cc6f496a P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:18.349977 10375 log.cc:1199] T b3754889e4574fc3a936ac31cc6f496a P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/b3754889e4574fc3a936ac31cc6f496a
I20260810 19:48:18.350349 13320 raft_consensus.cc:2804] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:18.350481 13320 raft_consensus.cc:697] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:18.350711 13320 consensus_queue.cc:237] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:18.358198 9611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.195:43797, user_credentials={real_user=slave}} blocked reactor thread for 56092.6us
I20260810 19:48:18.359215 9931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deeb390ae00646089e9f1d453ddb54a1" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:18.359990 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deeb390ae00646089e9f1d453ddb54a1" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:18.360041 13404 consensus_queue.cc:1048] T 18ed05a1eb4a4f6e9a7284caaa0bba05 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:18.360183 10151 raft_consensus.cc:3060] T deeb390ae00646089e9f1d453ddb54a1 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:18.360440 10370 tablet_bootstrap.cc:492] T 8d93821ff46a4096a8ebbac83faabed7 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:18.360579 10370 ts_tablet_manager.cc:1403] T 8d93821ff46a4096a8ebbac83faabed7 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.035s user 0.007s sys 0.000s
I20260810 19:48:18.361423 10370 raft_consensus.cc:359] T 8d93821ff46a4096a8ebbac83faabed7 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.361569 10370 raft_consensus.cc:385] T 8d93821ff46a4096a8ebbac83faabed7 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:18.361618 10370 raft_consensus.cc:740] T 8d93821ff46a4096a8ebbac83faabed7 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:18.361827 10370 consensus_queue.cc:260] T 8d93821ff46a4096a8ebbac83faabed7 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.362390 10370 ts_tablet_manager.cc:1434] T 8d93821ff46a4096a8ebbac83faabed7 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:18.362645 10370 tablet_bootstrap.cc:492] T 59a767c91abf45e79cebab582525ad2e P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:18.363296 10151 raft_consensus.cc:2468] T deeb390ae00646089e9f1d453ddb54a1 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:48:18.364141 10370 tablet_bootstrap.cc:654] T 59a767c91abf45e79cebab582525ad2e P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:18.366611 9611 leader_election.cc:304] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:18.367379 10375 ts_tablet_manager.cc:1950] T b3754889e4574fc3a936ac31cc6f496a P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:18.367702 13159 raft_consensus.cc:2804] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:18.368021 13159 raft_consensus.cc:697] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:48:18.368393 10375 tablet_replica.cc:333] T 263a5695e7754b44a64edbda27b42135 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:18.368353 13159 consensus_queue.cc:237] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.368607 10375 raft_consensus.cc:2243] T 263a5695e7754b44a64edbda27b42135 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:18.368896 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet b3754889e4574fc3a936ac31cc6f496a (table default.Table_6f102dcbbfc04cefa60e2601ea7bb372 [id=ab67d2215d85456cb3100985ad22b894]) successfully deleted
I20260810 19:48:18.369436 13404 consensus_queue.cc:1048] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:18.369805 10375 raft_consensus.cc:2272] T 263a5695e7754b44a64edbda27b42135 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:18.370443 10375 ts_tablet_manager.cc:1916] T 263a5695e7754b44a64edbda27b42135 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:18.377239 9611 leader_election.cc:343] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:18.378264 10366 tablet_bootstrap.cc:492] T 48eee4ce10114021855075812e356652 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:18.379163 10366 ts_tablet_manager.cc:1403] T 48eee4ce10114021855075812e356652 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.980s user 0.020s sys 0.028s
I20260810 19:48:18.383152 10366 raft_consensus.cc:359] T 48eee4ce10114021855075812e356652 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.384567 13309 consensus_queue.cc:1048] T 66acbafdcc8540368693c8f463b41752 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:18.384493 10366 raft_consensus.cc:385] T 48eee4ce10114021855075812e356652 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:18.385416 10366 raft_consensus.cc:740] T 48eee4ce10114021855075812e356652 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:18.387982 10370 tablet_bootstrap.cc:492] T 59a767c91abf45e79cebab582525ad2e P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:18.359333 13418 consensus_queue.cc:1048] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:18.388157 10370 ts_tablet_manager.cc:1403] T 59a767c91abf45e79cebab582525ad2e P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.001s
I20260810 19:48:18.389052 10370 raft_consensus.cc:359] T 59a767c91abf45e79cebab582525ad2e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.389256 10370 raft_consensus.cc:385] T 59a767c91abf45e79cebab582525ad2e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:18.389324 10370 raft_consensus.cc:740] T 59a767c91abf45e79cebab582525ad2e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:18.389541 10370 consensus_queue.cc:260] T 59a767c91abf45e79cebab582525ad2e P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.390074 10370 ts_tablet_manager.cc:1434] T 59a767c91abf45e79cebab582525ad2e P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:18.390448 10370 tablet_bootstrap.cc:492] T 87bbcc651d034e2a826478b805792e48 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:18.392333 10370 tablet_bootstrap.cc:654] T 87bbcc651d034e2a826478b805792e48 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:18.399039 10375 ts_tablet_manager.cc:1929] T 263a5695e7754b44a64edbda27b42135 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:18.399181 10375 log.cc:1199] T 263a5695e7754b44a64edbda27b42135 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/263a5695e7754b44a64edbda27b42135
I20260810 19:48:18.399519 10375 ts_tablet_manager.cc:1950] T 263a5695e7754b44a64edbda27b42135 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:18.400753 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 263a5695e7754b44a64edbda27b42135 (table default.Table_3b5fc2bb35a448e8bbe8bef5a535e9c2 [id=ef9ce56a9b874bfc92f88cae54ca0891]) successfully deleted
I20260810 19:48:18.410054 10375 tablet_replica.cc:333] T eb3e7d34b5314bc7a7c5ed53792728ca P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:18.410306 10375 raft_consensus.cc:2243] T eb3e7d34b5314bc7a7c5ed53792728ca P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:18.410514 10375 raft_consensus.cc:2272] T eb3e7d34b5314bc7a7c5ed53792728ca P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:18.412334 10370 tablet_bootstrap.cc:492] T 87bbcc651d034e2a826478b805792e48 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:18.412487 10370 ts_tablet_manager.cc:1403] T 87bbcc651d034e2a826478b805792e48 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.003s
I20260810 19:48:18.413549 10370 raft_consensus.cc:359] T 87bbcc651d034e2a826478b805792e48 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.413739 10370 raft_consensus.cc:385] T 87bbcc651d034e2a826478b805792e48 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:18.413789 10370 raft_consensus.cc:740] T 87bbcc651d034e2a826478b805792e48 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:18.413985 10370 consensus_queue.cc:260] T 87bbcc651d034e2a826478b805792e48 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.414211 13302 raft_consensus.cc:493] T 0849ea9c04104a8184f8a8cd40e06fc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:18.414407 13302 raft_consensus.cc:515] T 0849ea9c04104a8184f8a8cd40e06fc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.414680 10370 ts_tablet_manager.cc:1434] T 87bbcc651d034e2a826478b805792e48 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:18.414959 10370 tablet_bootstrap.cc:492] T 2d72c72f90964f34bbc2232118dc5172 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:18.415081 13302 leader_election.cc:290] T 0849ea9c04104a8184f8a8cd40e06fc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:18.415230 13302 raft_consensus.cc:493] T c8311ccef92c48b2a94bbb9e9262ea9d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:18.415326 13302 raft_consensus.cc:515] T c8311ccef92c48b2a94bbb9e9262ea9d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.388929 10367 tablet_bootstrap.cc:492] T 229dd737ee8547a89445593cc117fbc2 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:18.415820 13302 leader_election.cc:290] T c8311ccef92c48b2a94bbb9e9262ea9d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:18.416659 10370 tablet_bootstrap.cc:654] T 2d72c72f90964f34bbc2232118dc5172 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:18.417960 10375 ts_tablet_manager.cc:1916] T eb3e7d34b5314bc7a7c5ed53792728ca P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:18.420553 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0849ea9c04104a8184f8a8cd40e06fc2" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:18.420881 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0849ea9c04104a8184f8a8cd40e06fc2" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:18.420992 9941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8311ccef92c48b2a94bbb9e9262ea9d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:18.423015 9611 leader_election.cc:343] T 0849ea9c04104a8184f8a8cd40e06fc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:18.423321 9611 leader_election.cc:343] T c8311ccef92c48b2a94bbb9e9262ea9d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:18.423651 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8311ccef92c48b2a94bbb9e9262ea9d" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:18.424186 9611 leader_election.cc:343] T 0849ea9c04104a8184f8a8cd40e06fc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:18.424633 10375 ts_tablet_manager.cc:1929] T eb3e7d34b5314bc7a7c5ed53792728ca P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:18.424755 10375 log.cc:1199] T eb3e7d34b5314bc7a7c5ed53792728ca P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/eb3e7d34b5314bc7a7c5ed53792728ca
I20260810 19:48:18.425066 10375 ts_tablet_manager.cc:1950] T eb3e7d34b5314bc7a7c5ed53792728ca P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:18.426214 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet eb3e7d34b5314bc7a7c5ed53792728ca (table default.Table_c5eab30c1c344809be5b1289a88d2ca3 [id=64e2bbcc84434e268763f4ee1acc851d]) successfully deleted
I20260810 19:48:18.431529 10370 tablet_bootstrap.cc:492] T 2d72c72f90964f34bbc2232118dc5172 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:18.438561 10370 ts_tablet_manager.cc:1403] T 2d72c72f90964f34bbc2232118dc5172 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.002s
I20260810 19:48:18.426036 10375 tablet_replica.cc:333] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:18.439217 10375 raft_consensus.cc:2243] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:18.439363 10370 raft_consensus.cc:359] T 2d72c72f90964f34bbc2232118dc5172 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.439524 10370 raft_consensus.cc:385] T 2d72c72f90964f34bbc2232118dc5172 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:18.439580 10370 raft_consensus.cc:740] T 2d72c72f90964f34bbc2232118dc5172 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
W20260810 19:48:18.439702 9395 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 81f0f3f88d26432fbadc5e90aaa5d158 (table default.Table_ad111742aa3244339758e937715b7f4a [id=a779dbb85fac4fd691df7f5ab24b49f8], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 81f0f3f88d26432fbadc5e90aaa5d158 consensus state has no leader
I20260810 19:48:18.439764 10370 consensus_queue.cc:260] T 2d72c72f90964f34bbc2232118dc5172 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.441018 10370 ts_tablet_manager.cc:1434] T 2d72c72f90964f34bbc2232118dc5172 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:18.441359 10370 tablet_bootstrap.cc:492] T 1bbd3fe2117c42058dc108b5dc18d560 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:18.443336 10370 tablet_bootstrap.cc:654] T 1bbd3fe2117c42058dc108b5dc18d560 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:18.441018 10375 pending_rounds.cc:70] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0: Trying to abort 1 pending ops.
I20260810 19:48:18.450500 10375 pending_rounds.cc:77] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058756569714688 op_type: NO_OP noop_request { }
I20260810 19:48:18.450618 10375 raft_consensus.cc:2889] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:18.450717 10375 raft_consensus.cc:2272] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:18.451531 10375 ts_tablet_manager.cc:1916] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:18.461453 13404 raft_consensus.cc:493] T 749cea5cd8f842b891f4e2cab07c054e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:18.461624 13404 raft_consensus.cc:515] T 749cea5cd8f842b891f4e2cab07c054e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.463092 13404 leader_election.cc:290] T 749cea5cd8f842b891f4e2cab07c054e P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:18.463900 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749cea5cd8f842b891f4e2cab07c054e" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:18.464563 10067 leader_election.cc:343] T 749cea5cd8f842b891f4e2cab07c054e P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:18.458240 10375 ts_tablet_manager.cc:1929] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:18.464825 10375 log.cc:1199] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/b9b567b3338845e4a37cff2a955056ae
I20260810 19:48:18.465744 10375 ts_tablet_manager.cc:1950] T b9b567b3338845e4a37cff2a955056ae P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
W20260810 19:48:18.465816 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 81d60f7028ce474f92c4c1336badcbd5 consensus state has no leader
I20260810 19:48:18.466820 10375 tablet_replica.cc:333] T 9ed73161398f4f54a20a9173c18b4d3c P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:18.466988 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet b9b567b3338845e4a37cff2a955056ae (table default.Table_5f059e9b730d466a8e8e0437ac1edbe8 [id=a102fdb234e04e4e8512e9062b5cfaaa]) successfully deleted
I20260810 19:48:18.467032 10375 raft_consensus.cc:2243] T 9ed73161398f4f54a20a9173c18b4d3c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:18.467177 10375 raft_consensus.cc:2272] T 9ed73161398f4f54a20a9173c18b4d3c P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:18.468109 9421 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 56fa5de3bf7142b2b0978f9190091f33 (table default.Table_1881cd552cf54157a0a41766d5b1b259 [id=87220e53176e4254a5238c988b6a7311]). Expected version 2 got 0
I20260810 19:48:18.468629 9611 leader_election.cc:304] T 0849ea9c04104a8184f8a8cd40e06fc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
W20260810 19:48:18.469079 9611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.195:43797, user_credentials={real_user=slave}} blocked reactor thread for 44896.4us
W20260810 19:48:18.469484 9611 leader_election.cc:343] T c8311ccef92c48b2a94bbb9e9262ea9d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:18.469666 9611 leader_election.cc:304] T c8311ccef92c48b2a94bbb9e9262ea9d P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:18.469962 13302 raft_consensus.cc:2749] T 0849ea9c04104a8184f8a8cd40e06fc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:18.470117 13302 raft_consensus.cc:2749] T c8311ccef92c48b2a94bbb9e9262ea9d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:18.471534 10375 ts_tablet_manager.cc:1916] T 9ed73161398f4f54a20a9173c18b4d3c P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:18.478304 10375 ts_tablet_manager.cc:1929] T 9ed73161398f4f54a20a9173c18b4d3c P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:18.488330 10375 log.cc:1199] T 9ed73161398f4f54a20a9173c18b4d3c P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/9ed73161398f4f54a20a9173c18b4d3c
I20260810 19:48:18.488670 10375 ts_tablet_manager.cc:1950] T 9ed73161398f4f54a20a9173c18b4d3c P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:18.386940 10366 consensus_queue.cc:260] T 48eee4ce10114021855075812e356652 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.501315 10366 ts_tablet_manager.cc:1434] T 48eee4ce10114021855075812e356652 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.122s user 0.001s sys 0.003s
I20260810 19:48:18.501724 9879 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:38260 (request call id 210) took 1233 ms. Trace:
I20260810 19:48:18.501904 9879 rpcz_store.cc:276] 0810 19:48:17.268406 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.268462 (+ 56us) service_pool.cc:224] Handling call
0810 19:48:18.501653 (+1233191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:48:18.502758 10366 tablet_bootstrap.cc:492] T 7d939e3df62a45d9a964d4df01be4bfb P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:18.506142 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 9ed73161398f4f54a20a9173c18b4d3c (table default.Table_2adfdcdb33f543d49ea6f361bf8a55c4 [id=cfd27e7efc8f4c529e7dace21742b656]) successfully deleted
I20260810 19:48:18.509856 9421 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 5e47086440ef4a249f1eed23db655879 (table default.Table_b38998c1916842f1aa85263f019bde23 [id=a2b6e3d955f3426781465b670f4fa727]). Expected version 1 got 0
I20260810 19:48:18.513195 13338 raft_consensus.cc:493] T 48eee4ce10114021855075812e356652 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:18.513387 13338 raft_consensus.cc:515] T 48eee4ce10114021855075812e356652 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.513813 9416 catalog_manager.cc:5719] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195). New cstate: current_term: 1 leader_uuid: "eadde59fd6504d679e47f03a60c64bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: HEALTHY } } }
I20260810 19:48:18.514160 13404 raft_consensus.cc:493] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:18.514430 13404 raft_consensus.cc:515] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:18.514631 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6cd145af89874088b41d76d0e2bfdf86 consensus state has no leader
I20260810 19:48:18.515125 13404 leader_election.cc:290] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:18.515637 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_57fd8fee4e6243eea99866d63c8cf478"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:18.516240 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57fd8fee4e6243eea99866d63c8cf478 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:18.517685 9944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59942eba1014659b6f601e74d53d880" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:18.519302 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0b2d770d94e74c88bd7d0d7a9ab88982" } modify_external_catalogs: true
I20260810 19:48:18.520552 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_12449afa32674c328023f1d830b9a305"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:18.521198 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12449afa32674c328023f1d830b9a305 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:18.523103 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4a7879b46d414ea78cd53eede045fce1" } modify_external_catalogs: true
I20260810 19:48:18.525486 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_4a7879b46d414ea78cd53eede045fce1" } modify_external_catalogs: true
I20260810 19:48:18.527297 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f1f332ce5d104c2b889c1faf78a0510f" } modify_external_catalogs: true
I20260810 19:48:18.527482 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f1f332ce5d104c2b889c1faf78a0510f" } modify_external_catalogs: true
W20260810 19:48:18.528877 9407 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 53bb7e081b8747308d85ca933bb3528c consensus state has no leader
I20260810 19:48:18.529735 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f5301fb232b245139e9444210309ce06" } modify_external_catalogs: true
I20260810 19:48:18.529896 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_f5301fb232b245139e9444210309ce06" } modify_external_catalogs: true
W20260810 19:48:18.530577 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d0f9a22f81894a829fcb350001fc532b consensus state has no leader
I20260810 19:48:18.530858 13338 leader_election.cc:290] T 48eee4ce10114021855075812e356652 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:18.531431 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b14c1059b55a46fbb6d451b5a96c619b" } modify_external_catalogs: true
I20260810 19:48:18.531632 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b14c1059b55a46fbb6d451b5a96c619b" } modify_external_catalogs: true
I20260810 19:48:18.519498 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0b2d770d94e74c88bd7d0d7a9ab88982" } modify_external_catalogs: true
W20260810 19:48:18.533213 9830 leader_election.cc:343] T 48eee4ce10114021855075812e356652 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Not found: Tablet not found: 48eee4ce10114021855075812e356652
W20260810 19:48:18.535223 9830 consensus_peers.cc:597] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3e3dde1c29e4275bafb27df63b117be. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:18.537009 13450 tablet.cc:1724] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:18.514238 9416 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 7d939e3df62a45d9a964d4df01be4bfb (table default.Table_65f4c2fb3d1c49ae9cdfc041e51bd182 [id=2292ed1c178a4d458f52885e45c76d41]). Expected version 2 got 0
I20260810 19:48:18.540673 9416 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet a2fe67e8bd014acaa202c022c193cdc6 (table default.Table_28b8191a242a4d8ea55fdaeaec9c1c41 [id=3b14f80137654337b24c2bb4131e58d3]). Expected version 3 got 0
I20260810 19:48:18.542382 13404 raft_consensus.cc:493] T 8d93821ff46a4096a8ebbac83faabed7 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:18.542536 13404 raft_consensus.cc:515] T 8d93821ff46a4096a8ebbac83faabed7 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.543164 13404 leader_election.cc:290] T 8d93821ff46a4096a8ebbac83faabed7 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:18.546871 12266 ts_tablet_manager.cc:1929] T 3159795344ae492fb099fca0e52fcf20 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:18.547029 12266 log.cc:1199] T 3159795344ae492fb099fca0e52fcf20 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/3159795344ae492fb099fca0e52fcf20
I20260810 19:48:18.552086 12266 ts_tablet_manager.cc:1950] T 3159795344ae492fb099fca0e52fcf20 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:18.553226 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1260) took 1864 ms. Trace:
I20260810 19:48:18.554476 12266 rpcz_store.cc:276] 0810 19:48:16.689118 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:16.689181 (+ 63us) service_pool.cc:224] Handling call
0810 19:48:17.953961 (+1264780us) ts_tablet_manager.cc:1151] Deleting tablet 3159795344ae492fb099fca0e52fcf20
0810 19:48:17.954031 (+ 70us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:18.103463 (+149432us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:18.546775 (+443312us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:18.553196 (+ 6421us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1981,"tablet-delete.queue_time_us":1264534}
I20260810 19:48:18.555430 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1261) took 1849 ms. Trace:
I20260810 19:48:18.556013 12266 rpcz_store.cc:276] 0810 19:48:16.705905 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:16.705967 (+ 62us) service_pool.cc:224] Handling call
0810 19:48:18.555262 (+1849295us) ts_tablet_manager.cc:1151] Deleting tablet 5598878488864bfba663b2edd999e224
0810 19:48:18.555275 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:18.555408 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1840808}
I20260810 19:48:18.556675 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1263) took 1831 ms. Trace:
I20260810 19:48:18.557119 12266 rpcz_store.cc:276] 0810 19:48:16.725476 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:16.725531 (+ 55us) service_pool.cc:224] Handling call
0810 19:48:18.556561 (+1831030us) ts_tablet_manager.cc:1151] Deleting tablet a3f48f9bb29b4be6ab6ce167159ae793
0810 19:48:18.556573 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:18.556660 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1830823}
I20260810 19:48:18.557627 12266 tablet_replica.cc:333] T cb2c9782c034435088f991bef8edf288 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:18.560583 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_78b342a2c7134ba3a33ee9b59859ccb7" } new_table_name: "default.Table_7d03cd3753144a219948061a8a115a76" modify_external_catalogs: true
I20260810 19:48:18.560626 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_04e7864863604a64b3c681bc20c4be28"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:18.561195 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04e7864863604a64b3c681bc20c4be28 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:18.562633 13448 tablet.cc:1724] T 0292c3214aa84c40ace16760f414d912 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:18.563840 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_bac4df0a4c004be49f2e39e3c5805bf0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:18.564445 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bac4df0a4c004be49f2e39e3c5805bf0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:18.566016 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 3159795344ae492fb099fca0e52fcf20 (table default.Table_d9ae7658a1f24bd8aa85ffbc2ac9ee0f [id=f13bcadbcbc14466907b2850e5dce367]) successfully deleted
W20260810 19:48:18.566280 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 5598878488864bfba663b2edd999e224 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5598878488864bfba663b2edd999e224 already in progress: creating tablet
W20260810 19:48:18.566524 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet a3f48f9bb29b4be6ab6ce167159ae793 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3f48f9bb29b4be6ab6ce167159ae793 already in progress: creating tablet
I20260810 19:48:18.568426 10367 tablet_bootstrap.cc:654] T 229dd737ee8547a89445593cc117fbc2 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:18.570021 13454 tablet.cc:1724] T 0292c3214aa84c40ace16760f414d912 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:18.574759 10370 tablet_bootstrap.cc:492] T 1bbd3fe2117c42058dc108b5dc18d560 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:18.575021 10370 ts_tablet_manager.cc:1403] T 1bbd3fe2117c42058dc108b5dc18d560 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.134s user 0.030s sys 0.029s
I20260810 19:48:18.575939 10370 raft_consensus.cc:359] T 1bbd3fe2117c42058dc108b5dc18d560 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.576222 10370 raft_consensus.cc:385] T 1bbd3fe2117c42058dc108b5dc18d560 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:18.576319 10370 raft_consensus.cc:740] T 1bbd3fe2117c42058dc108b5dc18d560 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:18.576988 10370 consensus_queue.cc:260] T 1bbd3fe2117c42058dc108b5dc18d560 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:18.577212 9831 leader_election.cc:343] T 48eee4ce10114021855075812e356652 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 48eee4ce10114021855075812e356652
I20260810 19:48:18.577363 9831 leader_election.cc:304] T 48eee4ce10114021855075812e356652 P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:18.577659 10370 ts_tablet_manager.cc:1434] T 1bbd3fe2117c42058dc108b5dc18d560 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 19:48:18.577642 13104 raft_consensus.cc:2749] T 48eee4ce10114021855075812e356652 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:18.577963 10370 tablet_bootstrap.cc:492] T d5aaedde75d54341a87764c6e89a03d6 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:18.579730 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet c8311ccef92c48b2a94bbb9e9262ea9d with delete_type TABLET_DATA_DELETED (replaced by tablet 6aca62e4566648cabfdae1c84246f230) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:18.580617 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 0849ea9c04104a8184f8a8cd40e06fc2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:03 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:18.581498 12266 raft_consensus.cc:2243] T cb2c9782c034435088f991bef8edf288 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:18.581684 12266 raft_consensus.cc:2272] T cb2c9782c034435088f991bef8edf288 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:18.582249 12266 ts_tablet_manager.cc:1916] T cb2c9782c034435088f991bef8edf288 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:18.584676 10367 tablet_bootstrap.cc:492] T 229dd737ee8547a89445593cc117fbc2 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:18.584847 10367 ts_tablet_manager.cc:1403] T 229dd737ee8547a89445593cc117fbc2 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.196s user 0.004s sys 0.003s
I20260810 19:48:18.585608 10367 raft_consensus.cc:359] T 229dd737ee8547a89445593cc117fbc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.585803 10367 raft_consensus.cc:385] T 229dd737ee8547a89445593cc117fbc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:18.585877 10367 raft_consensus.cc:740] T 229dd737ee8547a89445593cc117fbc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:18.586115 10367 consensus_queue.cc:260] T 229dd737ee8547a89445593cc117fbc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.586565 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59942eba1014659b6f601e74d53d880" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:18.586766 9717 raft_consensus.cc:2468] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
W20260810 19:48:18.587036 10068 leader_election.cc:343] T 749cea5cd8f842b891f4e2cab07c054e P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 749cea5cd8f842b891f4e2cab07c054e
I20260810 19:48:18.587169 10068 leader_election.cc:304] T 749cea5cd8f842b891f4e2cab07c054e P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:18.587626 10068 leader_election.cc:304] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:18.587852 13309 raft_consensus.cc:2749] T 749cea5cd8f842b891f4e2cab07c054e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:18.588038 13309 raft_consensus.cc:2804] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:18.588102 13309 raft_consensus.cc:493] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:18.588160 13309 raft_consensus.cc:3060] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:18.590785 10370 tablet_bootstrap.cc:654] T d5aaedde75d54341a87764c6e89a03d6 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:18.591104 13309 raft_consensus.cc:515] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.598587 10367 ts_tablet_manager.cc:1434] T 229dd737ee8547a89445593cc117fbc2 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260810 19:48:18.602953 10367 tablet_bootstrap.cc:492] T 4579a71f8c8149798eb5f136135e5efe P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:18.605544 9413 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 50e3bcae1da6442aa57a4c8a46ee9493
I20260810 19:48:18.606837 13309 leader_election.cc:290] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:18.609056 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet f5b65c8a84b44b94896c62115144d386
I20260810 19:48:18.609441 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet e5f29e86e0854efd9987305e26d7361a
I20260810 19:48:18.610359 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet ef71075eb2cc4dcaa310786b3333f070
I20260810 19:48:18.610550 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet e5f29e86e0854efd9987305e26d7361a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:18 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:18.610550 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet f5b65c8a84b44b94896c62115144d386 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:18 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:18.612331 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 041844571695425eb6de69d251dffcf0
I20260810 19:48:18.612699 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet ef71075eb2cc4dcaa310786b3333f070 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:18 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:18.612357 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet e5f29e86e0854efd9987305e26d7361a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5f29e86e0854efd9987305e26d7361a already in progress: creating tablet
W20260810 19:48:18.613546 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet f5b65c8a84b44b94896c62115144d386 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5b65c8a84b44b94896c62115144d386 already in progress: creating tablet
W20260810 19:48:18.613720 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet ef71075eb2cc4dcaa310786b3333f070 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef71075eb2cc4dcaa310786b3333f070 already in progress: creating tablet
I20260810 19:48:18.614382 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet 041844571695425eb6de69d251dffcf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:18 UTC) from {username='slave'} at 127.0.0.1:41610
W20260810 19:48:18.615029 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 041844571695425eb6de69d251dffcf0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 041844571695425eb6de69d251dffcf0 already in progress: creating tablet
I20260810 19:48:18.619649 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet f5b65c8a84b44b94896c62115144d386 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:18 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:18.623433 10144 tablet_service.cc:1558] Processing DeleteTablet for tablet deeb390ae00646089e9f1d453ddb54a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 50e3bcae1da6442aa57a4c8a46ee9493) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:18.623564 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet b9b567b3338845e4a37cff2a955056ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:18.623696 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet 749cea5cd8f842b891f4e2cab07c054e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:18.623745 10375 tablet_replica.cc:333] T deeb390ae00646089e9f1d453ddb54a1 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:18.623939 10375 raft_consensus.cc:2243] T deeb390ae00646089e9f1d453ddb54a1 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:18.623953 9412 master_service.cc:960] ReplaceTablet: received request to replace tablet b33aa8be266a434cba899da7514c47e9 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:18.624092 10375 raft_consensus.cc:2272] T deeb390ae00646089e9f1d453ddb54a1 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:18.624656 10375 ts_tablet_manager.cc:1916] T deeb390ae00646089e9f1d453ddb54a1 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:18.628502 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet e5f29e86e0854efd9987305e26d7361a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:18 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:18.628719 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet ef71075eb2cc4dcaa310786b3333f070 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:18 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:18.628849 9887 tablet_service.cc:1558] Processing DeleteTablet for tablet 041844571695425eb6de69d251dffcf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:18 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:18.631233 10375 ts_tablet_manager.cc:1929] T deeb390ae00646089e9f1d453ddb54a1 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:18.631363 10375 log.cc:1199] T deeb390ae00646089e9f1d453ddb54a1 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/deeb390ae00646089e9f1d453ddb54a1
I20260810 19:48:18.631680 10375 ts_tablet_manager.cc:1950] T deeb390ae00646089e9f1d453ddb54a1 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:18.632663 10375 tablet_replica.cc:333] T 749cea5cd8f842b891f4e2cab07c054e P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:18.632877 10375 raft_consensus.cc:2243] T 749cea5cd8f842b891f4e2cab07c054e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:18.632910 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet deeb390ae00646089e9f1d453ddb54a1 (table default.Table_f1f332ce5d104c2b889c1faf78a0510f [id=a5becac787b84d398e96784d005d21f6]) successfully deleted
I20260810 19:48:18.633031 10375 raft_consensus.cc:2272] T 749cea5cd8f842b891f4e2cab07c054e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:18.633579 10375 ts_tablet_manager.cc:1916] T 749cea5cd8f842b891f4e2cab07c054e P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:18.633764 13309 raft_consensus.cc:493] T 1bbd3fe2117c42058dc108b5dc18d560 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:18.633894 13309 raft_consensus.cc:515] T 1bbd3fe2117c42058dc108b5dc18d560 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.634974 13309 leader_election.cc:290] T 1bbd3fe2117c42058dc108b5dc18d560 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:18.640056 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a761dc4c01d34b6db2d33655ec6f7dd3 consensus state has no leader
I20260810 19:48:18.643013 13450 tablet.cc:1724] T 8b24b75629ec423b90e4bf287e7cfd38 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 19:48:18.644488 13454 tablet.cc:1724] T 8b24b75629ec423b90e4bf287e7cfd38 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260810 19:48:18.647768 10068 leader_election.cc:343] T 8d93821ff46a4096a8ebbac83faabed7 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 8d93821ff46a4096a8ebbac83faabed7
W20260810 19:48:18.648305 10067 leader_election.cc:343] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:18.651600 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet b33aa8be266a434cba899da7514c47e9
I20260810 19:48:18.653271 9412 catalog_manager.cc:6807] ReplaceTablet: tablet b33aa8be266a434cba899da7514c47e9 deleted and replaced by tablet 3f59a69d726847aca111527aeaadfa9c
I20260810 19:48:18.653832 10124 tablet_service.cc:1558] Processing DeleteTablet for tablet b33aa8be266a434cba899da7514c47e9 with delete_type TABLET_DATA_DELETED (replaced by tablet 3f59a69d726847aca111527aeaadfa9c) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:18.654841 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet f5b65c8a84b44b94896c62115144d386 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:18 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:18.655045 9668 tablet_service.cc:1558] Processing DeleteTablet for tablet ef71075eb2cc4dcaa310786b3333f070 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:18 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:18.655287 9658 tablet_service.cc:1558] Processing DeleteTablet for tablet b33aa8be266a434cba899da7514c47e9 with delete_type TABLET_DATA_DELETED (replaced by tablet 3f59a69d726847aca111527aeaadfa9c) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:18.655663 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet e5f29e86e0854efd9987305e26d7361a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:18 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:18.655860 9655 tablet_service.cc:1558] Processing DeleteTablet for tablet 041844571695425eb6de69d251dffcf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:18 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:18.656504 10370 tablet_bootstrap.cc:492] T d5aaedde75d54341a87764c6e89a03d6 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:18.656665 10370 ts_tablet_manager.cc:1403] T d5aaedde75d54341a87764c6e89a03d6 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.079s user 0.007s sys 0.000s
W20260810 19:48:18.656697 10068 leader_election.cc:343] T 1bbd3fe2117c42058dc108b5dc18d560 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 1bbd3fe2117c42058dc108b5dc18d560
I20260810 19:48:18.657560 10370 raft_consensus.cc:359] T d5aaedde75d54341a87764c6e89a03d6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.657779 10370 raft_consensus.cc:385] T d5aaedde75d54341a87764c6e89a03d6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:18.657835 10370 raft_consensus.cc:740] T d5aaedde75d54341a87764c6e89a03d6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:18.658095 10370 consensus_queue.cc:260] T d5aaedde75d54341a87764c6e89a03d6 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.658695 9717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59942eba1014659b6f601e74d53d880" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:18.658856 10370 ts_tablet_manager.cc:1434] T d5aaedde75d54341a87764c6e89a03d6 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 19:48:18.658919 9717 raft_consensus.cc:3060] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:18.659379 10370 tablet_bootstrap.cc:492] T 985440898cc04a98877c15a5122a7dd3 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:18.661530 10370 tablet_bootstrap.cc:654] T 985440898cc04a98877c15a5122a7dd3 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:18.661665 9717 raft_consensus.cc:2468] T b59942eba1014659b6f601e74d53d880 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:18.662379 10068 leader_election.cc:304] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:18.662623 13309 raft_consensus.cc:2804] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:18.662746 13309 raft_consensus.cc:697] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:18.663017 13309 consensus_queue.cc:237] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.665839 13418 raft_consensus.cc:493] T 229dd737ee8547a89445593cc117fbc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:18.666332 13418 raft_consensus.cc:515] T 229dd737ee8547a89445593cc117fbc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.667146 13418 leader_election.cc:290] T 229dd737ee8547a89445593cc117fbc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:18.668689 10150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229dd737ee8547a89445593cc117fbc2" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:18.669226 9611 leader_election.cc:343] T 229dd737ee8547a89445593cc117fbc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:18.669577 12266 ts_tablet_manager.cc:1929] T cb2c9782c034435088f991bef8edf288 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:18.669751 12266 log.cc:1199] T cb2c9782c034435088f991bef8edf288 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/cb2c9782c034435088f991bef8edf288
I20260810 19:48:18.669785 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1978673641a647d096c688e3c7298029" } new_table_name: "default.Table_db7dbc983287444c94a05ac3d7c2572a" modify_external_catalogs: true
I20260810 19:48:18.670274 12266 ts_tablet_manager.cc:1950] T cb2c9782c034435088f991bef8edf288 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:18.672391 10367 tablet_bootstrap.cc:654] T 4579a71f8c8149798eb5f136135e5efe P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:18.673465 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1264) took 1812 ms. Trace:
I20260810 19:48:18.673723 12266 rpcz_store.cc:276] 0810 19:48:16.858525 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:16.858582 (+ 57us) service_pool.cc:224] Handling call
0810 19:48:18.557576 (+1698994us) ts_tablet_manager.cc:1151] Deleting tablet cb2c9782c034435088f991bef8edf288
0810 19:48:18.557586 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:18.656925 (+ 99339us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:18.669511 (+ 12586us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:18.671346 (+ 1835us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23379,"tablet-delete.queue_time_us":1698765}
I20260810 19:48:18.674839 12266 tablet_replica.cc:333] T 3109703c51e54af78b58e9bbca50af33 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:18.675076 12266 raft_consensus.cc:2243] T 3109703c51e54af78b58e9bbca50af33 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:18.675479 13357 raft_consensus.cc:493] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:18.675554 12266 raft_consensus.cc:2272] T 3109703c51e54af78b58e9bbca50af33 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:18.675609 13357 raft_consensus.cc:515] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.676072 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet cb2c9782c034435088f991bef8edf288 (table default.Table_9a949158a5f2417ea8f015281b20659a [id=8763b964126e48ba85394844a7628795]) successfully deleted
I20260810 19:48:18.676132 12266 ts_tablet_manager.cc:1916] T 3109703c51e54af78b58e9bbca50af33 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:18.676265 13357 leader_election.cc:290] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:18.676839 9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fe67e8bd014acaa202c022c193cdc6" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:18.677078 9711 raft_consensus.cc:2468] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 0.
I20260810 19:48:18.677738 10068 leader_election.cc:304] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:18.678047 13357 raft_consensus.cc:2804] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:18.678130 13357 raft_consensus.cc:493] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:18.678189 13357 raft_consensus.cc:3060] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:18.678565 13458 tablet.cc:1724] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 19:48:18.679630 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 13631a2b27df449bb2f696031d4f4efb has no consensus state
I20260810 19:48:18.680392 10370 tablet_bootstrap.cc:492] T 985440898cc04a98877c15a5122a7dd3 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:18.680594 10370 ts_tablet_manager.cc:1403] T 985440898cc04a98877c15a5122a7dd3 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.002s
I20260810 19:48:18.681849 10370 raft_consensus.cc:359] T 985440898cc04a98877c15a5122a7dd3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.682039 10370 raft_consensus.cc:385] T 985440898cc04a98877c15a5122a7dd3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:18.682103 10370 raft_consensus.cc:740] T 985440898cc04a98877c15a5122a7dd3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:18.682363 10370 consensus_queue.cc:260] T 985440898cc04a98877c15a5122a7dd3 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.682665 13357 raft_consensus.cc:515] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.684092 13357 leader_election.cc:290] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:18.684741 9709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fe67e8bd014acaa202c022c193cdc6" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4"
I20260810 19:48:18.685055 9709 raft_consensus.cc:3060] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:18.685560 10370 ts_tablet_manager.cc:1434] T 985440898cc04a98877c15a5122a7dd3 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260810 19:48:18.685859 10370 tablet_bootstrap.cc:492] T b54feebc7c9841d89808054602be7913 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:18.687652 10370 tablet_bootstrap.cc:654] T b54feebc7c9841d89808054602be7913 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:18.690338 13469 tablet.cc:1724] T 8b24b75629ec423b90e4bf287e7cfd38 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 19:48:18.695102 9709 raft_consensus.cc:2468] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadde59fd6504d679e47f03a60c64bb0 in term 1.
I20260810 19:48:18.695817 10068 leader_election.cc:304] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:18.696065 10375 ts_tablet_manager.cc:1929] T 749cea5cd8f842b891f4e2cab07c054e P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:18.696173 10375 log.cc:1199] T 749cea5cd8f842b891f4e2cab07c054e P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/749cea5cd8f842b891f4e2cab07c054e
I20260810 19:48:18.696183 13320 raft_consensus.cc:2804] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:18.696308 13320 raft_consensus.cc:697] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Becoming Leader. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Running, Role: LEADER
I20260810 19:48:18.696492 10375 ts_tablet_manager.cc:1950] T 749cea5cd8f842b891f4e2cab07c054e P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:18.696640 13320 consensus_queue.cc:237] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.699546 10367 tablet_bootstrap.cc:492] T 4579a71f8c8149798eb5f136135e5efe P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:18.699746 10367 ts_tablet_manager.cc:1403] T 4579a71f8c8149798eb5f136135e5efe P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.097s user 0.004s sys 0.000s
I20260810 19:48:18.700572 10367 raft_consensus.cc:359] T 4579a71f8c8149798eb5f136135e5efe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.700845 10367 raft_consensus.cc:385] T 4579a71f8c8149798eb5f136135e5efe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:18.700935 10367 raft_consensus.cc:740] T 4579a71f8c8149798eb5f136135e5efe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:18.701210 10367 consensus_queue.cc:260] T 4579a71f8c8149798eb5f136135e5efe P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.702282 10367 ts_tablet_manager.cc:1434] T 4579a71f8c8149798eb5f136135e5efe P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:18.702941 10367 tablet_bootstrap.cc:492] T 841f58b4e8f7465eaa7fa08629e0bc2a P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:18.705651 10367 tablet_bootstrap.cc:654] T 841f58b4e8f7465eaa7fa08629e0bc2a P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:18.714398 9887 tablet_service.cc:1558] Processing DeleteTablet for tablet b33aa8be266a434cba899da7514c47e9 with delete_type TABLET_DATA_DELETED (replaced by tablet 3f59a69d726847aca111527aeaadfa9c) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:18.715026 9941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59942eba1014659b6f601e74d53d880" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
W20260810 19:48:18.715642 10067 leader_election.cc:343] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:18.717285 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_271df3c038524d63b2e4979d96dd5192" } new_table_name: "default.Table_3c2f76d07ad24da08b7e624d8e1c94af" modify_external_catalogs: true
I20260810 19:48:18.721103 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_7f1237b0daef46828ceb12f434bd9beb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:18.722559 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_55ac347fbf024d41a7fc8bfb4815981f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:18.723145 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55ac347fbf024d41a7fc8bfb4815981f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:18.726524 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f1237b0daef46828ceb12f434bd9beb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:18.730225 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a43662790f914cb3874fe99ba9a519a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:18.730866 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a43662790f914cb3874fe99ba9a519a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:18.730243 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ef8b5c305a774a6cb5210e29488e831a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:18.731555 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef8b5c305a774a6cb5210e29488e831a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:18.740165 12266 ts_tablet_manager.cc:1929] T 3109703c51e54af78b58e9bbca50af33 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:18.740334 12266 log.cc:1199] T 3109703c51e54af78b58e9bbca50af33 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/3109703c51e54af78b58e9bbca50af33
I20260810 19:48:18.740700 12266 ts_tablet_manager.cc:1950] T 3109703c51e54af78b58e9bbca50af33 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:18.743635 10370 tablet_bootstrap.cc:492] T b54feebc7c9841d89808054602be7913 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:18.743798 10370 ts_tablet_manager.cc:1403] T b54feebc7c9841d89808054602be7913 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.058s user 0.004s sys 0.008s
I20260810 19:48:18.744652 10370 raft_consensus.cc:359] T b54feebc7c9841d89808054602be7913 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.744856 10370 raft_consensus.cc:385] T b54feebc7c9841d89808054602be7913 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:18.744916 10370 raft_consensus.cc:740] T b54feebc7c9841d89808054602be7913 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:18.745122 10370 consensus_queue.cc:260] T b54feebc7c9841d89808054602be7913 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.742144 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 749cea5cd8f842b891f4e2cab07c054e (table default.Table_eac904f0d8d945b3ab2e659358f3a485 [id=d319e3ece21e44b1860258156ffa0f72]) successfully deleted
W20260810 19:48:18.747087 9395 catalog_manager.cc:5017] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet b9b567b3338845e4a37cff2a955056ae because the tablet was not found. No further retry: Not found: Tablet not found: b9b567b3338845e4a37cff2a955056ae
I20260810 19:48:18.748893 10370 ts_tablet_manager.cc:1434] T b54feebc7c9841d89808054602be7913 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 19:48:18.749394 10375 tablet_replica.cc:333] T b33aa8be266a434cba899da7514c47e9 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:18.749866 10375 raft_consensus.cc:2243] T b33aa8be266a434cba899da7514c47e9 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:18.750059 10375 raft_consensus.cc:2272] T b33aa8be266a434cba899da7514c47e9 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:18.750628 10375 ts_tablet_manager.cc:1916] T b33aa8be266a434cba899da7514c47e9 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:18.752763 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d48083fb0e7247ecbb0432896bbf24a1 has no consensus state
I20260810 19:48:18.754626 10370 tablet_bootstrap.cc:492] T 676004738985441985278313d6064530 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:18.764578 9935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bbd3fe2117c42058dc108b5dc18d560" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:18.765280 10067 leader_election.cc:343] T 1bbd3fe2117c42058dc108b5dc18d560 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:18.765412 10067 leader_election.cc:304] T 1bbd3fe2117c42058dc108b5dc18d560 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:18.765671 13309 raft_consensus.cc:2749] T 1bbd3fe2117c42058dc108b5dc18d560 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:18.765959 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fe67e8bd014acaa202c022c193cdc6" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:18.765955 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_47b60293596b47298fd66de06fff3f84" } new_table_name: "default.Table_1c056d23c6064315bf9ca2c2f2bafa7c" modify_external_catalogs: true
I20260810 19:48:18.767223 9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229dd737ee8547a89445593cc117fbc2" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:18.767794 9611 leader_election.cc:343] T 229dd737ee8547a89445593cc117fbc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:18.767975 9611 leader_election.cc:304] T 229dd737ee8547a89445593cc117fbc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:18.767967 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_b1d68dd07fe64856b914b26331c893b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:18.768172 10067 leader_election.cc:343] T 8d93821ff46a4096a8ebbac83faabed7 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Not found: Tablet not found: 8d93821ff46a4096a8ebbac83faabed7
I20260810 19:48:18.768276 10067 leader_election.cc:304] T 8d93821ff46a4096a8ebbac83faabed7 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:48:18.768569 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1d68dd07fe64856b914b26331c893b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:18.768762 10067 leader_election.cc:343] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:18.769045 13357 raft_consensus.cc:2749] T 8d93821ff46a4096a8ebbac83faabed7 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:18.769641 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1a5b07808c9a4b3f92a32046e95b6640"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:18.770113 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a5b07808c9a4b3f92a32046e95b6640 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:18.771540 10370 tablet_bootstrap.cc:654] T 676004738985441985278313d6064530 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:18.771554 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_339557aab54447d284c9c637ae38b8ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:18.772102 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_339557aab54447d284c9c637ae38b8ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:18.772657 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fe67e8bd014acaa202c022c193cdc6" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
W20260810 19:48:18.773443 10067 leader_election.cc:343] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:18.774966 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_326e6714716f497c8408450e0828e9e8" } new_table_name: "default.Table_45716e8478c747948836942a5d58ba71" modify_external_catalogs: true
I20260810 19:48:18.778563 10366 tablet_bootstrap.cc:654] T 7d939e3df62a45d9a964d4df01be4bfb P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:18.779626 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_828aa8f5237d45a984bfc770cd9e5ef9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:18.779897 13418 raft_consensus.cc:2749] T 229dd737ee8547a89445593cc117fbc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:18.780136 13418 raft_consensus.cc:493] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 19:48:18.780221 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_828aa8f5237d45a984bfc770cd9e5ef9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:18.780267 13418 raft_consensus.cc:515] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.780978 13418 leader_election.cc:290] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:18.782022 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5aaedde75d54341a87764c6e89a03d6" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:18.782573 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5aaedde75d54341a87764c6e89a03d6" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:18.782786 10153 raft_consensus.cc:2468] T d5aaedde75d54341a87764c6e89a03d6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
W20260810 19:48:18.782796 9611 leader_election.cc:343] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:18.783149 9611 leader_election.cc:304] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691
I20260810 19:48:18.783700 13418 raft_consensus.cc:2804] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:18.783813 13418 raft_consensus.cc:493] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:18.783926 13418 raft_consensus.cc:3060] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:18.787742 13418 raft_consensus.cc:515] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.789209 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5aaedde75d54341a87764c6e89a03d6" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:18.789732 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5aaedde75d54341a87764c6e89a03d6" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:18.789939 10153 raft_consensus.cc:3060] T d5aaedde75d54341a87764c6e89a03d6 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
W20260810 19:48:18.789837 9611 leader_election.cc:343] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:18.789523 13418 leader_election.cc:290] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:18.793138 10153 raft_consensus.cc:2468] T d5aaedde75d54341a87764c6e89a03d6 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:48:18.798347 13309 raft_consensus.cc:493] T 59a767c91abf45e79cebab582525ad2e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:18.798564 9611 leader_election.cc:304] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691
I20260810 19:48:18.798560 13309 raft_consensus.cc:515] T 59a767c91abf45e79cebab582525ad2e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.799247 13309 leader_election.cc:290] T 59a767c91abf45e79cebab582525ad2e P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:18.799886 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a767c91abf45e79cebab582525ad2e" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:18.800540 10067 leader_election.cc:343] T 59a767c91abf45e79cebab582525ad2e P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:18.804730 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 548a6996692549df8087393ccef7b4a2 consensus state has no leader
I20260810 19:48:18.807632 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c66a98aa6e1f4ef5a7fcc4d8a5f6ed4e" } modify_external_catalogs: true
I20260810 19:48:18.807857 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c66a98aa6e1f4ef5a7fcc4d8a5f6ed4e" } modify_external_catalogs: true
W20260810 19:48:18.808115 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1031461c40a749b88f4f9e93c15abcff consensus state has no leader
I20260810 19:48:18.808846 10375 ts_tablet_manager.cc:1929] T b33aa8be266a434cba899da7514c47e9 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:18.808975 10375 log.cc:1199] T b33aa8be266a434cba899da7514c47e9 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/b33aa8be266a434cba899da7514c47e9
I20260810 19:48:18.809376 10375 ts_tablet_manager.cc:1950] T b33aa8be266a434cba899da7514c47e9 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:18.810938 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet b33aa8be266a434cba899da7514c47e9 (table default.Table_40317d27e3de4c7ebbe4a80239f78899 [id=4e38b3a52c3549889893d804ab0dfb89]) successfully deleted
I20260810 19:48:18.812023 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_88790a0f0d5c47079b55c152d71d4a1c" } modify_external_catalogs: true
I20260810 19:48:18.812206 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_88790a0f0d5c47079b55c152d71d4a1c" } modify_external_catalogs: true
I20260810 19:48:18.814244 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2b4a171707e745c0b06d669df83755fe" } modify_external_catalogs: true
I20260810 19:48:18.814465 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2b4a171707e745c0b06d669df83755fe" } modify_external_catalogs: true
I20260810 19:48:18.814505 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a43662790f914cb3874fe99ba9a519a6" } modify_external_catalogs: true
I20260810 19:48:18.814604 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_a43662790f914cb3874fe99ba9a519a6" } modify_external_catalogs: true
I20260810 19:48:18.818300 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c35ddec630d942db9ba85f10a2f405ee" } modify_external_catalogs: true
I20260810 19:48:18.818600 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c35ddec630d942db9ba85f10a2f405ee" } modify_external_catalogs: true
W20260810 19:48:18.827943 10068 leader_election.cc:343] T 59a767c91abf45e79cebab582525ad2e P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 59a767c91abf45e79cebab582525ad2e
I20260810 19:48:18.828130 10068 leader_election.cc:304] T 59a767c91abf45e79cebab582525ad2e P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:18.828397 13309 raft_consensus.cc:2749] T 59a767c91abf45e79cebab582525ad2e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:18.828438 9410 catalog_manager.cc:5719] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195). New cstate: current_term: 1 leader_uuid: "eadde59fd6504d679e47f03a60c64bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: HEALTHY } } }
I20260810 19:48:18.829267 9410 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 18ed05a1eb4a4f6e9a7284caaa0bba05 (table default.Table_5f86aedb4db8406090f1dd83566d57f8 [id=04cfb59bcc4e460f9063fe742900ba92]). Expected version 1 got 0
I20260810 19:48:18.830680 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c8883dc352884ba18ad8c63608b96108"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:18.831246 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8883dc352884ba18ad8c63608b96108 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:18.837388 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1265) took 1808 ms. Trace:
I20260810 19:48:18.837528 12266 rpcz_store.cc:276] 0810 19:48:17.028679 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.028736 (+ 57us) service_pool.cc:224] Handling call
0810 19:48:18.674757 (+1646021us) ts_tablet_manager.cc:1151] Deleting tablet 3109703c51e54af78b58e9bbca50af33
0810 19:48:18.674767 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:18.708067 (+ 33300us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:18.740058 (+ 31991us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:18.837323 (+ 97265us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1645777}
I20260810 19:48:18.838033 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 3109703c51e54af78b58e9bbca50af33 (table default.Table_b3ebb4935f244802a7b2b6e1a33cb904 [id=0c0d86100d3444bbafc7f7def5c5a317]) successfully deleted
I20260810 19:48:18.842259 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_21fcacdc6600475f94cfb970d662c931" } new_table_name: "default.Table_02462a9561cc4eaf9c6d3f6827ed5e68" modify_external_catalogs: true
I20260810 19:48:18.844375 9887 tablet_service.cc:1511] Processing CreateTablet for tablet 76035ac51b3c4724a541f14ff18190c4 (DEFAULT_TABLE table=default.Table_e437c0e9512842d3977b1963a2a0435c [id=36929391048246af87ca30f962f5db7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.846388 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 76035ac51b3c4724a541f14ff18190c4 (DEFAULT_TABLE table=default.Table_e437c0e9512842d3977b1963a2a0435c [id=36929391048246af87ca30f962f5db7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.846871 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76035ac51b3c4724a541f14ff18190c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.847193 10377 ts_tablet_manager.cc:1929] T 7459e64bd48449d2a8d4ff835b215d46 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:18.847395 10377 log.cc:1199] T 7459e64bd48449d2a8d4ff835b215d46 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/7459e64bd48449d2a8d4ff835b215d46
I20260810 19:48:18.847759 10377 ts_tablet_manager.cc:1950] T 7459e64bd48449d2a8d4ff835b215d46 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:18.848141 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1294) took 1866 ms. Trace:
I20260810 19:48:18.848271 10377 rpcz_store.cc:276] 0810 19:48:16.981222 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:16.981276 (+ 54us) service_pool.cc:224] Handling call
0810 19:48:18.250503 (+1269227us) ts_tablet_manager.cc:1151] Deleting tablet 7459e64bd48449d2a8d4ff835b215d46
0810 19:48:18.250515 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:18.554294 (+303779us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:18.847113 (+292819us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:18.848123 (+ 1010us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1251995}
I20260810 19:48:18.848814 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1306) took 1510 ms. Trace:
I20260810 19:48:18.850538 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 7459e64bd48449d2a8d4ff835b215d46 (table default.Table_4217f5ad81404f348810945248421770 [id=60c86daf4a0f4442ab6754a4e3dc2106]) successfully deleted
I20260810 19:48:18.850910 9407 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 372cf2e53aa64c65baa384e047a2a973
I20260810 19:48:18.850992 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet be90bb3ded454172aef6578669dfa908
I20260810 19:48:18.852259 9420 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 18ed05a1eb4a4f6e9a7284caaa0bba05 (table default.Table_5f86aedb4db8406090f1dd83566d57f8 [id=04cfb59bcc4e460f9063fe742900ba92]). Expected version 1 got 0
I20260810 19:48:18.853258 9655 tablet_service.cc:1558] Processing DeleteTablet for tablet 372cf2e53aa64c65baa384e047a2a973 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:18 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:18.853603 9420 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 8b24b75629ec423b90e4bf287e7cfd38 (table default.Table_ce3ea915b9dd44b3943c4de2b462d48c [id=9f58b113854b4d139e789332dfe00c8c]). Expected version 3 got 0
I20260810 19:48:18.853852 9655 tablet_service.cc:1558] Processing DeleteTablet for tablet be90bb3ded454172aef6578669dfa908 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:18 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:18.853888 10145 tablet_service.cc:1558] Processing DeleteTablet for tablet be90bb3ded454172aef6578669dfa908 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:18 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:18.854110 10144 tablet_service.cc:1558] Processing DeleteTablet for tablet 372cf2e53aa64c65baa384e047a2a973 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:18 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:18.854416 13309 raft_consensus.cc:493] T b54feebc7c9841d89808054602be7913 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:18.854472 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_9e545c4706b84b9c96b6d8853d9c2f6c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:18.854575 13309 raft_consensus.cc:515] T b54feebc7c9841d89808054602be7913 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:18.855075 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e545c4706b84b9c96b6d8853d9c2f6c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:18.855261 13309 leader_election.cc:290] T b54feebc7c9841d89808054602be7913 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:18.855948 9408 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 18ed05a1eb4a4f6e9a7284caaa0bba05 (table default.Table_5f86aedb4db8406090f1dd83566d57f8 [id=04cfb59bcc4e460f9063fe742900ba92]). Expected version 1 got 0
W20260810 19:48:18.856534 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet be90bb3ded454172aef6578669dfa908 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be90bb3ded454172aef6578669dfa908 already in progress: creating tablet
W20260810 19:48:18.856784 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 372cf2e53aa64c65baa384e047a2a973 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 372cf2e53aa64c65baa384e047a2a973 already in progress: creating tablet
I20260810 19:48:18.856930 9415 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 20b2cc37f0594d30b31e21176479389d
I20260810 19:48:18.857671 12266 tablet_replica.cc:333] T e87fd882e6b6413480a0cb06aee74722 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:18.857762 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 77cf30d2d79f404798378ab01af53b8c
I20260810 19:48:18.857920 12266 raft_consensus.cc:2243] T e87fd882e6b6413480a0cb06aee74722 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:18.858331 12266 raft_consensus.cc:2272] T e87fd882e6b6413480a0cb06aee74722 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:18.858974 10144 tablet_service.cc:1558] Processing DeleteTablet for tablet 77cf30d2d79f404798378ab01af53b8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:18 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:18.859372 12266 ts_tablet_manager.cc:1916] T e87fd882e6b6413480a0cb06aee74722 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:18.860450 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 72d92f8b6565416c9da4e8d1ec7a6d50
I20260810 19:48:18.861019 10375 tablet_replica.cc:333] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:18.861243 10375 raft_consensus.cc:2243] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:18.861452 10144 tablet_service.cc:1558] Processing DeleteTablet for tablet 72d92f8b6565416c9da4e8d1ec7a6d50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:18 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:18.861506 9655 tablet_service.cc:1558] Processing DeleteTablet for tablet 77cf30d2d79f404798378ab01af53b8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:18 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:18.861598 10375 raft_consensus.cc:2272] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:18.861708 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 72d92f8b6565416c9da4e8d1ec7a6d50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:18 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:18.862004 10068 leader_election.cc:343] T b54feebc7c9841d89808054602be7913 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: b54feebc7c9841d89808054602be7913
I20260810 19:48:18.862196 10375 ts_tablet_manager.cc:1916] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:18.862857 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 76035ac51b3c4724a541f14ff18190c4 (DEFAULT_TABLE table=default.Table_e437c0e9512842d3977b1963a2a0435c [id=36929391048246af87ca30f962f5db7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.863317 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76035ac51b3c4724a541f14ff18190c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.863583 10144 tablet_service.cc:1511] Processing CreateTablet for tablet f69a9251c9984c93b764290cb68342db (DEFAULT_TABLE table=default.Table_6b8863bd284444ed80fde8b5131ba710 [id=906b5c538f2f4d69a62cf7272f0da00c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.864084 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f69a9251c9984c93b764290cb68342db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.869380 9412 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 5e47086440ef4a249f1eed23db655879 (table default.Table_b38998c1916842f1aa85263f019bde23 [id=a2b6e3d955f3426781465b670f4fa727]). Expected version 1 got 0
I20260810 19:48:18.871155 9684 tablet_service.cc:1511] Processing CreateTablet for tablet f69a9251c9984c93b764290cb68342db (DEFAULT_TABLE table=default.Table_6b8863bd284444ed80fde8b5131ba710 [id=906b5c538f2f4d69a62cf7272f0da00c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.871618 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f69a9251c9984c93b764290cb68342db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.871608 10375 ts_tablet_manager.cc:1929] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:18.872260 10375 log.cc:1199] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/77cf30d2d79f404798378ab01af53b8c
I20260810 19:48:18.873620 10375 ts_tablet_manager.cc:1950] T 77cf30d2d79f404798378ab01af53b8c P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:18.876338 9655 tablet_service.cc:1511] Processing CreateTablet for tablet bf2230a579654d4a88f2b6cd16da0c01 (DEFAULT_TABLE table=default.Table_b14a1b59ea5e43e68958b8202562182e [id=47487201eda24532bfc16850fd5f1ed9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.876559 10124 tablet_service.cc:1511] Processing CreateTablet for tablet bf2230a579654d4a88f2b6cd16da0c01 (DEFAULT_TABLE table=default.Table_b14a1b59ea5e43e68958b8202562182e [id=47487201eda24532bfc16850fd5f1ed9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.876837 9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf2230a579654d4a88f2b6cd16da0c01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.877310 10144 tablet_service.cc:1511] Processing CreateTablet for tablet de6ab168b9194f0cb0e58139dc705d8f (DEFAULT_TABLE table=default.Table_b39b7dbc0b6e4f398a8cb0bc8b76666b [id=5e9825efbed747b0a21d57973184ce14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.877729 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf2230a579654d4a88f2b6cd16da0c01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.880139 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de6ab168b9194f0cb0e58139dc705d8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.881551 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 8643c9386b964a019556e6027480a672 (DEFAULT_TABLE table=default.Table_2b30f2552558478aa3e232e68390c193 [id=14b4ddb6814045febc170ebea941f2ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.881923 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8643c9386b964a019556e6027480a672. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.882263 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_87b726ec1327405d86e7c849c488b960" } new_table_name: "default.Table_00bac7d77ead4784bad5d4f161410393" modify_external_catalogs: true
I20260810 19:48:18.886489 9658 tablet_service.cc:1511] Processing CreateTablet for tablet 8643c9386b964a019556e6027480a672 (DEFAULT_TABLE table=default.Table_2b30f2552558478aa3e232e68390c193 [id=14b4ddb6814045febc170ebea941f2ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.886943 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8643c9386b964a019556e6027480a672. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.887059 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 77cf30d2d79f404798378ab01af53b8c (table default.Table_88790a0f0d5c47079b55c152d71d4a1c [id=f06fa8a4ae1c4ce89691f8abad3d3e7b]) successfully deleted
W20260810 19:48:18.887156 9413 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 01f778560eb9475da082dec2e2892e9c consensus state has no leader
W20260810 19:48:18.887351 9395 catalog_manager.cc:5030] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): delete failed for tablet 72d92f8b6565416c9da4e8d1ec7a6d50 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72d92f8b6565416c9da4e8d1ec7a6d50 already in progress: creating tablet
I20260810 19:48:18.887533 10137 tablet_service.cc:1511] Processing CreateTablet for tablet ac11301804a640969a67657e2449d837 (DEFAULT_TABLE table=default.Table_18b5d7c2de7c4a87bb24f7a67bc0b721 [id=37a0aea95e9548038ccfe5311fa29fca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.887908 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac11301804a640969a67657e2449d837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.894605 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 54fbb5c919b9499db026d2c32db03fe2 (DEFAULT_TABLE table=default.Table_b3424333fe664b7a8bbd68768e31c59d [id=50c7711f205b4204835e2ad0f9e37c07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.895038 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54fbb5c919b9499db026d2c32db03fe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.895710 9668 tablet_service.cc:1511] Processing CreateTablet for tablet 042248b8260f4c69910caacdb87543ed (DEFAULT_TABLE table=default.Table_0ee3eba17cf2454e9dd394cd7470a671 [id=5603a59ac3e046458ef213168ebf123b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.896142 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 042248b8260f4c69910caacdb87543ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.898830 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 453b9fde518d4e10a5a8fac5ff692972 (DEFAULT_TABLE table=default.Table_ff08ac2a902148c29690a097858fa0d8 [id=a1ea7939d9f7482a84c5005e78e49476]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.899256 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 453b9fde518d4e10a5a8fac5ff692972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.902802 10135 tablet_service.cc:1511] Processing CreateTablet for tablet bfaceee3a44840e0aeb78e18f47188e0 (DEFAULT_TABLE table=default.Table_17708a4f1cc94b65869c278f1293c503 [id=08c2a34ec4e14d73837c6a1029467844]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.903214 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfaceee3a44840e0aeb78e18f47188e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.903784 9658 tablet_service.cc:1511] Processing CreateTablet for tablet ac11301804a640969a67657e2449d837 (DEFAULT_TABLE table=default.Table_18b5d7c2de7c4a87bb24f7a67bc0b721 [id=37a0aea95e9548038ccfe5311fa29fca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.904299 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac11301804a640969a67657e2449d837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.906677 9655 tablet_service.cc:1511] Processing CreateTablet for tablet de6ab168b9194f0cb0e58139dc705d8f (DEFAULT_TABLE table=default.Table_b39b7dbc0b6e4f398a8cb0bc8b76666b [id=5e9825efbed747b0a21d57973184ce14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.906786 10130 tablet_service.cc:1511] Processing CreateTablet for tablet b9eceffbd4b94dff8f1a8fe2584ee00f (DEFAULT_TABLE table=default.Table_609bec2bcadf419db309d021dc9f9906 [id=28fcd31c1d97415ea5622bb5db1f883e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.907159 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9eceffbd4b94dff8f1a8fe2584ee00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.907280 9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de6ab168b9194f0cb0e58139dc705d8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.910853 10118 tablet_service.cc:1511] Processing CreateTablet for tablet 70ba31ccec7b41ed8ff1c8d659ea9737 (DEFAULT_TABLE table=default.Table_364f284b970d409bbd9cd3c59e6da18e [id=0a77db1a428045feb876e6cdc2dda5f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.910931 10140 tablet_service.cc:1511] Processing CreateTablet for tablet b4999eb4256841fd9d354c98da3fb95e (DEFAULT_TABLE table=default.Table_27ad51955a9e4751b768d1535121449d [id=cf75a389fbf8416095e152b4232cd82f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.911227 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 16242acf16174bd3afab1792737507c6 (DEFAULT_TABLE table=default.Table_d80279bdee9144d9b36f89aad71ca8aa [id=e62dc5c501444ec0802d2556b29738a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.911304 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 58c809993042480f9d9784aebad16b1d (DEFAULT_TABLE table=default.Table_7c4fc88cb6b74b37be38348e717f1280 [id=3a758c98282b4b6ebf72c3b6b2af917a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.911412 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 13631a2b27df449bb2f696031d4f4efb (DEFAULT_TABLE table=default.Table_db7dbc983287444c94a05ac3d7c2572a [id=c9182b3c9e154d658af659926a85dbd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.911528 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 116ec3ab4c5140d5a57a525d2aaa5bb7 (DEFAULT_TABLE table=default.Table_20c0928e4abc4405930a9632cfdc0e8f [id=14a9c177d10d4fb39c9883372ba6542a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.911322 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70ba31ccec7b41ed8ff1c8d659ea9737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.912102 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13631a2b27df449bb2f696031d4f4efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.912145 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 4284d9a61ab543fcacdcccf04e07d543 (DEFAULT_TABLE table=default.Table_30aa215301cf4468a1913b9e05104534 [id=430749267fd14a46a9e7843ea9590b96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.912268 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c809993042480f9d9784aebad16b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.912449 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4284d9a61ab543fcacdcccf04e07d543. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.912039 10116 tablet_service.cc:1511] Processing CreateTablet for tablet 8a78673bb8d9453fa4fb2b1768df77c3 (DEFAULT_TABLE table=default.Table_981f80e468834b91ba17192d0dea8e60 [id=cc0dfcbd1dcc4e5290d0dc55cb56c973]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.912719 10116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a78673bb8d9453fa4fb2b1768df77c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.914605 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 116ec3ab4c5140d5a57a525d2aaa5bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.914664 10134 tablet_service.cc:1511] Processing CreateTablet for tablet e233aa79ebb84a0f89411fc8166b1bb4 (DEFAULT_TABLE table=default.Table_c71e63f4580a439cb7ba4c2f4dd20436 [id=0508a65b1be14f12a89c1c9e8ede3795]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.914970 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e233aa79ebb84a0f89411fc8166b1bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.917647 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16242acf16174bd3afab1792737507c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.922551 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4999eb4256841fd9d354c98da3fb95e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.932760 9675 tablet_service.cc:1511] Processing CreateTablet for tablet 453b9fde518d4e10a5a8fac5ff692972 (DEFAULT_TABLE table=default.Table_ff08ac2a902148c29690a097858fa0d8 [id=a1ea7939d9f7482a84c5005e78e49476]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.933259 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 453b9fde518d4e10a5a8fac5ff692972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.933662 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 58c809993042480f9d9784aebad16b1d (DEFAULT_TABLE table=default.Table_7c4fc88cb6b74b37be38348e717f1280 [id=3a758c98282b4b6ebf72c3b6b2af917a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.933287 9681 tablet_service.cc:1511] Processing CreateTablet for tablet b4999eb4256841fd9d354c98da3fb95e (DEFAULT_TABLE table=default.Table_27ad51955a9e4751b768d1535121449d [id=cf75a389fbf8416095e152b4232cd82f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.934032 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c809993042480f9d9784aebad16b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.937929 9665 tablet_service.cc:1511] Processing CreateTablet for tablet 70ba31ccec7b41ed8ff1c8d659ea9737 (DEFAULT_TABLE table=default.Table_364f284b970d409bbd9cd3c59e6da18e [id=0a77db1a428045feb876e6cdc2dda5f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.938431 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70ba31ccec7b41ed8ff1c8d659ea9737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.938638 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4999eb4256841fd9d354c98da3fb95e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.932770 9667 tablet_service.cc:1511] Processing CreateTablet for tablet b9eceffbd4b94dff8f1a8fe2584ee00f (DEFAULT_TABLE table=default.Table_609bec2bcadf419db309d021dc9f9906 [id=28fcd31c1d97415ea5622bb5db1f883e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.939095 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9eceffbd4b94dff8f1a8fe2584ee00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.942934 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 042248b8260f4c69910caacdb87543ed (DEFAULT_TABLE table=default.Table_0ee3eba17cf2454e9dd394cd7470a671 [id=5603a59ac3e046458ef213168ebf123b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.943351 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 042248b8260f4c69910caacdb87543ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.932770 9664 tablet_service.cc:1511] Processing CreateTablet for tablet bfaceee3a44840e0aeb78e18f47188e0 (DEFAULT_TABLE table=default.Table_17708a4f1cc94b65869c278f1293c503 [id=08c2a34ec4e14d73837c6a1029467844]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.943730 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfaceee3a44840e0aeb78e18f47188e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.947002 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 854c845e3d1e43429f2fa5fa13d0fc5a (DEFAULT_TABLE table=default.Table_4a4190c1266e4af1b81f0e079408ed17 [id=6bff04963b744471b6e7d1a2eb7d543e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.947402 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 854c845e3d1e43429f2fa5fa13d0fc5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.934023 9668 tablet_service.cc:1511] Processing CreateTablet for tablet 54fbb5c919b9499db026d2c32db03fe2 (DEFAULT_TABLE table=default.Table_b3424333fe664b7a8bbd68768e31c59d [id=50c7711f205b4204835e2ad0f9e37c07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.948637 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54fbb5c919b9499db026d2c32db03fe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.949879 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 00e722772ea34fc382a30f6f7b180cd2 (DEFAULT_TABLE table=default.Table_f434eae9b387478d93beb21a4f479de3 [id=ce9aa844dd3b4b5e91d4584f5c3e0844]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.950248 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00e722772ea34fc382a30f6f7b180cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.952807 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_281135cc68d747deb6a696d48867a10d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:18.954470 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ac26bc30d7be42e49391fe1953de2e4d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:18.955047 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac26bc30d7be42e49391fe1953de2e4d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:18.955693 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_bdc8f5454bb34b05a6289f255d7e719a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:18.956198 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bdc8f5454bb34b05a6289f255d7e719a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:18.956763 9410 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_3ca7c069a1d34227aca0af884fac1b5b [id=b3ab2ecf4f4247369ce62adeb445c834] alter complete (version 1)
I20260810 19:48:18.958389 9412 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_ce3ea915b9dd44b3943c4de2b462d48c [id=9f58b113854b4d139e789332dfe00c8c] alter complete (version 3)
I20260810 19:48:18.958695 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_4df39177675e414d96b2478ffcc780f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:18.959177 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4df39177675e414d96b2478ffcc780f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:18.959547 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 96d1380e23494bbabdad11067159ed79 consensus state has no leader
I20260810 19:48:18.961283 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 8a78673bb8d9453fa4fb2b1768df77c3 (DEFAULT_TABLE table=default.Table_981f80e468834b91ba17192d0dea8e60 [id=cc0dfcbd1dcc4e5290d0dc55cb56c973]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.961468 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 116ec3ab4c5140d5a57a525d2aaa5bb7 (DEFAULT_TABLE table=default.Table_20c0928e4abc4405930a9632cfdc0e8f [id=14a9c177d10d4fb39c9883372ba6542a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.961720 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a78673bb8d9453fa4fb2b1768df77c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.962031 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 116ec3ab4c5140d5a57a525d2aaa5bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.962276 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 13631a2b27df449bb2f696031d4f4efb (DEFAULT_TABLE table=default.Table_db7dbc983287444c94a05ac3d7c2572a [id=c9182b3c9e154d658af659926a85dbd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.962635 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13631a2b27df449bb2f696031d4f4efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.965704 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_bb58c03ab3af444b99cd4fa12a0482cd" } new_table_name: "default.Table_d09d39bc02444add83b870428a596511" modify_external_catalogs: true
I20260810 19:48:18.965821 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 16242acf16174bd3afab1792737507c6 (DEFAULT_TABLE table=default.Table_d80279bdee9144d9b36f89aad71ca8aa [id=e62dc5c501444ec0802d2556b29738a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.966204 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16242acf16174bd3afab1792737507c6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:18.967345 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_281135cc68d747deb6a696d48867a10d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:18.976402 10116 tablet_service.cc:1511] Processing CreateTablet for tablet b61fb81c94594a71a3f9dcfef413b52b (DEFAULT_TABLE table=default.Table_0ea446f3947f42dba60adb416db9ebb6 [id=ed445eaaf2fc4768ba2fd27c0ae4e30b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.976490 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 30edf2b56e80413ab9a02f0caa1480c6 (DEFAULT_TABLE table=default.Table_cb5d4a067ef84d93b3c5f6182a716580 [id=8ef72f17b0cf40b7992e7c7d6b8153b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.976624 10120 tablet_service.cc:1511] Processing CreateTablet for tablet 6e86994d7adc4662a83614ecb13a26c1 (DEFAULT_TABLE table=default.Table_41bac9c99b9c403fb298a8ad414099bc [id=d978178d78b64fafbf18ad56c728d11d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.976933 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30edf2b56e80413ab9a02f0caa1480c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.977183 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e86994d7adc4662a83614ecb13a26c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.978227 10119 tablet_service.cc:1511] Processing CreateTablet for tablet d48083fb0e7247ecbb0432896bbf24a1 (DEFAULT_TABLE table=default.Table_3c2f76d07ad24da08b7e624d8e1c94af [id=c66cdd2a144d4e57968d0e8c204fa5fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.978904 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d48083fb0e7247ecbb0432896bbf24a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.980343 10116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b61fb81c94594a71a3f9dcfef413b52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.982450 10118 tablet_service.cc:1511] Processing CreateTablet for tablet f9d744866c8b486db27d538ac280cdb9 (DEFAULT_TABLE table=default.Table_1d1421fb907c4d5d9103c350b0557351 [id=8088bcbea9814ce3af15a9653a35d805]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.983105 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d744866c8b486db27d538ac280cdb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.984073 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 7b1baeb4170e436fa5cdcaa5ae7f47f6 (DEFAULT_TABLE table=default.Table_53bddb46400344258ce9e31df115c2a0 [id=4f307a6172944763bca99d53dcecca17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.984413 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b1baeb4170e436fa5cdcaa5ae7f47f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.988688 13357 raft_consensus.cc:493] T 87bbcc651d034e2a826478b805792e48 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:18.988837 13357 raft_consensus.cc:515] T 87bbcc651d034e2a826478b805792e48 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:18.989511 13357 leader_election.cc:290] T 87bbcc651d034e2a826478b805792e48 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:18.990259 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 4284d9a61ab543fcacdcccf04e07d543 (DEFAULT_TABLE table=default.Table_30aa215301cf4468a1913b9e05104534 [id=430749267fd14a46a9e7843ea9590b96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.990738 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4284d9a61ab543fcacdcccf04e07d543. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.994681 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 52d1a3f04e8c4819b2ec8367007576c6 (DEFAULT_TABLE table=default.Table_f1bfdcf5171d4d2e9269dd94a5c8ace1 [id=77eb57116dab4d9da107b311e092d9dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.995131 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d1a3f04e8c4819b2ec8367007576c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.995563 9675 tablet_service.cc:1511] Processing CreateTablet for tablet e233aa79ebb84a0f89411fc8166b1bb4 (DEFAULT_TABLE table=default.Table_c71e63f4580a439cb7ba4c2f4dd20436 [id=0508a65b1be14f12a89c1c9e8ede3795]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.995854 9688 tablet_service.cc:1511] Processing CreateTablet for tablet f9d744866c8b486db27d538ac280cdb9 (DEFAULT_TABLE table=default.Table_1d1421fb907c4d5d9103c350b0557351 [id=8088bcbea9814ce3af15a9653a35d805]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.996351 9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e233aa79ebb84a0f89411fc8166b1bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.996652 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d744866c8b486db27d538ac280cdb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.997179 9664 tablet_service.cc:1511] Processing CreateTablet for tablet 00e722772ea34fc382a30f6f7b180cd2 (DEFAULT_TABLE table=default.Table_f434eae9b387478d93beb21a4f479de3 [id=ce9aa844dd3b4b5e91d4584f5c3e0844]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.997556 9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00e722772ea34fc382a30f6f7b180cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.998888 9663 tablet_service.cc:1511] Processing CreateTablet for tablet 5cb4f4e17a16468597f154083a5c3e6e (DEFAULT_TABLE table=default.Table_2051fd14af9e42938ba8066fb2061f03 [id=019668ccf1b944f1b3d40c4caa11edad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.999225 9663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cb4f4e17a16468597f154083a5c3e6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.999646 9685 tablet_service.cc:1511] Processing CreateTablet for tablet d48083fb0e7247ecbb0432896bbf24a1 (DEFAULT_TABLE table=default.Table_3c2f76d07ad24da08b7e624d8e1c94af [id=c66cdd2a144d4e57968d0e8c204fa5fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.999963 9685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d48083fb0e7247ecbb0432896bbf24a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.002564 9669 tablet_service.cc:1511] Processing CreateTablet for tablet a721195640eb4368a7cbcc5df45ed086 (DEFAULT_TABLE table=default.Table_830fae4b55a24a80977d725471403000 [id=9515ceb023044ce08f2e47f5a845df2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.002842 9659 tablet_service.cc:1511] Processing CreateTablet for tablet 52d1a3f04e8c4819b2ec8367007576c6 (DEFAULT_TABLE table=default.Table_f1bfdcf5171d4d2e9269dd94a5c8ace1 [id=77eb57116dab4d9da107b311e092d9dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.002936 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a721195640eb4368a7cbcc5df45ed086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.003132 9659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d1a3f04e8c4819b2ec8367007576c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.003389 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 1aa91baf608d46a495847dc4cfc8bd49 (DEFAULT_TABLE table=default.Table_16ef5360f2e14f14854335370de7da9d [id=0607b06dd44a4804a84538c61db98c34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.003698 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa91baf608d46a495847dc4cfc8bd49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.006567 9687 tablet_service.cc:1511] Processing CreateTablet for tablet b61fb81c94594a71a3f9dcfef413b52b (DEFAULT_TABLE table=default.Table_0ea446f3947f42dba60adb416db9ebb6 [id=ed445eaaf2fc4768ba2fd27c0ae4e30b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.002564 9677 tablet_service.cc:1511] Processing CreateTablet for tablet 46caf44a52cc40b18a08cda148534e49 (DEFAULT_TABLE table=default.Table_dcd173e747ce4cd89b52951222967fc4 [id=9774c2986b0e4caba65ab2b515e0c0a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.006923 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b61fb81c94594a71a3f9dcfef413b52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.007082 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46caf44a52cc40b18a08cda148534e49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.008837 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_55ac347fbf024d41a7fc8bfb4815981f" } new_table_name: "default.Table_42dc6ea5ce034e2b871968591ebb3c86" modify_external_catalogs: true
I20260810 19:48:19.006567 9660 tablet_service.cc:1511] Processing CreateTablet for tablet 7b1baeb4170e436fa5cdcaa5ae7f47f6 (DEFAULT_TABLE table=default.Table_53bddb46400344258ce9e31df115c2a0 [id=4f307a6172944763bca99d53dcecca17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.010500 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_28e5e84b58a44f539fea3e4847ba0dd0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:19.010700 9660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b1baeb4170e436fa5cdcaa5ae7f47f6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:19.011057 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28e5e84b58a44f539fea3e4847ba0dd0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:18.998593 10130 tablet_service.cc:1511] Processing CreateTablet for tablet a721195640eb4368a7cbcc5df45ed086 (DEFAULT_TABLE table=default.Table_830fae4b55a24a80977d725471403000 [id=9515ceb023044ce08f2e47f5a845df2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.014802 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a721195640eb4368a7cbcc5df45ed086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.852164 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet be90bb3ded454172aef6578669dfa908 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:18 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:18.852643 9908 tablet_service.cc:1558] Processing DeleteTablet for tablet 372cf2e53aa64c65baa384e047a2a973 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:18 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:18.855813 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54feebc7c9841d89808054602be7913" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:18.858796 9894 tablet_service.cc:1558] Processing DeleteTablet for tablet 77cf30d2d79f404798378ab01af53b8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:18 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:19.018483 10377 rpcz_store.cc:276] 0810 19:48:17.337888 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.338380 (+ 492us) service_pool.cc:224] Handling call
0810 19:48:18.848672 (+1510292us) ts_tablet_manager.cc:1151] Deleting tablet 25da36714b1d4e89a2c4af713331f4ec
0810 19:48:18.848683 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:18.848794 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1509637}
I20260810 19:48:19.018913 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 8a78673bb8d9453fa4fb2b1768df77c3 (DEFAULT_TABLE table=default.Table_981f80e468834b91ba17192d0dea8e60 [id=cc0dfcbd1dcc4e5290d0dc55cb56c973]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.019141 10377 tablet_replica.cc:333] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:18.866962 9913 tablet_service.cc:1558] Processing DeleteTablet for tablet 72d92f8b6565416c9da4e8d1ec7a6d50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:18 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:18.867358 9898 tablet_service.cc:1511] Processing CreateTablet for tablet f69a9251c9984c93b764290cb68342db (DEFAULT_TABLE table=default.Table_6b8863bd284444ed80fde8b5131ba710 [id=906b5c538f2f4d69a62cf7272f0da00c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.876566 9905 tablet_service.cc:1511] Processing CreateTablet for tablet de6ab168b9194f0cb0e58139dc705d8f (DEFAULT_TABLE table=default.Table_b39b7dbc0b6e4f398a8cb0bc8b76666b [id=5e9825efbed747b0a21d57973184ce14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.019503 10377 raft_consensus.cc:2243] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:19.019554 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 4284d9a61ab543fcacdcccf04e07d543 (DEFAULT_TABLE table=default.Table_30aa215301cf4468a1913b9e05104534 [id=430749267fd14a46a9e7843ea9590b96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.875722 9906 tablet_service.cc:1511] Processing CreateTablet for tablet bf2230a579654d4a88f2b6cd16da0c01 (DEFAULT_TABLE table=default.Table_b14a1b59ea5e43e68958b8202562182e [id=47487201eda24532bfc16850fd5f1ed9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.019629 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_3e05663bfac3409cbdaf7019a07ca034"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:18.877377 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 8643c9386b964a019556e6027480a672 (DEFAULT_TABLE table=default.Table_2b30f2552558478aa3e232e68390c193 [id=14b4ddb6814045febc170ebea941f2ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.882052 9895 tablet_service.cc:1511] Processing CreateTablet for tablet ac11301804a640969a67657e2449d837 (DEFAULT_TABLE table=default.Table_18b5d7c2de7c4a87bb24f7a67bc0b721 [id=37a0aea95e9548038ccfe5311fa29fca]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:19.020175 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e05663bfac3409cbdaf7019a07ca034 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:18.885864 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 042248b8260f4c69910caacdb87543ed (DEFAULT_TABLE table=default.Table_0ee3eba17cf2454e9dd394cd7470a671 [id=5603a59ac3e046458ef213168ebf123b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.889410 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 54fbb5c919b9499db026d2c32db03fe2 (DEFAULT_TABLE table=default.Table_b3424333fe664b7a8bbd68768e31c59d [id=50c7711f205b4204835e2ad0f9e37c07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.890300 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 453b9fde518d4e10a5a8fac5ff692972 (DEFAULT_TABLE table=default.Table_ff08ac2a902148c29690a097858fa0d8 [id=a1ea7939d9f7482a84c5005e78e49476]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.891322 9885 tablet_service.cc:1511] Processing CreateTablet for tablet bfaceee3a44840e0aeb78e18f47188e0 (DEFAULT_TABLE table=default.Table_17708a4f1cc94b65869c278f1293c503 [id=08c2a34ec4e14d73837c6a1029467844]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.892022 9897 tablet_service.cc:1511] Processing CreateTablet for tablet b9eceffbd4b94dff8f1a8fe2584ee00f (DEFAULT_TABLE table=default.Table_609bec2bcadf419db309d021dc9f9906 [id=28fcd31c1d97415ea5622bb5db1f883e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.892882 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 70ba31ccec7b41ed8ff1c8d659ea9737 (DEFAULT_TABLE table=default.Table_364f284b970d409bbd9cd3c59e6da18e [id=0a77db1a428045feb876e6cdc2dda5f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.893811 9907 tablet_service.cc:1511] Processing CreateTablet for tablet b4999eb4256841fd9d354c98da3fb95e (DEFAULT_TABLE table=default.Table_27ad51955a9e4751b768d1535121449d [id=cf75a389fbf8416095e152b4232cd82f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.900723 9890 tablet_service.cc:1511] Processing CreateTablet for tablet 116ec3ab4c5140d5a57a525d2aaa5bb7 (DEFAULT_TABLE table=default.Table_20c0928e4abc4405930a9632cfdc0e8f [id=14a9c177d10d4fb39c9883372ba6542a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:18.901229 9899 tablet_service.cc:1511] Processing CreateTablet for tablet 16242acf16174bd3afab1792737507c6 (DEFAULT_TABLE table=default.Table_d80279bdee9144d9b36f89aad71ca8aa [id=e62dc5c501444ec0802d2556b29738a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.021463 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_cadbbfe4f5d04095b599c4f15a26eae5" } new_table_name: "default.Table_53959df4c9c045f8870724325982379e" modify_external_catalogs: true
I20260810 19:48:19.021906 9904 tablet_service.cc:1511] Processing CreateTablet for tablet e233aa79ebb84a0f89411fc8166b1bb4 (DEFAULT_TABLE table=default.Table_c71e63f4580a439cb7ba4c2f4dd20436 [id=0508a65b1be14f12a89c1c9e8ede3795]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.022975 9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16242acf16174bd3afab1792737507c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.896536 9911 tablet_service.cc:1511] Processing CreateTablet for tablet 58c809993042480f9d9784aebad16b1d (DEFAULT_TABLE table=default.Table_7c4fc88cb6b74b37be38348e717f1280 [id=3a758c98282b4b6ebf72c3b6b2af917a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:18.956063 9831 consensus_peers.cc:597] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Couldn't send request to peer fcd31b1bbb0340cbacfce652b4ad8da4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 263a5695e7754b44a64edbda27b42135. This is attempt 1: this message will repeat every 5th retry.
W20260810 19:48:19.023162 9831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 67144.3us
I20260810 19:48:19.023331 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c809993042480f9d9784aebad16b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.023576 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f69a9251c9984c93b764290cb68342db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.023962 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_31e9eac84a064d309abb8b0573ed9958"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:19.024509 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31e9eac84a064d309abb8b0573ed9958 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:19.024567 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9eceffbd4b94dff8f1a8fe2584ee00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.028131 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de6ab168b9194f0cb0e58139dc705d8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.030435 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a78673bb8d9453fa4fb2b1768df77c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.030613 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 453b9fde518d4e10a5a8fac5ff692972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.034570 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54fbb5c919b9499db026d2c32db03fe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.038784 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4999eb4256841fd9d354c98da3fb95e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.040757 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 00e722772ea34fc382a30f6f7b180cd2 (DEFAULT_TABLE table=default.Table_f434eae9b387478d93beb21a4f479de3 [id=ce9aa844dd3b4b5e91d4584f5c3e0844]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.041155 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00e722772ea34fc382a30f6f7b180cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.042433 9885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfaceee3a44840e0aeb78e18f47188e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.042222 9911 tablet_service.cc:1511] Processing CreateTablet for tablet f9d744866c8b486db27d538ac280cdb9 (DEFAULT_TABLE table=default.Table_1d1421fb907c4d5d9103c350b0557351 [id=8088bcbea9814ce3af15a9653a35d805]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.043778 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d744866c8b486db27d538ac280cdb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.046428 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 5cb4f4e17a16468597f154083a5c3e6e (DEFAULT_TABLE table=default.Table_2051fd14af9e42938ba8066fb2061f03 [id=019668ccf1b944f1b3d40c4caa11edad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.046608 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70ba31ccec7b41ed8ff1c8d659ea9737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.046897 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cb4f4e17a16468597f154083a5c3e6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.050446 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 116ec3ab4c5140d5a57a525d2aaa5bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.050738 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 46caf44a52cc40b18a08cda148534e49 (DEFAULT_TABLE table=default.Table_dcd173e747ce4cd89b52951222967fc4 [id=9774c2986b0e4caba65ab2b515e0c0a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.051312 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46caf44a52cc40b18a08cda148534e49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.055441 9882 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:38260 (request call id 208) took 1881 ms. Trace:
I20260810 19:48:19.055544 9882 rpcz_store.cc:276] 0810 19:48:17.174257 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.174355 (+ 98us) service_pool.cc:224] Handling call
0810 19:48:19.055367 (+1881012us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:48:19.056751 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 042248b8260f4c69910caacdb87543ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.058667 10139 tablet_service.cc:1511] Processing CreateTablet for tablet 1aa91baf608d46a495847dc4cfc8bd49 (DEFAULT_TABLE table=default.Table_16ef5360f2e14f14854335370de7da9d [id=0607b06dd44a4804a84538c61db98c34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.059075 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa91baf608d46a495847dc4cfc8bd49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.062446 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8643c9386b964a019556e6027480a672. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.064586 10142 tablet_service.cc:1511] Processing CreateTablet for tablet cdcf53ba85414193add40f92d5c75209 (DEFAULT_TABLE table=default.Table_8504e02662614f29a684e21a52f8f17b [id=c5e7a58d753c469e8da78e2654c4e834]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.065002 10142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdcf53ba85414193add40f92d5c75209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.066443 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac11301804a640969a67657e2449d837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.070449 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf2230a579654d4a88f2b6cd16da0c01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.070468 10115 tablet_service.cc:1511] Processing CreateTablet for tablet e0efd4331e014fde9fecf7592c86c0ad (DEFAULT_TABLE table=default.Table_1f3c66cf43f34e418f4baea736bc9669 [id=86e88a8488174a9796efb8d295cfae52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.070683 10120 tablet_service.cc:1511] Processing CreateTablet for tablet ddeb69be78ed440bb76bddb8e16acbdf (DEFAULT_TABLE table=default.Table_072335e923324709a99255e9f3fdadfa [id=31cddc1359544bc5be5b71a745d3d8e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.070900 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0efd4331e014fde9fecf7592c86c0ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.071393 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 854c845e3d1e43429f2fa5fa13d0fc5a (DEFAULT_TABLE table=default.Table_4a4190c1266e4af1b81f0e079408ed17 [id=6bff04963b744471b6e7d1a2eb7d543e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.071805 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 854c845e3d1e43429f2fa5fa13d0fc5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.075157 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4284d9a61ab543fcacdcccf04e07d543. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.046036 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 854c845e3d1e43429f2fa5fa13d0fc5a (DEFAULT_TABLE table=default.Table_4a4190c1266e4af1b81f0e079408ed17 [id=6bff04963b744471b6e7d1a2eb7d543e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.075596 10136 tablet_service.cc:1511] Processing CreateTablet for tablet a3588a8f738e49a2be1f57a6a6bcb0e5 (DEFAULT_TABLE table=default.Table_30732d5b4723469da64545f8603f37f7 [id=2e1ce68b06274e64a54fb71256d77ac9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:19.075810 9400 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.235.253:37397: connect: Connection refused (error 111) [suppressed 8 similar messages]
I20260810 19:48:19.075956 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 854c845e3d1e43429f2fa5fa13d0fc5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.075959 13159 raft_consensus.cc:2804] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:19.076006 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3588a8f738e49a2be1f57a6a6bcb0e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.076236 13159 raft_consensus.cc:697] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:48:19.076539 13159 consensus_queue.cc:237] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.076843 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e233aa79ebb84a0f89411fc8166b1bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.070466 10140 tablet_service.cc:1511] Processing CreateTablet for tablet 78c5a5a15a3f40e59daefe2bc750a802 (DEFAULT_TABLE table=default.Table_96b63be644654b1c9fb59633415031b4 [id=4d21dc6e491f4eee91c360e3cd80e833]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.077240 10140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c5a5a15a3f40e59daefe2bc750a802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:18.990244 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87bbcc651d034e2a826478b805792e48" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:18.990656 10366 tablet_bootstrap.cc:492] T 7d939e3df62a45d9a964d4df01be4bfb P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:19.077628 10366 ts_tablet_manager.cc:1403] T 7d939e3df62a45d9a964d4df01be4bfb P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.575s user 0.002s sys 0.003s
I20260810 19:48:19.019055 9894 tablet_service.cc:1511] Processing CreateTablet for tablet 13631a2b27df449bb2f696031d4f4efb (DEFAULT_TABLE table=default.Table_db7dbc983287444c94a05ac3d7c2572a [id=c9182b3c9e154d658af659926a85dbd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.077962 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13631a2b27df449bb2f696031d4f4efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.078481 10366 raft_consensus.cc:359] T 7d939e3df62a45d9a964d4df01be4bfb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.078644 10366 raft_consensus.cc:385] T 7d939e3df62a45d9a964d4df01be4bfb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:19.078685 10366 raft_consensus.cc:740] T 7d939e3df62a45d9a964d4df01be4bfb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
W20260810 19:48:19.078989 10067 leader_election.cc:343] T b54feebc7c9841d89808054602be7913 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:19.079118 10067 leader_election.cc:304] T b54feebc7c9841d89808054602be7913 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:19.079588 13309 raft_consensus.cc:2749] T b54feebc7c9841d89808054602be7913 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:19.079595 10067 leader_election.cc:343] T 87bbcc651d034e2a826478b805792e48 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:18.953745 9830 consensus_peers.cc:597] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 263a5695e7754b44a64edbda27b42135. This is attempt 1: this message will repeat every 5th retry.
W20260810 19:48:19.080031 9830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.195:43797, user_credentials={real_user=slave}} blocked reactor thread for 126325us
I20260810 19:48:19.078974 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddeb69be78ed440bb76bddb8e16acbdf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:19.086999 9611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.235.195:43797, user_credentials={real_user=slave}} blocked reactor thread for 288489us
I20260810 19:48:19.093632 10377 pending_rounds.cc:70] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691: Trying to abort 1 pending ops.
I20260810 19:48:19.093719 10377 pending_rounds.cc:77] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058755440029696 op_type: NO_OP noop_request { }
I20260810 19:48:19.093823 10377 raft_consensus.cc:2889] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:19.093920 10377 raft_consensus.cc:2272] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:19.094707 10116 tablet_service.cc:1511] Processing CreateTablet for tablet ba7a25592a484fcab5d3ac178b08ed55 (DEFAULT_TABLE table=default.Table_f916c7c5ea66493aa9377d0bde28cf58 [id=dfa26709942d4666bff12c3df9ffc67a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.095158 10116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba7a25592a484fcab5d3ac178b08ed55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.078887 10366 consensus_queue.cc:260] T 7d939e3df62a45d9a964d4df01be4bfb P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.098986 10366 ts_tablet_manager.cc:1434] T 7d939e3df62a45d9a964d4df01be4bfb P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20260810 19:48:19.099346 10366 tablet_bootstrap.cc:492] T 676004738985441985278313d6064530 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:19.101245 10366 tablet_bootstrap.cc:654] T 676004738985441985278313d6064530 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:19.102532 13357 raft_consensus.cc:493] T 2d72c72f90964f34bbc2232118dc5172 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:19.102674 13357 raft_consensus.cc:515] T 2d72c72f90964f34bbc2232118dc5172 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.103325 13357 leader_election.cc:290] T 2d72c72f90964f34bbc2232118dc5172 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:19.106721 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d72c72f90964f34bbc2232118dc5172" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:19.107355 10067 leader_election.cc:343] T 2d72c72f90964f34bbc2232118dc5172 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:19.107606 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 30edf2b56e80413ab9a02f0caa1480c6 (DEFAULT_TABLE table=default.Table_cb5d4a067ef84d93b3c5f6182a716580 [id=8ef72f17b0cf40b7992e7c7d6b8153b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.108083 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30edf2b56e80413ab9a02f0caa1480c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.110598 10366 tablet_bootstrap.cc:492] T 676004738985441985278313d6064530 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:19.110769 10366 ts_tablet_manager.cc:1403] T 676004738985441985278313d6064530 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.004s
I20260810 19:48:19.111609 10366 raft_consensus.cc:359] T 676004738985441985278313d6064530 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.111804 10366 raft_consensus.cc:385] T 676004738985441985278313d6064530 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:19.111871 10366 raft_consensus.cc:740] T 676004738985441985278313d6064530 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:19.112133 10366 consensus_queue.cc:260] T 676004738985441985278313d6064530 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.112865 10366 ts_tablet_manager.cc:1434] T 676004738985441985278313d6064530 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:19.113202 10366 tablet_bootstrap.cc:492] T eb3e7d34b5314bc7a7c5ed53792728ca P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:19.113950 9655 tablet_service.cc:1511] Processing CreateTablet for tablet 6e86994d7adc4662a83614ecb13a26c1 (DEFAULT_TABLE table=default.Table_41bac9c99b9c403fb298a8ad414099bc [id=d978178d78b64fafbf18ad56c728d11d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.114451 9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e86994d7adc4662a83614ecb13a26c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.115011 10366 tablet_bootstrap.cc:654] T eb3e7d34b5314bc7a7c5ed53792728ca P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:19.117349 9681 tablet_service.cc:1511] Processing CreateTablet for tablet a3588a8f738e49a2be1f57a6a6bcb0e5 (DEFAULT_TABLE table=default.Table_30732d5b4723469da64545f8603f37f7 [id=2e1ce68b06274e64a54fb71256d77ac9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.117766 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3588a8f738e49a2be1f57a6a6bcb0e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.120088 9677 tablet_service.cc:1511] Processing CreateTablet for tablet ba7a25592a484fcab5d3ac178b08ed55 (DEFAULT_TABLE table=default.Table_f916c7c5ea66493aa9377d0bde28cf58 [id=dfa26709942d4666bff12c3df9ffc67a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.120497 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba7a25592a484fcab5d3ac178b08ed55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.121549 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet 87bbcc651d034e2a826478b805792e48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:19.121835 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d93821ff46a4096a8ebbac83faabed7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:19.122026 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d72c72f90964f34bbc2232118dc5172 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:08 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:19.122154 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bbd3fe2117c42058dc108b5dc18d560 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:04 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:19.122267 10135 tablet_service.cc:1558] Processing DeleteTablet for tablet 59a767c91abf45e79cebab582525ad2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:55 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:19.132570 10366 tablet_bootstrap.cc:492] T eb3e7d34b5314bc7a7c5ed53792728ca P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:19.134841 10366 ts_tablet_manager.cc:1403] T eb3e7d34b5314bc7a7c5ed53792728ca P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.003s
I20260810 19:48:19.136183 9887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76035ac51b3c4724a541f14ff18190c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.137892 10377 ts_tablet_manager.cc:1916] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:19.138836 10375 tablet_replica.cc:333] T 87bbcc651d034e2a826478b805792e48 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:19.139063 10375 raft_consensus.cc:2243] T 87bbcc651d034e2a826478b805792e48 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:19.139235 10375 raft_consensus.cc:2272] T 87bbcc651d034e2a826478b805792e48 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:19.139873 10375 ts_tablet_manager.cc:1916] T 87bbcc651d034e2a826478b805792e48 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:19.141145 9660 tablet_service.cc:1511] Processing CreateTablet for tablet ddeb69be78ed440bb76bddb8e16acbdf (DEFAULT_TABLE table=default.Table_072335e923324709a99255e9f3fdadfa [id=31cddc1359544bc5be5b71a745d3d8e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.143904 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet 60e99cd75ada470380ab69da60ddac77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:09 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:19.144296 9660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddeb69be78ed440bb76bddb8e16acbdf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:19.149888 10068 leader_election.cc:343] T 87bbcc651d034e2a826478b805792e48 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 87bbcc651d034e2a826478b805792e48
I20260810 19:48:19.150059 10068 leader_election.cc:304] T 87bbcc651d034e2a826478b805792e48 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
W20260810 19:48:19.150288 10068 raft_consensus.cc:2686] T 87bbcc651d034e2a826478b805792e48 P eadde59fd6504d679e47f03a60c64bb0: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 19:48:19.153466 10367 tablet_bootstrap.cc:492] T 841f58b4e8f7465eaa7fa08629e0bc2a P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:19.153632 10367 ts_tablet_manager.cc:1403] T 841f58b4e8f7465eaa7fa08629e0bc2a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.451s user 0.018s sys 0.008s
I20260810 19:48:19.154382 10367 raft_consensus.cc:359] T 841f58b4e8f7465eaa7fa08629e0bc2a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.154569 10367 raft_consensus.cc:385] T 841f58b4e8f7465eaa7fa08629e0bc2a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:19.154629 10367 raft_consensus.cc:740] T 841f58b4e8f7465eaa7fa08629e0bc2a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:19.154819 10367 consensus_queue.cc:260] T 841f58b4e8f7465eaa7fa08629e0bc2a P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.155378 10367 ts_tablet_manager.cc:1434] T 841f58b4e8f7465eaa7fa08629e0bc2a P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 19:48:19.155679 10367 tablet_bootstrap.cc:492] T b853bf6bbc7845bc9cfa6347687582e2 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:19.157289 10367 tablet_bootstrap.cc:654] T b853bf6bbc7845bc9cfa6347687582e2 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:19.143370 9668 tablet_service.cc:1511] Processing CreateTablet for tablet e0efd4331e014fde9fecf7592c86c0ad (DEFAULT_TABLE table=default.Table_1f3c66cf43f34e418f4baea736bc9669 [id=86e88a8488174a9796efb8d295cfae52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.143656 9665 tablet_service.cc:1511] Processing CreateTablet for tablet 78c5a5a15a3f40e59daefe2bc750a802 (DEFAULT_TABLE table=default.Table_96b63be644654b1c9fb59633415031b4 [id=4d21dc6e491f4eee91c360e3cd80e833]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.143205 9669 tablet_service.cc:1511] Processing CreateTablet for tablet cdcf53ba85414193add40f92d5c75209 (DEFAULT_TABLE table=default.Table_8504e02662614f29a684e21a52f8f17b [id=c5e7a58d753c469e8da78e2654c4e834]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.158248 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0efd4331e014fde9fecf7592c86c0ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.158483 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c5a5a15a3f40e59daefe2bc750a802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.158715 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdcf53ba85414193add40f92d5c75209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.159521 13418 raft_consensus.cc:493] T 60e99cd75ada470380ab69da60ddac77 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:19.159657 13418 raft_consensus.cc:515] T 60e99cd75ada470380ab69da60ddac77 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.160296 13418 leader_election.cc:290] T 60e99cd75ada470380ab69da60ddac77 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:19.162523 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60e99cd75ada470380ab69da60ddac77" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:19.163075 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60e99cd75ada470380ab69da60ddac77" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:19.163116 9611 leader_election.cc:343] T 60e99cd75ada470380ab69da60ddac77 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260810 19:48:19.164547 9611 leader_election.cc:343] T 60e99cd75ada470380ab69da60ddac77 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:19.164769 9611 leader_election.cc:304] T 60e99cd75ada470380ab69da60ddac77 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
W20260810 19:48:19.165238 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 60d8ba917fe644e18279eaef8088ec63 consensus state has no leader
I20260810 19:48:19.165700 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_5253cc7a7532414eb993c6486f687c6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:19.166335 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5253cc7a7532414eb993c6486f687c6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:19.167651 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_112ea9a25c8642548fc7d4e0b2156b8e" } modify_external_catalogs: true
W20260810 19:48:19.167771 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 16b492b0109942c7b5ede1818fc36a88 has no consensus state
I20260810 19:48:19.167809 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_112ea9a25c8642548fc7d4e0b2156b8e" } modify_external_catalogs: true
I20260810 19:48:19.168077 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_585a8a9b06434703beb484747743577d" } modify_external_catalogs: true
I20260810 19:48:19.168202 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_585a8a9b06434703beb484747743577d" } modify_external_catalogs: true
I20260810 19:48:19.168439 13104 raft_consensus.cc:493] T 7d939e3df62a45d9a964d4df01be4bfb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:19.168592 13104 raft_consensus.cc:515] T 7d939e3df62a45d9a964d4df01be4bfb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.168635 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_29958c4b0dbc4bd792aaaaabe969c407"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:19.168916 9412 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2051fd14af9e42938ba8066fb2061f03" } modify_external_catalogs: true
I20260810 19:48:19.169051 9412 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2051fd14af9e42938ba8066fb2061f03" } modify_external_catalogs: true
W20260810 19:48:19.169175 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29958c4b0dbc4bd792aaaaabe969c407 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:19.169272 13104 leader_election.cc:290] T 7d939e3df62a45d9a964d4df01be4bfb P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
W20260810 19:48:19.169571 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 054c725b88c34372a922fc5be27c35a0 consensus state has no leader
I20260810 19:48:19.169864 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_77e9c60c358548bcae55a37d2cd94658" } modify_external_catalogs: true
I20260810 19:48:19.169991 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_77e9c60c358548bcae55a37d2cd94658" } modify_external_catalogs: true
I20260810 19:48:19.170614 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1db8b75e5c4f4810a2f97750a130c2cf" } modify_external_catalogs: true
I20260810 19:48:19.170742 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_1db8b75e5c4f4810a2f97750a130c2cf" } modify_external_catalogs: true
I20260810 19:48:19.171466 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e12b767f15c14df4bff9da1d856c2961" } new_table_name: "default.Table_e7421071093b4fe4835644eb7636655b" modify_external_catalogs: true
I20260810 19:48:19.171500 13357 raft_consensus.cc:493] T 985440898cc04a98877c15a5122a7dd3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:19.171674 13357 raft_consensus.cc:515] T 985440898cc04a98877c15a5122a7dd3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.172362 13357 leader_election.cc:290] T 985440898cc04a98877c15a5122a7dd3 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:19.173094 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985440898cc04a98877c15a5122a7dd3" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:19.173069 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_48d458d1d3aa46a989e8488779e29497"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:19.173564 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48d458d1d3aa46a989e8488779e29497 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:19.173799 10067 leader_election.cc:343] T 985440898cc04a98877c15a5122a7dd3 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:19.178788 9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d939e3df62a45d9a964d4df01be4bfb" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" is_pre_election: true
I20260810 19:48:19.179088 9710 raft_consensus.cc:2393] T 7d939e3df62a45d9a964d4df01be4bfb P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6986ed920dcb4af29a5eeeda6f671691 in current term 1: Already voted for candidate eadde59fd6504d679e47f03a60c64bb0 in this term.
I20260810 19:48:19.181034 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_828aa8f5237d45a984bfc770cd9e5ef9" } new_table_name: "default.Table_f9b40856ae7f42a79d8968c7625bb524" modify_external_catalogs: true
I20260810 19:48:19.185348 13418 raft_consensus.cc:2749] T 60e99cd75ada470380ab69da60ddac77 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:19.187228 10370 tablet_bootstrap.cc:492] T 676004738985441985278313d6064530 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:19.187413 10370 ts_tablet_manager.cc:1403] T 676004738985441985278313d6064530 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.433s user 0.017s sys 0.009s
I20260810 19:48:19.188246 10370 raft_consensus.cc:359] T 676004738985441985278313d6064530 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.188444 10370 raft_consensus.cc:385] T 676004738985441985278313d6064530 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:19.188503 10370 raft_consensus.cc:740] T 676004738985441985278313d6064530 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:19.195119 10139 tablet_service.cc:1511] Processing CreateTablet for tablet dbaf58354169429e85631af722f93612 (DEFAULT_TABLE table=default.Table_61622d0039ff4e02bd197850b26ed5dc [id=a12926000d6e4b3e90eb7a0daa9080ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.195295 10120 tablet_service.cc:1511] Processing CreateTablet for tablet 864b67b855cc49d0a2f4da6a914f7a41 (DEFAULT_TABLE table=default.Table_828aa8f5237d45a984bfc770cd9e5ef9 [id=678fe2a6dadb40b09bac8fa1bd5f20fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.195700 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 692d42b657b74accbd1860016ab37e81 (DEFAULT_TABLE table=default.Table_74c5066c29584dfca364436dd02a84b4 [id=2e7374c8af5246ce9ebc62b46baa8cd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.195796 10137 tablet_service.cc:1511] Processing CreateTablet for tablet d62c36ce5281417b948f2a52c742c9be (DEFAULT_TABLE table=default.Table_b1d68dd07fe64856b914b26331c893b6 [id=dde3534dda4240d096a71674bb93378a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.196146 10142 tablet_service.cc:1511] Processing CreateTablet for tablet 16b492b0109942c7b5ede1818fc36a88 (DEFAULT_TABLE table=default.Table_42dc6ea5ce034e2b871968591ebb3c86 [id=3fbf8eeacc79439dbb11ee3fd2e68a89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.196251 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 5acfb3c4e8054dfeac033fa88ce6dc18 (DEFAULT_TABLE table=default.Table_7f1237b0daef46828ceb12f434bd9beb [id=60211fc1c98747838e009af38de90aee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.196592 10136 tablet_service.cc:1511] Processing CreateTablet for tablet f294f7fce7ad4cca98423e9f78044b8e (DEFAULT_TABLE table=default.Table_837db8eddbb8449eb276b9a74d12b160 [id=6307c5c66bdb4a3f9eaf6ba8cbdb7945]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.196681 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 87454e85629a4a9aaf1be15466fc785a (DEFAULT_TABLE table=default.Table_ef8b5c305a774a6cb5210e29488e831a [id=dac2ef23e5304c8ba575ae9bc7152ba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.197106 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 15f123b000fe4cd2aa7ae2c8fb73aeb1 (DEFAULT_TABLE table=default.Table_bac4df0a4c004be49f2e39e3c5805bf0 [id=57db12ac55694e528471ec28748dda89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.197516 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 393a00ca58a04af1bec7eb8be83dfba2 (DEFAULT_TABLE table=default.Table_34d55298fe734e128bf7cc506c956a94 [id=6834237a1f324a40b1bcf7ef129f4e65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.203315 13357 consensus_queue.cc:1048] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 19:48:19.203563 10068 leader_election.cc:343] T 2d72c72f90964f34bbc2232118dc5172 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 2d72c72f90964f34bbc2232118dc5172
I20260810 19:48:19.203697 10068 leader_election.cc:304] T 2d72c72f90964f34bbc2232118dc5172 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:19.203930 13357 raft_consensus.cc:2749] T 2d72c72f90964f34bbc2232118dc5172 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:19.216576 12266 ts_tablet_manager.cc:1929] T e87fd882e6b6413480a0cb06aee74722 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:19.216758 12266 log.cc:1199] T e87fd882e6b6413480a0cb06aee74722 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/e87fd882e6b6413480a0cb06aee74722
I20260810 19:48:19.217137 12266 ts_tablet_manager.cc:1950] T e87fd882e6b6413480a0cb06aee74722 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:19.218120 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1266) took 2170 ms. Trace:
I20260810 19:48:19.221168 10370 consensus_queue.cc:260] T 676004738985441985278313d6064530 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.225229 9897 tablet_service.cc:1511] Processing CreateTablet for tablet 5cb4f4e17a16468597f154083a5c3e6e (DEFAULT_TABLE table=default.Table_2051fd14af9e42938ba8066fb2061f03 [id=019668ccf1b944f1b3d40c4caa11edad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.229840 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 78c5a5a15a3f40e59daefe2bc750a802 (DEFAULT_TABLE table=default.Table_96b63be644654b1c9fb59633415031b4 [id=4d21dc6e491f4eee91c360e3cd80e833]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.230844 9902 tablet_service.cc:1511] Processing CreateTablet for tablet a721195640eb4368a7cbcc5df45ed086 (DEFAULT_TABLE table=default.Table_830fae4b55a24a80977d725471403000 [id=9515ceb023044ce08f2e47f5a845df2a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:19.236521 9611 consensus_peers.cc:597] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: deeb390ae00646089e9f1d453ddb54a1. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:19.239549 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 1aa91baf608d46a495847dc4cfc8bd49 (DEFAULT_TABLE table=default.Table_16ef5360f2e14f14854335370de7da9d [id=0607b06dd44a4804a84538c61db98c34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.242868 9945 raft_consensus.cc:3060] T 7d939e3df62a45d9a964d4df01be4bfb P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:19.248414 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 52d1a3f04e8c4819b2ec8367007576c6 (DEFAULT_TABLE table=default.Table_f1bfdcf5171d4d2e9269dd94a5c8ace1 [id=77eb57116dab4d9da107b311e092d9dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.248953 9913 tablet_service.cc:1511] Processing CreateTablet for tablet d48083fb0e7247ecbb0432896bbf24a1 (DEFAULT_TABLE table=default.Table_3c2f76d07ad24da08b7e624d8e1c94af [id=c66cdd2a144d4e57968d0e8c204fa5fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.248426 9899 tablet_service.cc:1511] Processing CreateTablet for tablet 46caf44a52cc40b18a08cda148534e49 (DEFAULT_TABLE table=default.Table_dcd173e747ce4cd89b52951222967fc4 [id=9774c2986b0e4caba65ab2b515e0c0a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.250226 9895 tablet_service.cc:1511] Processing CreateTablet for tablet b61fb81c94594a71a3f9dcfef413b52b (DEFAULT_TABLE table=default.Table_0ea446f3947f42dba60adb416db9ebb6 [id=ed445eaaf2fc4768ba2fd27c0ae4e30b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.250432 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 7b1baeb4170e436fa5cdcaa5ae7f47f6 (DEFAULT_TABLE table=default.Table_53bddb46400344258ce9e31df115c2a0 [id=4f307a6172944763bca99d53dcecca17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.251091 9885 tablet_service.cc:1511] Processing CreateTablet for tablet 30edf2b56e80413ab9a02f0caa1480c6 (DEFAULT_TABLE table=default.Table_cb5d4a067ef84d93b3c5f6182a716580 [id=8ef72f17b0cf40b7992e7c7d6b8153b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.252413 10366 raft_consensus.cc:359] T eb3e7d34b5314bc7a7c5ed53792728ca P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.252601 10366 raft_consensus.cc:385] T eb3e7d34b5314bc7a7c5ed53792728ca P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:19.252661 10366 raft_consensus.cc:740] T eb3e7d34b5314bc7a7c5ed53792728ca P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:19.252880 10366 consensus_queue.cc:260] T eb3e7d34b5314bc7a7c5ed53792728ca P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.253440 10366 ts_tablet_manager.cc:1434] T eb3e7d34b5314bc7a7c5ed53792728ca P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.118s user 0.012s sys 0.003s
I20260810 19:48:19.253769 10366 tablet_bootstrap.cc:492] T b3754889e4574fc3a936ac31cc6f496a P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:19.255378 10366 tablet_bootstrap.cc:654] T b3754889e4574fc3a936ac31cc6f496a P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:19.255906 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 6e86994d7adc4662a83614ecb13a26c1 (DEFAULT_TABLE table=default.Table_41bac9c99b9c403fb298a8ad414099bc [id=d978178d78b64fafbf18ad56c728d11d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.255424 9906 tablet_service.cc:1511] Processing CreateTablet for tablet a3588a8f738e49a2be1f57a6a6bcb0e5 (DEFAULT_TABLE table=default.Table_30732d5b4723469da64545f8603f37f7 [id=2e1ce68b06274e64a54fb71256d77ac9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.261453 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 5acfb3c4e8054dfeac033fa88ce6dc18 (DEFAULT_TABLE table=default.Table_7f1237b0daef46828ceb12f434bd9beb [id=60211fc1c98747838e009af38de90aee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.261588 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 87454e85629a4a9aaf1be15466fc785a (DEFAULT_TABLE table=default.Table_ef8b5c305a774a6cb5210e29488e831a [id=dac2ef23e5304c8ba575ae9bc7152ba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.261920 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5acfb3c4e8054dfeac033fa88ce6dc18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.262166 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87454e85629a4a9aaf1be15466fc785a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.261602 9669 tablet_service.cc:1511] Processing CreateTablet for tablet d62c36ce5281417b948f2a52c742c9be (DEFAULT_TABLE table=default.Table_b1d68dd07fe64856b914b26331c893b6 [id=dde3534dda4240d096a71674bb93378a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.267303 9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d62c36ce5281417b948f2a52c742c9be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.270414 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 15f123b000fe4cd2aa7ae2c8fb73aeb1 (DEFAULT_TABLE table=default.Table_bac4df0a4c004be49f2e39e3c5805bf0 [id=57db12ac55694e528471ec28748dda89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.270901 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f123b000fe4cd2aa7ae2c8fb73aeb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.278995 9883 tablet_service.cc:1511] Processing CreateTablet for tablet ba7a25592a484fcab5d3ac178b08ed55 (DEFAULT_TABLE table=default.Table_f916c7c5ea66493aa9377d0bde28cf58 [id=dfa26709942d4666bff12c3df9ffc67a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.282784 9881 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:38260 (request call id 209) took 2090 ms. Trace:
I20260810 19:48:19.283069 9881 rpcz_store.cc:276] 0810 19:48:17.192505 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.192570 (+ 65us) service_pool.cc:224] Handling call
0810 19:48:19.282706 (+2090136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 19:48:19.284030 9677 tablet_service.cc:1511] Processing CreateTablet for tablet 864b67b855cc49d0a2f4da6a914f7a41 (DEFAULT_TABLE table=default.Table_828aa8f5237d45a984bfc770cd9e5ef9 [id=678fe2a6dadb40b09bac8fa1bd5f20fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.285102 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 864b67b855cc49d0a2f4da6a914f7a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.291514 9896 tablet_service.cc:1511] Processing CreateTablet for tablet ddeb69be78ed440bb76bddb8e16acbdf (DEFAULT_TABLE table=default.Table_072335e923324709a99255e9f3fdadfa [id=31cddc1359544bc5be5b71a745d3d8e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.292883 9876 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:38260 (request call id 211) took 1618 ms. Trace:
I20260810 19:48:19.293020 9876 rpcz_store.cc:276] 0810 19:48:17.674492 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.674550 (+ 58us) service_pool.cc:224] Handling call
0810 19:48:18.528940 (+854390us) spinlock_profiling.cc:243] Waited 79.3 ms on lock 0x616000154654. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd472ff1860 00007fd476ee009f 00007fd4712b1bd6 00007fd4712b1905 00007fd46e06461e 00007fd46e0634fe 00007fd46e069738 00007fd46e06a09f 00007fd46e069ec8 0000000000aaf86c
0810 19:48:19.292849 (+763909us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182304512}
I20260810 19:48:19.302536 9412 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 5cb4f4e17a16468597f154083a5c3e6e
I20260810 19:48:19.303089 9418 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 18ed05a1eb4a4f6e9a7284caaa0bba05 (table default.Table_5f86aedb4db8406090f1dd83566d57f8 [id=04cfb59bcc4e460f9063fe742900ba92]). Expected version 1 got 0
I20260810 19:48:19.303355 9418 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 4579a71f8c8149798eb5f136135e5efe (table default.Table_cec9f2727c1943e2a6e9be05722f268c [id=8387d76208d54536aab9a8cd1810c7de]). Expected version 2 got 0
I20260810 19:48:19.303442 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 31526aa9c74e45e585e280f88f73cfa9
I20260810 19:48:19.303565 9418 catalog_manager.cc:5719] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193). New cstate: current_term: 1 leader_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:19.303979 9421 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 1a7079614cda418583af74ae11a4d374
I20260810 19:48:19.304010 9418 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet d5aaedde75d54341a87764c6e89a03d6 (table default.Table_92a5dea12ac142e4ae87c3fa6d55e3db [id=4a442dde52a84379bc58bc03c3e80beb]). Expected version 1 got 0
W20260810 19:48:19.305946 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2467e2cb92f5456c81990838910dd923 consensus state has no leader
I20260810 19:48:19.306664 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 89191af180b542ce99bf0a798a945594
I20260810 19:48:19.231487 10139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbaf58354169429e85631af722f93612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.307613 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d62c36ce5281417b948f2a52c742c9be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.310483 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 864b67b855cc49d0a2f4da6a914f7a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.314445 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87454e85629a4a9aaf1be15466fc785a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:19.316102 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 864b67b855cc49d0a2f4da6a914f7a41 consensus state has no leader
I20260810 19:48:19.318264 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f123b000fe4cd2aa7ae2c8fb73aeb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.319355 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5acfb3c4e8054dfeac033fa88ce6dc18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.322661 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393a00ca58a04af1bec7eb8be83dfba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.326473 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 692d42b657b74accbd1860016ab37e81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.332569 10142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16b492b0109942c7b5ede1818fc36a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.335073 9408 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet d5aaedde75d54341a87764c6e89a03d6 (table default.Table_92a5dea12ac142e4ae87c3fa6d55e3db [id=4a442dde52a84379bc58bc03c3e80beb]). Expected version 1 got 0
I20260810 19:48:19.335379 9408 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 18ed05a1eb4a4f6e9a7284caaa0bba05 (table default.Table_5f86aedb4db8406090f1dd83566d57f8 [id=04cfb59bcc4e460f9063fe742900ba92]). Expected version 1 got 0
I20260810 19:48:19.335616 9408 catalog_manager.cc:5719] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195). New cstate: current_term: 1 leader_uuid: "eadde59fd6504d679e47f03a60c64bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: HEALTHY } } }
I20260810 19:48:19.336050 9408 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet a2fe67e8bd014acaa202c022c193cdc6 (table default.Table_28b8191a242a4d8ea55fdaeaec9c1c41 [id=3b14f80137654337b24c2bb4131e58d3]). Expected version 3 got 0
I20260810 19:48:19.336282 9408 catalog_manager.cc:5719] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195). New cstate: current_term: 1 leader_uuid: "eadde59fd6504d679e47f03a60c64bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: HEALTHY } } }
I20260810 19:48:19.338512 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f294f7fce7ad4cca98423e9f78044b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.341234 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 92c1f13f235a4ba696bd794af135bcba
I20260810 19:48:19.250715 13320 consensus_queue.cc:1048] T 7d939e3df62a45d9a964d4df01be4bfb P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:19.346069 10377 ts_tablet_manager.cc:1929] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:19.346251 10377 log.cc:1199] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/263a5695e7754b44a64edbda27b42135
I20260810 19:48:19.348963 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 393a00ca58a04af1bec7eb8be83dfba2 (DEFAULT_TABLE table=default.Table_34d55298fe734e128bf7cc506c956a94 [id=6834237a1f324a40b1bcf7ef129f4e65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.349359 9413 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 7d939e3df62a45d9a964d4df01be4bfb (table default.Table_65f4c2fb3d1c49ae9cdfc041e51bd182 [id=2292ed1c178a4d458f52885e45c76d41]). Expected version 2 got 0
I20260810 19:48:19.349550 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393a00ca58a04af1bec7eb8be83dfba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.351199 10370 ts_tablet_manager.cc:1434] T 676004738985441985278313d6064530 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.164s user 0.002s sys 0.001s
I20260810 19:48:19.353483 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 16b492b0109942c7b5ede1818fc36a88 (DEFAULT_TABLE table=default.Table_42dc6ea5ce034e2b871968591ebb3c86 [id=3fbf8eeacc79439dbb11ee3fd2e68a89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.353976 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16b492b0109942c7b5ede1818fc36a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.358708 9657 tablet_service.cc:1511] Processing CreateTablet for tablet f294f7fce7ad4cca98423e9f78044b8e (DEFAULT_TABLE table=default.Table_837db8eddbb8449eb276b9a74d12b160 [id=6307c5c66bdb4a3f9eaf6ba8cbdb7945]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.358673 9659 tablet_service.cc:1511] Processing CreateTablet for tablet dbaf58354169429e85631af722f93612 (DEFAULT_TABLE table=default.Table_61622d0039ff4e02bd197850b26ed5dc [id=a12926000d6e4b3e90eb7a0daa9080ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.359334 9659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbaf58354169429e85631af722f93612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.362802 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f294f7fce7ad4cca98423e9f78044b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.368584 9907 tablet_service.cc:1511] Processing CreateTablet for tablet e0efd4331e014fde9fecf7592c86c0ad (DEFAULT_TABLE table=default.Table_1f3c66cf43f34e418f4baea736bc9669 [id=86e88a8488174a9796efb8d295cfae52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.375500 9658 tablet_service.cc:1511] Processing CreateTablet for tablet c219f719097c43b69a980b7c564c1432 (DEFAULT_TABLE table=default.Table_0facd7b775174e8ab5239ab75b8f0a01 [id=0469d99904714f93beeb32aa5339b624]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.376050 9658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c219f719097c43b69a980b7c564c1432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.375501 9685 tablet_service.cc:1511] Processing CreateTablet for tablet 692d42b657b74accbd1860016ab37e81 (DEFAULT_TABLE table=default.Table_74c5066c29584dfca364436dd02a84b4 [id=2e7374c8af5246ce9ebc62b46baa8cd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.378160 9685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 692d42b657b74accbd1860016ab37e81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.380134 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_080a0d3d20124e6799203522eef6d2c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:19.380810 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_080a0d3d20124e6799203522eef6d2c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:19.381626 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_767a48c631cd40a486287ce3a875fe7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:19.382207 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_767a48c631cd40a486287ce3a875fe7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:19.383049 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_61fe0e3c334a462d8dc0ecff4080ee36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:19.383526 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61fe0e3c334a462d8dc0ecff4080ee36 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:19.384217 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_801168d295d544fba861469ea8f82f3a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:19.384694 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_801168d295d544fba861469ea8f82f3a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:19.385011 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1cfb553b004d4b1abb27027424a6f6b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:19.385469 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1cfb553b004d4b1abb27027424a6f6b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:19.386883 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e78e0629877643a088071529bac8e691"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:19.387362 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e78e0629877643a088071529bac8e691 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:19.396477 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_826eb7bec7c74d8892c9eec11070cea3" } new_table_name: "default.Table_ec26e19fed954218b10c3971f6f00981" modify_external_catalogs: true
I20260810 19:48:19.401769 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e497f222f0fe4a5f9358a38adc2a381f" } new_table_name: "default.Table_5c9c7ec9984c4359893b2949caa1ac34" modify_external_catalogs: true
I20260810 19:48:19.403390 9408 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_74c5066c29584dfca364436dd02a84b4" } new_table_name: "default.Table_f87b53dd81a74f15aa157c22f15e7256" modify_external_catalogs: true
I20260810 19:48:19.404636 9663 tablet_service.cc:1511] Processing CreateTablet for tablet 3f59a69d726847aca111527aeaadfa9c (DEFAULT_TABLE table=default.Table_40317d27e3de4c7ebbe4a80239f78899 [id=4e38b3a52c3549889893d804ab0dfb89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.405031 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 6ad0b9c828d240a5ad73eb0b0d749c55 (DEFAULT_TABLE table=default.Table_d4b2c9fd4f414031b98f4fe3c8d0ff5e [id=83c50e66b85f4719a00db52c2c643b6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.404636 9666 tablet_service.cc:1511] Processing CreateTablet for tablet 76889c1b6376415b88c18b06ca54bb2a (DEFAULT_TABLE table=default.Table_04e7864863604a64b3c681bc20c4be28 [id=2730539c308440c796d1166b43f83bca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.405135 9663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f59a69d726847aca111527aeaadfa9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.405741 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ad0b9c828d240a5ad73eb0b0d749c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.405957 9666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76889c1b6376415b88c18b06ca54bb2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.218230 12266 rpcz_store.cc:276] 0810 19:48:17.047803 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.047872 (+ 69us) service_pool.cc:224] Handling call
0810 19:48:18.857607 (+1809735us) ts_tablet_manager.cc:1151] Deleting tablet e87fd882e6b6413480a0cb06aee74722
0810 19:48:18.857620 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.044665 (+187045us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:19.216504 (+171839us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:19.218091 (+ 1587us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1809482}
I20260810 19:48:19.410614 10375 ts_tablet_manager.cc:1929] T 87bbcc651d034e2a826478b805792e48 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:19.410764 10375 log.cc:1199] T 87bbcc651d034e2a826478b805792e48 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/87bbcc651d034e2a826478b805792e48
I20260810 19:48:19.411088 10375 ts_tablet_manager.cc:1950] T 87bbcc651d034e2a826478b805792e48 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:19.411880 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_61f710413b444b4296dcab37e7e4152d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:19.412513 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61f710413b444b4296dcab37e7e4152d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:19.417892 9142 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.8.235.194:35105, user_credentials={real_user=slave}} blocked reactor thread for 121093us
I20260810 19:48:19.419315 9887 tablet_service.cc:1511] Processing CreateTablet for tablet cdcf53ba85414193add40f92d5c75209 (DEFAULT_TABLE table=default.Table_8504e02662614f29a684e21a52f8f17b [id=c5e7a58d753c469e8da78e2654c4e834]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:19.428825 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ba6002f2cfa463882b793f8f5cb5f41 consensus state has no leader
W20260810 19:48:19.431274 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fddb0b1ffc6d47f49a74b8c522eb7d1e consensus state has no leader
W20260810 19:48:19.432194 9408 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 692d42b657b74accbd1860016ab37e81 consensus state has no leader
W20260810 19:48:19.433529 10068 leader_election.cc:343] T 985440898cc04a98877c15a5122a7dd3 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 985440898cc04a98877c15a5122a7dd3
I20260810 19:48:19.433672 10068 leader_election.cc:304] T 985440898cc04a98877c15a5122a7dd3 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:19.434106 13320 raft_consensus.cc:2749] T 985440898cc04a98877c15a5122a7dd3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:19.435374 10370 tablet_bootstrap.cc:492] T 7459e64bd48449d2a8d4ff835b215d46 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:19.436568 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 830dcb9fb1eb40c392a960e8943e7a5e (DEFAULT_TABLE table=default.Table_c8883dc352884ba18ad8c63608b96108 [id=53c8abf9b66b4b3faec26ddc749aef5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.437394 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 830dcb9fb1eb40c392a960e8943e7a5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.440332 10370 tablet_bootstrap.cc:654] T 7459e64bd48449d2a8d4ff835b215d46 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:19.445714 9400 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 864b67b855cc49d0a2f4da6a914f7a41 (table default.Table_f9b40856ae7f42a79d8968c7625bb524 [id=678fe2a6dadb40b09bac8fa1bd5f20fb], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 864b67b855cc49d0a2f4da6a914f7a41 consensus state has no leader
I20260810 19:48:19.446449 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 2768f98df42541ad950d18ad6d465a4a (DEFAULT_TABLE table=default.Table_12449afa32674c328023f1d830b9a305 [id=3b541c69a49b43d0ada9dc91178cebe4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.447007 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2768f98df42541ad950d18ad6d465a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.450237 9408 master_service.cc:960] ReplaceTablet: received request to replace tablet 4abd3c95aa394e1cad066d49d22b5764 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:19.454128 9668 tablet_service.cc:1511] Processing CreateTablet for tablet e5f10cfb8cd6409085ac0ffbdb6eb368 (DEFAULT_TABLE table=default.Table_1a5b07808c9a4b3f92a32046e95b6640 [id=01e52513ceee4b44a76074fe0fc50eca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.454731 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f10cfb8cd6409085ac0ffbdb6eb368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.468679 9655 tablet_service.cc:1511] Processing CreateTablet for tablet 6b664a3ee6a842a6bfe25450e7237b5f (DEFAULT_TABLE table=default.Table_57fd8fee4e6243eea99866d63c8cf478 [id=f45cdc1719d243c898ad00a5a2300171]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.469115 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1277) took 2163 ms. Trace:
I20260810 19:48:19.469233 12266 rpcz_store.cc:276] 0810 19:48:17.305405 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.306554 (+ 1149us) service_pool.cc:224] Handling call
0810 19:48:19.453692 (+2147138us) ts_tablet_manager.cc:1151] Deleting tablet 25da36714b1d4e89a2c4af713331f4ec
0810 19:48:19.453704 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.469081 (+ 15377us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2146801}
I20260810 19:48:19.469573 12266 tablet_replica.cc:333] T 6f4b5c6d5bd14c59b3cd3f8ee00a3301 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:19.469789 12266 raft_consensus.cc:2243] T 6f4b5c6d5bd14c59b3cd3f8ee00a3301 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:19.469971 12266 raft_consensus.cc:2272] T 6f4b5c6d5bd14c59b3cd3f8ee00a3301 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:19.471060 12266 ts_tablet_manager.cc:1916] T 6f4b5c6d5bd14c59b3cd3f8ee00a3301 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:19.472751 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 4cb34219defa45eebe740497781bc3fd (DEFAULT_TABLE table=default.Table_339557aab54447d284c9c637ae38b8ba [id=36d83c564f5646f69e4e8d113ab27852]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.475119 9413 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 676004738985441985278313d6064530 (table default.Table_2d7f246476ac4544a3fa089ec3c52657 [id=c681008d2b5f43a9b7b6ed2d72653b1b]). Expected version 1 got 0
I20260810 19:48:19.477210 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet 5cb4f4e17a16468597f154083a5c3e6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:19.477437 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet 31526aa9c74e45e585e280f88f73cfa9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:19.477579 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a7079614cda418583af74ae11a4d374 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:19.477702 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet 89191af180b542ce99bf0a798a945594 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:19.477813 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet 229dd737ee8547a89445593cc117fbc2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:01 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:19.477934 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet 92c1f13f235a4ba696bd794af135bcba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:19.478070 9688 tablet_service.cc:1558] Processing DeleteTablet for tablet 841f58b4e8f7465eaa7fa08629e0bc2a with delete_type TABLET_DATA_DELETED (replaced by tablet 1a615a32f94949179de8e8ee8a444576) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:19.479504 9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b664a3ee6a842a6bfe25450e7237b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.481513 9413 catalog_manager.cc:5811] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797) does not have the latest schema for tablet 7d939e3df62a45d9a964d4df01be4bfb (table default.Table_65f4c2fb3d1c49ae9cdfc041e51bd182 [id=2292ed1c178a4d458f52885e45c76d41]). Expected version 2 got 0
I20260810 19:48:19.427325 9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cb4f4e17a16468597f154083a5c3e6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.430454 10377 ts_tablet_manager.cc:1950] T 263a5695e7754b44a64edbda27b42135 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:19.451323 9894 tablet_service.cc:1558] Processing DeleteTablet for tablet 48eee4ce10114021855075812e356652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:19.472335 9890 tablet_service.cc:1511] Processing CreateTablet for tablet 864b67b855cc49d0a2f4da6a914f7a41 (DEFAULT_TABLE table=default.Table_828aa8f5237d45a984bfc770cd9e5ef9 [id=678fe2a6dadb40b09bac8fa1bd5f20fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.490298 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1313) took 2064 ms. Trace:
I20260810 19:48:19.472946 9911 tablet_service.cc:1511] Processing CreateTablet for tablet d62c36ce5281417b948f2a52c742c9be (DEFAULT_TABLE table=default.Table_b1d68dd07fe64856b914b26331c893b6 [id=dde3534dda4240d096a71674bb93378a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.490427 10377 rpcz_store.cc:276] 0810 19:48:17.425502 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.428445 (+ 2943us) service_pool.cc:224] Handling call
0810 19:48:19.019043 (+1590598us) ts_tablet_manager.cc:1151] Deleting tablet 263a5695e7754b44a64edbda27b42135
0810 19:48:19.019058 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.093363 (+ 74305us) spinlock_profiling.cc:243] Waited 73.3 ms on lock 0x617000123cf0. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd472f018bf 00007fd472fb240c 00007fd473022863 00007fd4743a9023 00007fd476f6ec67 00007fd476fa1d34 00007fd476f82750 00007fd476f824dd 0000000000aaf86c 00007fd466f6784f
0810 19:48:19.141231 (+ 47868us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:19.345988 (+204757us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:19.490272 (+144284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168662784,"tablet-delete.queue_time_us":1589967}
I20260810 19:48:19.473428 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 5acfb3c4e8054dfeac033fa88ce6dc18 (DEFAULT_TABLE table=default.Table_7f1237b0daef46828ceb12f434bd9beb [id=60211fc1c98747838e009af38de90aee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.490794 9894 tablet_service.cc:1511] Processing CreateTablet for tablet 87454e85629a4a9aaf1be15466fc785a (DEFAULT_TABLE table=default.Table_ef8b5c305a774a6cb5210e29488e831a [id=dac2ef23e5304c8ba575ae9bc7152ba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.490962 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1312) took 2078 ms. Trace:
I20260810 19:48:19.491053 10377 rpcz_store.cc:276] 0810 19:48:17.412016 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.429099 (+ 17083us) service_pool.cc:224] Handling call
0810 19:48:19.490814 (+2061715us) ts_tablet_manager.cc:1151] Deleting tablet e341b104f53c4b6bb87ca3274845e58f
0810 19:48:19.490825 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.490941 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2061444}
I20260810 19:48:19.491394 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1311) took 2082 ms. Trace:
I20260810 19:48:19.491498 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d62c36ce5281417b948f2a52c742c9be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.491801 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5acfb3c4e8054dfeac033fa88ce6dc18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.492192 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 864b67b855cc49d0a2f4da6a914f7a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.493218 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet e87fd882e6b6413480a0cb06aee74722 (table default.Table_f90f1a0c22fa4781812518f44c9d7b17 [id=d12cb82567fd409988672b04a2e05a5b]) successfully deleted
I20260810 19:48:19.496948 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d1a3f04e8c4819b2ec8367007576c6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:19.500228 9400 consensus_peers.cc:597] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a -> Peer f52c40e347e24ab4b3129e7064f4a43e (127.8.235.253:37397): Couldn't send request to peer f52c40e347e24ab4b3129e7064f4a43e. Status: Network error: Client connection negotiation failed: client connection to 127.8.235.253:37397: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260810 19:48:19.502007 9880 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:38260 (request call id 212) took 1659 ms. Trace:
I20260810 19:48:19.502121 9880 rpcz_store.cc:276] 0810 19:48:17.842542 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.842613 (+ 71us) service_pool.cc:224] Handling call
0810 19:48:18.642743 (+800130us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x6160001a4a54. stack: 00007fd466f21326 00007fd466f210e0 00007fd465f4b34d 00000000009a5774 00000000009a573d 00000000009a510a 00007fd472ff1860 00007fd476ee009f 00007fd4712b1bd6 00007fd4712b1905 00007fd46e06461e 00007fd46e0634fe 00007fd46e069738 00007fd46e06a09f 00007fd46e069ec8 0000000000aaf86c
0810 19:48:19.501959 (+859216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328069504}
I20260810 19:48:19.502454 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b1baeb4170e436fa5cdcaa5ae7f47f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.506462 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b61fb81c94594a71a3f9dcfef413b52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.507017 13159 raft_consensus.cc:493] T 4579a71f8c8149798eb5f136135e5efe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:19.507182 13159 raft_consensus.cc:515] T 4579a71f8c8149798eb5f136135e5efe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.507867 13159 leader_election.cc:290] T 4579a71f8c8149798eb5f136135e5efe P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:19.508654 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87454e85629a4a9aaf1be15466fc785a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.510605 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_d2b9ae8b207e4ebb999e42e0d790b8ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:19.511270 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2b9ae8b207e4ebb999e42e0d790b8ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:19.513592 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8a47860f929d46cb8ddfa5e32149fa6d" } modify_external_catalogs: true
I20260810 19:48:19.513790 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_8a47860f929d46cb8ddfa5e32149fa6d" } modify_external_catalogs: true
I20260810 19:48:19.514540 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4579a71f8c8149798eb5f136135e5efe" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:19.515210 9611 leader_election.cc:343] T 4579a71f8c8149798eb5f136135e5efe P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:19.515376 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_c28b54050bc544a7ab71c810ccd4309c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:19.515949 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c28b54050bc544a7ab71c810ccd4309c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:19.516016 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b059137abb0e458bbadca41a2f2e8b50" } modify_external_catalogs: true
I20260810 19:48:19.516173 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b059137abb0e458bbadca41a2f2e8b50" } modify_external_catalogs: true
I20260810 19:48:19.517226 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ef8b5c305a774a6cb5210e29488e831a" } modify_external_catalogs: true
I20260810 19:48:19.517378 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ef8b5c305a774a6cb5210e29488e831a" } modify_external_catalogs: true
I20260810 19:48:19.518112 9911 tablet_service.cc:1511] Processing CreateTablet for tablet 16b492b0109942c7b5ede1818fc36a88 (DEFAULT_TABLE table=default.Table_42dc6ea5ce034e2b871968591ebb3c86 [id=3fbf8eeacc79439dbb11ee3fd2e68a89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.518581 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16b492b0109942c7b5ede1818fc36a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.519008 9412 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_46194b48775d4bafac9cbce8b13a6b48" } new_table_name: "default.Table_1545882c7e7a4fa1bd118a7123c0bf38" modify_external_catalogs: true
I20260810 19:48:19.520352 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ac52dad261e647a89f5175021e3ac8e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:19.491459 10377 rpcz_store.cc:276] 0810 19:48:17.408668 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.436250 (+ 27582us) service_pool.cc:224] Handling call
0810 19:48:19.491287 (+2055037us) ts_tablet_manager.cc:1151] Deleting tablet 6f4b5c6d5bd14c59b3cd3f8ee00a3301
0810 19:48:19.491296 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.491379 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2054780}
I20260810 19:48:19.520829 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ecfd2b6f417644beb5f796aa15a3fa13" } modify_external_catalogs: true
I20260810 19:48:19.520968 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1310) took 2112 ms. Trace:
I20260810 19:48:19.521013 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ecfd2b6f417644beb5f796aa15a3fa13" } modify_external_catalogs: true
I20260810 19:48:19.521047 10377 rpcz_store.cc:276] 0810 19:48:17.408541 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.436557 (+ 28016us) service_pool.cc:224] Handling call
0810 19:48:19.520814 (+2084257us) ts_tablet_manager.cc:1151] Deleting tablet 47bbe10c2ac0465caa86125babf12277
0810 19:48:19.520827 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.520946 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2084058}
I20260810 19:48:19.521337 10377 tablet_replica.cc:333] T b9b567b3338845e4a37cff2a955056ae P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:19.521513 10377 raft_consensus.cc:2243] T b9b567b3338845e4a37cff2a955056ae P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:19.521688 10377 raft_consensus.cc:2272] T b9b567b3338845e4a37cff2a955056ae P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:19.522238 10377 ts_tablet_manager.cc:1916] T b9b567b3338845e4a37cff2a955056ae P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:19.520849 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac52dad261e647a89f5175021e3ac8e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:19.524273 9895 tablet_service.cc:1511] Processing CreateTablet for tablet dbaf58354169429e85631af722f93612 (DEFAULT_TABLE table=default.Table_61622d0039ff4e02bd197850b26ed5dc [id=a12926000d6e4b3e90eb7a0daa9080ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.524336 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d1ef74ea96924073acb57beb996e40fd" } new_table_name: "default.Table_621cc1ba8a064c69afda67858fd058ca" modify_external_catalogs: true
I20260810 19:48:19.524797 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbaf58354169429e85631af722f93612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.528524 9908 tablet_service.cc:1511] Processing CreateTablet for tablet f294f7fce7ad4cca98423e9f78044b8e (DEFAULT_TABLE table=default.Table_837db8eddbb8449eb276b9a74d12b160 [id=6307c5c66bdb4a3f9eaf6ba8cbdb7945]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:19.528935 9611 consensus_peers.cc:597] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:19.529006 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f294f7fce7ad4cca98423e9f78044b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.529428 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 692d42b657b74accbd1860016ab37e81 (DEFAULT_TABLE table=default.Table_74c5066c29584dfca364436dd02a84b4 [id=2e7374c8af5246ce9ebc62b46baa8cd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.532177 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 692d42b657b74accbd1860016ab37e81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.521523 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 393a00ca58a04af1bec7eb8be83dfba2 (DEFAULT_TABLE table=default.Table_34d55298fe734e128bf7cc506c956a94 [id=6834237a1f324a40b1bcf7ef129f4e65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.534648 9890 tablet_service.cc:1511] Processing CreateTablet for tablet 15f123b000fe4cd2aa7ae2c8fb73aeb1 (DEFAULT_TABLE table=default.Table_bac4df0a4c004be49f2e39e3c5805bf0 [id=57db12ac55694e528471ec28748dda89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.534981 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393a00ca58a04af1bec7eb8be83dfba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.536437 9885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30edf2b56e80413ab9a02f0caa1480c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.538441 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a721195640eb4368a7cbcc5df45ed086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.542448 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e86994d7adc4662a83614ecb13a26c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.543638 9416 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e0cbf5c3255a4df480038df674f812b6" } modify_external_catalogs: true
I20260810 19:48:19.543881 9416 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e0cbf5c3255a4df480038df674f812b6" } modify_external_catalogs: true
I20260810 19:48:19.546461 9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0efd4331e014fde9fecf7592c86c0ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.550467 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba7a25592a484fcab5d3ac178b08ed55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.554484 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddeb69be78ed440bb76bddb8e16acbdf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:19.556780 9397 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 63564.6us
I20260810 19:48:19.560312 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa91baf608d46a495847dc4cfc8bd49. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:19.560317 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 25da36714b1d4e89a2c4af713331f4ec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25da36714b1d4e89a2c4af713331f4ec already in progress: creating tablet
I20260810 19:48:19.566512 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3588a8f738e49a2be1f57a6a6bcb0e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.570508 9890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f123b000fe4cd2aa7ae2c8fb73aeb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.574750 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d48083fb0e7247ecbb0432896bbf24a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.578450 9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46caf44a52cc40b18a08cda148534e49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.583300 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4579a71f8c8149798eb5f136135e5efe" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:19.583879 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c5a5a15a3f40e59daefe2bc750a802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.590502 9407 master_service.cc:960] ReplaceTablet: received request to replace tablet 27c75f3340e24fe1a10de5bd6bcdfb2f from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:19.591066 9887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdcf53ba85414193add40f92d5c75209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.591638 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cb34219defa45eebe740497781bc3fd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:19.592185 10067 consensus_peers.cc:597] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260810 19:48:19.592628 9611 leader_election.cc:343] T 4579a71f8c8149798eb5f136135e5efe P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:19.592770 9611 leader_election.cc:304] T 4579a71f8c8149798eb5f136135e5efe P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:19.598778 9665 tablet_service.cc:1511] Processing CreateTablet for tablet 030c3d9288814465b1eaa79f6b8b2060 (DEFAULT_TABLE table=default.Table_4df39177675e414d96b2478ffcc780f3 [id=51b05727ca444ecf83b795e56fa09402]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.599519 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 030c3d9288814465b1eaa79f6b8b2060. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:19.604175 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 25da36714b1d4e89a2c4af713331f4ec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25da36714b1d4e89a2c4af713331f4ec already in progress: creating tablet
I20260810 19:48:19.605173 9660 tablet_service.cc:1511] Processing CreateTablet for tablet bd2a5af15c95429dba3960e5530bb9a7 (DEFAULT_TABLE table=default.Table_3e05663bfac3409cbdaf7019a07ca034 [id=b752b01372ea45f4af2b66d6a73eb4a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.605293 10366 tablet_bootstrap.cc:492] T b3754889e4574fc3a936ac31cc6f496a P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:19.605463 10366 ts_tablet_manager.cc:1403] T b3754889e4574fc3a936ac31cc6f496a P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.352s user 0.015s sys 0.011s
I20260810 19:48:19.605623 9660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd2a5af15c95429dba3960e5530bb9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.606290 10366 raft_consensus.cc:359] T b3754889e4574fc3a936ac31cc6f496a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.606552 10366 raft_consensus.cc:385] T b3754889e4574fc3a936ac31cc6f496a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:19.606637 10366 raft_consensus.cc:740] T b3754889e4574fc3a936ac31cc6f496a P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:19.606802 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 03b9d47dabeb4c899140b95b48d0737f (DEFAULT_TABLE table=default.Table_281135cc68d747deb6a696d48867a10d [id=f56eba6a72d14b8ca4e7171c11e63285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.606870 10366 consensus_queue.cc:260] T b3754889e4574fc3a936ac31cc6f496a P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.607204 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03b9d47dabeb4c899140b95b48d0737f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.607681 10366 ts_tablet_manager.cc:1434] T b3754889e4574fc3a936ac31cc6f496a P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 19:48:19.608440 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 2768f98df42541ad950d18ad6d465a4a (DEFAULT_TABLE table=default.Table_12449afa32674c328023f1d830b9a305 [id=3b541c69a49b43d0ada9dc91178cebe4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.608880 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2768f98df42541ad950d18ad6d465a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.608834 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 3f59a69d726847aca111527aeaadfa9c (DEFAULT_TABLE table=default.Table_40317d27e3de4c7ebbe4a80239f78899 [id=4e38b3a52c3549889893d804ab0dfb89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.609157 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f59a69d726847aca111527aeaadfa9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.610598 10145 tablet_service.cc:1511] Processing CreateTablet for tablet 76889c1b6376415b88c18b06ca54bb2a (DEFAULT_TABLE table=default.Table_04e7864863604a64b3c681bc20c4be28 [id=2730539c308440c796d1166b43f83bca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.610641 9663 tablet_service.cc:1511] Processing CreateTablet for tablet 5c47462bbf864b27a0b5188fce01ac29 (DEFAULT_TABLE table=default.Table_28e5e84b58a44f539fea3e4847ba0dd0 [id=b584031eaa82476387da627d42afe93e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.610976 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76889c1b6376415b88c18b06ca54bb2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.611014 9663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c47462bbf864b27a0b5188fce01ac29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.612112 13357 consensus_queue.cc:1048] T 83b19479978c46bf8a425ccf1225ef45 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:19.613438 9657 tablet_service.cc:1511] Processing CreateTablet for tablet 7d63be70bd9544a2888ec954b570b547 (DEFAULT_TABLE table=default.Table_ac26bc30d7be42e49391fe1953de2e4d [id=d77bcd60466544529c9b3c1bb025ff20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.613839 9657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d63be70bd9544a2888ec954b570b547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.608505 10136 tablet_service.cc:1511] Processing CreateTablet for tablet c219f719097c43b69a980b7c564c1432 (DEFAULT_TABLE table=default.Table_0facd7b775174e8ab5239ab75b8f0a01 [id=0469d99904714f93beeb32aa5339b624]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.614580 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c219f719097c43b69a980b7c564c1432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.593325 13159 raft_consensus.cc:2749] T 4579a71f8c8149798eb5f136135e5efe P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:19.620491 9660 tablet_service.cc:1511] Processing CreateTablet for tablet 8e02508a16f048bc9944aa12a7502651 (DEFAULT_TABLE table=default.Table_9e545c4706b84b9c96b6d8853d9c2f6c [id=3b7f0d37570142308cd238db9835ab0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.622136 9688 tablet_service.cc:1511] Processing CreateTablet for tablet aadae72a4677444ab8b6661e2e5c3972 (DEFAULT_TABLE table=default.Table_bdc8f5454bb34b05a6289f255d7e719a [id=4483941a91b541f5958c40ddfd98c973]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.623548 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aadae72a4677444ab8b6661e2e5c3972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.626464 9660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e02508a16f048bc9944aa12a7502651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.628890 9407 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 7d939e3df62a45d9a964d4df01be4bfb (table default.Table_65f4c2fb3d1c49ae9cdfc041e51bd182 [id=2292ed1c178a4d458f52885e45c76d41]). Expected version 2 got 0
I20260810 19:48:19.641376 10366 tablet_bootstrap.cc:492] T b59942eba1014659b6f601e74d53d880 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:19.646209 10375 tablet_replica.cc:333] T 8d93821ff46a4096a8ebbac83faabed7 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:19.646719 10375 raft_consensus.cc:2243] T 8d93821ff46a4096a8ebbac83faabed7 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:19.646924 10375 raft_consensus.cc:2272] T 8d93821ff46a4096a8ebbac83faabed7 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:19.647491 10375 ts_tablet_manager.cc:1916] T 8d93821ff46a4096a8ebbac83faabed7 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:19.648947 10366 tablet_bootstrap.cc:654] T b59942eba1014659b6f601e74d53d880 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:19.652338 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d939e3df62a45d9a964d4df01be4bfb" candidate_uuid: "6986ed920dcb4af29a5eeeda6f671691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:19.655293 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 748b792882eb45aebedc63a5348257d4
I20260810 19:48:19.646782 10370 tablet_bootstrap.cc:492] T 7459e64bd48449d2a8d4ff835b215d46 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:19.656515 10370 ts_tablet_manager.cc:1403] T 7459e64bd48449d2a8d4ff835b215d46 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.221s user 0.002s sys 0.002s
I20260810 19:48:19.656544 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 87454e85629a4a9aaf1be15466fc785a
W20260810 19:48:19.657196 9412 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 84b7657b60d34da2b136d36c3abbb786 consensus state has no leader
W20260810 19:48:19.659060 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 89793065d3eb48ecab1340e7621a40c6 consensus state has no leader
I20260810 19:48:19.659533 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 71cebde162ad406b88f12fc1a313affe
I20260810 19:48:19.661666 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 63b649cbc1d141d8bb438105b8e8537c
I20260810 19:48:19.662523 9416 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet e56d9c164d2b47abb004d13b7f2488d9
I20260810 19:48:19.664546 10370 raft_consensus.cc:359] T 7459e64bd48449d2a8d4ff835b215d46 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.664763 10370 raft_consensus.cc:385] T 7459e64bd48449d2a8d4ff835b215d46 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:19.664819 10370 raft_consensus.cc:740] T 7459e64bd48449d2a8d4ff835b215d46 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:19.665045 10370 consensus_queue.cc:260] T 7459e64bd48449d2a8d4ff835b215d46 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.665620 10370 ts_tablet_manager.cc:1434] T 7459e64bd48449d2a8d4ff835b215d46 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.009s user 0.000s sys 0.000s
I20260810 19:48:19.668367 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ba73b85dc03a4ffcaee539624e34be9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:19.669092 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba73b85dc03a4ffcaee539624e34be9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:19.670388 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_350e803d66de4035a7263606a811cb39" } new_table_name: "default.Table_6e186ae71ceb4a6999e9142f80dddc1e" modify_external_catalogs: true
I20260810 19:48:19.672590 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_61622d0039ff4e02bd197850b26ed5dc" } new_table_name: "default.Table_c38ed8b5e8114106a05e0296c314b424" modify_external_catalogs: true
I20260810 19:48:19.673941 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a906250ffbb040219e0744d511ba3abf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:19.674496 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a906250ffbb040219e0744d511ba3abf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:19.674914 10370 tablet_bootstrap.cc:492] T 4bc41ad892a247848f5d2c1a0d3333ef P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:19.676275 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_d6d3fe7d27ef4bbdab881b19b509c129"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:19.676822 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6d3fe7d27ef4bbdab881b19b509c129 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:19.677282 10370 tablet_bootstrap.cc:654] T 4bc41ad892a247848f5d2c1a0d3333ef P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:19.680883 9420 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ef5283e9d78844209d07812da74d0fe8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:19.681401 9420 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef5283e9d78844209d07812da74d0fe8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:19.681800 12266 ts_tablet_manager.cc:1929] T 6f4b5c6d5bd14c59b3cd3f8ee00a3301 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:19.681933 12266 log.cc:1199] T 6f4b5c6d5bd14c59b3cd3f8ee00a3301 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/6f4b5c6d5bd14c59b3cd3f8ee00a3301
I20260810 19:48:19.682726 9418 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7c4a15fb9a454c01bb9fa99dd4f138c4" } new_table_name: "default.Table_07319959997f4367bf7aaf0dc63b6dea" modify_external_catalogs: true
I20260810 19:48:19.682801 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_e0abca0235104c63b0db24742dc4402f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:19.683279 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0abca0235104c63b0db24742dc4402f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:19.683519 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_7cda8233b4eb4ea5a51eadb2b6954340"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:19.683954 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7cda8233b4eb4ea5a51eadb2b6954340 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:19.688613 13159 raft_consensus.cc:493] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:19.688761 13159 raft_consensus.cc:515] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.689229 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet 71cebde162ad406b88f12fc1a313affe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:19.689395 13159 leader_election.cc:290] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:19.690207 9664 tablet_service.cc:1558] Processing DeleteTablet for tablet 63b649cbc1d141d8bb438105b8e8537c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:19.691864 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676004738985441985278313d6064530" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:19.692085 10151 raft_consensus.cc:2468] T 676004738985441985278313d6064530 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 0.
I20260810 19:48:19.693698 10375 ts_tablet_manager.cc:1929] T 8d93821ff46a4096a8ebbac83faabed7 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:19.693827 10375 log.cc:1199] T 8d93821ff46a4096a8ebbac83faabed7 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/8d93821ff46a4096a8ebbac83faabed7
I20260810 19:48:19.694109 10375 ts_tablet_manager.cc:1950] T 8d93821ff46a4096a8ebbac83faabed7 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:19.694205 9611 leader_election.cc:304] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:19.694684 13159 raft_consensus.cc:2804] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 19:48:19.694761 13159 raft_consensus.cc:493] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 19:48:19.694818 13159 raft_consensus.cc:3060] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:19.695079 10375 tablet_replica.cc:333] T 2d72c72f90964f34bbc2232118dc5172 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:19.695263 10375 raft_consensus.cc:2243] T 2d72c72f90964f34bbc2232118dc5172 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:19.695398 10375 raft_consensus.cc:2272] T 2d72c72f90964f34bbc2232118dc5172 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:19.695924 10375 ts_tablet_manager.cc:1916] T 2d72c72f90964f34bbc2232118dc5172 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:19.700251 13159 raft_consensus.cc:515] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.705039 13159 leader_election.cc:290] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Requested vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:19.705883 10370 tablet_bootstrap.cc:492] T 4bc41ad892a247848f5d2c1a0d3333ef P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:19.706048 10370 ts_tablet_manager.cc:1403] T 4bc41ad892a247848f5d2c1a0d3333ef P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.031s user 0.001s sys 0.001s
I20260810 19:48:19.706892 10370 raft_consensus.cc:359] T 4bc41ad892a247848f5d2c1a0d3333ef P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.707110 10370 raft_consensus.cc:385] T 4bc41ad892a247848f5d2c1a0d3333ef P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:19.707173 10370 raft_consensus.cc:740] T 4bc41ad892a247848f5d2c1a0d3333ef P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:19.707408 10370 consensus_queue.cc:260] T 4bc41ad892a247848f5d2c1a0d3333ef P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.708084 10370 ts_tablet_manager.cc:1434] T 4bc41ad892a247848f5d2c1a0d3333ef P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:19.708407 10370 tablet_bootstrap.cc:492] T 3da297aac2644fcabfcb21769576dca4 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:19.706961 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676004738985441985278313d6064530" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0"
I20260810 19:48:19.708740 10151 raft_consensus.cc:3060] T 676004738985441985278313d6064530 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:19.654138 10377 ts_tablet_manager.cc:1929] T b9b567b3338845e4a37cff2a955056ae P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:19.709641 10377 log.cc:1199] T b9b567b3338845e4a37cff2a955056ae P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/b9b567b3338845e4a37cff2a955056ae
I20260810 19:48:19.709973 10377 ts_tablet_manager.cc:1950] T b9b567b3338845e4a37cff2a955056ae P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:19.710373 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1318) took 2258 ms. Trace:
I20260810 19:48:19.710476 10377 rpcz_store.cc:276] 0810 19:48:17.451875 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.455135 (+ 3260us) service_pool.cc:224] Handling call
0810 19:48:19.521274 (+2066139us) ts_tablet_manager.cc:1151] Deleting tablet b9b567b3338845e4a37cff2a955056ae
0810 19:48:19.521296 (+ 22us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.525324 (+ 4028us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:19.654072 (+128748us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:19.710296 (+ 56224us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2065837}
I20260810 19:48:19.710924 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1317) took 2259 ms. Trace:
I20260810 19:48:19.711001 10377 rpcz_store.cc:276] 0810 19:48:17.451601 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.455486 (+ 3885us) service_pool.cc:224] Handling call
0810 19:48:19.710772 (+2255286us) ts_tablet_manager.cc:1151] Deleting tablet ed5ae28144b2488fb06e436920b3ca6a
0810 19:48:19.710783 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.710897 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2255042}
I20260810 19:48:19.711226 10118 tablet_service.cc:1511] Processing CreateTablet for tablet 6ad0b9c828d240a5ad73eb0b0d749c55 (DEFAULT_TABLE table=default.Table_d4b2c9fd4f414031b98f4fe3c8d0ff5e [id=83c50e66b85f4719a00db52c2c643b6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.711321 10377 tablet_replica.cc:333] T 99aa001db52149dd90ce86e7261f7424 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:19.711524 10377 raft_consensus.cc:2243] T 99aa001db52149dd90ce86e7261f7424 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:19.711643 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ad0b9c828d240a5ad73eb0b0d749c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.711684 10377 raft_consensus.cc:2272] T 99aa001db52149dd90ce86e7261f7424 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:19.711563 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_378d4036a30843c0b6735eef862601d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:19.712253 10377 ts_tablet_manager.cc:1916] T 99aa001db52149dd90ce86e7261f7424 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:19.712589 13357 consensus_queue.cc:1048] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:19.713838 9687 tablet_service.cc:1558] Processing DeleteTablet for tablet 87454e85629a4a9aaf1be15466fc785a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:19.683404 9830 consensus_peers.cc:597] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 -> Peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Couldn't send request to peer eadde59fd6504d679e47f03a60c64bb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b33aa8be266a434cba899da7514c47e9. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:19.714586 13418 raft_consensus.cc:493] T 841f58b4e8f7465eaa7fa08629e0bc2a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 19:48:19.714799 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_378d4036a30843c0b6735eef862601d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:19.714783 9830 leader_election.cc:304] T 7d939e3df62a45d9a964d4df01be4bfb P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:19.714726 13418 raft_consensus.cc:515] T 841f58b4e8f7465eaa7fa08629e0bc2a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.715420 13418 leader_election.cc:290] T 841f58b4e8f7465eaa7fa08629e0bc2a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:19.715531 13516 raft_consensus.cc:2749] T 7d939e3df62a45d9a964d4df01be4bfb P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:19.682281 12266 ts_tablet_manager.cc:1950] T 6f4b5c6d5bd14c59b3cd3f8ee00a3301 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:19.716485 9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841f58b4e8f7465eaa7fa08629e0bc2a" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:19.717048 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1282) took 2243 ms. Trace:
W20260810 19:48:19.717098 9611 leader_election.cc:343] T 841f58b4e8f7465eaa7fa08629e0bc2a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:19.717145 12266 rpcz_store.cc:276] 0810 19:48:17.473293 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.475888 (+ 2595us) service_pool.cc:224] Handling call
0810 19:48:19.469510 (+1993622us) ts_tablet_manager.cc:1151] Deleting tablet 6f4b5c6d5bd14c59b3cd3f8ee00a3301
0810 19:48:19.469523 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.615626 (+146103us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:19.681732 (+ 66106us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:19.717021 (+ 35289us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1993441}
I20260810 19:48:19.714721 9677 tablet_service.cc:1511] Processing CreateTablet for tablet b8adc9d13dc0478d895d67ad8e6ea454 (DEFAULT_TABLE table=default.Table_31e9eac84a064d309abb8b0573ed9958 [id=a159d1cc16ae4c518056f55400e98e74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.717619 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1283) took 2244 ms. Trace:
I20260810 19:48:19.717697 12266 rpcz_store.cc:276] 0810 19:48:17.473376 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.477506 (+ 4130us) service_pool.cc:224] Handling call
0810 19:48:19.717459 (+2239953us) ts_tablet_manager.cc:1151] Deleting tablet e341b104f53c4b6bb87ca3274845e58f
0810 19:48:19.717472 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.717599 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2239758}
I20260810 19:48:19.717844 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8adc9d13dc0478d895d67ad8e6ea454. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.718087 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1281) took 2244 ms. Trace:
I20260810 19:48:19.718179 12266 rpcz_store.cc:276] 0810 19:48:17.473170 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.483479 (+ 10309us) service_pool.cc:224] Handling call
0810 19:48:19.717946 (+2234467us) ts_tablet_manager.cc:1151] Deleting tablet 47bbe10c2ac0465caa86125babf12277
0810 19:48:19.717957 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.718071 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2234249}
I20260810 19:48:19.718519 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1287) took 2226 ms. Trace:
I20260810 19:48:19.718590 12266 rpcz_store.cc:276] 0810 19:48:17.492134 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.492213 (+ 79us) service_pool.cc:224] Handling call
0810 19:48:19.718418 (+2226205us) ts_tablet_manager.cc:1151] Deleting tablet ed5ae28144b2488fb06e436920b3ca6a
0810 19:48:19.718428 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.718505 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2225908}
I20260810 19:48:19.718842 12266 tablet_replica.cc:333] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:19.719069 12266 raft_consensus.cc:2243] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:19.719411 12266 pending_rounds.cc:70] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4: Trying to abort 1 pending ops.
I20260810 19:48:19.719472 12266 pending_rounds.cc:77] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317058758121222144 op_type: NO_OP noop_request { }
I20260810 19:48:19.719585 12266 raft_consensus.cc:2889] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 19:48:19.719683 12266 raft_consensus.cc:2272] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:19.720342 12266 ts_tablet_manager.cc:1916] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:19.728278 10367 tablet_bootstrap.cc:492] T b853bf6bbc7845bc9cfa6347687582e2 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:19.728442 10367 ts_tablet_manager.cc:1403] T b853bf6bbc7845bc9cfa6347687582e2 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.573s user 0.004s sys 0.000s
I20260810 19:48:19.729190 10367 raft_consensus.cc:359] T b853bf6bbc7845bc9cfa6347687582e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.729377 10367 raft_consensus.cc:385] T b853bf6bbc7845bc9cfa6347687582e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:19.729431 10367 raft_consensus.cc:740] T b853bf6bbc7845bc9cfa6347687582e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:19.690459 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676004738985441985278313d6064530" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:19.729653 10367 consensus_queue.cc:260] T b853bf6bbc7845bc9cfa6347687582e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.703929 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676004738985441985278313d6064530" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691"
I20260810 19:48:19.729894 9939 raft_consensus.cc:3060] T 676004738985441985278313d6064530 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:19.730180 10367 ts_tablet_manager.cc:1434] T b853bf6bbc7845bc9cfa6347687582e2 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 19:48:19.732864 9939 raft_consensus.cc:2468] T 676004738985441985278313d6064530 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:48:19.733430 9611 leader_election.cc:304] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4; no voters:
I20260810 19:48:19.733703 13159 raft_consensus.cc:2804] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 19:48:19.733976 13159 raft_consensus.cc:697] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 LEADER]: Becoming Leader. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Running, Role: LEADER
I20260810 19:48:19.734306 13159 consensus_queue.cc:237] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.733510 9945 raft_consensus.cc:2376] T 676004738985441985278313d6064530 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1. Re-sending same reply.
I20260810 19:48:19.744575 10151 raft_consensus.cc:2468] T 676004738985441985278313d6064530 P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd31b1bbb0340cbacfce652b4ad8da4 in term 1.
I20260810 19:48:19.745607 10124 tablet_service.cc:1511] Processing CreateTablet for tablet e5f10cfb8cd6409085ac0ffbdb6eb368 (DEFAULT_TABLE table=default.Table_1a5b07808c9a4b3f92a32046e95b6640 [id=01e52513ceee4b44a76074fe0fc50eca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.745869 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 6f4b5c6d5bd14c59b3cd3f8ee00a3301 (table default.Table_2050cbafb9a44f30b46f397b825f7231 [id=4bf40870a0554fb9b04a1f7cc8f87d85]) successfully deleted
I20260810 19:48:19.746100 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f10cfb8cd6409085ac0ffbdb6eb368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.746614 10116 tablet_service.cc:1511] Processing CreateTablet for tablet 4cb34219defa45eebe740497781bc3fd (DEFAULT_TABLE table=default.Table_339557aab54447d284c9c637ae38b8ba [id=36d83c564f5646f69e4e8d113ab27852]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.747011 10116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cb34219defa45eebe740497781bc3fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.747896 9665 tablet_service.cc:1558] Processing DeleteTablet for tablet e56d9c164d2b47abb004d13b7f2488d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:34544
W20260810 19:48:19.747957 10067 consensus_peers.cc:597] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:19.747946 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 6b664a3ee6a842a6bfe25450e7237b5f (DEFAULT_TABLE table=default.Table_57fd8fee4e6243eea99866d63c8cf478 [id=f45cdc1719d243c898ad00a5a2300171]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.748303 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b664a3ee6a842a6bfe25450e7237b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.748843 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 87bbcc651d034e2a826478b805792e48 (table default.Table_07cbcdfa939f47f0a8f10f834f5ce596 [id=51fc4051f8ac425e9b6b5f86acf32827]) successfully deleted
I20260810 19:48:19.749346 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 8d93821ff46a4096a8ebbac83faabed7 (table default.Table_422e53637be84964a1cd4bb082fec236 [id=79d6de9ae42e416fba0595834b38ce40]) successfully deleted
I20260810 19:48:19.749727 10144 tablet_service.cc:1511] Processing CreateTablet for tablet 830dcb9fb1eb40c392a960e8943e7a5e (DEFAULT_TABLE table=default.Table_c8883dc352884ba18ad8c63608b96108 [id=53c8abf9b66b4b3faec26ddc749aef5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.750197 10144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 830dcb9fb1eb40c392a960e8943e7a5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.751108 10151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841f58b4e8f7465eaa7fa08629e0bc2a" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:19.751587 9611 leader_election.cc:343] T 841f58b4e8f7465eaa7fa08629e0bc2a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:19.751725 9611 leader_election.cc:304] T 841f58b4e8f7465eaa7fa08629e0bc2a P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:19.752133 13418 raft_consensus.cc:2749] T 841f58b4e8f7465eaa7fa08629e0bc2a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:19.740113 10377 ts_tablet_manager.cc:1929] T 99aa001db52149dd90ce86e7261f7424 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:19.763335 10377 log.cc:1199] T 99aa001db52149dd90ce86e7261f7424 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/99aa001db52149dd90ce86e7261f7424
I20260810 19:48:19.763774 10377 ts_tablet_manager.cc:1950] T 99aa001db52149dd90ce86e7261f7424 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:19.764348 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet 5cb4f4e17a16468597f154083a5c3e6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:19.764565 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet 31526aa9c74e45e585e280f88f73cfa9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:19.764791 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a7079614cda418583af74ae11a4d374 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:19.764773 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1319) took 2312 ms. Trace:
I20260810 19:48:19.764858 10377 rpcz_store.cc:276] 0810 19:48:17.451997 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.455763 (+ 3766us) service_pool.cc:224] Handling call
0810 19:48:19.711270 (+2255507us) ts_tablet_manager.cc:1151] Deleting tablet 99aa001db52149dd90ce86e7261f7424
0810 19:48:19.711279 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.720157 (+ 8878us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:19.740033 (+ 19876us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:19.764746 (+ 24713us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2255376}
I20260810 19:48:19.765766 10119 tablet_service.cc:1558] Processing DeleteTablet for tablet 985440898cc04a98877c15a5122a7dd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:57 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:19.766204 10370 tablet_bootstrap.cc:654] T 3da297aac2644fcabfcb21769576dca4 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:19.766254 10120 tablet_service.cc:1558] Processing DeleteTablet for tablet b54feebc7c9841d89808054602be7913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:19.766215 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 030c3d9288814465b1eaa79f6b8b2060 (DEFAULT_TABLE table=default.Table_4df39177675e414d96b2478ffcc780f3 [id=51b05727ca444ecf83b795e56fa09402]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.766916 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 03b9d47dabeb4c899140b95b48d0737f (DEFAULT_TABLE table=default.Table_281135cc68d747deb6a696d48867a10d [id=f56eba6a72d14b8ca4e7171c11e63285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.767412 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 5c47462bbf864b27a0b5188fce01ac29 (DEFAULT_TABLE table=default.Table_28e5e84b58a44f539fea3e4847ba0dd0 [id=b584031eaa82476387da627d42afe93e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.768188 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 030c3d9288814465b1eaa79f6b8b2060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.768433 10122 tablet_service.cc:1558] Processing DeleteTablet for tablet 89191af180b542ce99bf0a798a945594 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:19.768615 10125 tablet_service.cc:1558] Processing DeleteTablet for tablet 92c1f13f235a4ba696bd794af135bcba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:19.770198 10375 ts_tablet_manager.cc:1929] T 2d72c72f90964f34bbc2232118dc5172 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:19.770330 10375 log.cc:1199] T 2d72c72f90964f34bbc2232118dc5172 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/2d72c72f90964f34bbc2232118dc5172
I20260810 19:48:19.770613 10375 ts_tablet_manager.cc:1950] T 2d72c72f90964f34bbc2232118dc5172 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:19.771073 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03b9d47dabeb4c899140b95b48d0737f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.772138 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c47462bbf864b27a0b5188fce01ac29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.773347 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet 63b649cbc1d141d8bb438105b8e8537c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:19.773566 10134 tablet_service.cc:1558] Processing DeleteTablet for tablet e56d9c164d2b47abb004d13b7f2488d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:19.773799 10142 tablet_service.cc:1511] Processing CreateTablet for tablet b8adc9d13dc0478d895d67ad8e6ea454 (DEFAULT_TABLE table=default.Table_31e9eac84a064d309abb8b0573ed9958 [id=a159d1cc16ae4c518056f55400e98e74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.774061 10140 tablet_service.cc:1558] Processing DeleteTablet for tablet 87454e85629a4a9aaf1be15466fc785a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:19.774179 10142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8adc9d13dc0478d895d67ad8e6ea454. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.774250 10139 tablet_service.cc:1558] Processing DeleteTablet for tablet 71cebde162ad406b88f12fc1a313affe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:19.774413 10127 tablet_service.cc:1558] Processing DeleteTablet for tablet 748b792882eb45aebedc63a5348257d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:41610
I20260810 19:48:19.774958 10120 tablet_service.cc:1511] Processing CreateTablet for tablet 8e02508a16f048bc9944aa12a7502651 (DEFAULT_TABLE table=default.Table_9e545c4706b84b9c96b6d8853d9c2f6c [id=3b7f0d37570142308cd238db9835ab0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.775306 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e02508a16f048bc9944aa12a7502651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.775601 10145 tablet_service.cc:1511] Processing CreateTablet for tablet bd2a5af15c95429dba3960e5530bb9a7 (DEFAULT_TABLE table=default.Table_3e05663bfac3409cbdaf7019a07ca034 [id=b752b01372ea45f4af2b66d6a73eb4a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.775955 10145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd2a5af15c95429dba3960e5530bb9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.776355 10122 tablet_service.cc:1511] Processing CreateTablet for tablet aadae72a4677444ab8b6661e2e5c3972 (DEFAULT_TABLE table=default.Table_bdc8f5454bb34b05a6289f255d7e719a [id=4483941a91b541f5958c40ddfd98c973]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.776669 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aadae72a4677444ab8b6661e2e5c3972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.777348 10125 tablet_service.cc:1511] Processing CreateTablet for tablet 7d63be70bd9544a2888ec954b570b547 (DEFAULT_TABLE table=default.Table_ac26bc30d7be42e49391fe1953de2e4d [id=d77bcd60466544529c9b3c1bb025ff20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.777648 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d63be70bd9544a2888ec954b570b547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.779752 10375 tablet_replica.cc:333] T 1bbd3fe2117c42058dc108b5dc18d560 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:19.788486 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 2d72c72f90964f34bbc2232118dc5172 (table default.Table_83e700e09b2a43c3b2133def7eb871bc [id=85104f90d64e4270a62cab5a7814a36d]) successfully deleted
I20260810 19:48:19.788183 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet 748b792882eb45aebedc63a5348257d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:19.789232 10375 raft_consensus.cc:2243] T 1bbd3fe2117c42058dc108b5dc18d560 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:19.789505 10375 raft_consensus.cc:2272] T 1bbd3fe2117c42058dc108b5dc18d560 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:19.790530 10375 ts_tablet_manager.cc:1916] T 1bbd3fe2117c42058dc108b5dc18d560 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:19.793424 10367 tablet_bootstrap.cc:492] T 73a2e6a512224caa892ac7541131349f P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:19.795044 10367 tablet_bootstrap.cc:654] T 73a2e6a512224caa892ac7541131349f P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:19.746124 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet e341b104f53c4b6bb87ca3274845e58f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e341b104f53c4b6bb87ca3274845e58f already in progress: creating tablet
W20260810 19:48:19.818819 9397 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 72698.3us
I20260810 19:48:19.824725 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1320) took 2351 ms. Trace:
I20260810 19:48:19.827767 12266 ts_tablet_manager.cc:1929] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:19.828266 12266 log.cc:1199] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/deeb390ae00646089e9f1d453ddb54a1
I20260810 19:48:19.828704 12266 ts_tablet_manager.cc:1950] T deeb390ae00646089e9f1d453ddb54a1 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:19.829695 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1289) took 2337 ms. Trace:
I20260810 19:48:19.829804 12266 rpcz_store.cc:276] 0810 19:48:17.492343 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.498461 (+ 6118us) service_pool.cc:224] Handling call
0810 19:48:19.718798 (+2220337us) ts_tablet_manager.cc:1151] Deleting tablet deeb390ae00646089e9f1d453ddb54a1
0810 19:48:19.718807 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.791162 (+ 72355us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:19.827674 (+ 36512us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:19.829664 (+ 1990us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2220085}
I20260810 19:48:19.830179 12266 tablet_replica.cc:333] T f5fa6060b9ef48cea6830cd9d19424ea P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
W20260810 19:48:19.831357 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 47bbe10c2ac0465caa86125babf12277 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47bbe10c2ac0465caa86125babf12277 already in progress: creating tablet
W20260810 19:48:19.836302 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet ed5ae28144b2488fb06e436920b3ca6a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed5ae28144b2488fb06e436920b3ca6a already in progress: creating tablet
I20260810 19:48:19.836609 10377 rpcz_store.cc:276] 0810 19:48:17.472912 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.487075 (+ 14163us) service_pool.cc:224] Handling call
0810 19:48:19.824531 (+2337456us) ts_tablet_manager.cc:1151] Deleting tablet deeb390ae00646089e9f1d453ddb54a1
0810 19:48:19.824549 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.824693 (+ 144us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2337093}
I20260810 19:48:19.838202 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1326) took 2118 ms. Trace:
I20260810 19:48:19.800122 10366 tablet_bootstrap.cc:492] T b59942eba1014659b6f601e74d53d880 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:19.830423 12266 raft_consensus.cc:2243] T f5fa6060b9ef48cea6830cd9d19424ea P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:19.842656 10366 ts_tablet_manager.cc:1403] T b59942eba1014659b6f601e74d53d880 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.201s user 0.002s sys 0.003s
I20260810 19:48:19.842696 12266 raft_consensus.cc:2272] T f5fa6060b9ef48cea6830cd9d19424ea P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:19.796512 9830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.195:43797, user_credentials={real_user=slave}} blocked reactor thread for 81183.1us
I20260810 19:48:19.845252 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 263a5695e7754b44a64edbda27b42135 (table default.Table_3b5fc2bb35a448e8bbe8bef5a535e9c2 [id=ef9ce56a9b874bfc92f88cae54ca0891]) successfully deleted
W20260810 19:48:19.845769 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet e341b104f53c4b6bb87ca3274845e58f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e341b104f53c4b6bb87ca3274845e58f already in progress: creating tablet
W20260810 19:48:19.846789 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 6f4b5c6d5bd14c59b3cd3f8ee00a3301 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f4b5c6d5bd14c59b3cd3f8ee00a3301 already in progress: creating tablet
W20260810 19:48:19.847198 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 47bbe10c2ac0465caa86125babf12277 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47bbe10c2ac0465caa86125babf12277 already in progress: creating tablet
I20260810 19:48:19.843605 10366 raft_consensus.cc:359] T b59942eba1014659b6f601e74d53d880 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.852811 10366 raft_consensus.cc:385] T b59942eba1014659b6f601e74d53d880 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:19.853071 12266 ts_tablet_manager.cc:1916] T f5fa6060b9ef48cea6830cd9d19424ea P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:19.853895 10366 raft_consensus.cc:740] T b59942eba1014659b6f601e74d53d880 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:19.855355 13531 tablet.cc:1724] T a2fe67e8bd014acaa202c022c193cdc6 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260810 19:48:19.859792 10068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.193:41413, user_credentials={real_user=slave}} blocked reactor thread for 57155.6us
I20260810 19:48:19.861131 10375 ts_tablet_manager.cc:1929] T 1bbd3fe2117c42058dc108b5dc18d560 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:19.861245 10375 log.cc:1199] T 1bbd3fe2117c42058dc108b5dc18d560 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/1bbd3fe2117c42058dc108b5dc18d560
I20260810 19:48:19.860991 10366 consensus_queue.cc:260] T b59942eba1014659b6f601e74d53d880 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.861554 10375 ts_tablet_manager.cc:1950] T 1bbd3fe2117c42058dc108b5dc18d560 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:19.862020 10366 ts_tablet_manager.cc:1434] T b59942eba1014659b6f601e74d53d880 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20260810 19:48:19.862638 9395 catalog_manager.cc:5050] TS eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): tablet 1bbd3fe2117c42058dc108b5dc18d560 (table default.Table_3fb4a80c47304a3e815594625c44c7a1 [id=0b09de8d5e854ef9a8ede352326b381e]) successfully deleted
I20260810 19:48:19.866981 9945 raft_consensus.cc:3060] T b59942eba1014659b6f601e74d53d880 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:19.869275 10370 tablet_bootstrap.cc:492] T 3da297aac2644fcabfcb21769576dca4 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:19.869448 10370 ts_tablet_manager.cc:1403] T 3da297aac2644fcabfcb21769576dca4 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.161s user 0.008s sys 0.002s
I20260810 19:48:19.870265 10370 raft_consensus.cc:359] T 3da297aac2644fcabfcb21769576dca4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.870479 10370 raft_consensus.cc:385] T 3da297aac2644fcabfcb21769576dca4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:19.870533 10370 raft_consensus.cc:740] T 3da297aac2644fcabfcb21769576dca4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:19.870735 10370 consensus_queue.cc:260] T 3da297aac2644fcabfcb21769576dca4 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.871294 10370 ts_tablet_manager.cc:1434] T 3da297aac2644fcabfcb21769576dca4 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 19:48:19.871603 10370 tablet_bootstrap.cc:492] T 3159795344ae492fb099fca0e52fcf20 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:19.876525 10370 tablet_bootstrap.cc:654] T 3159795344ae492fb099fca0e52fcf20 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:19.877480 10375 tablet_replica.cc:333] T 59a767c91abf45e79cebab582525ad2e P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:19.877697 10375 raft_consensus.cc:2243] T 59a767c91abf45e79cebab582525ad2e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:19.877882 10375 raft_consensus.cc:2272] T 59a767c91abf45e79cebab582525ad2e P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:19.877907 13309 consensus_queue.cc:1048] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:19.878541 10375 ts_tablet_manager.cc:1916] T 59a767c91abf45e79cebab582525ad2e P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:19.886523 13309 consensus_queue.cc:1048] T b59942eba1014659b6f601e74d53d880 P eadde59fd6504d679e47f03a60c64bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 19:48:19.842155 10377 rpcz_store.cc:276] 0810 19:48:17.719346 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.719594 (+ 248us) service_pool.cc:224] Handling call
0810 19:48:19.838029 (+2118435us) ts_tablet_manager.cc:1151] Deleting tablet 8569d63bbd8e4753b376ee6a5127fd3d
0810 19:48:19.838045 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.838176 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2118176}
I20260810 19:48:19.903061 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1327) took 2182 ms. Trace:
I20260810 19:48:19.909399 13522 raft_consensus.cc:493] T eb3e7d34b5314bc7a7c5ed53792728ca P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:19.911128 13522 raft_consensus.cc:515] T eb3e7d34b5314bc7a7c5ed53792728ca P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:19.912942 9397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.254:33891, user_credentials={real_user=slave}} blocked reactor thread for 71160.6us
I20260810 19:48:19.894337 12266 ts_tablet_manager.cc:1929] T f5fa6060b9ef48cea6830cd9d19424ea P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:19.915678 10367 tablet_bootstrap.cc:492] T 73a2e6a512224caa892ac7541131349f P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:19.928409 10367 ts_tablet_manager.cc:1403] T 73a2e6a512224caa892ac7541131349f P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.135s user 0.010s sys 0.023s
I20260810 19:48:19.910138 10377 rpcz_store.cc:276] 0810 19:48:17.720517 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.720616 (+ 99us) service_pool.cc:224] Handling call
0810 19:48:19.902880 (+2182264us) ts_tablet_manager.cc:1151] Deleting tablet f2d00c669285436bbafb4b657532f222
0810 19:48:19.902896 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.903032 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2182043}
I20260810 19:48:19.929256 10367 raft_consensus.cc:359] T 73a2e6a512224caa892ac7541131349f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.929453 10367 raft_consensus.cc:385] T 73a2e6a512224caa892ac7541131349f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:19.929509 10367 raft_consensus.cc:740] T 73a2e6a512224caa892ac7541131349f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:19.929733 10367 consensus_queue.cc:260] T 73a2e6a512224caa892ac7541131349f P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.930276 10367 ts_tablet_manager.cc:1434] T 73a2e6a512224caa892ac7541131349f P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:19.930822 10367 tablet_bootstrap.cc:492] T fdd82537177a4142bddd0544485b00c4 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:19.932512 10367 tablet_bootstrap.cc:654] T fdd82537177a4142bddd0544485b00c4 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:19.930907 9831 leader_election.cc:343] T eb3e7d34b5314bc7a7c5ed53792728ca P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: eb3e7d34b5314bc7a7c5ed53792728ca
I20260810 19:48:19.933147 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1329) took 2150 ms. Trace:
I20260810 19:48:19.928371 12266 log.cc:1199] T f5fa6060b9ef48cea6830cd9d19424ea P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/f5fa6060b9ef48cea6830cd9d19424ea
I20260810 19:48:19.933570 12266 ts_tablet_manager.cc:1950] T f5fa6060b9ef48cea6830cd9d19424ea P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:19.934432 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1294) took 2341 ms. Trace:
I20260810 19:48:19.934527 12266 rpcz_store.cc:276] 0810 19:48:17.592954 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.593040 (+ 86us) service_pool.cc:224] Handling call
0810 19:48:19.830123 (+2237083us) ts_tablet_manager.cc:1151] Deleting tablet f5fa6060b9ef48cea6830cd9d19424ea
0810 19:48:19.830135 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.856577 (+ 26442us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:19.894220 (+ 37643us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:19.934408 (+ 40188us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2236891}
I20260810 19:48:19.934967 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1295) took 2307 ms. Trace:
I20260810 19:48:19.935042 12266 rpcz_store.cc:276] 0810 19:48:17.627512 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.629293 (+ 1781us) service_pool.cc:224] Handling call
0810 19:48:19.934815 (+2305522us) ts_tablet_manager.cc:1151] Deleting tablet 8569d63bbd8e4753b376ee6a5127fd3d
0810 19:48:19.934825 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.934950 (+ 125us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2304825}
I20260810 19:48:19.935338 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1297) took 2254 ms. Trace:
I20260810 19:48:19.935395 12266 rpcz_store.cc:276] 0810 19:48:17.680613 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.680690 (+ 77us) service_pool.cc:224] Handling call
0810 19:48:19.935242 (+2254552us) ts_tablet_manager.cc:1151] Deleting tablet f2d00c669285436bbafb4b657532f222
0810 19:48:19.935250 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.935323 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2254344}
I20260810 19:48:19.935681 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1298) took 2203 ms. Trace:
I20260810 19:48:19.935750 12266 rpcz_store.cc:276] 0810 19:48:17.731928 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.733691 (+ 1763us) service_pool.cc:224] Handling call
0810 19:48:19.935594 (+2201903us) ts_tablet_manager.cc:1151] Deleting tablet ec11528c81d24cbc851a4c31cf9257a2
0810 19:48:19.935602 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.935668 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2201504}
I20260810 19:48:19.936043 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1300) took 2143 ms. Trace:
I20260810 19:48:19.936112 12266 rpcz_store.cc:276] 0810 19:48:17.792711 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.793048 (+ 337us) service_pool.cc:224] Handling call
0810 19:48:19.935953 (+2142905us) ts_tablet_manager.cc:1151] Deleting tablet 6b9baf2b3e644171b20e03b4c0704136
0810 19:48:19.935962 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.936030 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2142130}
I20260810 19:48:19.936344 12266 tablet_replica.cc:333] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:19.937641 12266 raft_consensus.cc:2243] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:19.937888 12266 raft_consensus.cc:2272] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:19.938530 12266 ts_tablet_manager.cc:1916] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:19.939082 10377 rpcz_store.cc:276] 0810 19:48:17.782985 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.784209 (+ 1224us) service_pool.cc:224] Handling call
0810 19:48:19.932980 (+2148771us) ts_tablet_manager.cc:1151] Deleting tablet ec11528c81d24cbc851a4c31cf9257a2
0810 19:48:19.932997 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.933123 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2148539}
I20260810 19:48:19.939643 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet f5fa6060b9ef48cea6830cd9d19424ea (table default.Table_9d569d756be84460b1b78812a13b95ad [id=14e993ddf3b646098d6d3a3e24d01b07]) successfully deleted
I20260810 19:48:19.933588 13522 leader_election.cc:290] T eb3e7d34b5314bc7a7c5ed53792728ca P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:19.943637 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet b9b567b3338845e4a37cff2a955056ae (table default.Table_5f059e9b730d466a8e8e0437ac1edbe8 [id=a102fdb234e04e4e8512e9062b5cfaaa]) successfully deleted
W20260810 19:48:19.944185 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 8569d63bbd8e4753b376ee6a5127fd3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8569d63bbd8e4753b376ee6a5127fd3d already in progress: creating tablet
I20260810 19:48:19.940670 10366 tablet_bootstrap.cc:492] T 5f4e2adee0264e418ff8c54912973e60 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
W20260810 19:48:19.947469 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet ed5ae28144b2488fb06e436920b3ca6a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed5ae28144b2488fb06e436920b3ca6a already in progress: creating tablet
W20260810 19:48:19.948233 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet f2d00c669285436bbafb4b657532f222 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2d00c669285436bbafb4b657532f222 already in progress: creating tablet
I20260810 19:48:19.945123 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1331) took 2137 ms. Trace:
W20260810 19:48:19.953071 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet ec11528c81d24cbc851a4c31cf9257a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec11528c81d24cbc851a4c31cf9257a2 already in progress: creating tablet
I20260810 19:48:19.950467 10377 rpcz_store.cc:276] 0810 19:48:17.807248 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.807335 (+ 87us) service_pool.cc:224] Handling call
0810 19:48:19.941853 (+2134518us) ts_tablet_manager.cc:1151] Deleting tablet 6b9baf2b3e644171b20e03b4c0704136
0810 19:48:19.941870 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.945094 (+ 3224us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2134293}
I20260810 19:48:19.954525 10377 tablet_replica.cc:333] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:19.958246 12266 ts_tablet_manager.cc:1929] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:19.958417 12266 log.cc:1199] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/f3e3dde1c29e4275bafb27df63b117be
I20260810 19:48:19.958829 12266 ts_tablet_manager.cc:1950] T f3e3dde1c29e4275bafb27df63b117be P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:19.909603 13530 tablet.cc:1724] T a2fe67e8bd014acaa202c022c193cdc6 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 19:48:19.966859 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1303) took 2085 ms. Trace:
I20260810 19:48:19.966979 12266 rpcz_store.cc:276] 0810 19:48:17.874558 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.874648 (+ 90us) service_pool.cc:224] Handling call
0810 19:48:19.936298 (+2061650us) ts_tablet_manager.cc:1151] Deleting tablet f3e3dde1c29e4275bafb27df63b117be
0810 19:48:19.936306 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.941743 (+ 5437us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:19.958159 (+ 16416us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:19.959697 (+ 1538us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2061413}
I20260810 19:48:19.954058 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet 99aa001db52149dd90ce86e7261f7424 (table default.Table_35de6164baf24ff79163d6b665fc6b8c [id=17f46f6e25bd4c3084a0fcb333694b71]) successfully deleted
I20260810 19:48:19.967456 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1304) took 2089 ms. Trace:
I20260810 19:48:19.967546 12266 rpcz_store.cc:276] 0810 19:48:17.877921 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.878022 (+ 101us) service_pool.cc:224] Handling call
0810 19:48:19.967307 (+2089285us) ts_tablet_manager.cc:1151] Deleting tablet 2acdafe2cb7840c693cdc8446a2f71d2
0810 19:48:19.967320 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.967436 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2089013}
I20260810 19:48:19.967818 12266 tablet_replica.cc:333] T 22954e727fb44a24bd382b9caee9996b P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:19.968017 12266 raft_consensus.cc:2243] T 22954e727fb44a24bd382b9caee9996b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:19.968182 12266 raft_consensus.cc:2272] T 22954e727fb44a24bd382b9caee9996b P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:19.968791 12266 ts_tablet_manager.cc:1916] T 22954e727fb44a24bd382b9caee9996b P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:19.971809 10377 raft_consensus.cc:2243] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
W20260810 19:48:19.970795 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 6b9baf2b3e644171b20e03b4c0704136 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b9baf2b3e644171b20e03b4c0704136 already in progress: creating tablet
W20260810 19:48:19.979032 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 8569d63bbd8e4753b376ee6a5127fd3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8569d63bbd8e4753b376ee6a5127fd3d already in progress: creating tablet
I20260810 19:48:19.976974 9887 tablet_service.cc:1511] Processing CreateTablet for tablet c219f719097c43b69a980b7c564c1432 (DEFAULT_TABLE table=default.Table_0facd7b775174e8ab5239ab75b8f0a01 [id=0469d99904714f93beeb32aa5339b624]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.977173 9911 tablet_service.cc:1511] Processing CreateTablet for tablet 3f59a69d726847aca111527aeaadfa9c (DEFAULT_TABLE table=default.Table_40317d27e3de4c7ebbe4a80239f78899 [id=4e38b3a52c3549889893d804ab0dfb89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.977342 9902 tablet_service.cc:1511] Processing CreateTablet for tablet 6ad0b9c828d240a5ad73eb0b0d749c55 (DEFAULT_TABLE table=default.Table_d4b2c9fd4f414031b98f4fe3c8d0ff5e [id=83c50e66b85f4719a00db52c2c643b6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.982630 9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ad0b9c828d240a5ad73eb0b0d749c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.982662 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet f3e3dde1c29e4275bafb27df63b117be (table default.Table_da45ba37a0804616b521723bc724e0f0 [id=d5afb5c8b2d042e5aec4a0721e2cae1d]) successfully deleted
I20260810 19:48:19.982825 9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f59a69d726847aca111527aeaadfa9c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:19.982981 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 2acdafe2cb7840c693cdc8446a2f71d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2acdafe2cb7840c693cdc8446a2f71d2 already in progress: creating tablet
I20260810 19:48:19.983996 10366 tablet_bootstrap.cc:654] T 5f4e2adee0264e418ff8c54912973e60 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:19.985818 9887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c219f719097c43b69a980b7c564c1432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.977453 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 76889c1b6376415b88c18b06ca54bb2a (DEFAULT_TABLE table=default.Table_04e7864863604a64b3c681bc20c4be28 [id=2730539c308440c796d1166b43f83bca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.977624 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 830dcb9fb1eb40c392a960e8943e7a5e (DEFAULT_TABLE table=default.Table_c8883dc352884ba18ad8c63608b96108 [id=53c8abf9b66b4b3faec26ddc749aef5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.977903 9885 tablet_service.cc:1511] Processing CreateTablet for tablet e5f10cfb8cd6409085ac0ffbdb6eb368 (DEFAULT_TABLE table=default.Table_1a5b07808c9a4b3f92a32046e95b6640 [id=01e52513ceee4b44a76074fe0fc50eca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.978227 9899 tablet_service.cc:1511] Processing CreateTablet for tablet 4cb34219defa45eebe740497781bc3fd (DEFAULT_TABLE table=default.Table_339557aab54447d284c9c637ae38b8ba [id=36d83c564f5646f69e4e8d113ab27852]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.978514 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 5c47462bbf864b27a0b5188fce01ac29 (DEFAULT_TABLE table=default.Table_28e5e84b58a44f539fea3e4847ba0dd0 [id=b584031eaa82476387da627d42afe93e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.978775 9908 tablet_service.cc:1511] Processing CreateTablet for tablet 03b9d47dabeb4c899140b95b48d0737f (DEFAULT_TABLE table=default.Table_281135cc68d747deb6a696d48867a10d [id=f56eba6a72d14b8ca4e7171c11e63285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.978533 9906 tablet_service.cc:1511] Processing CreateTablet for tablet 6b664a3ee6a842a6bfe25450e7237b5f (DEFAULT_TABLE table=default.Table_57fd8fee4e6243eea99866d63c8cf478 [id=f45cdc1719d243c898ad00a5a2300171]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.986724 9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03b9d47dabeb4c899140b95b48d0737f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.988471 10370 tablet_bootstrap.cc:492] T 3159795344ae492fb099fca0e52fcf20 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:19.989567 10370 ts_tablet_manager.cc:1403] T 3159795344ae492fb099fca0e52fcf20 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.118s user 0.025s sys 0.036s
I20260810 19:48:19.989786 10377 raft_consensus.cc:2272] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:19.979112 9913 tablet_service.cc:1511] Processing CreateTablet for tablet 8e02508a16f048bc9944aa12a7502651 (DEFAULT_TABLE table=default.Table_9e545c4706b84b9c96b6d8853d9c2f6c [id=3b7f0d37570142308cd238db9835ab0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.979112 9895 tablet_service.cc:1511] Processing CreateTablet for tablet 7d63be70bd9544a2888ec954b570b547 (DEFAULT_TABLE table=default.Table_ac26bc30d7be42e49391fe1953de2e4d [id=d77bcd60466544529c9b3c1bb025ff20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.979329 9896 tablet_service.cc:1558] Processing DeleteTablet for tablet 5cb4f4e17a16468597f154083a5c3e6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:19.979444 9890 tablet_service.cc:1558] Processing DeleteTablet for tablet 31526aa9c74e45e585e280f88f73cfa9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:19.979522 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a7079614cda418583af74ae11a4d374 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:19.990483 10377 ts_tablet_manager.cc:1916] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:19.979598 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet 89191af180b542ce99bf0a798a945594 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:19.990758 9896 tablet_service.cc:1511] Processing CreateTablet for tablet aadae72a4677444ab8b6661e2e5c3972 (DEFAULT_TABLE table=default.Table_bdc8f5454bb34b05a6289f255d7e719a [id=4483941a91b541f5958c40ddfd98c973]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.990900 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet 748b792882eb45aebedc63a5348257d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:19.991073 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet 71cebde162ad406b88f12fc1a313affe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:19.991210 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet 87454e85629a4a9aaf1be15466fc785a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:19.991340 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet 63b649cbc1d141d8bb438105b8e8537c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:19.991470 9907 tablet_service.cc:1558] Processing DeleteTablet for tablet e56d9c164d2b47abb004d13b7f2488d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:19.979677 9897 tablet_service.cc:1558] Processing DeleteTablet for tablet 92c1f13f235a4ba696bd794af135bcba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:19 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:19.991739 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76889c1b6376415b88c18b06ca54bb2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.979902 9894 tablet_service.cc:1511] Processing CreateTablet for tablet 030c3d9288814465b1eaa79f6b8b2060 (DEFAULT_TABLE table=default.Table_4df39177675e414d96b2478ffcc780f3 [id=51b05727ca444ecf83b795e56fa09402]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.978250 9901 tablet_service.cc:1511] Processing CreateTablet for tablet bd2a5af15c95429dba3960e5530bb9a7 (DEFAULT_TABLE table=default.Table_3e05663bfac3409cbdaf7019a07ca034 [id=b752b01372ea45f4af2b66d6a73eb4a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.976974 9904 tablet_service.cc:1511] Processing CreateTablet for tablet 2768f98df42541ad950d18ad6d465a4a (DEFAULT_TABLE table=default.Table_12449afa32674c328023f1d830b9a305 [id=3b541c69a49b43d0ada9dc91178cebe4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.990758 9883 tablet_service.cc:1511] Processing CreateTablet for tablet b8adc9d13dc0478d895d67ad8e6ea454 (DEFAULT_TABLE table=default.Table_31e9eac84a064d309abb8b0573ed9958 [id=a159d1cc16ae4c518056f55400e98e74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:19.992556 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 830dcb9fb1eb40c392a960e8943e7a5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.992969 9885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f10cfb8cd6409085ac0ffbdb6eb368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.993405 9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cb34219defa45eebe740497781bc3fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:19.997216 10370 raft_consensus.cc:359] T 3159795344ae492fb099fca0e52fcf20 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.997426 10370 raft_consensus.cc:385] T 3159795344ae492fb099fca0e52fcf20 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:19.997538 10370 raft_consensus.cc:740] T 3159795344ae492fb099fca0e52fcf20 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:19.998011 10370 consensus_queue.cc:260] T 3159795344ae492fb099fca0e52fcf20 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:19.998461 12266 ts_tablet_manager.cc:1929] T 22954e727fb44a24bd382b9caee9996b P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:19.998631 12266 log.cc:1199] T 22954e727fb44a24bd382b9caee9996b P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/22954e727fb44a24bd382b9caee9996b
I20260810 19:48:19.998968 12266 ts_tablet_manager.cc:1950] T 22954e727fb44a24bd382b9caee9996b P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:19.999826 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1309) took 1922 ms. Trace:
I20260810 19:48:19.999944 12266 rpcz_store.cc:276] 0810 19:48:18.081255 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:18.081649 (+ 394us) service_pool.cc:224] Handling call
0810 19:48:19.967764 (+1886115us) ts_tablet_manager.cc:1151] Deleting tablet 22954e727fb44a24bd382b9caee9996b
0810 19:48:19.967773 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:19.980832 (+ 13059us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:19.998395 (+ 17563us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:19.999797 (+ 1402us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1884822}
I20260810 19:48:20.000330 12266 tablet_replica.cc:333] T c8311ccef92c48b2a94bbb9e9262ea9d P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:20.000542 12266 raft_consensus.cc:2243] T c8311ccef92c48b2a94bbb9e9262ea9d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:20.000720 12266 raft_consensus.cc:2272] T c8311ccef92c48b2a94bbb9e9262ea9d P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:20.001302 12266 ts_tablet_manager.cc:1916] T c8311ccef92c48b2a94bbb9e9262ea9d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:20.008023 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dbaf58354169429e85631af722f93612 consensus state has no leader
I20260810 19:48:20.008469 9421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2db59f43abcb44d790739bb36e244618"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:20.009096 9421 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2db59f43abcb44d790739bb36e244618 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:20.009543 9410 master_service.cc:960] ReplaceTablet: received request to replace tablet bef956a173084e7698a37dddc574ea65 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:20.010779 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2a3e95916cae4ac79d7baa1ebf357eff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:20.011309 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a3e95916cae4ac79d7baa1ebf357eff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:20.011345 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ae7cc16a22e34413a8d1ddf892cc7010" } modify_external_catalogs: true
I20260810 19:48:20.011474 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_ae7cc16a22e34413a8d1ddf892cc7010" } modify_external_catalogs: true
W20260810 19:48:20.012539 9418 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 34fb654d56f249c8a0353c495802250b consensus state has no leader
I20260810 19:48:20.012848 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c71e63f4580a439cb7ba4c2f4dd20436" } modify_external_catalogs: true
I20260810 19:48:20.013005 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c71e63f4580a439cb7ba4c2f4dd20436" } modify_external_catalogs: true
W20260810 19:48:20.015321 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d1f88b5c7685407590a1677dfa0ea697 consensus state has no leader
I20260810 19:48:20.017632 9420 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_30732d5b4723469da64545f8603f37f7" } modify_external_catalogs: true
I20260810 19:48:20.017818 9420 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_30732d5b4723469da64545f8603f37f7" } modify_external_catalogs: true
I20260810 19:48:20.020823 10377 ts_tablet_manager.cc:1929] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:20.021059 10377 log.cc:1199] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/f3e3dde1c29e4275bafb27df63b117be
I20260810 19:48:20.021564 10377 ts_tablet_manager.cc:1950] T f3e3dde1c29e4275bafb27df63b117be P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:20.021710 9416 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 7d939e3df62a45d9a964d4df01be4bfb (table default.Table_65f4c2fb3d1c49ae9cdfc041e51bd182 [id=2292ed1c178a4d458f52885e45c76d41]). Expected version 2 got 0
I20260810 19:48:20.021931 9416 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 676004738985441985278313d6064530 (table default.Table_2d7f246476ac4544a3fa089ec3c52657 [id=c681008d2b5f43a9b7b6ed2d72653b1b]). Expected version 1 got 0
I20260810 19:48:20.022629 9413 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_361836440e714f89b85618c3ec886efa" } modify_external_catalogs: true
I20260810 19:48:20.022804 9413 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_361836440e714f89b85618c3ec886efa" } modify_external_catalogs: true
I20260810 19:48:20.023941 9415 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_cdf7ea6b6e514a2fba968ac13ac259dd" } modify_external_catalogs: true
I20260810 19:48:20.023975 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_28563b0737204efda911ebadbeff9fc0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:20.024092 9415 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_cdf7ea6b6e514a2fba968ac13ac259dd" } modify_external_catalogs: true
W20260810 19:48:20.024487 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28563b0737204efda911ebadbeff9fc0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:20.025331 9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b664a3ee6a842a6bfe25450e7237b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.025638 9416 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d4b2c9fd4f414031b98f4fe3c8d0ff5e" } new_table_name: "default.Table_355c9c8da0ce4527ab73147f80b979c4" modify_external_catalogs: true
I20260810 19:48:20.026787 9410 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_b21befc85a6646199611d93c23783d4e" } new_table_name: "default.Table_3b9848abb4174454ac7aac26a8b70b23" modify_external_catalogs: true
I20260810 19:48:20.030650 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c47462bbf864b27a0b5188fce01ac29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.030908 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aadae72a4677444ab8b6661e2e5c3972. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:20.034103 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet f2d00c669285436bbafb4b657532f222 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2d00c669285436bbafb4b657532f222 already in progress: creating tablet
I20260810 19:48:20.034559 9895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d63be70bd9544a2888ec954b570b547. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:20.036168 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet ec11528c81d24cbc851a4c31cf9257a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec11528c81d24cbc851a4c31cf9257a2 already in progress: creating tablet
W20260810 19:48:20.036639 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 6b9baf2b3e644171b20e03b4c0704136 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b9baf2b3e644171b20e03b4c0704136 already in progress: creating tablet
I20260810 19:48:20.038431 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e02508a16f048bc9944aa12a7502651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.042609 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 030c3d9288814465b1eaa79f6b8b2060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.042815 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8adc9d13dc0478d895d67ad8e6ea454. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.046672 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd2a5af15c95429dba3960e5530bb9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.050454 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2768f98df42541ad950d18ad6d465a4a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 19:48:20.057094 9830 leader_election.cc:343] T eb3e7d34b5314bc7a7c5ed53792728ca P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Not found: Tablet not found: eb3e7d34b5314bc7a7c5ed53792728ca
I20260810 19:48:20.057265 9830 leader_election.cc:304] T eb3e7d34b5314bc7a7c5ed53792728ca P 6986ed920dcb4af29a5eeeda6f671691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6986ed920dcb4af29a5eeeda6f671691; no voters: eadde59fd6504d679e47f03a60c64bb0, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:20.057488 13522 raft_consensus.cc:2749] T eb3e7d34b5314bc7a7c5ed53792728ca P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:20.058863 10370 ts_tablet_manager.cc:1434] T 3159795344ae492fb099fca0e52fcf20 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260810 19:48:20.059211 10370 tablet_bootstrap.cc:492] T f42e9b00e3da4d73b4beb1b325f09f4a P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:20.059821 10375 ts_tablet_manager.cc:1929] T 59a767c91abf45e79cebab582525ad2e P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:20.059976 10375 log.cc:1199] T 59a767c91abf45e79cebab582525ad2e P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/59a767c91abf45e79cebab582525ad2e
I20260810 19:48:20.060348 10375 ts_tablet_manager.cc:1950] T 59a767c91abf45e79cebab582525ad2e P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:20.061837 9913 tablet_service.cc:1511] Processing CreateTablet for tablet b9ee991d980349388b26b690077f8405 (DEFAULT_TABLE table=default.Table_1cfb553b004d4b1abb27027424a6f6b8 [id=615bb187fa9b41aea23e10ec56c20167]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.062532 9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9ee991d980349388b26b690077f8405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.065722 10375 tablet_replica.cc:333] T 985440898cc04a98877c15a5122a7dd3 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:20.065963 10375 raft_consensus.cc:2243] T 985440898cc04a98877c15a5122a7dd3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:20.066134 10375 raft_consensus.cc:2272] T 985440898cc04a98877c15a5122a7dd3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:20.066723 10375 ts_tablet_manager.cc:1916] T 985440898cc04a98877c15a5122a7dd3 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:20.068846 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 1db17b8e574e464ea5c8080166293c20 (DEFAULT_TABLE table=default.Table_61f710413b444b4296dcab37e7e4152d [id=67c6bb3c23e94f14a39627f55f94f8e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.071467 10370 tablet_bootstrap.cc:654] T f42e9b00e3da4d73b4beb1b325f09f4a P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:20.072508 9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1db17b8e574e464ea5c8080166293c20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.073702 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 22954e727fb44a24bd382b9caee9996b (table default.Table_a16400f647e94437932730ebd220e795 [id=1fee039754f440c398b5d2297eb89999]) successfully deleted
I20260810 19:48:20.074496 12266 ts_tablet_manager.cc:1929] T c8311ccef92c48b2a94bbb9e9262ea9d P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:20.074633 12266 log.cc:1199] T c8311ccef92c48b2a94bbb9e9262ea9d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/c8311ccef92c48b2a94bbb9e9262ea9d
I20260810 19:48:20.075618 9677 tablet_service.cc:1511] Processing CreateTablet for tablet d5870f14a1fb4664a74a400348f9d999 (DEFAULT_TABLE table=default.Table_e78e0629877643a088071529bac8e691 [id=635ca2c582b94c64b3928abdc1db9e61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.076031 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5870f14a1fb4664a74a400348f9d999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.077158 9655 tablet_service.cc:1511] Processing CreateTablet for tablet 2a2511fdcd29471982745e98b9e9af2b (DEFAULT_TABLE table=default.Table_5253cc7a7532414eb993c6486f687c6d [id=32bd7cfa05274e7ba28678716b98e6b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.077493 9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2511fdcd29471982745e98b9e9af2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.078645 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 60588cd7e875411a9fd2ee15ea368696 (DEFAULT_TABLE table=default.Table_d2b9ae8b207e4ebb999e42e0d790b8ce [id=52c4c44d51ad46c59709374eb75af1ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.078950 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60588cd7e875411a9fd2ee15ea368696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.079944 9681 tablet_service.cc:1511] Processing CreateTablet for tablet 8546bf7410924bd3b5de4eead750a893 (DEFAULT_TABLE table=default.Table_801168d295d544fba861469ea8f82f3a [id=bd498f32ec4440fabae36dd10e86885b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.069406 9883 tablet_service.cc:1511] Processing CreateTablet for tablet d5870f14a1fb4664a74a400348f9d999 (DEFAULT_TABLE table=default.Table_e78e0629877643a088071529bac8e691 [id=635ca2c582b94c64b3928abdc1db9e61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.081671 9663 tablet_service.cc:1511] Processing CreateTablet for tablet a48617a1b7bd4274be5846f4737de015 (DEFAULT_TABLE table=default.Table_48d458d1d3aa46a989e8488779e29497 [id=2d59f7b15f3d4da5bc96878897bd5f00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.081722 9684 tablet_service.cc:1511] Processing CreateTablet for tablet 1db17b8e574e464ea5c8080166293c20 (DEFAULT_TABLE table=default.Table_61f710413b444b4296dcab37e7e4152d [id=67c6bb3c23e94f14a39627f55f94f8e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.082057 9668 tablet_service.cc:1511] Processing CreateTablet for tablet f6b91890c21d48dfa582db0c19aeef26 (DEFAULT_TABLE table=default.Table_61fe0e3c334a462d8dc0ecff4080ee36 [id=7c18c4aa1e3640c4931ad81c645b4e1e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 19:48:20.082273 9611 consensus_peers.cc:597] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 -> Peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Couldn't send request to peer 6986ed920dcb4af29a5eeeda6f671691. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 19:48:20.082489 9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6b91890c21d48dfa582db0c19aeef26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.083113 13159 raft_consensus.cc:493] T 73a2e6a512224caa892ac7541131349f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:20.083240 9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8546bf7410924bd3b5de4eead750a893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.083521 9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1db17b8e574e464ea5c8080166293c20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.083245 13159 raft_consensus.cc:515] T 73a2e6a512224caa892ac7541131349f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.084913 12266 ts_tablet_manager.cc:1950] T c8311ccef92c48b2a94bbb9e9262ea9d P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:20.085723 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1312) took 1506 ms. Trace:
I20260810 19:48:20.085801 12266 rpcz_store.cc:276] 0810 19:48:18.579599 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:18.579660 (+ 61us) service_pool.cc:224] Handling call
0810 19:48:20.000276 (+1420616us) ts_tablet_manager.cc:1151] Deleting tablet c8311ccef92c48b2a94bbb9e9262ea9d
0810 19:48:20.000288 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:20.071046 (+ 70758us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:20.074429 (+ 3383us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:20.085703 (+ 11274us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1420395}
I20260810 19:48:20.086104 12266 tablet_replica.cc:333] T 0849ea9c04104a8184f8a8cd40e06fc2 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:20.086293 12266 raft_consensus.cc:2243] T 0849ea9c04104a8184f8a8cd40e06fc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:20.086469 12266 raft_consensus.cc:2272] T 0849ea9c04104a8184f8a8cd40e06fc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:20.087180 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet c8311ccef92c48b2a94bbb9e9262ea9d (table default.Table_5e59db5efe264421a5f3455e9aa63c62 [id=4b52435931f6482a8c3bca2d0c05bd53]) successfully deleted
I20260810 19:48:20.087330 12266 ts_tablet_manager.cc:1916] T 0849ea9c04104a8184f8a8cd40e06fc2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:20.077665 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1333) took 2187 ms. Trace:
I20260810 19:48:20.092482 9665 tablet_service.cc:1511] Processing CreateTablet for tablet b9ee991d980349388b26b690077f8405 (DEFAULT_TABLE table=default.Table_1cfb553b004d4b1abb27027424a6f6b8 [id=615bb187fa9b41aea23e10ec56c20167]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.092414 10377 rpcz_store.cc:276] 0810 19:48:17.890452 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.890523 (+ 71us) service_pool.cc:224] Handling call
0810 19:48:19.954444 (+2063921us) ts_tablet_manager.cc:1151] Deleting tablet f3e3dde1c29e4275bafb27df63b117be
0810 19:48:19.954463 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:20.001829 (+ 47366us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:20.020741 (+ 18912us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:20.077639 (+ 56898us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6664,"tablet-delete.queue_time_us":2063630}
I20260810 19:48:20.092840 9665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9ee991d980349388b26b690077f8405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.092845 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1334) took 2196 ms. Trace:
I20260810 19:48:20.092914 10377 rpcz_store.cc:276] 0810 19:48:17.896456 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:17.896548 (+ 92us) service_pool.cc:224] Handling call
0810 19:48:20.092714 (+2196166us) ts_tablet_manager.cc:1151] Deleting tablet 2acdafe2cb7840c693cdc8446a2f71d2
0810 19:48:20.092726 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:20.092828 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2195949}
I20260810 19:48:20.093202 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1341) took 1482 ms. Trace:
I20260810 19:48:20.093273 10377 rpcz_store.cc:276] 0810 19:48:18.611135 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:18.611228 (+ 93us) service_pool.cc:224] Handling call
0810 19:48:20.093110 (+1481882us) ts_tablet_manager.cc:1151] Deleting tablet f5b65c8a84b44b94896c62115144d386
0810 19:48:20.093119 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:20.093189 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1473285}
I20260810 19:48:20.093539 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1342) took 1465 ms. Trace:
I20260810 19:48:20.093600 10377 rpcz_store.cc:276] 0810 19:48:18.628094 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:18.628435 (+ 341us) service_pool.cc:224] Handling call
0810 19:48:20.093445 (+1465010us) ts_tablet_manager.cc:1151] Deleting tablet e5f29e86e0854efd9987305e26d7361a
0810 19:48:20.093453 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:20.093524 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1464796}
I20260810 19:48:20.093858 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1343) took 1465 ms. Trace:
I20260810 19:48:20.093912 10377 rpcz_store.cc:276] 0810 19:48:18.628276 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:18.628687 (+ 411us) service_pool.cc:224] Handling call
0810 19:48:20.093774 (+1465087us) ts_tablet_manager.cc:1151] Deleting tablet ef71075eb2cc4dcaa310786b3333f070
0810 19:48:20.093781 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:20.093844 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1464974}
I20260810 19:48:20.094184 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1344) took 1465 ms. Trace:
I20260810 19:48:20.094249 10377 rpcz_store.cc:276] 0810 19:48:18.628381 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:18.628824 (+ 443us) service_pool.cc:224] Handling call
0810 19:48:20.094101 (+1465277us) ts_tablet_manager.cc:1151] Deleting tablet 041844571695425eb6de69d251dffcf0
0810 19:48:20.094108 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:20.094171 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1465181}
I20260810 19:48:20.094497 9663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a48617a1b7bd4274be5846f4737de015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.094502 10377 tablet_replica.cc:333] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:20.094684 10377 raft_consensus.cc:2243] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:20.095252 10377 raft_consensus.cc:2272] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:20.079639 9667 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2b9e70cfad4270a8e9f66f616912d1 (DEFAULT_TABLE table=default.Table_080a0d3d20124e6799203522eef6d2c1 [id=40b90f318dc24efab8b28bd45651e592]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.095682 9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2b9e70cfad4270a8e9f66f616912d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.076885 9687 tablet_service.cc:1511] Processing CreateTablet for tablet 715c283dcd504e45b13554a2da32deba (DEFAULT_TABLE table=default.Table_29958c4b0dbc4bd792aaaaabe969c407 [id=7058c09e47b242e388d9800511136228]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.095846 10377 ts_tablet_manager.cc:1916] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:20.096065 9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 715c283dcd504e45b13554a2da32deba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.087817 9887 tablet_service.cc:1511] Processing CreateTablet for tablet a48617a1b7bd4274be5846f4737de015 (DEFAULT_TABLE table=default.Table_48d458d1d3aa46a989e8488779e29497 [id=2d59f7b15f3d4da5bc96878897bd5f00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.102644 9688 tablet_service.cc:1511] Processing CreateTablet for tablet 86be4b98751f4903a773d378fd91e8fc (DEFAULT_TABLE table=default.Table_767a48c631cd40a486287ce3a875fe7b [id=e9b3a76a0665450aa0071b873705d576]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.103075 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86be4b98751f4903a773d378fd91e8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.108784 9887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a48617a1b7bd4274be5846f4737de015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.089828 9894 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2b9e70cfad4270a8e9f66f616912d1 (DEFAULT_TABLE table=default.Table_080a0d3d20124e6799203522eef6d2c1 [id=40b90f318dc24efab8b28bd45651e592]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.109656 9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2b9e70cfad4270a8e9f66f616912d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.090170 9896 tablet_service.cc:1511] Processing CreateTablet for tablet 8546bf7410924bd3b5de4eead750a893 (DEFAULT_TABLE table=default.Table_801168d295d544fba861469ea8f82f3a [id=bd498f32ec4440fabae36dd10e86885b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.114641 9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8546bf7410924bd3b5de4eead750a893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.114797 13159 leader_election.cc:290] T 73a2e6a512224caa892ac7541131349f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:20.118268 13309 raft_consensus.cc:493] T 3da297aac2644fcabfcb21769576dca4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:20.118470 13309 raft_consensus.cc:515] T 3da297aac2644fcabfcb21769576dca4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.119092 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a2e6a512224caa892ac7541131349f" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
W20260810 19:48:20.119628 9611 leader_election.cc:343] T 73a2e6a512224caa892ac7541131349f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:20.120186 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a2e6a512224caa892ac7541131349f" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:20.120237 9939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da297aac2644fcabfcb21769576dca4" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
W20260810 19:48:20.120851 10067 leader_election.cc:343] T 3da297aac2644fcabfcb21769576dca4 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:20.121063 13309 leader_election.cc:290] T 3da297aac2644fcabfcb21769576dca4 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
W20260810 19:48:20.122407 9611 leader_election.cc:343] T 73a2e6a512224caa892ac7541131349f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:20.122529 9611 leader_election.cc:304] T 73a2e6a512224caa892ac7541131349f P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:20.122928 13159 raft_consensus.cc:2749] T 73a2e6a512224caa892ac7541131349f P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 19:48:20.123514 10068 leader_election.cc:343] T 3da297aac2644fcabfcb21769576dca4 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 3da297aac2644fcabfcb21769576dca4
I20260810 19:48:20.123639 10068 leader_election.cc:304] T 3da297aac2644fcabfcb21769576dca4 P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:20.124504 13309 raft_consensus.cc:2749] T 3da297aac2644fcabfcb21769576dca4 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:20.090677 9905 tablet_service.cc:1511] Processing CreateTablet for tablet 60588cd7e875411a9fd2ee15ea368696 (DEFAULT_TABLE table=default.Table_d2b9ae8b207e4ebb999e42e0d790b8ce [id=52c4c44d51ad46c59709374eb75af1ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.124953 9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60588cd7e875411a9fd2ee15ea368696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.129146 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet f3e3dde1c29e4275bafb27df63b117be (table default.Table_da45ba37a0804616b521723bc724e0f0 [id=d5afb5c8b2d042e5aec4a0721e2cae1d]) successfully deleted
I20260810 19:48:20.091006 9885 tablet_service.cc:1511] Processing CreateTablet for tablet 2a2511fdcd29471982745e98b9e9af2b (DEFAULT_TABLE table=default.Table_5253cc7a7532414eb993c6486f687c6d [id=32bd7cfa05274e7ba28678716b98e6b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.130201 9885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2511fdcd29471982745e98b9e9af2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.091295 9892 tablet_service.cc:1511] Processing CreateTablet for tablet 86be4b98751f4903a773d378fd91e8fc (DEFAULT_TABLE table=default.Table_767a48c631cd40a486287ce3a875fe7b [id=e9b3a76a0665450aa0071b873705d576]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.133442 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86be4b98751f4903a773d378fd91e8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.136487 9407 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 7d939e3df62a45d9a964d4df01be4bfb (table default.Table_65f4c2fb3d1c49ae9cdfc041e51bd182 [id=2292ed1c178a4d458f52885e45c76d41]). Expected version 2 got 0
I20260810 19:48:20.138168 9407 master_service.cc:960] ReplaceTablet: received request to replace tablet f2d00c669285436bbafb4b657532f222 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:20.091586 9898 tablet_service.cc:1511] Processing CreateTablet for tablet 715c283dcd504e45b13554a2da32deba (DEFAULT_TABLE table=default.Table_29958c4b0dbc4bd792aaaaabe969c407 [id=7058c09e47b242e388d9800511136228]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.138706 9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 715c283dcd504e45b13554a2da32deba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.141590 10375 ts_tablet_manager.cc:1929] T 985440898cc04a98877c15a5122a7dd3 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:20.141752 10375 log.cc:1199] T 985440898cc04a98877c15a5122a7dd3 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/985440898cc04a98877c15a5122a7dd3
I20260810 19:48:20.142079 10375 ts_tablet_manager.cc:1950] T 985440898cc04a98877c15a5122a7dd3 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:20.088716 9904 tablet_service.cc:1511] Processing CreateTablet for tablet f6b91890c21d48dfa582db0c19aeef26 (DEFAULT_TABLE table=default.Table_61fe0e3c334a462d8dc0ecff4080ee36 [id=7c18c4aa1e3640c4931ad81c645b4e1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.143147 10375 tablet_replica.cc:333] T b54feebc7c9841d89808054602be7913 P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:20.143352 9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6b91890c21d48dfa582db0c19aeef26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.143482 10375 raft_consensus.cc:2243] T b54feebc7c9841d89808054602be7913 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:20.143653 10375 raft_consensus.cc:2272] T b54feebc7c9841d89808054602be7913 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:20.144301 10375 ts_tablet_manager.cc:1916] T b54feebc7c9841d89808054602be7913 P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:20.147119 10370 tablet_bootstrap.cc:492] T f42e9b00e3da4d73b4beb1b325f09f4a P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:20.147393 10370 ts_tablet_manager.cc:1403] T f42e9b00e3da4d73b4beb1b325f09f4a P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.088s user 0.003s sys 0.005s
I20260810 19:48:20.148341 10370 raft_consensus.cc:359] T f42e9b00e3da4d73b4beb1b325f09f4a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.148527 10370 raft_consensus.cc:385] T f42e9b00e3da4d73b4beb1b325f09f4a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:20.148581 10370 raft_consensus.cc:740] T f42e9b00e3da4d73b4beb1b325f09f4a P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:20.148797 10370 consensus_queue.cc:260] T f42e9b00e3da4d73b4beb1b325f09f4a P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.149312 10370 ts_tablet_manager.cc:1434] T f42e9b00e3da4d73b4beb1b325f09f4a P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:20.149928 9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5870f14a1fb4664a74a400348f9d999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.150053 10370 tablet_bootstrap.cc:492] T fafad8559b074dab958f03061e65b8c3 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
I20260810 19:48:20.155566 10367 tablet_bootstrap.cc:492] T fdd82537177a4142bddd0544485b00c4 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:20.155725 10367 ts_tablet_manager.cc:1403] T fdd82537177a4142bddd0544485b00c4 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.225s user 0.008s sys 0.008s
I20260810 19:48:20.158145 10367 raft_consensus.cc:359] T fdd82537177a4142bddd0544485b00c4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.158370 10367 raft_consensus.cc:385] T fdd82537177a4142bddd0544485b00c4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 19:48:20.158345 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 2acdafe2cb7840c693cdc8446a2f71d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2acdafe2cb7840c693cdc8446a2f71d2 already in progress: creating tablet
I20260810 19:48:20.158430 10367 raft_consensus.cc:740] T fdd82537177a4142bddd0544485b00c4 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:20.158624 10367 consensus_queue.cc:260] T fdd82537177a4142bddd0544485b00c4 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:20.159057 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet f5b65c8a84b44b94896c62115144d386 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5b65c8a84b44b94896c62115144d386 already in progress: creating tablet
I20260810 19:48:20.159086 10367 ts_tablet_manager.cc:1434] T fdd82537177a4142bddd0544485b00c4 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 19:48:20.159399 10367 tablet_bootstrap.cc:492] T cbcaa7106df24aaeb07428b7b590e282 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
W20260810 19:48:20.161159 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet e5f29e86e0854efd9987305e26d7361a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5f29e86e0854efd9987305e26d7361a already in progress: creating tablet
W20260810 19:48:20.161643 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet ef71075eb2cc4dcaa310786b3333f070 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef71075eb2cc4dcaa310786b3333f070 already in progress: creating tablet
W20260810 19:48:20.162099 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 041844571695425eb6de69d251dffcf0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 041844571695425eb6de69d251dffcf0 already in progress: creating tablet
I20260810 19:48:20.162886 10370 tablet_bootstrap.cc:654] T fafad8559b074dab958f03061e65b8c3 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:20.171665 10367 tablet_bootstrap.cc:654] T cbcaa7106df24aaeb07428b7b590e282 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:20.171775 9408 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 2067e0b1bf2841a2920b0e57ebd1780d
I20260810 19:48:20.173116 9418 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet e233aa79ebb84a0f89411fc8166b1bb4
W20260810 19:48:20.173574 9410 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 75228e6dbe14460ab1280b1951b26c83 consensus state has no leader
I20260810 19:48:20.173779 9420 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet a3588a8f738e49a2be1f57a6a6bcb0e5
I20260810 19:48:20.174422 9413 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet dee05338a75f43be8eb2546d06dd8068
I20260810 19:48:20.175150 9415 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: Sending DeleteTablet for 3 replicas of tablet 11cf9e6ff4f4436f9d9b5d82df3def82
W20260810 19:48:20.175879 9416 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ad0b9c828d240a5ad73eb0b0d749c55 consensus state has no leader
I20260810 19:48:20.180115 9665 tablet_service.cc:1558] Processing DeleteTablet for tablet 11cf9e6ff4f4436f9d9b5d82df3def82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:20 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:20.183688 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet eb3e7d34b5314bc7a7c5ed53792728ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:47:56 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:20.184437 9895 tablet_service.cc:1558] Processing DeleteTablet for tablet e233aa79ebb84a0f89411fc8166b1bb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:20 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:20.184723 9894 tablet_service.cc:1558] Processing DeleteTablet for tablet 11cf9e6ff4f4436f9d9b5d82df3def82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:20 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:20.184921 9887 tablet_service.cc:1558] Processing DeleteTablet for tablet f3e3dde1c29e4275bafb27df63b117be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:17 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:20.185384 9904 tablet_service.cc:1558] Processing DeleteTablet for tablet b3754889e4574fc3a936ac31cc6f496a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:06 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:20.187974 9684 tablet_service.cc:1558] Processing DeleteTablet for tablet dee05338a75f43be8eb2546d06dd8068 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:20 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:20.189788 9681 tablet_service.cc:1558] Processing DeleteTablet for tablet a3588a8f738e49a2be1f57a6a6bcb0e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:20 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:20.191092 9655 tablet_service.cc:1558] Processing DeleteTablet for tablet e233aa79ebb84a0f89411fc8166b1bb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:20 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:20.191978 9905 tablet_service.cc:1558] Processing DeleteTablet for tablet 2067e0b1bf2841a2920b0e57ebd1780d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:20 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:20.192288 9901 tablet_service.cc:1558] Processing DeleteTablet for tablet a3588a8f738e49a2be1f57a6a6bcb0e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:20 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:20.195013 9898 tablet_service.cc:1558] Processing DeleteTablet for tablet dee05338a75f43be8eb2546d06dd8068 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:20 UTC) from {username='slave'} at 127.0.0.1:38276
I20260810 19:48:20.201450 13531 tablet.cc:1724] T 56fa5de3bf7142b2b0978f9190091f33 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:20.205340 9677 tablet_service.cc:1558] Processing DeleteTablet for tablet 2067e0b1bf2841a2920b0e57ebd1780d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 19:48:20 UTC) from {username='slave'} at 127.0.0.1:34544
I20260810 19:48:20.207387 10366 tablet_bootstrap.cc:492] T 5f4e2adee0264e418ff8c54912973e60 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:20.207679 10366 ts_tablet_manager.cc:1403] T 5f4e2adee0264e418ff8c54912973e60 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.267s user 0.009s sys 0.000s
I20260810 19:48:20.208577 10366 raft_consensus.cc:359] T 5f4e2adee0264e418ff8c54912973e60 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.210219 10366 raft_consensus.cc:385] T 5f4e2adee0264e418ff8c54912973e60 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:20.210182 9416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_2ddd3cd49e0b4d769b3a7939fcf28113"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:20.210638 10366 raft_consensus.cc:740] T 5f4e2adee0264e418ff8c54912973e60 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
W20260810 19:48:20.210908 9416 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ddd3cd49e0b4d769b3a7939fcf28113 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:20.210886 10366 consensus_queue.cc:260] T 5f4e2adee0264e418ff8c54912973e60 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.227991 9415 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_6b8863bd284444ed80fde8b5131ba710" } new_table_name: "default.Table_b2fe575459844d01aec1e9a93255a736" modify_external_catalogs: true
I20260810 19:48:20.229591 10377 ts_tablet_manager.cc:1929] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:20.229610 9420 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_0bb7c2bf3cb64b988e69e769ce83ff41" } new_table_name: "default.Table_e4be624572cb42c3a9bcd7f644fe185e" modify_external_catalogs: true
I20260810 19:48:20.229720 10377 log.cc:1199] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-1/wal/wals/b33aa8be266a434cba899da7514c47e9
I20260810 19:48:20.230111 10377 ts_tablet_manager.cc:1950] T b33aa8be266a434cba899da7514c47e9 P 6986ed920dcb4af29a5eeeda6f671691: Deleting consensus metadata
I20260810 19:48:20.231093 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_f5670c298dff4585921a26a8278b39eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:20.231650 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f5670c298dff4585921a26a8278b39eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:20.232702 12266 ts_tablet_manager.cc:1929] T 0849ea9c04104a8184f8a8cd40e06fc2 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:20.232826 12266 log.cc:1199] T 0849ea9c04104a8184f8a8cd40e06fc2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/0849ea9c04104a8184f8a8cd40e06fc2
I20260810 19:48:20.232977 9418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_ec2c0bd62f45471bbf38c07a4b607318"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:20.233140 12266 ts_tablet_manager.cc:1950] T 0849ea9c04104a8184f8a8cd40e06fc2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
W20260810 19:48:20.233474 9418 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec2c0bd62f45471bbf38c07a4b607318 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:20.234570 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_755eed7438a342a694561002cb0f57c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:20.235051 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_755eed7438a342a694561002cb0f57c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:20.236222 9408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_312dc207f0534778818e1677d15089f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:20.236683 9408 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_312dc207f0534778818e1677d15089f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:20.238085 9413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_a6aaf10aec8a4cbb8629d9f425994b47"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:20.238569 9413 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6aaf10aec8a4cbb8629d9f425994b47 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:20.238747 13572 tablet.cc:1724] T 56fa5de3bf7142b2b0978f9190091f33 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:20.241984 9407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_104f054488a14dd3acf51dbe4c841659"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 19:48:20.243014 9407 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_104f054488a14dd3acf51dbe4c841659 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:20.243178 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1311) took 1663 ms. Trace:
I20260810 19:48:20.243295 12266 rpcz_store.cc:276] 0810 19:48:18.579463 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:18.580554 (+ 1091us) service_pool.cc:224] Handling call
0810 19:48:20.086060 (+1505506us) ts_tablet_manager.cc:1151] Deleting tablet 0849ea9c04104a8184f8a8cd40e06fc2
0810 19:48:20.086070 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:20.091831 (+ 5761us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:20.232620 (+140789us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:20.243151 (+ 10531us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":298,"tablet-delete.queue_time_us":1505294}
I20260810 19:48:20.244114 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 0849ea9c04104a8184f8a8cd40e06fc2 (table default.Table_2c45b8ef81f94485a39df1d41c96f9a6 [id=061ee47a7ec24c2389a57b68997bff51]) successfully deleted
I20260810 19:48:20.245381 10367 tablet_bootstrap.cc:492] T cbcaa7106df24aaeb07428b7b590e282 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:20.245625 10367 ts_tablet_manager.cc:1403] T cbcaa7106df24aaeb07428b7b590e282 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.086s user 0.006s sys 0.004s
I20260810 19:48:20.246623 9421 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 0c56283079e74549afd0096f7e72046a: default.Table_28b8191a242a4d8ea55fdaeaec9c1c41 [id=3b14f80137654337b24c2bb4131e58d3] alter complete (version 3)
I20260810 19:48:20.247189 10366 ts_tablet_manager.cc:1434] T 5f4e2adee0264e418ff8c54912973e60 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.039s user 0.001s sys 0.001s
I20260810 19:48:20.248183 9421 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_602cb1451851485d819ae1c5853c46a3" } new_table_name: "default.Table_ddce60e06ea24f69bdc74ecb3bba1a3e" modify_external_catalogs: true
I20260810 19:48:20.247870 10367 raft_consensus.cc:359] T cbcaa7106df24aaeb07428b7b590e282 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.248648 10367 raft_consensus.cc:385] T cbcaa7106df24aaeb07428b7b590e282 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:20.248739 10367 raft_consensus.cc:740] T cbcaa7106df24aaeb07428b7b590e282 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:20.250797 10367 consensus_queue.cc:260] T cbcaa7106df24aaeb07428b7b590e282 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.256848 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1314) took 1602 ms. Trace:
I20260810 19:48:20.256956 12266 rpcz_store.cc:276] 0810 19:48:18.654698 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:18.654774 (+ 76us) service_pool.cc:224] Handling call
0810 19:48:20.256699 (+1601925us) ts_tablet_manager.cc:1151] Deleting tablet f5b65c8a84b44b94896c62115144d386
0810 19:48:20.256713 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:20.256824 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1601702}
W20260810 19:48:20.257440 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet f5b65c8a84b44b94896c62115144d386 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5b65c8a84b44b94896c62115144d386 already in progress: creating tablet
I20260810 19:48:20.266187 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1315) took 1611 ms. Trace:
I20260810 19:48:20.266438 12266 rpcz_store.cc:276] 0810 19:48:18.654869 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:18.654985 (+ 116us) service_pool.cc:224] Handling call
0810 19:48:20.265997 (+1611012us) ts_tablet_manager.cc:1151] Deleting tablet ef71075eb2cc4dcaa310786b3333f070
0810 19:48:20.266015 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:20.266153 (+ 138us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1602776}
W20260810 19:48:20.267067 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet ef71075eb2cc4dcaa310786b3333f070 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef71075eb2cc4dcaa310786b3333f070 already in progress: creating tablet
I20260810 19:48:20.267788 12266 tablet_replica.cc:333] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:20.268745 12266 raft_consensus.cc:2243] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:20.269037 12266 raft_consensus.cc:2272] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:20.268512 10367 ts_tablet_manager.cc:1434] T cbcaa7106df24aaeb07428b7b590e282 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20260810 19:48:20.272003 12266 ts_tablet_manager.cc:1916] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:20.272193 10367 tablet_bootstrap.cc:492] T 82609a50781d43f38baa6b76187e02ef P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:20.278263 13575 tablet.cc:1724] T 4571e0c723f74c828220b33116fed9e9 P 6986ed920dcb4af29a5eeeda6f671691: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:20.279876 13531 tablet.cc:1724] T 4571e0c723f74c828220b33116fed9e9 P fcd31b1bbb0340cbacfce652b4ad8da4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 19:48:20.280460 10366 tablet_bootstrap.cc:492] T 73abedd88ba548bdb5a23f508b77403d P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:20.282079 10366 tablet_bootstrap.cc:654] T 73abedd88ba548bdb5a23f508b77403d P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:20.285000 10367 tablet_bootstrap.cc:654] T 82609a50781d43f38baa6b76187e02ef P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:20.300942 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1345) took 1587 ms. Trace:
I20260810 19:48:20.301074 10377 rpcz_store.cc:276] 0810 19:48:18.713197 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:18.714287 (+ 1090us) service_pool.cc:224] Handling call
0810 19:48:20.094459 (+1380172us) ts_tablet_manager.cc:1151] Deleting tablet b33aa8be266a434cba899da7514c47e9
0810 19:48:20.094467 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:20.112936 (+ 18469us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:20.229511 (+116575us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:20.300911 (+ 71400us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1379891}
I20260810 19:48:20.301575 10377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38276 (request call id 1347) took 1449 ms. Trace:
I20260810 19:48:20.301590 9395 catalog_manager.cc:5050] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): tablet b33aa8be266a434cba899da7514c47e9 (table default.Table_40317d27e3de4c7ebbe4a80239f78899 [id=4e38b3a52c3549889893d804ab0dfb89]) successfully deleted
I20260810 19:48:20.301663 10377 rpcz_store.cc:276] 0810 19:48:18.851683 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:18.852582 (+ 899us) service_pool.cc:224] Handling call
0810 19:48:20.301421 (+1448839us) ts_tablet_manager.cc:1151] Deleting tablet 372cf2e53aa64c65baa384e047a2a973
0810 19:48:20.301433 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:20.301554 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1282859}
I20260810 19:48:20.301973 10377 tablet_replica.cc:333] T 77cf30d2d79f404798378ab01af53b8c P 6986ed920dcb4af29a5eeeda6f671691: stopping tablet replica
I20260810 19:48:20.302208 10377 raft_consensus.cc:2243] T 77cf30d2d79f404798378ab01af53b8c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:20.302438 10377 raft_consensus.cc:2272] T 77cf30d2d79f404798378ab01af53b8c P 6986ed920dcb4af29a5eeeda6f671691 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 19:48:20.302531 9395 catalog_manager.cc:5030] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): delete failed for tablet 372cf2e53aa64c65baa384e047a2a973 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 372cf2e53aa64c65baa384e047a2a973 already in progress: creating tablet
I20260810 19:48:20.303159 10377 ts_tablet_manager.cc:1916] T 77cf30d2d79f404798378ab01af53b8c P 6986ed920dcb4af29a5eeeda6f671691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:20.303870 12266 ts_tablet_manager.cc:1929] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 19:48:20.307955 13309 raft_consensus.cc:493] T 4bc41ad892a247848f5d2c1a0d3333ef P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:20.308152 13309 raft_consensus.cc:515] T 4bc41ad892a247848f5d2c1a0d3333ef P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.304003 12266 log.cc:1199] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/b33aa8be266a434cba899da7514c47e9
I20260810 19:48:20.309854 12266 ts_tablet_manager.cc:1950] T b33aa8be266a434cba899da7514c47e9 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:20.310858 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1317) took 1655 ms. Trace:
I20260810 19:48:20.310974 12266 rpcz_store.cc:276] 0810 19:48:18.655122 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:18.655203 (+ 81us) service_pool.cc:224] Handling call
0810 19:48:20.267723 (+1612520us) ts_tablet_manager.cc:1151] Deleting tablet b33aa8be266a434cba899da7514c47e9
0810 19:48:20.267736 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:20.294238 (+ 26502us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:20.303795 (+ 9557us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:20.310830 (+ 7035us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1612316}
I20260810 19:48:20.311512 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet b33aa8be266a434cba899da7514c47e9 (table default.Table_40317d27e3de4c7ebbe4a80239f78899 [id=4e38b3a52c3549889893d804ab0dfb89]) successfully deleted
I20260810 19:48:20.314955 10367 tablet_bootstrap.cc:492] T 82609a50781d43f38baa6b76187e02ef P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:20.315128 10367 ts_tablet_manager.cc:1403] T 82609a50781d43f38baa6b76187e02ef P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.000s
I20260810 19:48:20.315975 10367 raft_consensus.cc:359] T 82609a50781d43f38baa6b76187e02ef P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.316155 10367 raft_consensus.cc:385] T 82609a50781d43f38baa6b76187e02ef P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:20.316205 10367 raft_consensus.cc:740] T 82609a50781d43f38baa6b76187e02ef P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:20.316475 10367 consensus_queue.cc:260] T 82609a50781d43f38baa6b76187e02ef P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
W20260810 19:48:20.318007 9400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.235.253:37397, user_credentials={real_user=slave}} blocked reactor thread for 60087.2us
I20260810 19:48:20.318158 10367 ts_tablet_manager.cc:1434] T 82609a50781d43f38baa6b76187e02ef P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260810 19:48:20.319708 10367 tablet_bootstrap.cc:492] T 7f4ca5a1ec3d4ca392f389f2dabae296 P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:20.323573 10367 tablet_bootstrap.cc:654] T 7f4ca5a1ec3d4ca392f389f2dabae296 P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:20.328651 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1313) took 1679 ms. Trace:
I20260810 19:48:20.328776 12266 rpcz_store.cc:276] 0810 19:48:18.649325 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:18.649436 (+ 111us) service_pool.cc:224] Handling call
0810 19:48:20.328480 (+1679044us) ts_tablet_manager.cc:1151] Deleting tablet e5f29e86e0854efd9987305e26d7361a
0810 19:48:20.328493 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:20.328624 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1672695}
W20260810 19:48:20.329376 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet e5f29e86e0854efd9987305e26d7361a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5f29e86e0854efd9987305e26d7361a already in progress: creating tablet
I20260810 19:48:20.329872 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1316) took 1674 ms. Trace:
I20260810 19:48:20.329968 12266 rpcz_store.cc:276] 0810 19:48:18.654977 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:18.655824 (+ 847us) service_pool.cc:224] Handling call
0810 19:48:20.329731 (+1673907us) ts_tablet_manager.cc:1151] Deleting tablet 041844571695425eb6de69d251dffcf0
0810 19:48:20.329743 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:20.329850 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1673741}
W20260810 19:48:20.330484 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 041844571695425eb6de69d251dffcf0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 041844571695425eb6de69d251dffcf0 already in progress: creating tablet
I20260810 19:48:20.331039 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1318) took 1477 ms. Trace:
I20260810 19:48:20.331130 12266 rpcz_store.cc:276] 0810 19:48:18.853129 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:18.853196 (+ 67us) service_pool.cc:224] Handling call
0810 19:48:20.330912 (+1477716us) ts_tablet_manager.cc:1151] Deleting tablet 372cf2e53aa64c65baa384e047a2a973
0810 19:48:20.330923 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:20.331020 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1477498}
W20260810 19:48:20.331561 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 372cf2e53aa64c65baa384e047a2a973 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 372cf2e53aa64c65baa384e047a2a973 already in progress: creating tablet
I20260810 19:48:20.333721 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1319) took 1480 ms. Trace:
I20260810 19:48:20.333810 12266 rpcz_store.cc:276] 0810 19:48:18.853663 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:18.853799 (+ 136us) service_pool.cc:224] Handling call
0810 19:48:20.333606 (+1479807us) ts_tablet_manager.cc:1151] Deleting tablet be90bb3ded454172aef6578669dfa908
0810 19:48:20.333615 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:20.333704 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1479619}
W20260810 19:48:20.334208 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet be90bb3ded454172aef6578669dfa908 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be90bb3ded454172aef6578669dfa908 already in progress: creating tablet
I20260810 19:48:20.334259 10366 tablet_bootstrap.cc:492] T 73abedd88ba548bdb5a23f508b77403d P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:20.335547 10367 tablet_bootstrap.cc:492] T 7f4ca5a1ec3d4ca392f389f2dabae296 P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:20.335711 10367 ts_tablet_manager.cc:1403] T 7f4ca5a1ec3d4ca392f389f2dabae296 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.000s
I20260810 19:48:20.335851 12266 tablet_replica.cc:333] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:20.335997 10366 ts_tablet_manager.cc:1403] T 73abedd88ba548bdb5a23f508b77403d P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.056s user 0.012s sys 0.032s
I20260810 19:48:20.336103 12266 raft_consensus.cc:2243] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:20.336297 12266 raft_consensus.cc:2272] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:20.336898 12266 ts_tablet_manager.cc:1916] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:20.337057 10366 raft_consensus.cc:359] T 73abedd88ba548bdb5a23f508b77403d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.337332 10366 raft_consensus.cc:385] T 73abedd88ba548bdb5a23f508b77403d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:20.337455 10366 raft_consensus.cc:740] T 73abedd88ba548bdb5a23f508b77403d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:20.337756 10366 consensus_queue.cc:260] T 73abedd88ba548bdb5a23f508b77403d P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.338410 10366 ts_tablet_manager.cc:1434] T 73abedd88ba548bdb5a23f508b77403d P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:20.338755 10366 tablet_bootstrap.cc:492] T 749cea5cd8f842b891f4e2cab07c054e P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:20.340469 10366 tablet_bootstrap.cc:654] T 749cea5cd8f842b891f4e2cab07c054e P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:20.346103 10367 raft_consensus.cc:359] T 7f4ca5a1ec3d4ca392f389f2dabae296 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.346369 10367 raft_consensus.cc:385] T 7f4ca5a1ec3d4ca392f389f2dabae296 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:20.346433 10367 raft_consensus.cc:740] T 7f4ca5a1ec3d4ca392f389f2dabae296 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
W20260810 19:48:20.346625 9415 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f69a9251c9984c93b764290cb68342db consensus state has no leader
I20260810 19:48:20.346655 10367 consensus_queue.cc:260] T 7f4ca5a1ec3d4ca392f389f2dabae296 P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.346925 9415 master_service.cc:960] ReplaceTablet: received request to replace tablet cb2c9782c034435088f991bef8edf288 from {username='slave'} at 127.0.0.1:56048
I20260810 19:48:20.347239 10367 ts_tablet_manager.cc:1434] T 7f4ca5a1ec3d4ca392f389f2dabae296 P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.011s user 0.000s sys 0.001s
I20260810 19:48:20.347573 10367 tablet_bootstrap.cc:492] T ea9408ecf3784a80ac0c064e1689d25e P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:20.347564 9415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_71e3adcea80b43c19ca44e1cf8fbd28e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:20.348263 9883 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f4e2adee0264e418ff8c54912973e60 with delete_type TABLET_DATA_DELETED (replaced by tablet 883bf419763f4dcfab870fea49137eff) from {username='slave'} at 127.0.0.1:38276
W20260810 19:48:20.348435 9420 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 86203f7a635d406c95ed1d08cfc22400 consensus state has no leader
I20260810 19:48:20.350543 9420 catalog_manager.cc:5811] TS 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105) does not have the latest schema for tablet 73abedd88ba548bdb5a23f508b77403d (table default.Table_2c70d731dd51405188ec44cbbcffaf57 [id=85908f0b736c4bf9bdbcd67352e2d491]). Expected version 1 got 0
I20260810 19:48:20.350625 10367 tablet_bootstrap.cc:654] T ea9408ecf3784a80ac0c064e1689d25e P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:20.352246 9410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_45d297482dad4b8a916c890b778b39d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:20.362578 10366 tablet_bootstrap.cc:492] T 749cea5cd8f842b891f4e2cab07c054e P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:20.362836 10366 ts_tablet_manager.cc:1403] T 749cea5cd8f842b891f4e2cab07c054e P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.024s user 0.008s sys 0.002s
I20260810 19:48:20.363708 9939 raft_consensus.cc:3060] T 73abedd88ba548bdb5a23f508b77403d P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 19:48:20.363716 10366 raft_consensus.cc:359] T 749cea5cd8f842b891f4e2cab07c054e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.364087 10366 raft_consensus.cc:385] T 749cea5cd8f842b891f4e2cab07c054e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:20.364189 10366 raft_consensus.cc:740] T 749cea5cd8f842b891f4e2cab07c054e P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:20.364506 10366 consensus_queue.cc:260] T 749cea5cd8f842b891f4e2cab07c054e P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.365190 10366 ts_tablet_manager.cc:1434] T 749cea5cd8f842b891f4e2cab07c054e P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 19:48:20.365558 10366 tablet_bootstrap.cc:492] T d5aaedde75d54341a87764c6e89a03d6 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:20.367516 10367 tablet_bootstrap.cc:492] T ea9408ecf3784a80ac0c064e1689d25e P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:20.367678 10367 ts_tablet_manager.cc:1403] T ea9408ecf3784a80ac0c064e1689d25e P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.003s
I20260810 19:48:20.368516 10367 raft_consensus.cc:359] T ea9408ecf3784a80ac0c064e1689d25e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.368702 10367 raft_consensus.cc:385] T ea9408ecf3784a80ac0c064e1689d25e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:20.368765 10367 raft_consensus.cc:740] T ea9408ecf3784a80ac0c064e1689d25e P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:20.369040 10367 consensus_queue.cc:260] T ea9408ecf3784a80ac0c064e1689d25e P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.369469 10366 tablet_bootstrap.cc:654] T d5aaedde75d54341a87764c6e89a03d6 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:20.369618 9410 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45d297482dad4b8a916c890b778b39d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:20.370854 9415 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71e3adcea80b43c19ca44e1cf8fbd28e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 19:48:20.371390 10367 ts_tablet_manager.cc:1434] T ea9408ecf3784a80ac0c064e1689d25e P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260810 19:48:20.371743 10367 tablet_bootstrap.cc:492] T 97c78c188c024b0f9da45cd99d2cb80c P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:20.373345 12266 ts_tablet_manager.cc:1929] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 19:48:20.373471 12266 log.cc:1199] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/77cf30d2d79f404798378ab01af53b8c
I20260810 19:48:20.373816 12266 ts_tablet_manager.cc:1950] T 77cf30d2d79f404798378ab01af53b8c P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:20.374650 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1320) took 1513 ms. Trace:
I20260810 19:48:20.374589 9407 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2c70d731dd51405188ec44cbbcffaf57" } modify_external_catalogs: true
I20260810 19:48:20.374788 9407 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_2c70d731dd51405188ec44cbbcffaf57" } modify_external_catalogs: true
I20260810 19:48:20.374737 12266 rpcz_store.cc:276] 0810 19:48:18.861349 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:18.861449 (+ 100us) service_pool.cc:224] Handling call
0810 19:48:20.335752 (+1474303us) ts_tablet_manager.cc:1151] Deleting tablet 77cf30d2d79f404798378ab01af53b8c
0810 19:48:20.335761 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:20.361564 (+ 25803us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:20.373151 (+ 11587us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:20.374628 (+ 1477us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1474118}
I20260810 19:48:20.375213 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 77cf30d2d79f404798378ab01af53b8c (table default.Table_88790a0f0d5c47079b55c152d71d4a1c [id=f06fa8a4ae1c4ce89691f8abad3d3e7b]) successfully deleted
I20260810 19:48:20.375667 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1321) took 1514 ms. Trace:
I20260810 19:48:20.375742 12266 rpcz_store.cc:276] 0810 19:48:18.861484 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:18.861670 (+ 186us) service_pool.cc:224] Handling call
0810 19:48:20.375521 (+1513851us) ts_tablet_manager.cc:1151] Deleting tablet 72d92f8b6565416c9da4e8d1ec7a6d50
0810 19:48:20.375533 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:20.375646 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1513703}
W20260810 19:48:20.376179 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 72d92f8b6565416c9da4e8d1ec7a6d50 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72d92f8b6565416c9da4e8d1ec7a6d50 already in progress: creating tablet
I20260810 19:48:20.376499 12266 tablet_replica.cc:333] T 60e99cd75ada470380ab69da60ddac77 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:20.376696 12266 raft_consensus.cc:2243] T 60e99cd75ada470380ab69da60ddac77 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:20.376855 12266 raft_consensus.cc:2272] T 60e99cd75ada470380ab69da60ddac77 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:20.377471 12266 ts_tablet_manager.cc:1916] T 60e99cd75ada470380ab69da60ddac77 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 19:48:20.377934 13309 leader_election.cc:290] T 4bc41ad892a247848f5d2c1a0d3333ef P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413), 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105)
I20260810 19:48:20.380338 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc41ad892a247848f5d2c1a0d3333ef" candidate_uuid: "eadde59fd6504d679e47f03a60c64bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:20.381639 13159 consensus_queue.cc:1048] T d5aaedde75d54341a87764c6e89a03d6 P fcd31b1bbb0340cbacfce652b4ad8da4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 19:48:20.382233 10067 leader_election.cc:343] T 4bc41ad892a247848f5d2c1a0d3333ef P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:20.383639 9413 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_7f42e3c0170c41f6aab544a1d359c022" } new_table_name: "default.Table_b4d4133a294a44398234778e3e187fe1" modify_external_catalogs: true
I20260810 19:48:20.385262 9408 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c38ed8b5e8114106a05e0296c314b424" } modify_external_catalogs: true
I20260810 19:48:20.385442 9408 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_c38ed8b5e8114106a05e0296c314b424" } modify_external_catalogs: true
I20260810 19:48:20.387905 12266 ts_tablet_manager.cc:1929] T 60e99cd75ada470380ab69da60ddac77 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:20.388028 12266 log.cc:1199] T 60e99cd75ada470380ab69da60ddac77 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/60e99cd75ada470380ab69da60ddac77
I20260810 19:48:20.388402 12266 ts_tablet_manager.cc:1950] T 60e99cd75ada470380ab69da60ddac77 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:20.388828 9418 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d8e6b3a8ee554914bf34612fe63b3056" } modify_external_catalogs: true
I20260810 19:48:20.389030 9418 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_d8e6b3a8ee554914bf34612fe63b3056" } modify_external_catalogs: true
I20260810 19:48:20.389288 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1361) took 1333 ms. Trace:
I20260810 19:48:20.389812 12266 rpcz_store.cc:276] 0810 19:48:19.055337 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:19.143851 (+ 88514us) service_pool.cc:224] Handling call
0810 19:48:20.376447 (+1232596us) ts_tablet_manager.cc:1151] Deleting tablet 60e99cd75ada470380ab69da60ddac77
0810 19:48:20.376459 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:20.384373 (+ 7914us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:20.387831 (+ 3458us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:20.389247 (+ 1416us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1232397}
I20260810 19:48:20.389820 9412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56048:
name: "default.Table_1648de1d80ad412fbce277573570e558"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 19:48:20.390395 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 60e99cd75ada470380ab69da60ddac77 (table default.Table_f11b6cec3ddf4b339b5f90841b7b3d8b [id=e872b31132a34cf5bd9a65bde184c182]) successfully deleted
W20260810 19:48:20.390506 9412 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1648de1d80ad412fbce277573570e558 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 19:48:20.391211 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 5cb4f4e17a16468597f154083a5c3e6e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5cb4f4e17a16468597f154083a5c3e6e already in progress: creating tablet
W20260810 19:48:20.391861 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 31526aa9c74e45e585e280f88f73cfa9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31526aa9c74e45e585e280f88f73cfa9 already in progress: creating tablet
W20260810 19:48:20.392464 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 1a7079614cda418583af74ae11a4d374 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a7079614cda418583af74ae11a4d374 already in progress: creating tablet
W20260810 19:48:20.393052 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 89191af180b542ce99bf0a798a945594 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89191af180b542ce99bf0a798a945594 already in progress: creating tablet
I20260810 19:48:20.393321 12266 tablet_replica.cc:333] T 229dd737ee8547a89445593cc117fbc2 P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:20.393523 12266 raft_consensus.cc:2243] T 229dd737ee8547a89445593cc117fbc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:20.393671 12266 raft_consensus.cc:2272] T 229dd737ee8547a89445593cc117fbc2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:20.394244 12266 ts_tablet_manager.cc:1916] T 229dd737ee8547a89445593cc117fbc2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:20.394459 10068 leader_election.cc:343] T 4bc41ad892a247848f5d2c1a0d3333ef P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): Not found: Tablet not found: 4bc41ad892a247848f5d2c1a0d3333ef
I20260810 19:48:20.398038 10367 tablet_bootstrap.cc:654] T 97c78c188c024b0f9da45cd99d2cb80c P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:20.402406 10366 tablet_bootstrap.cc:492] T d5aaedde75d54341a87764c6e89a03d6 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:20.402699 10366 ts_tablet_manager.cc:1403] T d5aaedde75d54341a87764c6e89a03d6 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.003s
I20260810 19:48:20.403810 10366 raft_consensus.cc:359] T d5aaedde75d54341a87764c6e89a03d6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.404088 10366 raft_consensus.cc:385] T d5aaedde75d54341a87764c6e89a03d6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:20.404186 10366 raft_consensus.cc:740] T d5aaedde75d54341a87764c6e89a03d6 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:20.404531 10366 consensus_queue.cc:260] T d5aaedde75d54341a87764c6e89a03d6 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.405303 10366 ts_tablet_manager.cc:1434] T d5aaedde75d54341a87764c6e89a03d6 P 6986ed920dcb4af29a5eeeda6f671691: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 19:48:20.405673 10366 tablet_bootstrap.cc:492] T 83b19479978c46bf8a425ccf1225ef45 P 6986ed920dcb4af29a5eeeda6f671691: Bootstrap starting.
I20260810 19:48:20.407560 10366 tablet_bootstrap.cc:654] T 83b19479978c46bf8a425ccf1225ef45 P 6986ed920dcb4af29a5eeeda6f671691: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:20.416388 10366 tablet_bootstrap.cc:492] T 83b19479978c46bf8a425ccf1225ef45 P 6986ed920dcb4af29a5eeeda6f671691: No bootstrap required, opened a new log
I20260810 19:48:20.417464 10370 tablet_bootstrap.cc:492] T fafad8559b074dab958f03061e65b8c3 P eadde59fd6504d679e47f03a60c64bb0: No bootstrap required, opened a new log
I20260810 19:48:20.417630 10370 ts_tablet_manager.cc:1403] T fafad8559b074dab958f03061e65b8c3 P eadde59fd6504d679e47f03a60c64bb0: Time spent bootstrapping tablet: real 0.268s user 0.007s sys 0.002s
I20260810 19:48:20.418502 10375 ts_tablet_manager.cc:1929] T b54feebc7c9841d89808054602be7913 P eadde59fd6504d679e47f03a60c64bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:20.418606 10375 log.cc:1199] T b54feebc7c9841d89808054602be7913 P eadde59fd6504d679e47f03a60c64bb0: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-2/wal/wals/b54feebc7c9841d89808054602be7913
I20260810 19:48:20.418889 10375 ts_tablet_manager.cc:1950] T b54feebc7c9841d89808054602be7913 P eadde59fd6504d679e47f03a60c64bb0: Deleting consensus metadata
I20260810 19:48:20.418890 12266 ts_tablet_manager.cc:1929] T 229dd737ee8547a89445593cc117fbc2 P fcd31b1bbb0340cbacfce652b4ad8da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 19:48:20.419023 12266 log.cc:1199] T 229dd737ee8547a89445593cc117fbc2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting WAL directory at /tmp/dist-test-taskcRGNMp/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786391261752970-9135-0/minicluster-data/ts-0/wal/wals/229dd737ee8547a89445593cc117fbc2
I20260810 19:48:20.419314 12266 ts_tablet_manager.cc:1950] T 229dd737ee8547a89445593cc117fbc2 P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting consensus metadata
I20260810 19:48:20.420106 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1385) took 1012 ms. Trace:
I20260810 19:48:20.420203 12266 rpcz_store.cc:276] 0810 19:48:19.407636 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:19.477785 (+ 70149us) service_pool.cc:224] Handling call
0810 19:48:20.393262 (+915477us) ts_tablet_manager.cc:1151] Deleting tablet 229dd737ee8547a89445593cc117fbc2
0810 19:48:20.393271 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:20.404501 (+ 11230us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:20.418818 (+ 14317us) tablet_metadata.cc:665] Metadata flushed
0810 19:48:20.420081 (+ 1263us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":915366}
I20260810 19:48:20.420513 10366 ts_tablet_manager.cc:1403] T 83b19479978c46bf8a425ccf1225ef45 P 6986ed920dcb4af29a5eeeda6f671691: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.002s
I20260810 19:48:20.420876 9397 catalog_manager.cc:5050] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): tablet 229dd737ee8547a89445593cc117fbc2 (table default.Table_bfa0ef28a4704e2589883d5ebd21cb92 [id=df4d2ed4289f45c68927ac7fb7c77f06]) successfully deleted
I20260810 19:48:20.423102 10367 tablet_bootstrap.cc:492] T 97c78c188c024b0f9da45cd99d2cb80c P fcd31b1bbb0340cbacfce652b4ad8da4: No bootstrap required, opened a new log
I20260810 19:48:20.423233 10367 ts_tablet_manager.cc:1403] T 97c78c188c024b0f9da45cd99d2cb80c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent bootstrapping tablet: real 0.052s user 0.003s sys 0.007s
I20260810 19:48:20.424077 10367 raft_consensus.cc:359] T 97c78c188c024b0f9da45cd99d2cb80c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.424260 10367 raft_consensus.cc:385] T 97c78c188c024b0f9da45cd99d2cb80c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:20.424316 10367 raft_consensus.cc:740] T 97c78c188c024b0f9da45cd99d2cb80c P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd31b1bbb0340cbacfce652b4ad8da4, State: Initialized, Role: FOLLOWER
I20260810 19:48:20.424528 10367 consensus_queue.cc:260] T 97c78c188c024b0f9da45cd99d2cb80c P fcd31b1bbb0340cbacfce652b4ad8da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.425405 10367 ts_tablet_manager.cc:1434] T 97c78c188c024b0f9da45cd99d2cb80c P fcd31b1bbb0340cbacfce652b4ad8da4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 19:48:20.425699 10367 tablet_bootstrap.cc:492] T c2604484e3114564812653a15298cc0b P fcd31b1bbb0340cbacfce652b4ad8da4: Bootstrap starting.
I20260810 19:48:20.418401 10370 raft_consensus.cc:359] T fafad8559b074dab958f03061e65b8c3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.426460 10370 raft_consensus.cc:385] T fafad8559b074dab958f03061e65b8c3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:20.426539 10370 raft_consensus.cc:740] T fafad8559b074dab958f03061e65b8c3 P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadde59fd6504d679e47f03a60c64bb0, State: Initialized, Role: FOLLOWER
I20260810 19:48:20.426764 10370 consensus_queue.cc:260] T fafad8559b074dab958f03061e65b8c3 P eadde59fd6504d679e47f03a60c64bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.426877 13159 raft_consensus.cc:493] T b853bf6bbc7845bc9cfa6347687582e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 19:48:20.427008 13159 raft_consensus.cc:515] T b853bf6bbc7845bc9cfa6347687582e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.427616 13159 leader_election.cc:290] T b853bf6bbc7845bc9cfa6347687582e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105), eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797)
I20260810 19:48:20.427723 10367 tablet_bootstrap.cc:654] T c2604484e3114564812653a15298cc0b P fcd31b1bbb0340cbacfce652b4ad8da4: Neither blocks nor log segments found. Creating new log.
I20260810 19:48:20.429792 9945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b853bf6bbc7845bc9cfa6347687582e2" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6986ed920dcb4af29a5eeeda6f671691" is_pre_election: true
I20260810 19:48:20.430392 12266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34544 (request call id 1386) took 1022 ms. Trace:
W20260810 19:48:20.430444 9611 leader_election.cc:343] T b853bf6bbc7845bc9cfa6347687582e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6986ed920dcb4af29a5eeeda6f671691 (127.8.235.194:35105): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:20.430485 12266 rpcz_store.cc:276] 0810 19:48:19.407696 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 19:48:19.477910 (+ 70214us) service_pool.cc:224] Handling call
0810 19:48:20.430191 (+952281us) ts_tablet_manager.cc:1151] Deleting tablet 92c1f13f235a4ba696bd794af135bcba
0810 19:48:20.430202 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 19:48:20.430366 (+ 164us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":952154}
I20260810 19:48:20.430809 10370 ts_tablet_manager.cc:1434] T fafad8559b074dab958f03061e65b8c3 P eadde59fd6504d679e47f03a60c64bb0: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260810 19:48:20.394587 10068 leader_election.cc:304] T 4bc41ad892a247848f5d2c1a0d3333ef P eadde59fd6504d679e47f03a60c64bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eadde59fd6504d679e47f03a60c64bb0; no voters: 6986ed920dcb4af29a5eeeda6f671691, fcd31b1bbb0340cbacfce652b4ad8da4
I20260810 19:48:20.431123 10370 tablet_bootstrap.cc:492] T 25570b1795164aeca86a5313bd30a4c9 P eadde59fd6504d679e47f03a60c64bb0: Bootstrap starting.
W20260810 19:48:20.431118 9397 catalog_manager.cc:5030] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413): delete failed for tablet 92c1f13f235a4ba696bd794af135bcba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92c1f13f235a4ba696bd794af135bcba already in progress: creating tablet
I20260810 19:48:20.431645 12266 tablet_replica.cc:333] T 841f58b4e8f7465eaa7fa08629e0bc2a P fcd31b1bbb0340cbacfce652b4ad8da4: stopping tablet replica
I20260810 19:48:20.431916 13309 raft_consensus.cc:2749] T 4bc41ad892a247848f5d2c1a0d3333ef P eadde59fd6504d679e47f03a60c64bb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:20.432123 10166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b853bf6bbc7845bc9cfa6347687582e2" candidate_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eadde59fd6504d679e47f03a60c64bb0" is_pre_election: true
I20260810 19:48:20.433120 12266 raft_consensus.cc:2243] T 841f58b4e8f7465eaa7fa08629e0bc2a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 19:48:20.433308 12266 raft_consensus.cc:2272] T 841f58b4e8f7465eaa7fa08629e0bc2a P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:20.433866 12266 ts_tablet_manager.cc:1916] T 841f58b4e8f7465eaa7fa08629e0bc2a P fcd31b1bbb0340cbacfce652b4ad8da4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:20.434280 9611 leader_election.cc:343] T b853bf6bbc7845bc9cfa6347687582e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eadde59fd6504d679e47f03a60c64bb0 (127.8.235.195:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260810 19:48:20.434425 9611 leader_election.cc:304] T b853bf6bbc7845bc9cfa6347687582e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd31b1bbb0340cbacfce652b4ad8da4; no voters: 6986ed920dcb4af29a5eeeda6f671691, eadde59fd6504d679e47f03a60c64bb0
I20260810 19:48:20.434571 10375 tablet_replica.cc:333] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0: stopping tablet replica
I20260810 19:48:20.434751 10375 raft_consensus.cc:2243] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 19:48:20.434842 13159 raft_consensus.cc:2749] T b853bf6bbc7845bc9cfa6347687582e2 P fcd31b1bbb0340cbacfce652b4ad8da4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 19:48:20.436522 10375 raft_consensus.cc:2272] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 19:48:20.437186 10375 ts_tablet_manager.cc:1916] T 63b649cbc1d141d8bb438105b8e8537c P eadde59fd6504d679e47f03a60c64bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 19:48:20.447016 9395 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 76cd3adb759342c0b2d34f956a81c9e0 (table default.Table_67e55147983548869ce84ab222a3de3d [id=97d6d1420ddd4daa92ac5bd8716a1fdd], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 76cd3adb759342c0b2d34f956a81c9e0 consensus state has no leader
I20260810 19:48:20.454391 13530 tablet.cc:1724] T 56fa5de3bf7142b2b0978f9190091f33 P eadde59fd6504d679e47f03a60c64bb0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 19:48:20.460237 10370 tablet_bootstrap.cc:654] T 25570b1795164aeca86a5313bd30a4c9 P eadde59fd6504d679e47f03a60c64bb0: Neither blocks nor log segments found. Creating new log.
W20260810 19:48:20.464521 9421 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 89fa072ad5f74ed9bdab2ca19e0522ac consensus state has no leader
I20260810 19:48:20.466955 9421 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e9beb6e0dbe741c4a2582c7024a00ac1" } modify_external_catalogs: true
I20260810 19:48:20.467154 9421 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56048:
table { table_name: "default.Table_e9beb6e0dbe741c4a2582c7024a00ac1" } modify_external_catalogs: true
I20260810 19:48:20.468614 9673 tablet_service.cc:1511] Processing CreateTablet for tablet 181466e737f8433c8e141e96b5a282ba (DEFAULT_TABLE table=default.Table_378d4036a30843c0b6735eef862601d7 [id=4dae54eb3ffe4fa7a2da4c69f16a83de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.469138 9673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 181466e737f8433c8e141e96b5a282ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.474071 9883 tablet_service.cc:1511] Processing CreateTablet for tablet 181466e737f8433c8e141e96b5a282ba (DEFAULT_TABLE table=default.Table_378d4036a30843c0b6735eef862601d7 [id=4dae54eb3ffe4fa7a2da4c69f16a83de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.474465 9885 tablet_service.cc:1511] Processing CreateTablet for tablet 24cf14a540424cac8840922394f434ef (DEFAULT_TABLE table=default.Table_7cda8233b4eb4ea5a51eadb2b6954340 [id=b64a032c824a4036a7423124cd2550c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.475122 9901 tablet_service.cc:1511] Processing CreateTablet for tablet 8fe87b48cea444b786ea457e6b76151a (DEFAULT_TABLE table=default.Table_a906250ffbb040219e0744d511ba3abf [id=df5a7f54f47249fdbe2b4b11c3d9559f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.475114 9416 catalog_manager.cc:5719] T 676004738985441985278313d6064530 P fcd31b1bbb0340cbacfce652b4ad8da4 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193). New cstate: current_term: 1 leader_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260810 19:48:20.475530 9416 catalog_manager.cc:5811] TS fcd31b1bbb0340cbacfce652b4ad8da4 (127.8.235.193:41413) does not have the latest schema for tablet 676004738985441985278313d6064530 (table default.Table_2d7f246476ac4544a3fa089ec3c52657 [id=c681008d2b5f43a9b7b6ed2d72653b1b]). Expected version 1 got 0
I20260810 19:48:20.474143 9898 tablet_service.cc:1511] Processing CreateTablet for tablet c2dd54549a5a4dfe9fdfb3de68b1ea8b (DEFAULT_TABLE table=default.Table_e0abca0235104c63b0db24742dc4402f [id=f6a740afd1f3436dbfcadf4862d1386c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.476359 9905 tablet_service.cc:1511] Processing CreateTablet for tablet fa6ea204290643a4a8ef3d05dcf6d198 (DEFAULT_TABLE table=default.Table_ac52dad261e647a89f5175021e3ac8e4 [id=3ee7b3ad207e489db1a7da791d68553b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.477072 9688 tablet_service.cc:1511] Processing CreateTablet for tablet c2dd54549a5a4dfe9fdfb3de68b1ea8b (DEFAULT_TABLE table=default.Table_e0abca0235104c63b0db24742dc4402f [id=f6a740afd1f3436dbfcadf4862d1386c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 19:48:20.477528 9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2dd54549a5a4dfe9fdfb3de68b1ea8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 19:48:20.477869 10366 raft_consensus.cc:359] T 83b19479978c46bf8a425ccf1225ef45 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195" port: 43797 } }
I20260810 19:48:20.478082 10366 raft_consensus.cc:385] T 83b19479978c46bf8a425ccf1225ef45 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 19:48:20.478139 10366 raft_consensus.cc:740] T 83b19479978c46bf8a425ccf1225ef45 P 6986ed920dcb4af29a5eeeda6f671691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6986ed920dcb4af29a5eeeda6f671691, State: Initialized, Role: FOLLOWER
I20260810 19:48:20.478681 10366 consensus_queue.cc:260] T 83b19479978c46bf8a425ccf1225ef45 P 6986ed920dcb4af29a5eeeda6f671691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd31b1bbb0340cbacfce652b4ad8da4" member_type: VOTER last_known_addr { host: "127.8.235.193" port: 41413 } } peers { permanent_uuid: "6986ed920dcb4af29a5eeeda6f671691" member_type: VOTER last_known_addr { host: "127.8.235.194" port: 35105 } } peers { permanent_uuid: "eadde59fd6504d679e47f03a60c64bb0" member_type: VOTER last_known_addr { host: "127.8.235.195"